如何配置AWS CDK ApplicationLoadBalancedFargateService以使用Firelens和Firebit记录已解析的JSON行

如何解决如何配置AWS CDK ApplicationLoadBalancedFargateService以使用Firelens和Firebit记录已解析的JSON行

当我使用Firelens日志驱动程序创建ApplicationLoadBalancedFargateService时，应用程序将JSON行写为日志消息，例如，将net.logstash.logback.encoder.LoggingEventCompositeJsonEncoder与Logback一起使用时，日志消息将显示在我的日志存储库中（例如Sumo Logic），作为转义字符串，例如：

如何获取日志消息以另存为已解析的JSON？

解决方法

扫描CDK源代码后，浏览几个相关参考（我将在其中提供链接以帮助引导适当的流量），然后使用cdk diff直到唯一的更改是启用json解析，我才能够进行如以下代码所示工作。此处的关键是使用addFirelensLogRouter方法及其中包含的Firelens配置。

TaskDefinition代码不会自动创建一个LogRouter容器，如果任务定义中已经包含一个容器，这就是我们可以覆盖默认行为的原因。

protected _createFargateService() {
    const logDriver = LogDrivers.firelens({
        options: {
            Name: 'http',Host: this._props.containerLogging.endpoint,URI: this._props.containerLogging.uri,Port: '443',tls: 'on','tls.verify': 'off',Format: 'json_lines'
        }
    });
    const fargateService = new ApplicationLoadBalancedFargateService(this,this._props.serviceName,{
        cluster: this._accountEnvironmentLookups.getComputeCluster(),cpu: this._props.cpu,// Default is 256
        desiredCount: this._props.desiredCount,// Default is 1
        taskImageOptions: {
            image: ContainerImage.fromEcrRepository(this._props.serviceRepository,this._props.imageVersion),environment: this._props.environment,containerPort: this._props.containerPort,logDriver
        },memoryLimitMiB: this._props.memoryLimitMiB,// Default is 512
        publicLoadBalancer: this._props.publicLoadBalancer,// Default is false
        domainName: this._props.domainName,domainZone: !!this._props.hostedZoneDomain ? HostedZone.fromLookup(this,'ZoneFromLookup',{
            domainName: this._props.hostedZoneDomain
        }) : undefined,certificate: !!this._props.certificateArn ? Certificate.fromCertificateArn(this,'CertificateFromArn',this._props.certificateArn) : undefined,serviceName: `${this._props.accountShortName}-${this._props.deploymentEnvironment}-${this._props.serviceName}`,// The new ARN and resource ID format must be enabled to work with ECS managed tags.
        //enableECSManagedTags: true,//propagateTags: PropagatedTagSource.SERVICE,// CloudMap properties cannot be set from a stack separate from the stack where the cluster is created.
        // see https://github.com/aws/aws-cdk/issues/7825
    });
    if (this._props.logMessagesAreJsonLines) {
        // The default log driver setup doesn't enable json line parsing.
        const firelensLogRouter = fargateService.service.taskDefinition.addFirelensLogRouter('log-router',{
            // Figured out how get the default fluent bit ECR image from here https://github.com/aws/aws-cdk/blob/60c782fe173449ebf912f509de7db6df89985915/packages/%40aws-cdk/aws-ecs/lib/base/task-definition.ts#L509
            image: obtainDefaultFluentBitECRImage(fargateService.service.taskDefinition,fargateService.service.taskDefinition.defaultContainer?.logDriverConfig),essential: true,firelensConfig: {
                type: FirelensLogRouterType.FLUENTBIT,options: {
                    enableECSLogMetadata: true,configFileType: FirelensConfigFileType.FILE,// This enables parsing of log messages that are json lines
                    configFileValue: '/fluent-bit/configs/parse-json.conf'
                }
            },memoryReservationMiB: 50,logging: new AwsLogDriver({streamPrefix: 'firelens'})
        });
        firelensLogRouter.logDriverConfig;
    }
    fargateService.targetGroup.configureHealthCheck({
        path: this._props.healthUrlPath,port: this._props.containerPort.toString(),interval: Duration.seconds(120),unhealthyThresholdCount: 5
    });
    const scalableTaskCount = fargateService.service.autoScaleTaskCount({
        minCapacity: this._props.desiredCount,maxCapacity: this._props.maxCapacity
    });
    scalableTaskCount.scaleOnCpuUtilization(`ScaleOnCpuUtilization${this._props.cpuTargetUtilization}`,{
        targetUtilizationPercent: this._props.cpuTargetUtilization
    });
    scalableTaskCount.scaleOnMemoryUtilization(`ScaleOnMemoryUtilization${this._props.memoryTargetUtilization}`,{
        targetUtilizationPercent: this._props.memoryTargetUtilization
    });
    this.fargateService = fargateService;
}

资源：

• 我第一次发现它是可能的。 https://github.com/aws-samples/amazon-ecs-firelens-examples/tree/master/examples/fluent-bit/parse-json
• 我如何发现CDK https://github.com/aws/aws-cdk/pull/6322成为可能
• 从AWS服务的观点https://docs.aws.amazon.com/AmazonECS/latest/userguide/using_firelens.html理解它
• 缩小CDK源中的位置。 https://docs.aws.amazon.com/cdk/api/latest/docs/@aws-cdk_aws-ecs.FirelensLogRouter.html
• 最终我降落在这里并找出了https://github.com/aws/aws-cdk/blob/60c782fe173449ebf912f509de7db6df89985915/packages/%40aws-cdk/aws-ecs/lib/base/task-definition.ts#L509