如何解决即使 linger.ms 为 0,Kafka 超时异常
在 Spring + Kafka 应用中,batch.size
是默认值 16384,而 linger.ms=0
。所以我认为当一条消息被创建时,它会立即发送给代理,因为 0 徘徊。但是在运行时,有时还是会出现异常。
org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for cn-mcd-pos-promotion-3: 30033 ms has passed since batch creation plus linger time
大多数时候,制作人是好的。有时它会得到这个异常。奇怪的是,所有异常都与 cn-mcd-pos-promotion-3
相关。
- 即使 linger.ms 为 0,也可能导致此超时?
-
cn-mcd-pos-promotion-3
中的 -3 是什么意思?
PS:生产者的配置。
bootstrap.servers = [wqdcsrv3078.cn.infra:9093,wqdcsrv3079.cn.infra:9093,wqdcsrv3080.cn.infra:9095]
buffer.memory = 33554432
client.id = mcd.client
compression.type = none
connections.max.idle.ms = 540000
enable.idempotence = false
interceptor.classes = null
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 0
retry.backoff.ms = 100
sasl.jaas.config = [hidden]
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = SCRAM-SHA-256
security.protocol = SASL_PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2,TLSv1.1,TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class org.springframework.kafka.support.serializer.JsonSerializer```
Could anyone help? Thanks.
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。