发送消息时，部署在kuberenetees中的Kafka重新启动

分类：编程问答

如何解决发送消息时，部署在kuberenetees中的Kafka重新启动

我使用Debezium泊坞映像在kubernetes中部署了Kafka，Zookeeper和Kafka Connect。它们看起来不错，但是当我尝试使用控制台使用者和生产者来测试发送和接收消息时，kafka部署会重新启动。 首先，我开始消费者：

bin/kafka-console-consumer.sh --topic topic --from-beginning --bootstrap-server cluster-IP:9092

然后是制作人：

bin/kafka-console-producer.sh --topic topic --bootstrap-server cluster-IP:9092

到目前为止，一切似乎都还不错。使用者正在等待消息，而生产者正在等待键入消息。但是，当我尝试输入任何消息并将其发送到生产者中时，kafka部署会重新启动。

我可能只是添加，当我尝试列出主题时，一切正常，并且可以使用以下命令查看主题名称：

bin/kafka-topics.sh --list --zookeeper cluster-IP:2181

在重新启动后，当我从主题开始尝试使用使用者时，也没有消息。

这是最近的日志：


2020-10-24 13:49:16,421 - DEBUG [Controller-1-to-broker-1-send-thread:NetworkClient@840] - [Controller id=1,targetBrokerId=1] Received UPDATE_METADATA response from node 1 for request with header RequestHeader(apiKey=UPDATE_METADATA,apiVersion=6,clientId=1,correlationId=2): org.apache.kafka.common.requests.UpdateMetadataResponse@78b355b9
2020-10-24 13:49:21,437 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 0ms
2020-10-24 13:49:27,441 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 0ms
2020-10-24 13:49:33,445 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 0ms
2020-10-24 13:49:39,451 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 0ms
2020-10-24 13:49:45,459 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 1ms
2020-10-24 13:49:51,465 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 1ms
2020-10-24 13:49:57,465 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 0ms
2020-10-24 13:50:03,471 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 0ms
2020-10-24 13:50:09,522 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 1ms
2020-10-24 13:50:15,528 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 2ms
2020-10-24 13:50:21,624 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 4ms
2020-10-24 13:50:22,720 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@199] - [SocketServer brokerId=1] clients: Adding a new metric ClientInformation(softwareName=unknown,softwareVersion=unknown).
2020-10-24 13:50:22,721 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@213] - [SocketServer brokerId=1] clients: entering performPendingMetricsOperations
2020-10-24 13:50:22,721 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@224] - [SocketServer brokerId=1] clients: adding metric MetricName [name=connections,group=socket-server-metrics,description=The number of connections with this client and version.,tags={clientSoftwareName=unknown,clientSoftwareVersion=unknown,listener=PLAINTEXT,networkProcessor=1}]
2020-10-24 13:50:22,721 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:Metrics@587] - Registered metric named MetricName [name=connections,721 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@229] - [SocketServer brokerId=1] clients: leaving performPendingMetricsOperations
2020-10-24 13:50:23,024 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@247] - [SocketServer brokerId=1] clients: Removed a reference to ClientInformation(softwareName=unknown,softwareVersion=unknown).  0 reference(s) remaining.
2020-10-24 13:50:23,024 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@199] - [SocketServer brokerId=1] clients: Adding a new metric ClientInformation(softwareName=apache-kafka-java,softwareVersion=2.6.0).
2020-10-24 13:50:23,024 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@213] - [SocketServer brokerId=1] clients: entering performPendingMetricsOperations
2020-10-24 13:50:23,024 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@224] - [SocketServer brokerId=1] clients: adding metric MetricName [name=connections,tags={clientSoftwareName=apache-kafka-java,clientSoftwareVersion=2.6.0,networkProcessor=1}]
2020-10-24 13:50:23,025 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:Metrics@587] - Registered metric named MetricName [name=connections,025 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-1:IntGaugeSuite@229] - [SocketServer brokerId=1] clients: leaving performPendingMetricsOperations
2020-10-24 13:50:24,422 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@199] - [SocketServer brokerId=1] clients: Adding a new metric ClientInformation(softwareName=unknown,softwareVersion=unknown).
2020-10-24 13:50:24,422 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@213] - [SocketServer brokerId=1] clients: entering performPendingMetricsOperations
2020-10-24 13:50:24,422 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@224] - [SocketServer brokerId=1] clients: adding metric MetricName [name=connections,networkProcessor=2}]
2020-10-24 13:50:24,422 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:Metrics@587] - Registered metric named MetricName [name=connections,422 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@229] - [SocketServer brokerId=1] clients: leaving performPendingMetricsOperations
2020-10-24 13:50:24,630 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@247] - [SocketServer brokerId=1] clients: Removed a reference to ClientInformation(softwareName=unknown,softwareVersion=unknown).  0 reference(s) remaining.
2020-10-24 13:50:24,630 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@199] - [SocketServer brokerId=1] clients: Adding a new metric ClientInformation(softwareName=apache-kafka-java,softwareVersion=2.6.0).
2020-10-24 13:50:24,630 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@213] - [SocketServer brokerId=1] clients: entering performPendingMetricsOperations
2020-10-24 13:50:24,630 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@224] - [SocketServer brokerId=1] clients: adding metric MetricName [name=connections,630 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:Metrics@587] - Registered metric named MetricName [name=connections,630 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-2:IntGaugeSuite@229] - [SocketServer brokerId=1] clients: leaving performPendingMetricsOperations
2020-10-24 13:50:25,231 - INFO  [data-plane-kafka-request-handler-2:Logging@66] - [GroupCoordinator 1]: Preparing to rebalance group console-consumer-88244 in state PreparingRebalance with old generation 0 (__consumer_offsets-37) (reason: Adding new member consumer-console-consumer-88244-1-4d8b1104-ffeb-454a-8730-0ef3aa554c1e with group instance id None)
2020-10-24 13:50:25,728 - INFO  [executor-Rebalance:Logging@66] - [GroupCoordinator 1]: Stabilized group console-consumer-88244 generation 1 (__consumer_offsets-37)
2020-10-24 13:50:25,932 - INFO  [data-plane-kafka-request-handler-3:Logging@66] - [GroupCoordinator 1]: Assignment received from leader for group console-consumer-88244 for generation 1
2020-10-24 13:50:27,722 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 98ms
2020-10-24 13:50:28,221 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:IntGaugeSuite@247] - [SocketServer brokerId=1] clients: Removed a reference to ClientInformation(softwareName=unknown,softwareVersion=unknown).  1 reference(s) remaining.
2020-10-24 13:50:28,221 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:IntGaugeSuite@199] - [SocketServer brokerId=1] clients: Adding a new metric ClientInformation(softwareName=apache-kafka-java,softwareVersion=2.6.0).
2020-10-24 13:50:28,221 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:IntGaugeSuite@213] - [SocketServer brokerId=1] clients: entering performPendingMetricsOperations
2020-10-24 13:50:28,221 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:IntGaugeSuite@224] - [SocketServer brokerId=1] clients: adding metric MetricName [name=connections,networkProcessor=0}]
2020-10-24 13:50:28,221 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:Metrics@587] - Registered metric named MetricName [name=connections,221 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:IntGaugeSuite@229] - [SocketServer brokerId=1] clients: leaving performPendingMetricsOperations
2020-10-24 13:50:29,325 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 73,total bytes written so far: 73,expected bytes to write: 73
2020-10-24 13:50:29,933 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,total bytes written so far: 22,expected bytes to write: 22
2020-10-24 13:50:30,523 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22
2020-10-24 13:50:31,028 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,625 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22
2020-10-24 13:50:32,134 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,725 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22
2020-10-24 13:50:33,321 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,720 - DEBUG [main-SendThread(zookeeper:2181):ClientCnxn$SendThread@821] - Got ping response for sessionid: 0x1001526a2a1002d after 90ms
2020-10-24 13:50:33,830 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22
2020-10-24 13:50:34,424 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22
2020-10-24 13:50:35,021 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,528 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22
2020-10-24 13:50:36,121 - TRACE [data-plane-kafka-network-thread-1-ListenerName(PLAINTEXT)-PLAINTEXT-0:MultiRecordsSend@107] - Bytes written as part of multi-send call: 22,expected bytes to write: 22

版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 dio@foxmail.com 举报，一经查实，本站将立刻删除。

相关推荐

导入项目后报错问题
依赖报错 idea导入项目后依赖报错，解决方案：https://blog.csdn.net/weixin_42420249/article/details/81191861 依赖版本报错：更换其他版本 无法下载依赖可参考：https://blog.csdn.net/weixin_42628809/a
idea不能识别yaml文件
使用mybatis plus常见错误
错误1：代码生成器依赖和mybatis依赖冲突 启动项目时报错如下 2021-12-03 13:33:33.927 ERROR 7228 [ main] o.s.b.d.LoggingFailureAnalysisReporter : *************************** APPL
gradle常见问题与错误
错误1：gradle项目控制台输出为乱码 # 解决方案：https://blog.csdn.net/weixin_43501566/article/details/112482302 # 在gradle-wrapper.properties 添加以下内容 org.gradle.jvmargs=-Df
Mybatis Plus传入参数0不起作用
错误还原：在查询的过程中，传入的workType为0时，该条件不起作用 <select id="xxx"> SELECT di.id, di.name, di.work_type, di.updated... <where> <if test=&qu
linux中make编译源码包失败
报错如下，gcc版本太低 ^ server.c:5346:31: 错误：‘struct redisServer’没有名为‘server_cpulist’的成员 redisSetCpuAffinity(server.server_cpulist); ^ server.c: 在函数‘hasActiveC
微服务启动错误：Command line is too long. Shorten command line for
解决方案1 1、改项目中.idea/workspace.xml配置文件，增加dynamic.classpath参数 2、搜索PropertiesComponent，添加如下 <property name="dynamic.classpath" value="tru
vue常见错误
删除根组件app.vue中的默认代码后报错：Module Error (from ./node_modules/eslint-loader/index.js): 解决方案：关闭ESlint代码检测，在项目根目录创建vue.config.js，在文件中添加 module.exports = { lin
spark常见错误
查看spark默认的python版本 [root@master day27]# pyspark /home/software/spark-2.3.4-bin-hadoop2.7/conf/spark-env.sh: line 2: /usr/local/hadoop/bin/hadoop: No s
matplotlib报错：AttributeError: module 'backend_interagg' has no attribute 'FigureCanvas'. Did you mean: 'FigureCanvasAgg'?
使用本地python环境可以成功执行 import pandas as pd import matplotlib.pyplot as plt # 设置字体 plt.rcParams['font.sans-serif'] = ['SimHei'] # 能正确显示负号 p
gitlab登录失败，报错：This challenge page was accidentally cached by an intermediary and is no longer available.
设置时间 控制面板
后端开发常见错误
错误1：Request method ‘DELETE‘ not supported 错误还原：controller层有一个接口，访问该接口时报错：Request method ‘DELETE‘ not supported 错误原因：没有接收到前端传入的参数，修改为如下 参考 错误2：cannot r
docker常见错误
错误1：启动docker镜像时报错：Error response from daemon: driver failed programming external connectivity on endpoint quirky_allen 解决方法：重启docker -> systemctl r
idea常见错误
错误1：private field ‘xxx‘ is never assigned 按Altʾnter快捷键，选择第2项 参考：https://blog.csdn.net/shi_hong_fei_hei/article/details/88814070 错误2：启动时报错，不能找到主启动类 #
pip安装依赖失败
报错如下，通过源不能下载，最后警告pip需升级版本 Requirement already satisfied: pip in c:\users\ychen\appdata\local\programs\python\python310\lib\site-packages (22.0.4) Coll
maven常见错误
错误1：maven打包报错 错误还原：使用maven打包项目时报错如下 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources)
cloud项目中常见错误
错误1：服务调用时报错 服务消费者模块assess通过openFeign调用服务提供者模块hires 如下为服务提供者模块hires的控制层接口 @RestController @RequestMapping("/hires") public class FeignControl
springboot常见错误
错误1：运行项目后报如下错误 解决方案 报错2：Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project sb 解决方案：在pom.
springmvc拦截器中使用redisTemplate报空指针异常
参考 错误原因 过滤器或拦截器在生效时，redisTemplate还没有注入 解决方案：在注入容器时就生效 @Component //项目运行时就注入Spring容器 public class RedisBean { @Resource private RedisTemplate<String
vite报错：npm ERR! command C:WINDOWSsystem32cmd.exe /d /s /c C:UsersychenAppDataLocalTempnpx-dde1c848.cmd
使用vite构建项目报错 C:\Users\ychen\work>npm init @vitejs/app @vitejs/create-app is deprecated, use npm init vite instead C:\Users\ychen\AppData\Local\npm-
pythonJavaScriptjavaHTMLPHPreactjsC#AndroidCSSNode.jssqlrpython-3.xMysqLjQueryc++pandasFlutterangularIOSdjangolinuxswifttypescript路由器JSON路由器设置无线路由器h3c华三华三路由器设置华三路由器电脑软件教程arraysdocker软件图文教程Cvue.jslaravelspring-boot