如何解决卡夫卡消息未插入数据库
Kafka消息未插入到postgresql数据库中。我可以在使用者中看到消息,但消息未插入表中。任何建议都会有所帮助。
Sink_connect.properties
connection.url=jdbc:postgresql://localhost:5432/postgres
user=postgres
password=xxxxxx
insert.mode=insert
table.name.format=kafka_sink_pg
pk.mode=none
pk.fields=none
auto.create=true
制作人
kafka-avro-console-producer --broker-list localhost:9092 --topic Kafka_pg --property value.schema='{"type":"record","name":"kafka_sink_pg","fields":[{"name":"serial_no","type":"int"},{"name":"technology","type": "string"},{"name":"platform","type": "string"}]}'
消息
{"serial_no": 1,"technology": "ETL","platform": "Informatica"}
{"serial_no": 2,"platform": "Talend"}
下面是日志文件中的错误消息,
[2020-08-12 03:50:09,940] INFO Kafka Connect started (org.apache.kafka.connect.runtime.Connect:57)
[2020-08-12 03:50:09,943] ERROR Failed to create job for ../config/sink-quickstart-Postgres.properties (org.apache.kafka.connect.cli.ConnectStandalone:110)
[2020-08-12 03:50:09,952] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:121)
java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.connect.jdbc.JdbcSinkConnector
解决方法
错误是由于jdbc驱动程序导致插件路径无法标识位置。
通过在connect-avro-standalone.properties
文件中提供插件的完整路径来解决此问题
初始
plugin.path=share/java
更改为
plugin.path=/usr/kafka/share/java #Provided the complete path
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。