elasticsearch - org.apache.kafka.connect.errors.ConnectException : Tolerance exceeded in error handler

Question

我正在从 kafka 创建一个新的 Elasticsearch 连接器，但出现此错误:org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler
看起来是主题的序列化，但我已经在值和键转换器中测试了 JsonConverter 和 AvroConverter。

有什么想法是这里的问题吗？

{
  "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
  "connection.url": "es-endpoint",
  "tasks.max": "1",
  "topics": "simple.elasticsearch.data",
  "name": "simple-elasticsearch-connector",
  "type.name": "_doc",
  "value.converter": "org.apache.kafka.connect.json.JsonConverter",
  "value.converter.schemas.enable": "false",
  "schema.ignore": "true",
  "key.ignore": "true"
 }

我在这里遵循示例: https://www.confluent.io/blog/kafka-elasticsearch-connector-tutorial/

Answer 1

错误不全。如果你错误显示这样的东西；

org.apache.kafka.connect.runtime.errors.RetryWithToleranceOperator.execAndHandleError(RetryWithToleranceOperator.java:180)\n\t... 11 more\nCaused by: org.apache.kafka.common.errors.SerializationException: Error serializing Avro message\nCaused by: java.net.MalformedURLException: unknown protocol: confluent-schema-registry\n\tat

描述您的 pod 并检查环境变量。

kubectl.exe describe pod cp-kafka-connect-12fc858c8b-jj5sx -n namespace

查看是否为您的架构注册表 URL 指定了协议(protocol)；

CONNECT_KEY_CONVERTER_SCHEMA_REGISTRY_URL:    confluent-schema-registry:18081
CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL:  confluent-schema-registry:18081

如果与上面类似，请将您的部署编辑为如下所示，或使用 HTTP 或 HTTPS 协议(protocol)重新部署带有模式注册表的 kafka-connect。

CONNECT_KEY_CONVERTER_SCHEMA_REGISTRY_URL:    http://confluent-schema-registry:18081
CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL:  http://confluent-schema-registry:18081