apache-kafka - Confluent Schema Registry 集群模式

Question

我正在使用 Confluent 的 Kafka Connect 来使用 Kafka 流并以 Parquet 格式写入 HDFS。我在 1 个节点中使用 Schema Registry 服务并且运行良好。现在我想将架构注册表分发到集群模式来处理故障转移。关于如何实现这一点的任何链接或片段都将非常有用。

Answer 1

很难找到，但我们在文档中介绍了这种架构:
http://docs.confluent.io/3.0.0/schema-registry/docs/deployment.html#multi-dc-setup

稍微引用一​​下文档(尽管您应该阅读文档，但其中包含许多好的架构建议和恢复运行手册):

Assuming you have Schema Registry running, here are the recommended steps to add Schema Registry instances in a new “slave” datacenter (call it DC B):

In DC B, make sure Kafka has unclean.leader.election.enable set to false. In Kafka in DC B, create the _schemas topic. It should have 1 partition, kafkastore.topic.replication.factor of 3, and min.insync.replicas at least 2. In DC B, run MirrorMaker with Kafka in the “master” datacenter as the source and Kafka in DC B as the target. In the Schema Registry config files in DC B, set kafkastore.connection.url and schema.registry.zk.namespace to match the instances already running, and set master.eligibility to false. Start your new Schema Registry instances with these configs.