docker - Streamsets Solr 目标模块错误不允许我直接从管道将数据添加到 Solr 集合

Question

我已经构建并部署了以下 docker-compose.yml 文件:

services:
  solr1:
    container_name: solr1
    image: solr:5-slim
    ports:
      - "9981:9983"
      - "8981:8983"
    volumes:
      - data:/var/solr
      - ./solr_configs/schema.xml:/opt/solr/server/solr/configsets/mri_config/schema.xml
      - ./solr_configs/schema.xml:/opt/solr/server/solr/configsets/mri_config/conf/managed-schema
      - ./solr_configs:/opt/solr/server/solr/configsets/mri_config/conf
    environment:
      - ZK_HOST=zoo1:2181,zoo2:2181,zoo3:2181
    networks:
      - solr
    depends_on:
      - zoo1
      - zoo2
      - zoo3

  solr2:
    image: solr:5-slim
    container_name: solr2
    ports:
      - "9982:9983"
      - "8982:8983"
    volumes:
      - data:/var/solr
      - ./solr_configs/schema.xml:/opt/solr/server/solr/configsets/mri_config/schema.xml
      - ./solr_configs/schema.xml:/opt/solr/server/solr/configsets/mri_config/conf/managed-schema
      - ./solr_configs:/opt/solr/server/solr/configsets/mri_config/conf
    environment:
      - ZK_HOST=zoo1:2181,zoo2:2181,zoo3:2181
    networks:
      - solr
    depends_on:
      - zoo1
      - zoo2
      - zoo3

  solr3:
    image: solr:5-slim
    container_name: solr3
    ports:
      - "9983:9983"
      - "8983:8983"
    volumes:
      - data:/var/solr
      - ./solr_configs/schema.xml:/opt/solr/server/solr/configsets/mri_config/schema.xml
      - ./solr_configs/schema.xml:/opt/solr/server/solr/configsets/mri_config/conf/managed-schema
      - ./solr_configs:/opt/solr/server/solr/configsets/mri_config/conf
    environment:
      - ZK_HOST=zoo1:2181,zoo2:2181,zoo3:2181
    ports:
      - 9983:9983
      - 8983:8983
    networks:
      - solr
    depends_on:
      - zoo1
      - zoo2
      - zoo3

  zoo1:
    image: zookeeper:3.4
    container_name: zoo1
    restart: always
    hostname: zoo1
    ports:
      - 2181:2181
    environment:
      ZOO_MY_ID: 1
      ZOO_SERVERS: server.1=zoo1:2888:3888 server.2=zoo2:2888:3888 server.3=zoo3:2888:3888
    networks:
      - solr

  zoo2:
    image: zookeeper:3.4
    container_name: zoo2
    restart: always
    hostname: zoo2
    ports:
      - 2182:2181
    environment:
      ZOO_MY_ID: 2
      ZOO_SERVERS: server.1=zoo1:2888:3888 server.2=zoo2:2888:3888 server.3=zoo3:2888:3888
    networks:
      - solr

  zoo3:
    image: zookeeper:3.4
    container_name: zoo3
    restart: always
    hostname: zoo3
    ports:
      - 2183:2181
    environment:
      ZOO_MY_ID: 3
      ZOO_SERVERS: server.1=zoo1:2888:3888 server.2=zoo2:2888:3888 server.3=zoo3:2888:3888
    networks:
      - solr

  sdc:
    image: streamsets/datacollector
    ports:
      - 18630:18630
    volumes:
      - /local/directory/path/streamsets:/data:rw
    networks:
      - solr

networks:
  solr:

volumes:
  data:

然后我通过执行创建了一个名为 collection1 的 Solr 集合

docker exec solr1 solr create -c collection1

在 Streamsets 中转换我的数据后，我安装并添加了 Solr-6.1.0 目标模块，方法是从包管理器中添加它，然后重新启动 sdc docker 容器。这是我在 Streamsets 中对 SolrCloud 设置和单节点设置的设置:





每次我运行预览或管道时，我都会收到一条错误消息:

SOLR_3 - Could not connect to the Solr instance: java.lang.ClassCastException: org.apache.solr.common.util.SimpleOrderedMap cannot be cast to java.util.Map

这个错误是什么意思？为了能够连接管道并将数据直接传输到 Solr 集合中，我应该更改或添加哪些内容？

这也是该集合的 Solr Admin UI state.json 的附加图像。



SDC 堆栈跟踪:



任何帮助深表感谢。

Answer 1

我最终从包管理器安装了 CDH 5.15.0 包。这使我们能够连接到我们的 docker 容器中的 Solr 5.5-slim。然后，在 Solr 目标模块的常规选项卡中，我们在暂存库字段中选择了 CDH 5.15.0 包，然后定义了允许我们连接到 Solr 数据库的单节点信息。