elasticsearch - Storm ui中没有通过拓扑发射或传输元组

Question

我正在使用带有Elasticsearch 7.2.0的Stormcrawler 1.16。我已经用acrhetype建立了项目。
我运行以提交拓扑的命令

 storm jar target/stormcrawler-1.0-SNAPSHOT.jar  org.apache.storm.flux.Flux --remote es-crawler.flux

我在输出中得到这个-

 Parsing file: /home/ubuntu/stormcrawler/es-crawler.flux
 835  [main] INFO  o.a.s.f.p.FluxParser - loading YAML from input 
 stream...
 841  [main] INFO  o.a.s.f.p.FluxParser - Not performing property 
 substitution.
 841  [main] INFO  o.a.s.f.p.FluxParser - Not performing environment 
 variable substitution.
 900  [main] INFO  o.a.s.f.p.FluxParser - Loading includes from 
 resource: /crawler-default.yaml
 901  [main] INFO  o.a.s.f.p.FluxParser - loading YAML from input 
 stream...
 903  [main] INFO  o.a.s.f.p.FluxParser - Not performing property 
 substitution.
 903  [main] INFO  o.a.s.f.p.FluxParser - Not performing environment 
 variable substitution.
 Configuration (interpreted): 

然后我最后输出线-

   2014 [main] WARN  o.a.s.u.Utils - STORM-VERSION new 1.2.3 old 1.2.3
   2376 [main] INFO  o.a.s.StormSubmitter - Finished submitting topology: crawler

但是，当我在Storm ui中检查此爬网程序拓扑时，然后在拓扑统计信息中，此爬网程序拓扑不会发出或传输任何元组。

我在下面的链接中对 Storm ui的快照进行了attech处理。

[在拓扑统计中，没有元组被发出或传递。我该如何解决这个问题？ 1

Answer 1

您的POM文件可能缺少“storm-crawler-elasticsearch”依赖性。

您可以将代码与Storm-crawler-elasticsearch-archetype生成的代码进行比较，这将为您提供有效的配置。

Use the archetype for Elasticsearch with:

mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=LATEST

You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (e.g. stormcrawler), a version and package name.

This will not only create a fully formed project containing a POM with the dependency above but also a set of resources, configuration files and a topology class. Enter the directory you just created (should be the same as the artefactId you specified earlier) and follow the instructions on the README file.