elasticsearch - elasticsearch_http Logstash错误

Question

我正在尝试运行此:

input {  
    twitter {
        # add your data
        consumer_key => "shhhhh"
        consumer_secret => "shhhhh"
        oauth_token => "shhhhh"
        oauth_token_secret => "shhhhh"
        keywords => ["words"]
        full_tweet => true
    }
}
output {  
    elasticsearch_http {
        host => "shhhhh"
        index => "idx_ls"
        index_type => "tweet_ls"
    }
}

这是我得到的错误:

Sending Logstash's logs to /usr/local/Cellar/logstash/5.2.1/libexec/logs which is now configured via log4j2.properties
[2017-02-24T04:48:03,060][ERROR][logstash.plugins.registry] Problems loading a plugin with {:type=>"output", :name=>"elasticsearch_http", :path=>"logstash/outputs/elasticsearch_http", :error_message=>"NameError", :error_class=>NameError, :error_backtrace=>["/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/plugins/registry.rb:221:in `namespace_lookup'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/plugins/registry.rb:157:in `legacy_lookup'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/plugins/registry.rb:133:in `lookup'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/plugins/registry.rb:175:in `lookup_pipeline_plugin'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/plugin.rb:129:in `lookup'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/pipeline.rb:452:in `plugin'", "(eval):12:in `initialize'", "org/jruby/RubyKernel.java:1079:in `eval'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/pipeline.rb:98:in `initialize'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/agent.rb:246:in `create_pipeline'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/agent.rb:95:in `register_pipeline'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/runner.rb:264:in `execute'", "/usr/local/Cellar/logstash/5.2.1/libexec/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:67:in `run'", "/usr/local/Cellar/logstash/5.2.1/libexec/logstash-core/lib/logstash/runner.rb:183:in `run'", "/usr/local/Cellar/logstash/5.2.1/libexec/vendor/bundle/jruby/1.9/gems/clamp-0.6.5/lib/clamp/command.rb:132:in `run'", "/usr/local/Cellar/logstash/5.2.1/libexec/lib/bootstrap/environment.rb:71:in `(root)'"]}
[2017-02-24T04:48:03,073][ERROR][logstash.agent           ] fetched an invalid config {:config=>"input {  \n    twitter {\n        # add your data\n        consumer_key => \"shhhhh\"\n        consumer_secret => \"Shhhhhh\"\n        oauth_token => \"shhhh\"\n        oauth_token_secret => \"shhhhh\"\n        keywords => [\"word\"]\n        full_tweet => true\n    }\n}\noutput {  \n    elasticsearch_http {\n        host => \"shhhhh.amazonaws.com\"\n        index => \"idx_ls\"\n        index_type => \"tweet_ls\"\n    }\n}\n", :reason=>"Couldn't find any output plugin named 'elasticsearch_http'. Are you sure this is correct? Trying to load the elasticsearch_http output plugin resulted in this error: Problems loading the requested plugin named elasticsearch_http of type output. Error: NameError NameError"}

我尝试安装 elasticsearch_http，但它似乎不是一个软件包。我也尝试过

logstash-plugin安装logstash-input-elasticsearch
和
logstash-plugin安装logstash-output-elasticsearch

确实安装了但出现了相同的错误。

Logstash完全陌生，因此这可能非常简单。
我正在尝试遵循此 https://www.rittmanmead.com/blog/2015/08/three-easy-ways-to-stream-twitter-data-into-elasticsearch/

我尝试了瓦尔的答案，并得到了:

[2017-02-24T05:12:45,385][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>#<URI::HTTP:0x4c2332e0 URL:http://shhhhh:9200/>, :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://sshhhhhh:9200/][Manticore::ConnectTimeout] connect timed out"}

我可以转到url，然后在浏览器上得到响应，我将其设置为打开权限，因此我不确定那是什么问题。

Answer 1

elasticsearch_http输出不再有效。您需要改为使用elasticsearch输出。

elasticsearch {
    hosts => "localhost:9200"
    index => "idx_ls"
    document_type => "tweet_ls"
}