java - org.apache.solr.common.SolrException : Bad Request Bad Request request: http://localhost:8080/solr/update? wt=javabin&version=2-6ren

java - org.apache.solr.common.SolrException : Bad Request Bad Request request: http://localhost:8080/solr/update? wt=javabin&version=2

转载作者：可可西里更新时间：2023-11-01 14:50:34

请大家帮帮我我正在尝试使用 NUTCH 抓取网站，但它给我错误“java.io.IOException: Job failed!”

我正在运行此命令“bin/nutch solrindex http://<host name>:8080/solr/ crawl/crawldb -linkdb crawl/linkdb crawl/segments/*”并且我正在使用 NUTCH 1.5.1 和 SOLR 3.6.1 以及 jdk java-7-openjdk-i386 和 ubuntu 12.04。

在 hadoop.log 存在于 NUTCH/log 文件夹中显示以下内容:

2012-09-13 12:56:10,524 INFO  solr.SolrIndexer - SolrIndexer: starting at 2012-09-13 12:56:10

2012-09-13 12:56:10,604 INFO  indexer.IndexerMapReduce - IndexerMapReduce: crawldb: crawl/crawldb

2012-09-13 12:56:10,604 INFO  indexer.IndexerMapReduce - IndexerMapReduce: linkdb: crawl/linkdb

2012-09-13 12:56:10,604 INFO  indexer.IndexerMapReduce - IndexerMapReduces: adding segment: crawl/segments/20120910160403

2012-09-13 12:56:10,711 INFO  indexer.IndexerMapReduce - IndexerMapReduces: adding segment: crawl/segments/20120910160448

2012-09-13 12:56:10,715 INFO  indexer.IndexerMapReduce - IndexerMapReduces: adding segment: crawl/segments/20120910160631

2012-09-13 12:56:10,760 WARN  util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2012-09-13 12:56:11,212 INFO  plugin.PluginRepository - Plugins: looking in: /home/zapbuild/Nutch/plugins

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository - Plugin Auto-activation mode: [true]

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository - Registered Plugins:

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository -     the nutch core extension points (nutch-extensionpoints)

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository -     Regex URL Normalizer (urlnormalizer-regex)

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository -     CyberNeko HTML Parser (lib-nekohtml)

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository -     OPIC Scoring Plug-in (scoring-opic)

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository -     Basic URL Normalizer (urlnormalizer-basic)

2012-09-13 12:56:11,310 INFO  plugin.PluginRepository -     Tika Parser Plug-in (parse-tika)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Basic Indexing Filter (index-basic)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Html Parse Plug-in (parse-html)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Anchor Indexing Filter (index-anchor)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     HTTP Framework (lib-http)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Regex URL Filter (urlfilter-regex)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Regex URL Filter Framework (lib-regex-filter)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Pass-through URL Normalizer (urlnormalizer-pass)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Http Protocol Plug-in (protocol-http)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository - Registered Extension-Points:

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch URL Normalizer (org.apache.nutch.net.URLNormalizer)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch Protocol (org.apache.nutch.protocol.Protocol)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch Segment Merge Filter (org.apache.nutch.segment.SegmentMergeFilter)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch URL Filter (org.apache.nutch.net.URLFilter)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch Indexing Filter (org.apache.nutch.indexer.IndexingFilter)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     HTML Parse Filter (org.apache.nutch.parse.HtmlParseFilter)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch Content Parser (org.apache.nutch.parse.Parser)

2012-09-13 12:56:11,311 INFO  plugin.PluginRepository -     Nutch Scoring (org.apache.nutch.scoring.ScoringFilter)

2012-09-13 12:56:11,313 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter


2012-09-13 12:56:11,314 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:11,314 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:14,104 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:14,104 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:14,104 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:17,135 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:17,136 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:17,136 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:20,204 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:20,205 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:20,205 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:23,297 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:23,297 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:23,297 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:26,232 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:26,232 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:26,233 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:29,252 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:29,252 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:29,252 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:32,284 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:32,284 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:32,284 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:35,258 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:35,258 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:35,258 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:38,283 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:38,284 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:38,284 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:41,278 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:41,278 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:41,278 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:44,334 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:44,334 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:44,334 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:47,338 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:47,338 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:47,338 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:50,360 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:50,360 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:50,360 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:53,309 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter

2012-09-13 12:56:53,310 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off

2012-09-13 12:56:53,310 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: content dest: content

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: title dest: title

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: host dest: host

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: segment dest: segment

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: boost dest: boost

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: digest dest: digest

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: tstamp dest: tstamp

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: url dest: id

2012-09-13 12:56:53,357 INFO  solr.SolrMappingReader - source: url dest: url

2012-09-13 12:56:53,409 INFO  solr.SolrWriter - Indexing 18 documents

2012-09-13 12:56:53,604 WARN  mapred.LocalJobRunner - job_local_0001

org.apache.solr.common.SolrException: Missing solr core name in path

Missing solr core name in path

request: http://<host name>:8983/solr/update?wt=javabin&version=2
    at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:430)
    at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
    at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
    at org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:142)
    at org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.java:48)
    at org.apache.hadoop.mapred.ReduceTask$OldTrackingRecordWriter.close(ReduceTask.java:466)
    at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:530)
    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:420)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
2012-09-13 12:56:53,981 ERROR solr.SolrIndexer - java.io.IOException: Job failed!

在 Solr 中我没有找到任何日志文件。

请帮我解决我真正遇到的问题。

最佳答案

您的日志说明了问题所在: Missing solr core name in path

您的请求应在 /solr/ 之间具有 Solr 核心名称和 /update?wt=...

是这样的: http://<host name>:8983/solr/<core_name>/update?wt=javabin&version=2

也许您应该将核心名称添加到您的 nutch 命令 URL 中

关于java - org.apache.solr.common.SolrException : Bad Request Bad Request request: http://localhost:8080/solr/update? wt=javabin&version=2，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/12369644/

文章推荐： windows - cmd.exe 命令行中必须转义哪些符号？

文章推荐： jquery - HTML 高级搜索 - 标题部分

文章推荐： javascript - 如何在收到服务器回复消息后才显示DIV？

文章推荐： c++ - 在表中预计算一次 cos() 和 sin()

http - HTTP 服务器如何处理非常大的 HTTP 请求？
据我了解，HTTP POST 请求的正文大小没有限制。因此，客户端可能会在一个 HTTP 请求中发送千兆字节的数据。现在我想知道 HTTP 服务器应该如何处理此类请求。 Tomcat 和 Jett
http - http ://*:80 and http://+:80有什么区别
在了解Web Deploy我遇到了一些讨论 http://+:80 和 http://*:80 的 netsh.exe 命令。这些是什么意思？最佳答案引自URLPrefix Strings (Wi
http - HTTP 响应是否遵循与 HTTP 请求相同的路径？
假设我有一个负载均衡器，然后是 2 个 Web 服务器，然后是一个负载均衡器，然后是 4 个应用程序服务器。 HTTP 响应是否遵循与 HTTP 请求服务相同的路径？最佳答案按路径，我假设您是网络
http - HTTP 删除操作失败的 HTTP 响应代码是什么？
我有一个带有 uri /api/books/122 的资源，如果在客户端为此资源发送 HTTP Delete 时该资源不存在，那么相应的响应代码是什么这个 Action ？是不是404 Not Fou
http - HTTP 服务器应用程序如何优雅地拒绝 HTTP 管道请求？
是否有特定的(或约定的)HTTP 响应消息(或除断开连接之外的其他操作)来阐明服务器不接受 pipelined HTTP requests ？我正在寻找能让客户端停止流水线化它的请求并分别发送每个请
http - http ://*:80 and http://+:80有什么区别
在了解Web Deploy我遇到了一些讨论 http://+:80 和 http://*:80 的 netsh.exe 命令。这些是什么意思？最佳答案引自URLPrefix Strings (Wi
http - HTTP 删除操作失败的 HTTP 响应代码是什么？
我有一个带有 uri /api/books/122 的资源，如果在客户端为此资源发送 HTTP Delete 时该资源不存在，那么相应的响应代码是什么这个 Action ？是不是404 Not Fou
angularjs - $http.get 、 $http.post 、 $http.put 、 $http.delete $http.head 和 $http.jsonp 之间的区别
关闭。这个问题需要更多focused .它目前不接受答案。想改进这个问题吗？更新问题，使其只关注一个问题 editing this post . 关闭 8 年前。 Improve this qu
http - Mule HTTP 点的自定义 HTTP 方法
我使用 Mule 作为 REST API AMQP。我必须发送自定义请求方法:“PRINT”，但我收到: Status Code: 400 Bad Request The request could
http - 不同 HTTP 响应代码的示例 http url
我需要针对具有不同 HTTP 响应代码的 URL 测试我的脚本。我如何获取响应代码 300、303 或 307 等的示例/示例现有 URL？谢谢! 最佳答案您可以使用 httpbin为此目的。例
http - 将 HTTP 响应与其相应的 HTTP 流水线请求相匹配
我正在尝试编写一个程序来匹配 HTTP 请求及其相应的响应。似乎在大多数情况下一切都运行良好(当传输完全有序时，即使不是，通过使用 TCP 序列号)。我发现的唯一问题是当我有流水线请求时。在那之后，
http - 其他 HTTP 方法是否可以接受 HTTP 303？
RESTful Web Services鼓励使用 HTTP 303将客户端重定向到资源的规范表示。它仅在 HTTP GET 的上下文中讨论主题。这是否也适用于其他 HTTP 方法？如果客户端尝试对非
http - HTTP 客户端应该如何正确解析 *chunked* HTTP 响应主体？
当使用chunked HTTP传输编码时，为什么服务器需要同时写出chunk的字节大小并且后续的chunk数据以CRLF结尾？这不会使发送二进制数据“CRLF-unclean”和方法有点多余吗？如
http - 我可以在完全读取 HTTP 请求之前发送 HTTP 响应吗？
这个问题在这里已经有了答案: Is it acceptable for a server to send a HTTP response before the entire request has
http - 将 HTTP 请求映射到 HTTP 响应
如果我向同一台服务器发出多个 HTTP Get 请求并收到每个请求的 HTTP 200 OK 响应，我如何使用 Wireshark 判断哪个请求映射到哪个响应？目前看起来像是发出了一个 http 请
http - 传递给 http.HandleFunc 的函数如何访问 http.ResponseWriter 和 http.Request？
func main() { http.HandleFunc("/", handler) } func handler(w http.ResponseWriter, r http.Request
node.js - import http = require ('http' ); 之间的区别并从 'http' 导入 * 作为 http ；？
我找不到有值(value)的 NodeJS with Typescript 教程，所以我在无指导下潜入水中，果然我有一个问题。我不明白这两行之间的区别: import * as http from
http - HTTP 方法是否区分大小写？
问一个关于Are HTTP headers case-sensitive?的问题，如果 HTTP 方法区分大小写，大多数服务器如何处理“get”或“post”与“GET”或“POST”？例如，看起来
http - HTTP GET错误用户无效
我正在使用ASP.NET，在其中我通过动词GET接收查询，该应用程序专用于该URL。该代码有效，但是如果用户发送的密码使http 200无效，请回答我，并在消息的正文中显示“Fail user or
http - http.HandleFunc始终匹配“/”
Closed. This question needs details or clarity。它当前不接受答案。想改善这个问题吗？添加详细信息，并通过editing this post阐明问题。 9

可可西里

个人简介

我是一名优秀的程序员,十分优秀！

作者热门文章

滴滴打车优惠券免费领取

全站热门文章

首页

博学

6Ren·AI

商城

java - org.apache.solr.common.SolrException : Bad Request Bad Request request: http://localhost:8080/solr/update? wt=javabin&version=2