java - Lucene索引和Map/Reduce搜索

Question

这个问题已经在这里有了答案:




9年前关闭。

Possible Duplicate:
instant searching in petabyte of data…

如何在Lucene索引和搜索中使用HADOOP的Map / Reduce？

Answer 1

我可以为您找到的最接近的东西是Katta:

Katta is a distributed application running on many commodity hardware servers very similar to Hadoop MapReduce, Hadoop DFS, HBase, Bigtable or Hypertable.

(...)

Katta supports distributed scoring for its lucene implementation - this is because we do not expect that term distribution is fully balanced over all shards.

Each search query that is done in Katta ends up being two network roundtrips: first we get the document frequencies for a query from all the nodes and on the second trip pass this value and the search query to all nodes. Please note that we also provide a simple count method that just counts documents matching the query but does that within one network roundtrip.