gpt4 book ai didi

hadoop - Apache 纳奇 2.3 : throwing Error Failed with exit value 255

转载 作者:可可西里 更新时间:2023-11-01 16:07:33 24 4
gpt4 key购买 nike

我使用的是 apache nutch 2.3 版本。我的hadoop版本是2.6.0。Hadoop在单节点上运行。

当我按照nutch的命令运行时

./crawl --index ~/test/seed ~/test -1

上述命令的输出如下。

InjectorJob: starting at 2016-01-04 12:03:26
InjectorJob: Injecting urlDir: --index
InjectorJob: Using class org.apache.gora.memory.store.MemStore as the
Gora storage class.
InjectorJob:
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input
path does not exist: file:/usr/local/nutch/runtime/local/bin/--index
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus
(FileInputFormat.java:235)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits
(FileInputFormat.java:252)
at org.apache.hadoop.mapred.JobClient.writeNewSplits
(JobClient.java:1054)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1071)
at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:983)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs
(UserGroupInformation.java:1190
at org.apache.hadoop.mapred.JobClient.submitJobInternal
(JobClient.java:936)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:50)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:231)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:284)

Error running:
/usr/local/nutch/runtime/local/bin/nutch inject --index -crawlId
/home/jalaj/test/seed
Failed with exit value 255.

nutch 有什么问题?我需要安装 Apache Gora 吗?

最佳答案

问题在这里:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/usr/local/nutch/runtime/local/bin/--index

Nutch 尝试读取种子文件,但不能。请确保您的命令正确。

希望对您有所帮助,

乐国岛

关于hadoop - Apache 纳奇 2.3 : throwing Error Failed with exit value 255,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/34586164/

24 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com