【问题标题】:Apache Nutch 2.3: throwing Error Failed with exit value 255Apache Nutch 2.3:抛出错误失败,退出值为 255
【发布时间】:2016-05-27 05:50:43
【问题描述】:

我使用的是 apache nutch 2.3 版本。 我的 hadoop 版本是 2.6.0。Hadoop 在单节点上运行。

当我运行 nutch 的以下命令时

./crawl --index ~/test/seed ~/test -1

上述命令的输出如下。

InjectorJob: starting at 2016-01-04 12:03:26
InjectorJob: Injecting urlDir: --index
InjectorJob: Using class org.apache.gora.memory.store.MemStore as the    
Gora storage class.
InjectorJob:    
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input
path does not exist: file:/usr/local/nutch/runtime/local/bin/--index
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus
(FileInputFormat.java:235)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits
(FileInputFormat.java:252)
at org.apache.hadoop.mapred.JobClient.writeNewSplits
(JobClient.java:1054)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1071)
at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:983)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs
(UserGroupInformation.java:1190
at org.apache.hadoop.mapred.JobClient.submitJobInternal
(JobClient.java:936)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:50)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:231)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:284)

Error running:
/usr/local/nutch/runtime/local/bin/nutch inject --index -crawlId    
/home/jalaj/test/seed
Failed with exit value 255.

nutch 有什么问题?我需要安装 Apache Gora 吗?

【问题讨论】:

    标签: hadoop nutch


    【解决方案1】:

    问题出在这里:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/usr/local/nutch/runtime/local/bin/--index

    Nutch 尝试读取种子文件,但不能。请确保您的命令正确。

    希望这会有所帮助,

    乐国岛

    【讨论】:

    • 感谢您的回答,我会检查并回复此问题。
    猜你喜欢
    • 1970-01-01
    • 2014-09-22
    • 1970-01-01
    • 2011-07-10
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2016-04-19
    • 2018-10-24
    相关资源
    最近更新 更多