gpt4 book ai didi

hadoop - map 缩小输出未生成

转载 作者:行者123 更新时间:2023-12-02 21:45:31 26 4
gpt4 key购买 nike

我正在尝试运行map reduce作业,但是即使在这里未创建'outp'文件夹的情况下也无法看到输出。以下是控制台o / p。

**alok@alok-Aspire-5920:~/Documents$ hadoop jar  /usr/local/hadoop_test_file/votecount.jar VoteCountApplication /input/booth1.txt /outp**

14/09/06 09:30:41 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/09/06 09:30:41 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
14/09/06 09:30:41 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
14/09/06 09:30:42 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
14/09/06 09:30:42 INFO input.FileInputFormat: Total input paths to process : 1
14/09/06 09:30:42 INFO mapreduce.JobSubmitter: number of splits:1
14/09/06 09:30:42 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local336021261_0001
14/09/06 09:30:42 WARN conf.Configuration: file:/tmp/hadoop-alok/mapred/staging/alok336021261/.staging/job_local336021261_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
14/09/06 09:30:42 WARN conf.Configuration: file:/tmp/hadoop-alok/mapred/staging/alok336021261/.staging/job_local336021261_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
14/09/06 09:30:43 WARN conf.Configuration: file:/tmp/hadoop-alok/mapred/local/localRunner/alok/job_local336021261_0001/job_local336021261_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
14/09/06 09:30:43 WARN conf.Configuration: file:/tmp/hadoop-alok/mapred/local/localRunner/alok/job_local336021261_0001/job_local336021261_0001.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
14/09/06 09:30:43 INFO mapreduce.Job: The url to track the job: localhost:8080/
14/09/06 09:30:43 INFO mapred.LocalJobRunner: OutputCommitter set in config null
14/09/06 09:30:43 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

最佳答案

指定VoteCountApplication和程序包,请尝试以下操作

$ hadoop jar /usr/local/hadoop_test_file/votecount.jar com.test.VoteCountApplication /input/booth1.txt /outpath

关于hadoop - map 缩小输出未生成,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/25696696/

26 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com