hadoop - PIG 设置抛出错误

Question

我试图在我的 Fedora 20 系统中安装 PIG v0.13.0。提取tar.gz 内容后，我为JAVA_HOME 和PIG/bin 设置了PATH。然后我在控制台中输入命令 pig，这就是我得到的结果:无法理解出了什么问题:

[root@localhost /]# pig
14/12/21 00:05:15 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/12/21 00:05:15 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/12/21 00:05:15 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-12-21 00:05:16,082 [main] INFO  org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-12-21 00:05:16,083 [main] INFO  org.apache.pig.Main - Logging error messages to: //pig_1419100516081.log
2014-12-21 00:05:16,130 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /root/.pigbootup not found
2014-12-21 00:05:16,765 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-12-21 00:05:16,771 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-12-21 00:05:16,771 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:8020
2014-12-21 00:05:16,780 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2014-12-21 00:05:19,130 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2014-12-21 00:05:19,130 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: localhost:8021
2014-12-21 00:05:19,136 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
grunt> ls
2014-12-21 00:05:33,697 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2997: Encountered IOException. Call From localhost.localdomain/127.0.0.1 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
Details at logfile: //pig_1419100516081.log

请告诉我为什么 grunt shell 中的 ls 命令会抛出错误？

请指导。

Answer 1

当您在控制台中键入 pig 时，默认情况下它将进入 MAPREDUCE 模式，为此您需要访问 Hadoop 集群和 HDFS 安装。 Mapreduce模式是pig的默认模式。
看起来您的 hadoop 集群配置不正确，这就是您收到连接已退款错误的原因。请按照此链接解决此连接被拒绝的问题。 http://wiki.apache.org/hadoop/ConnectionRefused .

解决方法是使用LOCAL 模式，这不需要安装 hadoop。
在控制台中键入 pig -x local 这将打开 grunt shell 并键入 ls 命令。

本地模式

$ pig -x local

Mapreduce 模式

$ pig 
(or)                 //try to connect HDFS
$ pig -x mapreduce