hadoop - Hive始终以本地模式运行

Question

我有hadoop集群(3个节点)，所有节点都运行正常。但是Hive始终以本地模式运行查询。我将mapred.job.tracker坐在跟踪器主机上，但仍然无法正常工作。

Answer 1

我发现问题出在某些hadoop配置中。似乎Hive无法检测到群集配置。

由于我使用的是hadoop 2.6.0，因此根据发行版更改了mapred-site.xml，请参见下面的mapred-site.xml文件

   <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
<property>
  <name>mapreduce.jobtracker.address</name>
  <value>hadoopMaster:54311</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
</property>

<property>
  <name>mapreduce.jobtracker.http.address</name>
  <value>hadoopMaster:50030</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
</property>

这是Apache Hadoop中mapred-site.xml的默认值。

https://hadoop.apache.org/docs/r2.6.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml