warnings - 配置单元启动期间警告和信息消息过多

Question

目前，我使用hadoop-2.2.0.tar.gz和hive-0.11.0.tar.gz来研究hadoop和hive。我只是从这两个 tarball 中提取文件并为它们设置环境。

然后我使用 hive 命令启动配置单元。我发现它有太多 WARN 和 INFO 消息，如下所示。有什么办法可以消除这些消息吗？我还没有设置任何配置。 hadoop版本是否与hive不兼容？

14/03/21 09:24:52 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
14/03/21 09:24:52 INFO Configuration.deprecation: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
14/03/21 09:24:52 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
14/03/21 09:24:52 INFO Configuration.deprecation: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
14/03/21 09:24:52 INFO Configuration.deprecation: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
14/03/21 09:24:52 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
14/03/21 09:24:52 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
14/03/21 09:24:52 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@6295eb:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
14/03/21 09:24:52 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@6295eb:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.

Logging initialized using configuration in jar:file:/home/ljq/hive-0.11.0/lib/hive-common-0.11.0.jar!/hive-log4j.properties
Hive history file=/tmp/ljq/hive_job_log_ljq_8719@rhel6-hadoop1_201403210924_1350715255.txt
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/ljq/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/ljq/hive-0.11.0/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
hive (default)>

Answer 1

根据下一个链接:org.apache.hadoop.hive.conf.HiveConf.java这些值是在类内部定义的，并且这些值现在已被弃用，因此始终会显示此警告。另一个链接中提出的解决方案:hadoop.apache.org/Configuration只是省略警告。您必须编辑文件 $HADOOP_HOME/etc/hadoop/log4j.properties 并取消注释图例后的行:

# Uncomment the following line to turn off configuration deprecation warnings.

log4j.logger.org.apache.hadoop.conf.Configuration.deprecation=WARN