hadoop - Hive进程内存大小

Question

请您帮我理解 Hive 上下文中的 512mb(以粗体突出显示)是什么？它的内存大小是多少？我在我的 hive-site.xml 文件中设置了 export HADOOP_HEAPSIZE=4192

hadoop@master:~/hive/conf$ ps -ef | grep ' hive '

hadoop 5587 1 0 Feb14 ? 00:05:27 /usr/lib/jvm/default-jdk/bin/java -Xmx4192m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.7.3/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.7.3 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop-2.7.3/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx512m -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /home/hadoop/hive/lib/hive-metastore-2.3.2.jar org.apache.hadoop.hive.metastore.HiveMetaStore

hadoop 9903 8034 0 10:54 pts/0 00:00:00 grep --color=auto 配置单元

hadoop 21646 15918 1 07:37 pts/3 00:03:02 /usr/lib/jvm/default-jdk/bin/java -Xmx4192m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.7.3/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.7.3 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop-2.7.3/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx512m -Dproc_hivecli -Dlog4j.configurationFile=hive-log4j2.properties -Djava.util.logging.config.file=/home/hadoop/hive/conf/parquet-logging.properties -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /home/hadoop/hive/lib/hive-cli-2.3.2.jar org.apache.hadoop.hive.cli.CliDriver

Answer 1

您编辑的变量用于客户端，而不是服务器，并且您不从 XML 文件中导出任何内容

To configure the heap size for HiveServer2 and Hive metastore, set the -Xmx parameter in the HADOOP_OPTS variable to the desired maximum heap size in /etc/hive/hive-env.sh

对比

To configure the heap size for the Beeline CLI, set the HADOOP_HEAPSIZE environment variable in /etc/hive/hive-env.sh

除此之外，这两个值都成功了，所以你可能想看看

Duplicated Java runtime options : what is the order of preference?