hadoop - 无法从 IDEA 连接到资源管理器

Question

我在 IDEA Intellij 中以 yarn-client 模式提交作业时遇到连接问题。

我确实设置了 env 变量并通过打印出来对其进行了双重检查:

System.setProperty("YARN_CONF_DIR",  "D:\\HadoopDev\\UserClick\\src\\main\\resources\\hadoop-vm");

System.setProperty("HADOOP_CONF_DIR", "D:\\HadoopDev\\UserClick\\src\\main\\resources\\hadoop-vm");

但我仍然收到错误信息告诉我:

INFO - Connecting to ResourceManager at /0.0.0.0:8032 INFO - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 >time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, >sleepTime=1 SECONDS) INFO - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 1 》>time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, >sleepTime=1 SECONDS) INFO - Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 2 >time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, >sleepTime=1 SECONDS)

所有与 hadoop 相关的配置文件都在该文件夹中。我尝试上传 jar 并在集群中以 yarn-client 模式提交，结果成功了。

有什么帮助吗？谢谢~

Answer 1

set .config("spark.hadoop.yarn.resourcemanager.address", "hadoop:8032")  

做覆盖技巧。