java - MapReduce 2 作业在本地运行而不是提交到 yarn

Question

所以我尝试将我的作业配置为提交给 yarn，但它在本地运行:

config.set("yarn.resourcemanager.address", "ADDRESS:8032");
config.set("mapreduce.framework.name", "yarn"); 
config.set("fs.default.name", "hdfs://ADDRESS:8020");

如果我设置 ma​​pred.job.tracker 它会失败:

Exception in thread "main" org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RpcServerException): Unknown rpc kind in rpc headerRPC_WRITABLE

因为它不是 MR1。

那么为什么app没有提交到yarn呢？

Answer 1

通过这样做解决了它:

config.set("yarn.resourcemanager.address", "ADDRESS:8032");
config.set("yarn.resourcemanager.scheduler.address", "ADDRESS:8030");
config.set("yarn.resourcemanager.resource-tracker.address", "ADDRESS:8031");
config.set("yarn.resourcemanager.admin.address", "ADDRESS:8033");

代替:

config.set("yarn.resourcemanager.address", "ADDRESS:8032");