hadoop - java.io.IOException : failure to login: No LoginModules configured for hadoop_simple 异常

Question

我正在尝试从 TAC 运行我的第一个 Talend 作业。我正在尝试从标准作业中调用大数据批处理。它在本地集群中运行良好，但在从 TAC 运行相同的作业时我遇到了这个错误。

moment;pid;root_pid;father_pid;project;job;context;priority;type;origin;message;code
2017-02-13 07:54:29;20170213075427_jnxLB;20170213075427_jnxLB;20170213075427_jnxLB;ELT_3_0;CustomerDataLoad;hadoop;6;Java Exception;tRunJob_2;java.lang.RuntimeException:Child job returns 1. It doesn't terminate normally.
java.io.IOException: failure to login: No LoginModules configured for hadoop_simple
    at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:724)
    at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:676)
    at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:560)
    at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2784)
    at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2776)
    at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2642)
    at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
    at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:375)
    at org.apache.hadoop.util.GenericOptionsParser.validateFiles(GenericOptionsParser.java:392)
    at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:288)
    at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:479)
    at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
    at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)
    at elt_3_0.hbase_customertable_0_1.Hbase_customertable.runJobInTOS(Hbase_customertable.java:38664)
    at elt_3_0.hbase_customertable_0_1.Hbase_customertable.main(Hbase_customertable.java:38642)
Caused by: javax.security.auth.login.LoginException: No LoginModules configured for hadoop_simple
    at javax.security.auth.login.LoginContext.init(LoginContext.java:272)
    at javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
    at org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:450)
    at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:696)
    ... 15 more

我是否缺少任何依赖项？任何帮助都将不胜感激。

Answer 1

解决了，通过在 JVM Prop 中添加属性“-Djava.security.auth.login.config”并将该属性指向/opt/mapr/conf/mapr.login.conf。因此，在 mapr.login.conf 中有 hadoop 登录类

/**
 * simple login, just get OS creds
 */
hadoop_simple {
  org.apache.hadoop.security.login.GenericOSLoginModule required;
  org.apache.hadoop.security.login.HadoopLoginModule required;
};

这使用户能够将应用程序提交到包含所有适当模块的服务器。