sql - Apache Spark 中的授权

Question

我正在尝试通过添加以下属性在 Spark 1.4.0 中配置基于 SQL 标准的授权，这是我为 Hive 0.13.1 所做的。

<property>
  <name>hive.security.authorization.enabled</name>
  <value>true</value>
  <description>enable or disable the Hive client authorization</description>
</property>

<property>
  <name>hive.security.authorization.manager</name>
  <value>org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory</value>
  <description>The Hive client authorization manager class name. The user defined authorization class should implement interface org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProvider.</description>
</property>


<property>
  <name>hive.security.authenticator.manager</name>
  <value>org.apache.hadoop.hive.ql.security.SessionStateUserAuthenticator</value>
  <description>hive client authenticator manager class name. The user defined authenticator should implement interface org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider.</description>
</property>

<property>
  <name>hive.users.in.admin.role</name>
  <value>hduser</value>
  <description>Comma separated list of users who are in admin role forbootstrapping. More users can be added in ADMIN role later.</description>
</property>

<property>
  <name>hive.server2.enable.doAs</name>
  <value>true</value>
  <description>Setting this property to true will have HiveServer2 execute Hive operations as the user making the calls to it.</description>
</property>

在 Hive 中它很好，但在 Spark 中它不能正常工作意味着当我尝试为表设置一些规则或尝试创建一些角色时，返回一些异常。

Answer 1

Spark 目前不支持 Hive 授权。见 https://issues.apache.org/jira/browse/SPARK-12008