hadoop - Apache 麒麟 : Intermediate table not found

Question

我是麒麟的新手。安装后，我运行 sample.sh，然后构建立方体，但得到错误消息:

java.io.IOException: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table not found)
     at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
     at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
     at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)
     at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)
     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
     at org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
     at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
     at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
     at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
     at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:745)
Caused by: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table not found)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1569)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)
     at com.sun.proxy.$Proxy49.get_table(Unknown Source)
     at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1008)
     at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:191)
     at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
     at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
     at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
     ... 13 more

`

Issue 975建议 kylin.job.hive.database.for.intermediatetable = default。之后，但我也收到此错误消息。

当我在 hive shell 中运行 desc formatted kylin_intermediate_kylin_sales_cube_desc_1970... 命令时，我可以获得其格式化信息。说明这个表存在于Hive中。为什么 Kylin 不能从 Hive 加载这张表？

Kylin version = 1.2
Hive version = 0.13.1-cdh5.3.2
Hbase version = 0.98.6+cdh5.3.2
Hadoop version = 2.5.0-cdh5.3.2

Answer 1

我已经解决了这个问题。原因是 hive.metastore.uris 属性没有在 hive-site.xml 中设置。 Kylin 使用 HCatalog 读取 Hive 表。 HCatalog 将使用 hive.metastore.uris 属性创建 HiveMetaStoreClient 并获取表元数据。这page有详细的解释。

<property>
  <name>hive.metastore.uris</name>
  <value>thrift://localhost:9083</value>
  <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description>
</property>

使用命令启动 Metastore:

nohup hive --service metastore -p 9083 &