apache kylin:找不到中间表

daolsyd0  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(614)

我是Kylin的新手。安装后,我运行 sample.sh ,然后构建多维数据集,但得到错误消息:

java.io.IOException: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table not found)
     at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
     at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
     at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)
     at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)
     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
     at org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
     at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
     at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
     at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
     at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:745)
Caused by: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table not found)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1569)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)
     at com.sun.proxy.$Proxy49.get_table(Unknown Source)
     at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1008)
     at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:191)
     at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
     at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
     at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
     ... 13 more

第975期建议kylin.job.hive.database.for.intermediatetable = default. 在那之后,我也得到了这个错误信息。 当我跑的时候desc formatted kylin_intermediate_kylin_sales_cube_desc_1970...` 命令,我可以得到它的格式化信息。它表明此表存在于配置单元中。为什么kylin不能从Hive里装这个table?

Kylin version = 1.2
Hive version = 0.13.1-cdh5.3.2
Hbase version = 0.98.6+cdh5.3.2
Hadoop version = 2.5.0-cdh5.3.2
luaexgnf

luaexgnf1#

我已经解决了这个问题。原因是 hive.metastore.uris 属性未在中设置 hive-site.xml . kylin使用hcatalog读取配置单元表。hcatalog将使用 hive.metastore.uris 属性创建hivemetastoreclient并获取表meta。本页有详细说明。

<property>
  <name>hive.metastore.uris</name>
  <value>thrift://localhost:9083</value>
  <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description>
</property>

要使用命令启动元存储,请执行以下操作:

nohup hive --service metastore -p 9083 &

相关问题