我们第一次构建流式多维数据集失败step:save data Kafka的输出日志如下：
Counters: 12
Job Counters
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=10836
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=10836
Total vcore-seconds taken by all map tasks=10836
Total megabyte-seconds taken by all map tasks=11096064
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0有人能告诉我怎么解决吗？
1条答案
按热度按时间ztyzrc3y1#
我在运行kylin流式多维数据集构建时遇到了相同的问题。当我打开纱窗时，我看到
错误：java.lang.classnotfoundexception:org.apache.kafka.clients.consumer.consumer位于java.net.urlclassloader.findclass（urlclassloader）。java:381)在java.lang.classloader.loadclass（classloader。java:424)在sun.misc.launcher$appclassloader.loadclass（launcher。java:331)在java.lang.classloader.loadclass（classloader。java:357)在org.apache.kylin.source.kafka.hadoop.kafkainputformat.createrecordreader（kafkainputformat）。java:107)在org.apache.hadoop.mapred.maptask$newtrackingrecordreader.（maptask。java:515)在org.apache.hadoop.mapred.maptask.runnewmapper（maptask。java:758)在org.apache.hadoop.mapred.maptask.run（maptask。java:341)在org.apache.hadoop.mapred.yarnchild$2.run（yarnchild。java:164)位于javax.security.auth.subject.doas（subject）的java.security.accesscontroller.doprivileged（本机方法）。java:422)在org.apache.hadoop.security.usergroupinformation.doas（usergroupinformation。java:1758)在org.apache.hadoop.mapred.yarnchild.main（yarnchild。java:158)
按照这里的说明，我设置KAFKA_HOME然后重新启动kylin` . 没有这样的日志。