运行flume代理时出错

p4tfgftt  于 2021-06-03  发布在  Flume
关注(0)|答案(1)|浏览(432)

我正在使用带有hbase0.94.10和hadoop1.1.2的flume 1.4.0….我是flume的新手。在运行flume代理时,出现以下错误。。

Error occurred during initialization of VM The size of the object heap + VM data   exceeds the maximum representable size org.apache.flume.node.Application --conf-file=/usr/local/flume/conf/flume.conf --name agent
Exception in thread "main" java.lang.NoClassDefFoundError: occurred
Caused by: java.lang.ClassNotFoundException: occurred
    at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: occurred. Program will exit.

我的代理配置如下:

agent1.sources = tail
agent1.channels = memoryChannel
agent1.sinks = sink1
agent1.sources.tail.type = exec
agent1.sources.tail.command = tail -f  /usr/local/jarsfortest/LogsForTest/generatingLogs-app.logs
agent1.sources.tail.channels = memoryChannel
agent1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
agent1.sinks.sink1.channel = memoryChannel
agent1.sinks.sink1.table = testFlume
agent1.sinks.sink1.columnFamily = log
agent1.sinks.sink1.serializer = org.apache.flume.sink.hbase.RegexHbaseEventSerializer
agent1.sinks.sink1.serializer.regex = [a-zA-Zo-9]*[^C][a-zA-Z0-9]*[^C][a-zA-Z0-9]*
agent1.sinks.sink1.serializer.regexIgnoreCase = true
agent1.sinks.sink1.serializer.colNames = id, no_fill_reason, bid
agent1.sinks.sink1.channel = memoryChannel
agent1.sinks.sink1.type = logger
agent1.channels.memoryChannel.type = memory
agent1.channels.memoryChannel.capacity = 100

请帮帮我。。提前谢谢

d4so4syb

d4so4syb1#

这看起来像是jvm问题,而不是flume问题。我要检查jar文件是否损坏,是否没有将最大堆大小设置得太小,等等。
不管这封被截断的邮件的结尾是什么都可能是线索, the size of the object heap + VM data ###更新 agent1.channels.memoryChannel.capacity = 100 这个容量看起来很小。我会删除那行,让它使用默认值。

相关问题