You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "sri (JIRA)" <ji...@apache.org> on 2017/02/05 21:55:41 UTC
[jira] [Comment Edited] (FLUME-3052) Getting heap space error even
changing the memory channel to file channel
[ https://issues.apache.org/jira/browse/FLUME-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853387#comment-15853387 ]
sri edited comment on FLUME-3052 at 2/5/17 9:54 PM:
----------------------------------------------------
configuration file content :
# configure the agent
agentName.sources = execsource
agentName.channels = filechannel
agentName.sinks = filesink
# Describe/configure Source
agentName.sources.execsource.type = jms
agentName.sources.execsource.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
agentName.sources.execsource.connectionFactory = QueueConnectionFactory
agentName.sources.execsource.providerURL =tcp://localhost:61616
agentName.sources.execsource.destinationName = sfdp1
agentName.sources.execsource.destinationType = QUEUE
# Describe the sink
agentName.sinks.filesink.type = org.apache.flume.sink.kafka.KafkaSink
agentName.sinks.filesink.topic = sfdp1
agentName.sinks.filesink.brokerList = localhost:9092
agentName.sinks.filesink.batchSize = 20
# Use a channel which buffers events in file
agentName.channels.filechannel.type = file
agentName.channels.filechannel.transactionCapacity = 100
agentName.channels.filechannel.checkpointDir =/home/sriram/Documents/flume/checkpoint/a
agentName.channels.filechannel.dataDirs = /home/sriram/Documents/flume/data/b
agentName.channels.filechannel.capacity = 10000
# connect source, channel, sink
agentName.sources.execsource.channels = filechannel
agentName.sinks.filesink.channel = filechannel
was (Author: sriramk):
configuration file content :
# configure the agent
agentName.sources = execsource
agentName.channels = filechannel
agentName.sinks = filesink
# Describe/configure Source
agentName.sources.execsource.type = jms
agentName.sources.execsource.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
agentName.sources.execsource.connectionFactory = QueueConnectionFactory
agentName.sources.execsource.providerURL =tcp://localhost:61616
agentName.sources.execsource.destinationName = sfdp1
agentName.sources.execsource.destinationType = QUEUE
# Describe the sink
agentName.sinks.filesink.type = org.apache.flume.sink.kafka.KafkaSink
agentName.sinks.filesink.topic = sfdp1
agentName.sinks.filesink.brokerList = localhost:9092
agentName.sinks.filesink.batchSize = 20
# Use a channel which buffers events in file
agentName.channels.filechannel.type = file
agentName.channels.filechannel.transactionCapacity = 100
agentName.channels.filechannel.checkpointDir =/home/sriram/Documents/flume/checkpoint/a
agentName.channels.filechannel.dataDirs = /home/sriram/Documents/flume/data/b
agentName.channels.filechannel.capacity = 10000
# connect source, channel, sink
agentName.sources.execsource.channels = filechannel
agentName.sinks.filesink.channel = filechannel
# configure the agent
agentName.sources = execsource
agentName.channels = filechannel
agentName.sinks = filesink
# Describe/configure Source
agentName.sources.execsource.type = jms
agentName.sources.execsource.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
agentName.sources.execsource.connectionFactory = QueueConnectionFactory
agentName.sources.execsource.providerURL =tcp://localhost:61616
agentName.sources.execsource.destinationName = sfdp1
agentName.sources.execsource.destinationType = QUEUE
# Describe the sink
agentName.sinks.filesink.type = org.apache.flume.sink.kafka.KafkaSink
agentName.sinks.filesink.topic = sfdp1
agentName.sinks.filesink.brokerList = localhost:9092
agentName.sinks.filesink.batchSize = 20
# Use a channel which buffers events in file
agentName.channels.filechannel.type = file
agentName.channels.filechannel.transactionCapacity = 100
agentName.channels.filechannel.checkpointDir =/home/sriram/Documents/flume/checkpoint/a
agentName.channels.filechannel.dataDirs = /home/sriram/Documents/flume/data/b
agentName.channels.filechannel.capacity = 10000
# connect source, channel, sink
agentName.sources.execsource.channels = filechannel
agentName.sinks.filesink.channel = filechannel
> Getting heap space error even changing the memory channel to file channel
> --------------------------------------------------------------------------
>
> Key: FLUME-3052
> URL: https://issues.apache.org/jira/browse/FLUME-3052
> Project: Flume
> Issue Type: Bug
> Components: File Channel, Sinks+Sources
> Reporter: sri
>
> INFO | Component type: SINK, name: filesink started
> ERROR | Unexpected error processing events
> java.lang.OutOfMemoryError: Java heap space
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)