You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jason Perez (Jira)" <ji...@apache.org> on 2021/05/01 13:47:00 UTC

[jira] [Updated] (FLINK-22436) twitter datastream connector hangs, CRLF expected at end of chunk

     [ https://issues.apache.org/jira/browse/FLINK-22436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Perez updated FLINK-22436:
--------------------------------
    Summary: twitter datastream connector hangs, CRLF expected at end of chunk  (was: twitter datastream connector hangs)

> twitter datastream connector hangs, CRLF expected at end of chunk
> -----------------------------------------------------------------
>
>                 Key: FLINK-22436
>                 URL: https://issues.apache.org/jira/browse/FLINK-22436
>             Project: Flink
>          Issue Type: Bug
>          Components: API / DataStream, Connectors / Common
>         Environment: My environment is just simple local flink env, using the twitter connector example.
>            Reporter: Jason Perez
>            Priority: Major
>
> Sorry for selecting Connectors/Common, Twitter didn't show up in the Connectors / "X" list, I'm not sure why that is.
>  
> in addition to item FLINK-22435 I found this exception as well when the recent version (1.12) twitter connector just hangs. 
>  
> basically I am following the example here:
> [https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/twitter/TwitterExample.java]
>  
> which just seems to run indefinitely but not have any data throughput/results or exceptions.
>  
> task manager stdout (not logs) looks something like this:
>  
> {code:java}
> WARNING: Please consider reporting this to the maintainers of org.apache.flink.shaded.akka.org.jboss.netty.util.internal.ByteBufferUtilWARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operationsWARNING: All illegal access operations will be denied in a future releaseMay 01, 2021 8:37:04 AM org.apache.flink.twitter.shaded.com.google.common.io.Closeables closeWARNING: IOException thrown while closing Closeable.org.apache.http.MalformedChunkCodingException: CRLF expected at end of chunk    at org.apache.http.impl.io.ChunkedInputStream.getChunkSize(ChunkedInputStream.java:253)    at org.apache.http.impl.io.ChunkedInputStream.nextChunk(ChunkedInputStream.java:225)    at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:184)    at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:213)    at org.apache.http.impl.io.ChunkedInputStream.close(ChunkedInputStream.java:315)    at org.apache.http.conn.BasicManagedEntity.streamClosed(BasicManagedEntity.java:166)    at org.apache.http.conn.EofSensorInputStream.checkClose(EofSensorInputStream.java:228)    at org.apache.http.conn.EofSensorInputStream.close(EofSensorInputStream.java:172)    at java.base/java.util.zip.InflaterInputStream.close(InflaterInputStream.java:231)    at java.base/java.util.zip.GZIPInputStream.close(GZIPInputStream.java:136)    at org.apache.http.client.entity.LazyDecompressingInputStream.close(LazyDecompressingInputStream.java:94)    at org.apache.flink.twitter.shaded.com.google.common.io.Closeables.close(Closeables.java:77)    at com.twitter.hbc.httpclient.Connection.close(Connection.java:64)    at com.twitter.hbc.httpclient.ClientBase.run(ClientBase.java:148)    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)    at java.base/java.lang.Thread.run(Thread.java:832)
> May 01, 2021 8:39:06 AM org.apache.flink.twitter.shaded.com.google.common.io.Closeables closeWARNING: IOException thrown while closing Closeable.org.apache.http.MalformedChunkCodingException: CRLF expected at end of chunk    at org.apache.http.impl.io.ChunkedInputStream.getChunkSize(ChunkedInputStream.java:253)    at org.apache.http.impl.io.ChunkedInputStream.nextChunk(ChunkedInputStream.java:225)    at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:184)    at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:213)    at org.apache.http.impl.io.ChunkedInputStream.close(ChunkedInputStream.java:315)    at org.apache.http.conn.BasicManagedEntity.streamClosed(BasicManagedEntity.java:166)    at org.apache.http.conn.EofSensorInputStream.checkClose(EofSensorInputStream.java:228)    at org.apache.http.conn.EofSensorInputStream.close(EofSensorInputStream.java:172)    at java.base/java.util.zip.InflaterInputStream.close(InflaterInputStream.java:231)    at java.base/java.util.zip.GZIPInputStream.close(GZIPInputStream.java:136)    at org.apache.http.client.entity.LazyDecompressingInputStream.close(LazyDecompressingInputStream.java:94)    at org.apache.flink.twitter.shaded.com.google.common.io.Closeables.close(Closeables.java:77)    at com.twitter.hbc.httpclient.Connection.close(Connection.java:64)    at com.twitter.hbc.httpclient.ClientBase.run(ClientBase.java:148)    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)    at java.base/java.lang.Thread.run(Thread.java:832)
> May 01, 2021 8:49:48 AM org.apache.flink.twitter.shaded.com.google.common.io.Closeables closeWARNING: IOException thrown while closing Closeable.org.apache.http.MalformedChunkCodingException: CRLF expected at end of chunk    at org.apache.http.impl.io.ChunkedInputStream.getChunkSize(ChunkedInputStream.java:253)    at org.apache.http.impl.io.ChunkedInputStream.nextChunk(ChunkedInputStream.java:225)    at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:184)    at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:213)    at org.apache.http.impl.io.ChunkedInputStream.close(ChunkedInputStream.java:315)    at org.apache.http.conn.BasicManagedEntity.streamClosed(BasicManagedEntity.java:166)    at org.apache.http.conn.EofSensorInputStream.checkClose(EofSensorInputStream.java:228)    at org.apache.http.conn.EofSensorInputStream.close(EofSensorInputStream.java:172)    at java.base/java.util.zip.InflaterInputStream.close(InflaterInputStream.java:231)    at java.base/java.util.zip.GZIPInputStream.close(GZIPInputStream.java:136)    at org.apache.http.client.entity.LazyDecompressingInputStream.close(LazyDecompressingInputStream.java:94)    at org.apache.flink.twitter.shaded.com.google.common.io.Closeables.close(Closeables.java:77)    at com.twitter.hbc.httpclient.Connection.close(Connection.java:64)    at com.twitter.hbc.httpclient.ClientBase.run(ClientBase.java:148)    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)    at java.base/java.lang.Thread.run(Thread.java:832)
> {code}
> and this just seems to repeat in the log.
> I can provide more info if needed but my setup is really basic/simple.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)