You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2022/02/14 23:06:00 UTC
[jira] [Created] (HUDI-3427) Investigate timeouts in Hudi Kafka Connect Sink
Ethan Guo created HUDI-3427:
-------------------------------
Summary: Investigate timeouts in Hudi Kafka Connect Sink
Key: HUDI-3427
URL: https://issues.apache.org/jira/browse/HUDI-3427
Project: Apache Hudi
Issue Type: Improvement
Reporter: Ethan Guo
Fix For: 0.11.0
When following Quick Start Guide for Hudi Kafka Connect Sink, the sink periodically throws timeout exceptions, though they does not affect delta commits:
{code:java}
[2022-02-14 15:02:39,832] DEBUG [hudi-sink|task-0] ignored: WriteFlusher@349724cf{IDLE}->null (org.apache.hudi.org.eclipse.jetty.io.WriteFlusher:471)
java.nio.channels.ClosedChannelException
at org.apache.hudi.org.eclipse.jetty.io.WriteFlusher.onClose(WriteFlusher.java:502)
at org.apache.hudi.org.eclipse.jetty.io.AbstractEndPoint.onClose(AbstractEndPoint.java:353)
at org.apache.hudi.org.eclipse.jetty.io.ChannelEndPoint.onClose(ChannelEndPoint.java:215)
at org.apache.hudi.org.eclipse.jetty.io.AbstractEndPoint.doOnClose(AbstractEndPoint.java:225)
at org.apache.hudi.org.eclipse.jetty.io.AbstractEndPoint.close(AbstractEndPoint.java:192)
at org.apache.hudi.org.eclipse.jetty.io.AbstractEndPoint.close(AbstractEndPoint.java:175)
at org.apache.hudi.org.eclipse.jetty.io.AbstractConnection.onFillInterestedFailed(AbstractConnection.java:174)
at org.apache.hudi.org.eclipse.jetty.server.HttpConnection.onFillInterestedFailed(HttpConnection.java:503)
at org.apache.hudi.org.eclipse.jetty.io.AbstractConnection$ReadCallback.failed(AbstractConnection.java:311)
at org.apache.hudi.org.eclipse.jetty.io.FillInterest.onFail(FillInterest.java:138)
at org.apache.hudi.org.eclipse.jetty.io.AbstractEndPoint.onIdleExpired(AbstractEndPoint.java:406)
at org.apache.hudi.org.eclipse.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.eclipse.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2022-02-14 15:02:39,833] DEBUG [hudi-sink|task-0] onClose FillInterest@1c255bc0{null} (org.apache.hudi.org.eclipse.jetty.io.FillInterest:147)
[2022-02-14 15:02:39,833] DEBUG [hudi-sink|task-0] ignored: WriteFlusher@349724cf{IDLE}->null (org.apache.hudi.org.eclipse.jetty.io.WriteFlusher:471)
java.util.concurrent.TimeoutException: Idle timeout expired: 30003/30000 ms
at org.apache.hudi.org.eclipse.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.eclipse.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)