You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "ocean-zhc (via GitHub)" <gi...@apache.org> on 2023/07/02 07:17:28 UTC

[GitHub] [seatunnel] ocean-zhc opened a new issue, #5006: [Bug] [kafka source] 无法设置max.poll.records参数

ocean-zhc opened a new issue, #5006:
URL: https://github.com/apache/seatunnel/issues/5006

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   source kafka  kafka.config 设置  `max.poll.records` 参数,取消则正常!
   
   ### SeaTunnel Version
   
   2.3.2 
   2.3.2-SNAPSHOT
   
   ### SeaTunnel Config
   
   ```conf
   env {
     execution.parallelism = 1
     job.mode = "STREAMING"
     execution.planner = blink
     job.name = "kafka_console_test"
     execution.checkpoint.interval = 60000
   }
   
   source {
   
     Kafka {
       result_table_name = "kafka_table"
       schema = {
         fields {
           name = "string"
           age = "int"
         }
       }
       topic = "topic1"
       bootstrap.servers = "local:19092"
       kafka.config = {
         client.id = client_1
         max.poll.records = 10000
         auto.offset.reset = "earliest"
         enable.auto.commit = "false"
       }
     }
     
   }
   
   transform {
     
   }
   
   sink {
     Hive {
       table_name = "default.user1"
       metastore_uri = "thrift://centos4:9083"
     }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/start-seatunnel-flink-15-connector-v2.sh --config ./config/kafka2hive.conf
   ```
   
   
   ### Error Exception
   
   ```log
   ![image](https://github.com/apache/seatunnel/assets/46189785/0efddddb-9ac3-49f9-ba11-4d3dc504bf0d)
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   ![image](https://github.com/apache/seatunnel/assets/46189785/0efddddb-9ac3-49f9-ba11-4d3dc504bf0d)
   
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] liugddx commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数

Posted by "liugddx (via GitHub)" <gi...@apache.org>.
liugddx commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1618836124

   I tried it and found no problem, can you try it with `jdk1.8.351` or later.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] ocean-zhc commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数

Posted by "ocean-zhc (via GitHub)" <gi...@apache.org>.
ocean-zhc commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1622848776

   tks!I'm OK!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] ocean-zhc commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数

Posted by "ocean-zhc (via GitHub)" <gi...@apache.org>.
ocean-zhc commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1623308900

   > jdk1.8.351
   
   <img width="1183" alt="企业微信截图_d0f14283-94d8-4022-84dc-b353a1aa0cba" src="https://github.com/apache/seatunnel/assets/46189785/4e387cab-1851-405f-8b82-64b006329350">
   
   <img width="1267" alt="image" src="https://github.com/apache/seatunnel/assets/46189785/21901a63-b394-4bc1-bb73-0ea0240e32f0">
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [kafka source] 无法设置max.poll.records参数 [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1765466041

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [kafka source] 无法设置max.poll.records参数 [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-3071526966

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] ocean-zhc commented on issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数

Posted by "ocean-zhc (via GitHub)" <gi...@apache.org>.
ocean-zhc commented on issue #5006:
URL: https://github.com/apache/seatunnel/issues/5006#issuecomment-1632196494

   max.poll.records = "10000"  can solved!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] [kafka source] 无法设置max.poll.records参数 [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #5006: [Bug] [kafka source] 无法设置max.poll.records参数
URL: https://github.com/apache/seatunnel/issues/5006


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org