You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2020/10/03 06:35:00 UTC

[jira] [Created] (SPARK-33058) Fetch topic partitions once when getting offset ranges

L. C. Hsieh created SPARK-33058:
-----------------------------------

             Summary: Fetch topic partitions once when getting offset ranges
                 Key: SPARK-33058
                 URL: https://issues.apache.org/jira/browse/SPARK-33058
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.1.0
            Reporter: L. C. Hsieh
            Assignee: L. C. Hsieh


We fetch topic partition twice by `fetchPartitionOffsets` in `KafkaOffsetReader` when trying to fetch partition offsets. We can reduce unnecessary poll.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org