You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "DavidXU (Jira)" <ji...@apache.org> on 2020/02/20 14:18:00 UTC

[jira] [Created] (SPARK-30901) [DOC] In streaming-kinesis-integration.md, the initialPosition method changed

DavidXU created SPARK-30901:
-------------------------------

             Summary: [DOC] In streaming-kinesis-integration.md, the initialPosition method changed
                 Key: SPARK-30901
                 URL: https://issues.apache.org/jira/browse/SPARK-30901
             Project: Spark
          Issue Type: Bug
          Components: Documentation
    Affects Versions: 2.4.4
            Reporter: DavidXU


In Spark documentation : [https://spark.apache.org/docs/2.4.0/streaming-kinesis-integration.html#configuring-spark-streaming-application]

I find that here we still give exemple like: 

{{_".initialPositionInStream([initial position])"_}}

{{}}

{{But in the code source of _spark-streaming-kinesis-asl_2.11-2.4.4_}}

I noticed:

_@deprecated("use initialPosition(initialPosition: KinesisInitialPosition)", "2.3.0")_
 _def initialPositionInStream(initialPosition: InitialPositionInStream): Builder_ 

 

{{So, I think that the doc here should be updated, to give an exemple like:}}

{{_".initialPosition([initial position])"_}}

{{}}

{{}}{{}}

And the same thing goes to the description below:

"_{{[initial position]}}: Can be either {{InitialPositionInStream.TRIM_HORIZON}} or {{InitialPositionInStream.LATEST}}_"

In fact, now we can use _{{KinesisInitialPositions.}}__{{TRIM_HORIZON KinesisInitialPositions.LATEST or *KinesisInitialPositions.AT_TIMESTAMP*}}_

_{{**}}_{{(by using }}{{initialPosition in the place of initialPositionInStream)}}

{{}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org