You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "DavidXU (Jira)" <ji...@apache.org> on 2020/02/20 14:18:00 UTC
[jira] [Created] (SPARK-30901) [DOC] In
streaming-kinesis-integration.md, the initialPosition method changed
DavidXU created SPARK-30901:
-------------------------------
Summary: [DOC] In streaming-kinesis-integration.md, the initialPosition method changed
Key: SPARK-30901
URL: https://issues.apache.org/jira/browse/SPARK-30901
Project: Spark
Issue Type: Bug
Components: Documentation
Affects Versions: 2.4.4
Reporter: DavidXU
In Spark documentation : [https://spark.apache.org/docs/2.4.0/streaming-kinesis-integration.html#configuring-spark-streaming-application]
I find that here we still give exemple like:
{{_".initialPositionInStream([initial position])"_}}
{{}}
{{But in the code source of _spark-streaming-kinesis-asl_2.11-2.4.4_}}
I noticed:
_@deprecated("use initialPosition(initialPosition: KinesisInitialPosition)", "2.3.0")_
_def initialPositionInStream(initialPosition: InitialPositionInStream): Builder_
{{So, I think that the doc here should be updated, to give an exemple like:}}
{{_".initialPosition([initial position])"_}}
{{}}
{{}}{{}}
And the same thing goes to the description below:
"_{{[initial position]}}: Can be either {{InitialPositionInStream.TRIM_HORIZON}} or {{InitialPositionInStream.LATEST}}_"
In fact, now we can use _{{KinesisInitialPositions.}}__{{TRIM_HORIZON KinesisInitialPositions.LATEST or *KinesisInitialPositions.AT_TIMESTAMP*}}_
_{{**}}_{{(by using }}{{initialPosition in the place of initialPositionInStream)}}
{{}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org