You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aaron Langford (JIRA)" <ji...@apache.org> on 2018/06/20 00:17:00 UTC

[jira] [Commented] (FLINK-9618) NullPointerException in FlinkKinesisProducer when aws.region is not set and aws.endpoint is set

    [ https://issues.apache.org/jira/browse/FLINK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517645#comment-16517645 ] 

Aaron Langford commented on FLINK-9618:
---------------------------------------

I would be happy to take the work to fix this.

> NullPointerException in FlinkKinesisProducer when aws.region is not set and aws.endpoint is set
> -----------------------------------------------------------------------------------------------
>
>                 Key: FLINK-9618
>                 URL: https://issues.apache.org/jira/browse/FLINK-9618
>             Project: Flink
>          Issue Type: Bug
>          Components: Kinesis Connector
>    Affects Versions: 1.5.0
>         Environment: N/A
>            Reporter: Aaron Langford
>            Priority: Minor
>   Original Estimate: 3h
>  Remaining Estimate: 3h
>
> This problem arose while trying to write to a local kinesalite instance. Specifying the aws.region and the aws.endpoint is not allowed. However when the aws.region is not present, a NullPointer exception is thrown.
> Here is some example Scala code:
> {code:java}
> /**
>   *
>   * @param region the AWS region the stream lives in
>   * @param streamName the stream to write records to
>   * @param endpoint if in local dev, this points to a kinesalite instance
>   * @return
>   */
> def getSink(region: String,
>             streamName: String,
>             endpoint: Option[String]): FlinkKinesisProducer[ProcessedMobilePageView] = {
>   val props = new Properties()
>   props.put(AWSConfigConstants.AWS_CREDENTIALS_PROVIDER, "AUTO")
>   endpoint match {
>     case Some(uri) => props.put(AWSConfigConstants.AWS_ENDPOINT, uri)
>     case None => props.put(AWSConfigConstants.AWS_REGION, region)
>   }
>   val producer = new FlinkKinesisProducer[ProcessedMobilePageView](
>     new JsonSerializer[ProcessedMobilePageView](DefaultSerializationBuilder),
>     props
>   )
>   producer.setDefaultStream(streamName)
>   producer
> }
> {code}
> To produce the NullPointerException, pass in `Some("localhost:4567")` for endpoint.
> The source of the error is found at org.apache.flink.streaming.connectors.kinesis.util.KinesisConfigUtil.java, on line 194. This line should perform some kind of check if aws.endpoint is present before grabbing it from the Properties object.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)