You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/08/08 18:07:00 UTC
[jira] [Work logged] (BEAM-3218) Change PubsubBoundedWriter to
check total byte size
[ https://issues.apache.org/jira/browse/BEAM-3218?focusedWorklogId=132508&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-132508 ]
ASF GitHub Bot logged work on BEAM-3218:
----------------------------------------
Author: ASF GitHub Bot
Created on: 08/Aug/18 18:06
Start Date: 08/Aug/18 18:06
Worklog Time Spent: 10m
Work Description: amotamed opened a new pull request #6183: [BEAM-3218] Added Quota checks for PubsubMessage in PubsubBoundedWriter
URL: https://github.com/apache/beam/pull/6183
[BEAM-3218] Added Quota checks for PubsubMessage in PubsubBoundedWriter
@nguyent @kennknowles
Please note this is a port of https://github.com/apache/beam/pull/4275. I ran into issues rebasing the old change so I copied the PR changes here
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | --- | --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 132508)
Time Spent: 50m (was: 40m)
> Change PubsubBoundedWriter to check total byte size
> ---------------------------------------------------
>
> Key: BEAM-3218
> URL: https://issues.apache.org/jira/browse/BEAM-3218
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Reporter: Thang Nguyen
> Assignee: Reuven Lax
> Priority: Minor
> Time Spent: 50m
> Remaining Estimate: 0h
>
> The PubsubBoundedWriter [does not check|https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java#L895-L897] the total byte size of outgoing messages when publishing.
> AC:
> * Add a check to ensure the total bytes of the outgoing messages is less than pubsub's allowed max
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)