You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/04/24 13:18:00 UTC
[jira] [Work logged] (BEAM-7133) Spark job server Gradle task
should pass along system properties
[ https://issues.apache.org/jira/browse/BEAM-7133?focusedWorklogId=232082&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-232082 ]
ASF GitHub Bot logged work on BEAM-7133:
----------------------------------------
Author: ASF GitHub Bot
Created on: 24/Apr/19 13:17
Start Date: 24/Apr/19 13:17
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #8386: [BEAM-7133] make Spark job server Gradle task pass along system prope…
URL: https://github.com/apache/beam/pull/8386
…rties
The Spark job server Gradle task (:beam-runners-spark-job-server:runShadow) should pass along system properties (especially but not limited to the ones passed into the Gradle invocation), as Spark applications often rely on system properties for configuration.
R: @angoenka
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python3_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) <br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/lastCompletedBuild/) | --- | --- | ---
Pre-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
--- |Java | Python | Go | Website
--- | --- | --- | --- | ---
Non-portable | [](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/)
Portable | --- | [](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/) | --- | ---
See [.test-infra/jenkins/README](https://github.com/apache/beam/blob/master/.test-infra/jenkins/README.md) for trigger phrase, status and link of all Jenkins jobs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 232082)
Time Spent: 10m
Remaining Estimate: 0h
> Spark job server Gradle task should pass along system properties
> ----------------------------------------------------------------
>
> Key: BEAM-7133
> URL: https://issues.apache.org/jira/browse/BEAM-7133
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The Spark job server Gradle task (:beam-runners-spark-job-server:runShadow) should pass on system properties, as Spark applications often rely on system properties for configuration. For example, if I want to enable logging, I currently have to set it programatically:
> System.setProperty("spark.eventLog.enabled", "true");
> whereas I should be able to just do this:
> ./gradlew :beam-runners-spark-job-server:runShadow -Dspark.eventLog.enabled=true
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)