You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/04/23 01:21:26 UTC
[spark] branch master updated (c619990 -> 95aec09)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from c619990 [SPARK-31272][SQL] Support DB2 Kerberos login in JDBC connector
add 95aec09 [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests
No new revisions were added by this update.
Summary of changes:
.../scala/org/apache/spark/api/java/JavaRDD.scala | 15 ++
.../org/apache/spark/api/python/PythonRunner.scala | 25 ++-
.../spark/resource/ExecutorResourceRequests.scala | 3 +
.../apache/spark/resource/ResourceProfile.scala | 8 +-
.../spark/resource/TaskResourceRequests.scala | 3 +
.../org/apache/spark/scheduler/DAGScheduler.scala | 23 +++
.../java/test/org/apache/spark/JavaAPISuite.java | 14 ++
dev/sparktestsupport/modules.py | 15 ++
python/pyspark/java_gateway.py | 1 +
python/pyspark/rdd.py | 66 +++++---
.../pyspark/{mllib/stat => resource}/__init__.py | 17 ++-
python/pyspark/resource/executorrequests.py | 169 +++++++++++++++++++++
python/pyspark/resource/resourceprofile.py | 72 +++++++++
python/pyspark/resource/resourceprofilebuilder.py | 117 ++++++++++++++
python/pyspark/resource/taskrequests.py | 102 +++++++++++++
.../{streaming => resource}/tests/__init__.py | 0
python/pyspark/resource/tests/test_resources.py | 82 ++++++++++
python/pyspark/tests/test_rdd.py | 30 ++++
python/pyspark/tests/test_worker.py | 11 +-
python/pyspark/util.py | 15 ++
python/pyspark/worker.py | 1 +
python/setup.py | 1 +
22 files changed, 755 insertions(+), 35 deletions(-)
copy python/pyspark/{mllib/stat => resource}/__init__.py (59%)
create mode 100644 python/pyspark/resource/executorrequests.py
create mode 100644 python/pyspark/resource/resourceprofile.py
create mode 100644 python/pyspark/resource/resourceprofilebuilder.py
create mode 100644 python/pyspark/resource/taskrequests.py
copy python/pyspark/{streaming => resource}/tests/__init__.py (100%)
create mode 100644 python/pyspark/resource/tests/test_resources.py
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org