You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@sdap.apache.org by nc...@apache.org on 2022/06/13 17:37:37 UTC
[incubator-sdap-in-situ-data-services] branch master updated (998d124 -> f77a833)
This is an automated email from the ASF dual-hosted git repository.
nchung pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-sdap-in-situ-data-services.git
from 998d124 Merge pull request #3 from briansaildrone/general-configuration-updates
new 7b1873e feat: faster pagination + fix: wrong pagination URL caused by extra prefix in reverse proxy (#62)
new 4839b48 fix: missing keys in the schema class
new f51cbe7 chore: merge from master
new 227f099 chore: Adjust.spark.parallel.process (#68)
new d543e87 fix: ignore columns & variable if they are empty (#69)
new 268e233 chore: update test with empty variable
new 0ff0ef1 fix: add more conditions & validations for null queries
new 8fa08e1 chore: add more log statements for delayed query performance
new 20fe50e chore: merge from apache master
new f77a833 Merge pull request #4 from wphyojpl/master
The 174 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
k8s_spark/parquet.spark.helm/README.md | 2 +-
.../parquet.spark.helm/templates/deployment.yaml | 2 +
k8s_spark/parquet.spark.helm/values.yaml | 27 ++++-
parquet_flask/io_logic/cdms_schema.py | 73 ++++++++++--
parquet_flask/io_logic/query_v2.py | 19 +++-
parquet_flask/io_logic/query_v4.py | 87 +++++++++++----
parquet_flask/utils/config.py | 1 +
parquet_flask/utils/general_utils.py | 6 +
parquet_flask/v1/__init__.py | 11 +-
parquet_flask/v1/query_data_doms.py | 4 +-
...oms.py => query_data_doms_custom_pagination.py} | 79 +++++++------
tests/bench_mark/bench_mark.py | 115 ++++++++++++++++++-
tests/bench_mark/bench_parallel_process.py | 122 +++++++++++++++++++++
tests/bench_mark/func_exec_time_decorator.py | 2 +-
14 files changed, 474 insertions(+), 76 deletions(-)
copy parquet_flask/v1/{query_data_doms.py => query_data_doms_custom_pagination.py} (64%)
create mode 100644 tests/bench_mark/bench_parallel_process.py