You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@sdap.apache.org by nc...@apache.org on 2022/06/13 17:37:37 UTC

[incubator-sdap-in-situ-data-services] branch master updated (998d124 -> f77a833)

This is an automated email from the ASF dual-hosted git repository.

nchung pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-sdap-in-situ-data-services.git


    from 998d124  Merge pull request #3 from briansaildrone/general-configuration-updates
     new 7b1873e  feat: faster pagination + fix: wrong pagination URL caused by extra prefix in reverse proxy (#62)
     new 4839b48  fix: missing keys in the schema class
     new f51cbe7  chore: merge from master
     new 227f099  chore: Adjust.spark.parallel.process (#68)
     new d543e87  fix: ignore columns & variable if they are empty (#69)
     new 268e233  chore: update test with empty variable
     new 0ff0ef1  fix: add more conditions & validations for null queries
     new 8fa08e1  chore: add more log statements for delayed query performance
     new 20fe50e  chore: merge from apache master
     new f77a833  Merge pull request #4 from wphyojpl/master

The 174 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 k8s_spark/parquet.spark.helm/README.md             |   2 +-
 .../parquet.spark.helm/templates/deployment.yaml   |   2 +
 k8s_spark/parquet.spark.helm/values.yaml           |  27 ++++-
 parquet_flask/io_logic/cdms_schema.py              |  73 ++++++++++--
 parquet_flask/io_logic/query_v2.py                 |  19 +++-
 parquet_flask/io_logic/query_v4.py                 |  87 +++++++++++----
 parquet_flask/utils/config.py                      |   1 +
 parquet_flask/utils/general_utils.py               |   6 +
 parquet_flask/v1/__init__.py                       |  11 +-
 parquet_flask/v1/query_data_doms.py                |   4 +-
 ...oms.py => query_data_doms_custom_pagination.py} |  79 +++++++------
 tests/bench_mark/bench_mark.py                     | 115 ++++++++++++++++++-
 tests/bench_mark/bench_parallel_process.py         | 122 +++++++++++++++++++++
 tests/bench_mark/func_exec_time_decorator.py       |   2 +-
 14 files changed, 474 insertions(+), 76 deletions(-)
 copy parquet_flask/v1/{query_data_doms.py => query_data_doms_custom_pagination.py} (64%)
 create mode 100644 tests/bench_mark/bench_parallel_process.py