Change in asterixdb[master]: [ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables

["Hussain Towaileb (Code Review)" <de...@asterixdb.apache.org>]

Hello Anon. E. Moose (1000171), Jenkins, 

I'd like you to reexamine a change. Please visit

    https://asterix-gerrit.ics.uci.edu/3437

to look at the new patch set (#3).

Change subject: [ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables
......................................................................

[ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables

- user model changes: yes
  - user can call the tpcds_datagen() by passing only the scaling
    factor, and that will automatically generate all the tables.
- storage format changes: no
- interface changes: no

Details:
- Added support to a second version of the tpcds_datagen()
function to take only a single parameter that will result in
generating the data for all the tables in one go. The user
now can generate the data for a single table at a time, or
all the tables in one go.
- Overridden the behavior for activating the parallelism.
Before, the library wouldn't activate parallelism unless
the tables are big, and the number of data generated per
table is over 1,000,000. With this change, the parallelism
is always activated, regardless of the table size or the
data size being generated.
- Added a new test, TPCExecutionTest, to execute the long
tests for the TPC. Some of the TPC tests take longer than
5 minutes to finish and could result in high usage of
disk space.

Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486
---
M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FunctionRewriter.java
R asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSAllTablesDataGeneratorDatasource.java
C asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSAllTablesDataGeneratorRewriter.java
M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSDataGeneratorFunction.java
M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSDataGeneratorReader.java
C asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSSingleTableDataGeneratorDatasource.java
R asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSSingleTableDataGeneratorRewriter.java
M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/MetadataBuiltinFunctions.java
M asterixdb/asterix-app/src/test/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java
A asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/TPCExecutionTest.java
A asterixdb/asterix-app/src/test/resources/runtimets/only_tpc.xml
R asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/datagen_sf_1_all_tables_1/datagen_sf_1_all_tables_1.1.query.sqlpp
A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/datagen_sf_1_all_tables_2/datagen_sf_1_all_tables_2.1.query.sqlpp
R asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/datagen_sf_1_all_tables_1/datagen_sf_1_all_tables_1.1.adm
A asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/datagen_sf_1_all_tables_2/datagen_sf_1_all_tables_2.1.adm
M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml
A asterixdb/asterix-app/src/test/resources/runtimets/testsuite_tpc.xml
M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/declared/FunctionDataSource.java
18 files changed, 560 insertions(+), 154 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/37/3437/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/3437
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486
Gerrit-Change-Number: 3437
Gerrit-PatchSet: 3
Gerrit-Owner: Hussain Towaileb <hu...@gmail.com>
Gerrit-Reviewer: Anon. E. Moose (1000171)
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>