You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by za...@apache.org on 2023/03/09 15:37:05 UTC

[hive] branch master updated (dfb1dd9edba -> cd53e0a4d9b)

This is an automated email from the ASF dual-hosted git repository.

zabetak pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


    from dfb1dd9edba HIVE-27123 : In PRE_OPTIMIZED_BOOTSTRAP operation, Load side stores dump_execution_id as -1 (#4100) (Harshal Patel, reviewed by Teddy Choi)
     new da967c215dc HIVE-27131: Remove empty module shims/scheduler (Stamatis Zampetakis reviewed by Krisztian Kasa)
     new cd53e0a4d9b HIVE-27100: Remove unused data/files from repo (Stamatis Zampetakis reviewed by Krisztian Kasa)

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 data/files/SortDescCol1Col2.txt              |   4 -
 data/files/SortDescCol2Col1.txt              |   4 -
 data/files/cbo_t4.txt                        |  20 ----
 data/files/cbo_t5.txt                        |  20 ----
 data/files/cbo_t6.txt                        |  20 ----
 data/files/compressed_4line_file1.csv.bz2    | Bin 55 -> 0 bytes
 data/files/empty2.txt                        |   0
 data/files/filterCard.txt                    | 101 --------------------
 data/files/fullouter_string_big_1a_old.txt   |  13 ---
 data/files/fullouter_string_small_1a_old.txt |  38 --------
 data/files/futurama_episodes.avro            | Bin 3044 -> 0 bytes
 data/files/in9.txt                           |   6 --
 data/files/map_null_schema.avro              |   1 -
 data/files/sample-queryplan-in-history.txt   |   1 -
 data/files/sample-queryplan.txt              |   1 -
 data/files/sample.json                       |   1 -
 data/files/smb_bucket_input.txt              |   7 --
 data/files/smbbucket_2.txt                   |   4 -
 data/files/sortdp.txt                        |  32 -------
 data/files/srcsortbucket1outof4.txt          | 118 -----------------------
 data/files/srcsortbucket2outof4.txt          | 120 -----------------------
 data/files/srcsortbucket4outof4.txt          | 138 ---------------------------
 shims/aggregator/pom.xml                     |   6 --
 shims/pom.xml                                |   1 -
 shims/scheduler/pom.xml                      | 120 -----------------------
 25 files changed, 776 deletions(-)
 delete mode 100644 data/files/SortDescCol1Col2.txt
 delete mode 100644 data/files/SortDescCol2Col1.txt
 delete mode 100644 data/files/cbo_t4.txt
 delete mode 100644 data/files/cbo_t5.txt
 delete mode 100644 data/files/cbo_t6.txt
 delete mode 100644 data/files/compressed_4line_file1.csv.bz2
 delete mode 100644 data/files/empty2.txt
 delete mode 100644 data/files/filterCard.txt
 delete mode 100644 data/files/fullouter_string_big_1a_old.txt
 delete mode 100644 data/files/fullouter_string_small_1a_old.txt
 delete mode 100644 data/files/futurama_episodes.avro
 delete mode 100644 data/files/in9.txt
 delete mode 100644 data/files/map_null_schema.avro
 delete mode 100644 data/files/sample-queryplan-in-history.txt
 delete mode 100644 data/files/sample-queryplan.txt
 delete mode 100644 data/files/sample.json
 delete mode 100644 data/files/smb_bucket_input.txt
 delete mode 100644 data/files/smbbucket_2.txt
 delete mode 100644 data/files/sortdp.txt
 delete mode 100644 data/files/srcsortbucket1outof4.txt
 delete mode 100644 data/files/srcsortbucket2outof4.txt
 delete mode 100644 data/files/srcsortbucket4outof4.txt
 delete mode 100644 shims/scheduler/pom.xml


[hive] 01/02: HIVE-27131: Remove empty module shims/scheduler (Stamatis Zampetakis reviewed by Krisztian Kasa)

Posted by za...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

zabetak pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git

commit da967c215dc0a155dc7fabd3e40ecbd9b30bb3c2
Author: Stamatis Zampetakis <za...@gmail.com>
AuthorDate: Wed Mar 8 13:18:54 2023 +0100

    HIVE-27131: Remove empty module shims/scheduler (Stamatis Zampetakis reviewed by Krisztian Kasa)
    
    The module has nothing more than a plain pom.xml file and the latter
    does not seem to do anything special apart from bundling up together
    some optional dependencies.
    
    There is no source code, no tests, and no reason for the module to
    exist.
    
    At some point it used to contain a few classes but these were removed
    progressively (e.g., HIVE-22398) leaving back an empty module.
    
    Closes #4103
---
 shims/aggregator/pom.xml |   6 ---
 shims/pom.xml            |   1 -
 shims/scheduler/pom.xml  | 120 -----------------------------------------------
 3 files changed, 127 deletions(-)

diff --git a/shims/aggregator/pom.xml b/shims/aggregator/pom.xml
index b68f629ff75..9ad5c8807ac 100644
--- a/shims/aggregator/pom.xml
+++ b/shims/aggregator/pom.xml
@@ -40,11 +40,5 @@
       <version>${project.version}</version>
       <scope>runtime</scope>
     </dependency>
-    <dependency>
-      <groupId>org.apache.hive.shims</groupId>
-      <artifactId>hive-shims-scheduler</artifactId>
-      <version>${project.version}</version>
-      <scope>runtime</scope>
-    </dependency>
   </dependencies>
 </project>
diff --git a/shims/pom.xml b/shims/pom.xml
index 44a1c1fda9f..83d653ad21b 100644
--- a/shims/pom.xml
+++ b/shims/pom.xml
@@ -29,7 +29,6 @@
   <modules>
     <module>common</module>
     <module>0.23</module>
-    <module>scheduler</module>
     <module>aggregator</module>
   </modules>
 </project>
diff --git a/shims/scheduler/pom.xml b/shims/scheduler/pom.xml
deleted file mode 100644
index ebd0388b041..00000000000
--- a/shims/scheduler/pom.xml
+++ /dev/null
@@ -1,120 +0,0 @@
-<?xml version="1.0" encoding="UTF-8"?>
-<!--
-  Licensed under the Apache License, Version 2.0 (the "License");
-  you may not use this file except in compliance with the License.
-  You may obtain a copy of the License at
-
-      http://www.apache.org/licenses/LICENSE-2.0
-
-  Unless required by applicable law or agreed to in writing, software
-  distributed under the License is distributed on an "AS IS" BASIS,
-  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-  See the License for the specific language governing permissions and
-  limitations under the License.
--->
-<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
-  <modelVersion>4.0.0</modelVersion>
-  <parent>
-    <groupId>org.apache.hive</groupId>
-    <artifactId>hive</artifactId>
-    <version>4.0.0-SNAPSHOT</version>
-    <relativePath>../../pom.xml</relativePath>
-  </parent>
-  <groupId>org.apache.hive.shims</groupId>
-  <artifactId>hive-shims-scheduler</artifactId>
-  <packaging>jar</packaging>
-  <name>Hive Shims Scheduler</name>
-  <properties>
-    <hive.path.to.root>../..</hive.path.to.root>
-  </properties>
-  <dependencies>
-    <!-- dependencies are always listed in sorted order by groupId, artifactId -->
-    <!-- intra-project -->
-    <dependency>
-      <groupId>org.apache.hive.shims</groupId>
-      <artifactId>hive-shims-common</artifactId>
-      <version>${project.version}</version>
-    </dependency>
-    <!-- inter-project -->
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-common</artifactId>
-      <optional>true</optional>
-      <exclusions>
-        <exclusion>
-          <groupId>commons-beanutils</groupId>
-          <artifactId>commons-beanutils</artifactId>
-        </exclusion>
-        <exclusion>
-          <groupId>org.slf4j</groupId>
-          <artifactId>slf4j-log4j12</artifactId>
-        </exclusion>
-        <exclusion>
-          <groupId>org.slf4j</groupId>
-          <artifactId>slf4j-reload4j</artifactId>
-        </exclusion>
-        <exclusion>
-          <groupId>ch.qos.reload4j</groupId>
-          <artifactId>reload4j</artifactId>
-        </exclusion>
-        <exclusion>
-          <groupId>commons-logging</groupId>
-          <artifactId>commons-logging</artifactId>
-        </exclusion>
-      </exclusions>
-    </dependency>
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-mapreduce-client-core</artifactId>
-      <optional>true</optional>
-    </dependency>
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-yarn-api</artifactId>
-      <optional>true</optional>
-    </dependency>
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-yarn-common</artifactId>
-      <optional>true</optional>
-    </dependency>
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-yarn-client</artifactId>
-      <optional>true</optional>
-    </dependency>
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-yarn-server-resourcemanager</artifactId>
-      <version>${hadoop.version}</version>
-      <optional>true</optional>
-      <exclusions>
-        <exclusion>
-          <groupId>org.slf4j</groupId>
-          <artifactId>slf4j-log4j12</artifactId>
-        </exclusion>
-        <exclusion>
-          <groupId>org.slf4j</groupId>
-          <artifactId>slf4j-reload4j</artifactId>
-        </exclusion>
-        <exclusion>
-          <groupId>ch.qos.reload4j</groupId>
-          <artifactId>reload4j</artifactId>
-        </exclusion>
-      </exclusions>
-    </dependency>
-    <dependency>
-      <groupId>org.apache.hadoop</groupId>
-      <artifactId>hadoop-yarn-server-tests</artifactId>
-      <version>${hadoop.version}</version>
-      <optional>true</optional>
-      <classifier>tests</classifier>
-      <exclusions>
-        <exclusion>
-          <groupId>com.codahale.metrics</groupId>
-          <artifactId>metrics-core</artifactId>
-        </exclusion>
-      </exclusions>
-    </dependency>
-  </dependencies>
-</project>


[hive] 02/02: HIVE-27100: Remove unused data/files from repo (Stamatis Zampetakis reviewed by Krisztian Kasa)

Posted by za...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

zabetak pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git

commit cd53e0a4d9b99f825beb7a7f5c9acc1b3e822edd
Author: Stamatis Zampetakis <za...@gmail.com>
AuthorDate: Fri Feb 24 10:48:08 2023 +0100

    HIVE-27100: Remove unused data/files from repo (Stamatis Zampetakis reviewed by Krisztian Kasa)
    
    The files are not referenced anywhere in the repo so they can be safely
    dropped to remove noise and slighly reduce release size.
    
    Note that regex-path-2015* files are not explicitly referenced but they
    are used by symlink_text_input_format.q via regex so they cannot be
    removed.
    
    Closes #4081
---
 data/files/SortDescCol1Col2.txt              |   4 -
 data/files/SortDescCol2Col1.txt              |   4 -
 data/files/cbo_t4.txt                        |  20 ----
 data/files/cbo_t5.txt                        |  20 ----
 data/files/cbo_t6.txt                        |  20 ----
 data/files/compressed_4line_file1.csv.bz2    | Bin 55 -> 0 bytes
 data/files/empty2.txt                        |   0
 data/files/filterCard.txt                    | 101 --------------------
 data/files/fullouter_string_big_1a_old.txt   |  13 ---
 data/files/fullouter_string_small_1a_old.txt |  38 --------
 data/files/futurama_episodes.avro            | Bin 3044 -> 0 bytes
 data/files/in9.txt                           |   6 --
 data/files/map_null_schema.avro              |   1 -
 data/files/sample-queryplan-in-history.txt   |   1 -
 data/files/sample-queryplan.txt              |   1 -
 data/files/sample.json                       |   1 -
 data/files/smb_bucket_input.txt              |   7 --
 data/files/smbbucket_2.txt                   |   4 -
 data/files/sortdp.txt                        |  32 -------
 data/files/srcsortbucket1outof4.txt          | 118 -----------------------
 data/files/srcsortbucket2outof4.txt          | 120 -----------------------
 data/files/srcsortbucket4outof4.txt          | 138 ---------------------------
 22 files changed, 649 deletions(-)

diff --git a/data/files/SortDescCol1Col2.txt b/data/files/SortDescCol1Col2.txt
deleted file mode 100644
index d18cfac4049..00000000000
--- a/data/files/SortDescCol1Col2.txt
+++ /dev/null
@@ -1,4 +0,0 @@
-211
-210
-111
-110
diff --git a/data/files/SortDescCol2Col1.txt b/data/files/SortDescCol2Col1.txt
deleted file mode 100644
index ea929de3900..00000000000
--- a/data/files/SortDescCol2Col1.txt
+++ /dev/null
@@ -1,4 +0,0 @@
-211
-111
-210
-110
diff --git a/data/files/cbo_t4.txt b/data/files/cbo_t4.txt
deleted file mode 100644
index 22825b3d622..00000000000
--- a/data/files/cbo_t4.txt
+++ /dev/null
@@ -1,20 +0,0 @@
-1,1,1,1,true
-2,2,2,2,true
-3,3,3,3,true
-4,4,4,4,true
-1,1,1,1,true
-2,2,2,2,true
-3,3,3,3,true
-4,4,4,4,true
-1,1,1,1,true
-2,2,2,2,true
- 1, 1,1,1,true
- 1, 1,1,1,true
- 1 , 1 ,1,1,true
- 1 , 1 ,1,1,true
-1 ,1 ,1,1,true
-1 ,1 ,1,1,true
-1,1,1,1,false
-1,1,1,1,false
-\N,\N,\N,\N,\N
-\N,\N,\N,\N,\N
diff --git a/data/files/cbo_t5.txt b/data/files/cbo_t5.txt
deleted file mode 100644
index 9dadc77bd3c..00000000000
--- a/data/files/cbo_t5.txt
+++ /dev/null
@@ -1,20 +0,0 @@
-1,1,1,1,true
-2,2,2,2,true
-3,3,3,3,true
-4,4,4,4,true
-5,5,5,5,true
-1,1,1,1,true
-2,2,2,2,true
-3,3,3,3,true
-4,4,4,4,true
-5,5,5,5,true
- 1, 1,1,1,true
- 1, 1,1,1,true
- 1 , 1 ,1,1,true
- 1 , 1 ,1,1,true
-1 ,1 ,1,1,true
-1 ,1 ,1,1,true
-1,1,1,1,false
-1,1,1,1,false
-\N,\N,\N,\N,\N
-\N,\N,\N,\N,\N
diff --git a/data/files/cbo_t6.txt b/data/files/cbo_t6.txt
deleted file mode 100644
index 5f25ccbb85b..00000000000
--- a/data/files/cbo_t6.txt
+++ /dev/null
@@ -1,20 +0,0 @@
-1,1,1,1,true
-2,2,2,2,true
-3,3,3,3,true
-4,4,4,4,true
-5,5,5,5,true
-6,6,6,6,true
-1,1,1,1,true
-2,2,2,2,true
-3,3,3,3,true
-4,4,4,4,true
- 1, 1,1,1,true
- 1, 1,1,1,true
- 1 , 1 ,1,1,true
- 1 , 1 ,1,1,true
-1 ,1 ,1,1,true
-1 ,1 ,1,1,true
-1,1,1,1,false
-1,1,1,1,false
-\N,\N,\N,\N,\N
-\N,\N,\N,\N,\N
diff --git a/data/files/compressed_4line_file1.csv.bz2 b/data/files/compressed_4line_file1.csv.bz2
deleted file mode 100644
index ada697db2d1..00000000000
Binary files a/data/files/compressed_4line_file1.csv.bz2 and /dev/null differ
diff --git a/data/files/empty2.txt b/data/files/empty2.txt
deleted file mode 100644
index e69de29bb2d..00000000000
diff --git a/data/files/filterCard.txt b/data/files/filterCard.txt
deleted file mode 100644
index 6246bfb86e9..00000000000
--- a/data/files/filterCard.txt
+++ /dev/null
@@ -1,101 +0,0 @@
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-10,10,10
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
-20,20,20
diff --git a/data/files/fullouter_string_big_1a_old.txt b/data/files/fullouter_string_big_1a_old.txt
deleted file mode 100644
index 1fa51ad799b..00000000000
--- a/data/files/fullouter_string_big_1a_old.txt
+++ /dev/null
@@ -1,13 +0,0 @@
-WXHJ
-WXHJ
-WXHJ
-WXHJ
-WXHJ
-QNCYBDW
-PXLD
-PXLD
-PXLD
-UA
-\N
-FTWURVH
-MXGDMBD
diff --git a/data/files/fullouter_string_small_1a_old.txt b/data/files/fullouter_string_small_1a_old.txt
deleted file mode 100644
index 505c4032e52..00000000000
--- a/data/files/fullouter_string_small_1a_old.txt
+++ /dev/null
@@ -1,38 +0,0 @@
-,2021-02-21,2802-04-21 18:48:18.5933838
-,1985-01-22,2111-01-10 15:44:28
-VNRXWQ,1883-02-06,2287-07-17 16:46:58.287
-VNRXWQ,2276-11-16,2072-08-16 17:45:47.48349887
-KL,1980-09-22,2073-08-25 11:51:10.318
-FYW,1807-03-20,2305-08-17 01:32:44
-WNGFTTY,2251-08-16,2649-12-21 18:30:42.498
-WNGFTTY,1843-06-10,2411-01-28 20:03:59
-FTWURVH,1976-03-10,2683-11-22 13:07:04.66673556
-CQMTQLI,2031-09-13,1927-02-13 08:39:25.000919094
-CQMTQLI,2090-11-13,2693-03-17 16:19:55.82
-BEP,2141-02-19,2521-06-09 01:20:07.121
-BEP,2206-08-10,2331-10-09 10:59:51
-FROPIK,2023-02-28,2467-05-11 06:04:13.426693647
-FROPIK,2214-02-09,1949-08-18 17:14:38.000703738
-FROPIK,2124-10-01,2974-07-06 12:05:08.000146048
-SDA,2196-04-12,2462-10-26 19:28:12.733
-ATZJTPECF,2217-10-22,2808-10-20 16:01:24.558
-ATZJTPECF,1829-10-16,2357-05-08 07:09:09.000482799
-MXGDMBD,1880-11-01,2765-10-06 13:28:17.000688592
-IWEZJHKE,\N,\N
-NADANUQMW,2037-10-19,2320-04-26 18:50:25.000426922
-GOYJHW,1993-04-07,1950-05-04 09:28:22.000114784
-GOYJHW,1976-03-06,2805-07-10 10:51:57.00083302
-GOYJHW,1959-04-27,\N
-QTSRKSKB,2144-01-13,2627-12-20 03:38:53.000389266
-IOQIDQBHU,2198-02-08,2073-03-21 15:32:57.617920888
-ZNOUDCR,\N,1988-04-23 08:40:21
-AARNZRVZQ,2000-11-13,2309-06-05 19:54:13
-AARNZRVZQ,2002-10-23,2525-05-12 15:59:35
-BDBMW,2278-04-27,2101-02-21 08:53:34.692
-\N,1865-11-08,2893-04-07 07:36:12
-\N,2250-04-22,2548-03-21 08:23:13.133573801
-\N,1915-02-22,2554-10-27 09:34:30
-LOTLS,1957-11-09,2092-06-07 06:42:30.000538454
-LOTLS,2126-09-16,1977-12-15 15:28:56
-LOTLS,2099-08-04,2181-01-25 01:04:25.000030055
-GSJPSIYOU,1948-07-17,2006-09-24 16:01:24.000239251
diff --git a/data/files/futurama_episodes.avro b/data/files/futurama_episodes.avro
deleted file mode 100644
index c08b97b46e3..00000000000
Binary files a/data/files/futurama_episodes.avro and /dev/null differ
diff --git a/data/files/in9.txt b/data/files/in9.txt
deleted file mode 100644
index b38f3c191ee..00000000000
--- a/data/files/in9.txt
+++ /dev/null
@@ -1,6 +0,0 @@
-
-110
-110
-135
-148
-200200
diff --git a/data/files/map_null_schema.avro b/data/files/map_null_schema.avro
deleted file mode 100644
index d8ceaa7a10a..00000000000
--- a/data/files/map_null_schema.avro
+++ /dev/null
@@ -1 +0,0 @@
-{"type":"record","name":"dku_record_0","namespace":"com.dataiku.dss","doc":"","fields":[{"name":"avreau_col_1","type":["null",{"type":"map","values":["null","string"]}],"default":null}]}
diff --git a/data/files/sample-queryplan-in-history.txt b/data/files/sample-queryplan-in-history.txt
deleted file mode 100644
index 79c034dabed..00000000000
--- a/data/files/sample-queryplan-in-history.txt
+++ /dev/null
@@ -1 +0,0 @@
-Counters plan="{"queryId":"rmurthy_20090806105454","queryType":null,"queryAttributes":{"queryString":"select count(1) from nectar_fbalias_r where ds = '2009-08-03'"},"queryCounters":"null","stageGraph":{"nodeType":"1","roots":"null","adjacencyList":"]"},"stageList":[{"stageId":"Stage-1","stageType":"3","stageAttributes":"null","stageCounters":"null","taskList":[{"taskId":"Stage-1_map","taskType":"0","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"0","roots":"nu [...]
diff --git a/data/files/sample-queryplan.txt b/data/files/sample-queryplan.txt
deleted file mode 100644
index 3b9167b4ac7..00000000000
--- a/data/files/sample-queryplan.txt
+++ /dev/null
@@ -1 +0,0 @@
-{"queryId":"rmurthy_20090806105454","queryType":null,"queryAttributes":{"queryString":"select count(1) from nectar_fbalias_r where ds = '2009-08-03'"},"queryCounters":"null","stageGraph":{"nodeType":"1","roots":"null","adjacencyList":"]"},"stageList":[{"stageId":"Stage-1","stageType":"3","stageAttributes":"null","stageCounters":"null","taskList":[{"taskId":"Stage-1_map","taskType":"0","taskAttributes":"null","taskCounters":"null","operatorGraph":{"nodeType":"0","roots":"null","adjacencyL [...]
diff --git a/data/files/sample.json b/data/files/sample.json
deleted file mode 100644
index 7b749791ef4..00000000000
--- a/data/files/sample.json
+++ /dev/null
@@ -1 +0,0 @@
-{"a" : "2" ,"b" : "blah"}
diff --git a/data/files/smb_bucket_input.txt b/data/files/smb_bucket_input.txt
deleted file mode 100644
index e3a7e2977bc..00000000000
--- a/data/files/smb_bucket_input.txt
+++ /dev/null
@@ -1,7 +0,0 @@
-4val_356
-484val_169
-1000val_1000
-2000val_169
-3000val_169
-4000val_125
-5000val_125
diff --git a/data/files/smbbucket_2.txt b/data/files/smbbucket_2.txt
deleted file mode 100644
index 430a0ca8877..00000000000
--- a/data/files/smbbucket_2.txt
+++ /dev/null
@@ -1,4 +0,0 @@
-20val_20
-23val_23
-25val_25
-30val_30
diff --git a/data/files/sortdp.txt b/data/files/sortdp.txt
deleted file mode 100644
index dc7781d7374..00000000000
--- a/data/files/sortdp.txt
+++ /dev/null
@@ -1,32 +0,0 @@
-ffff67aef705abda0b89d899e408c28ef230fd0bb2cb0bb23b057e946ba9ca91\N\N2015-01-21
-fffee943d640a7714d09f9bd50dba08a9d0ebdd146655e4642c293a4396cb385\N\N2015-01-21
-fffe069c9bba031c86f1f49ec87bf75d4feb5cc5c7d430282f739ebc4337c673002015-01-21
-fffdc9482d8a88626887d92851951b92e58dba2cfa7e22caeafe98baac4d2a3e042015-01-21
-fffd4906f05ab50dfa41f4ab226e83de981fd8aa4ce0d4f516e7ebf9566a4213\N\N2015-01-21
-fffd37a9ebbef0ed3d3440f7bacd64b823df685c90c827a75a5e9556126a8d0c\N\N2015-01-21
-fffcf74695669d1f444936243869f3586418c6d61d3abb5cc9acb67a3ad7bd2f002015-01-21
-fffce560fc7c69c5185eda181759a62f30f908c55f04291d612039a3ca16357a\N\N2015-01-21
-fffcb494aa56beb88fddb83cc3b0296d417d3ab7782be76c8c12d33e3f3d6a3c\N\N2015-01-21
-fffc8a89a8406ba3ed651fc9248fe9b2afb1ee672999ef75d2d9c42484435bca\N\N2015-01-21
-fffc502293653c4249cdeb8fad4ba2437006b56d527eae844d18e6d6324e424d002015-01-21
-fffc0450ec9b28bae495dffc87a37cc3eea6d2d067ccea8b333185d28847ae2a\N\N2015-01-21
-fffbe3c110c390ec20218e5ad4a026ff515668ed55488b717319b556daa962a1002015-01-21
-fffb1b226efc3cfaac8d73647ce4fa4e82413d67265fb55366ac3a4996518738012015-01-21
-fffad5028e769fdf811eea954785629c064826a5a008253136dbd4f189334827\N\N2015-01-21
-fffad1074d813e6db5c23302a9170fe472c2968844499c90445cbc8559d64fe1082015-01-21
-fff876f50b99444aa7ef901383336299c47f035b87d253283f737d88a05edce8\N\N2015-01-21
-fff66e6646a820cf6d39ba467a735db4ffe4df344256bb1a1cb854086e766810\N\N2015-01-21
-fff56191e39b15f0e2f04984c70152fb1bde2ecba52ff5a73b4c28bf4d58c017002015-01-21
-fff4cabcf8a5f2f8edd27d5d92659ad80e3513d15ac2df7557a82ade5ed80b86\N\N2015-01-21
-fff42e4d4463fa981df990041ba914deaa1d1c1cdcb1547678ab899e34248526012015-01-21
-fff4166378aa9d94cd4f8a9cd543375890a61b4f09a57dbfb31a66b33b3e3fd9\N\N2015-01-21
-fff3474e56ee23c0df629b538268a438d74da36208bdb114bda2da4253f0b4c9\N\N2015-01-21
-fff2de7c5a9929257705996690aa45e5848e57a85eb91f83dfcfa6ac4219ae1b\N\N2015-01-21
-fff201d3ead782d817f222c73cd241df1683cecdb109a5a22b02004b7b228b14\N\N2015-01-21
-fff0fbdf2bf7bfed9ea314bfa7fa14bf179345dde9ea79838f66acd70b943f0b\N\N2015-01-21
-fff06e59d471f90aa055c3089c1d8e380bbb86d5642142ecd0589b544dd44688002015-01-21
-fff06c6e0fd675ebeff09350e6b7a3900115f72341fd353e5e185e8983d10534002015-01-21
-fff03007f38c32085bb4c9389270b965d371168032845555b663b7d4653ec8ee\N\N2015-01-21
-ffefa017a261a0b3e94c2386e0c47a015e2095e5d56b0f4fca2033d9755c9e45012015-01-21
-ffef4b7433ee6008e389a1a4121a82b828123864e563a2afe67dcf29e2b71591\N\N2015-01-21
-ffef34be95399a087af57dd713ca3510377625811bb4232473c1ba223239f284002015-01-21
diff --git a/data/files/srcsortbucket1outof4.txt b/data/files/srcsortbucket1outof4.txt
deleted file mode 100644
index 3d749a441bb..00000000000
--- a/data/files/srcsortbucket1outof4.txt
+++ /dev/null
@@ -1,118 +0,0 @@
-0val_0
-0val_0
-0val_0
-103val_103
-103val_103
-11val_11
-114val_114
-118val_118
-118val_118
-125val_125
-125val_125
-129val_129
-129val_129
-136val_136
-143val_143
-15val_15
-15val_15
-150val_150
-158val_158
-165val_165
-165val_165
-169val_169
-169val_169
-169val_169
-169val_169
-172val_172
-172val_172
-176val_176
-176val_176
-183val_183
-187val_187
-187val_187
-187val_187
-19val_19
-190val_190
-194val_194
-202val_202
-213val_213
-213val_213
-217val_217
-217val_217
-224val_224
-224val_224
-228val_228
-235val_235
-239val_239
-239val_239
-242val_242
-242val_242
-257val_257
-26val_26
-26val_26
-260val_260
-275val_275
-282val_282
-282val_282
-286val_286
-305val_305
-309val_309
-309val_309
-316val_316
-316val_316
-316val_316
-323val_323
-327val_327
-327val_327
-327val_327
-33val_33
-338val_338
-341val_341
-345val_345
-356val_356
-367val_367
-367val_367
-37val_37
-37val_37
-374val_374
-378val_378
-389val_389
-392val_392
-396val_396
-396val_396
-396val_396
-4val_4
-400val_400
-404val_404
-404val_404
-411val_411
-419val_419
-437val_437
-44val_44
-444val_444
-448val_448
-455val_455
-459val_459
-459val_459
-462val_462
-462val_462
-466val_466
-466val_466
-466val_466
-477val_477
-480val_480
-480val_480
-480val_480
-484val_484
-491val_491
-495val_495
-51val_51
-51val_51
-66val_66
-77val_77
-8val_8
-80val_80
-84val_84
-84val_84
-95val_95
-95val_95
diff --git a/data/files/srcsortbucket2outof4.txt b/data/files/srcsortbucket2outof4.txt
deleted file mode 100644
index 0fa67279aac..00000000000
--- a/data/files/srcsortbucket2outof4.txt
+++ /dev/null
@@ -1,120 +0,0 @@
-100val_100
-100val_100
-104val_104
-104val_104
-111val_111
-119val_119
-119val_119
-119val_119
-12val_12
-12val_12
-126val_126
-133val_133
-137val_137
-137val_137
-155val_155
-162val_162
-166val_166
-177val_177
-180val_180
-191val_191
-191val_191
-195val_195
-195val_195
-199val_199
-199val_199
-199val_199
-203val_203
-203val_203
-207val_207
-207val_207
-214val_214
-218val_218
-221val_221
-221val_221
-229val_229
-229val_229
-247val_247
-258val_258
-265val_265
-265val_265
-27val_27
-272val_272
-272val_272
-283val_283
-287val_287
-298val_298
-298val_298
-298val_298
-30val_30
-302val_302
-306val_306
-317val_317
-317val_317
-331val_331
-331val_331
-335val_335
-339val_339
-34val_34
-342val_342
-342val_342
-353val_353
-353val_353
-360val_360
-364val_364
-368val_368
-375val_375
-379val_379
-382val_382
-382val_382
-386val_386
-393val_393
-397val_397
-397val_397
-401val_401
-401val_401
-401val_401
-401val_401
-401val_401
-409val_409
-409val_409
-409val_409
-41val_41
-427val_427
-430val_430
-430val_430
-430val_430
-438val_438
-438val_438
-438val_438
-449val_449
-452val_452
-463val_463
-463val_463
-467val_467
-470val_470
-478val_478
-478val_478
-481val_481
-485val_485
-489val_489
-489val_489
-489val_489
-489val_489
-492val_492
-492val_492
-496val_496
-5val_5
-5val_5
-5val_5
-67val_67
-67val_67
-70val_70
-70val_70
-70val_70
-74val_74
-78val_78
-85val_85
-9val_9
-92val_92
-96val_96
diff --git a/data/files/srcsortbucket4outof4.txt b/data/files/srcsortbucket4outof4.txt
deleted file mode 100644
index 400ad1f447b..00000000000
--- a/data/files/srcsortbucket4outof4.txt
+++ /dev/null
@@ -1,138 +0,0 @@
-10val_10
-113val_113
-113val_113
-120val_120
-120val_120
-128val_128
-128val_128
-128val_128
-131val_131
-146val_146
-146val_146
-153val_153
-157val_157
-160val_160
-164val_164
-164val_164
-168val_168
-175val_175
-175val_175
-179val_179
-179val_179
-18val_18
-18val_18
-186val_186
-193val_193
-193val_193
-193val_193
-197val_197
-197val_197
-201val_201
-205val_205
-205val_205
-209val_209
-209val_209
-216val_216
-216val_216
-223val_223
-223val_223
-230val_230
-230val_230
-230val_230
-230val_230
-230val_230
-238val_238
-238val_238
-241val_241
-249val_249
-252val_252
-256val_256
-256val_256
-263val_263
-274val_274
-278val_278
-278val_278
-281val_281
-281val_281
-285val_285
-289val_289
-292val_292
-296val_296
-308val_308
-311val_311
-311val_311
-311val_311
-315val_315
-322val_322
-322val_322
-333val_333
-333val_333
-344val_344
-344val_344
-348val_348
-348val_348
-348val_348
-348val_348
-348val_348
-351val_351
-362val_362
-366val_366
-373val_373
-377val_377
-384val_384
-384val_384
-384val_384
-395val_395
-395val_395
-399val_399
-399val_399
-403val_403
-403val_403
-403val_403
-407val_407
-414val_414
-414val_414
-418val_418
-421val_421
-429val_429
-429val_429
-43val_43
-432val_432
-436val_436
-443val_443
-454val_454
-454val_454
-454val_454
-458val_458
-458val_458
-469val_469
-469val_469
-469val_469
-469val_469
-469val_469
-47val_47
-472val_472
-483val_483
-487val_487
-490val_490
-494val_494
-498val_498
-498val_498
-498val_498
-54val_54
-58val_58
-58val_58
-65val_65
-69val_69
-72val_72
-72val_72
-76val_76
-76val_76
-83val_83
-83val_83
-87val_87
-90val_90
-90val_90
-90val_90
-98val_98
-98val_98