You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2011/12/24 23:02:24 UTC

Hive-trunk-h0.23.0 - Build # 46 - Still Failing

Changes for Build #1

Changes for Build #2
[jvs] HIVE-2625. Fix maven-build Ant target
(Carl Steinbach via jvs)


Changes for Build #3

Changes for Build #4
[jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file
(Marek Sapota via John Sichi)

Summary:
Remove property overrides

Run `ant test <del>Dtestcase=TestHiveServer && ant testreport`, the test report
will be empty because not 'TEST</del>*.xml' file was produced by JUnit.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 621

[jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v'
(Carl Steinbach via jvs)


Changes for Build #5
[hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan)

[hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan)


Changes for Build #6

Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)




No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #46)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/46/ to view the results.

Hive-trunk-h0.23.0 - Build # 53 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47

Changes for Build #48
[cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws)


Changes for Build #49

Changes for Build #50

Changes for Build #51

Changes for Build #52

Changes for Build #53
[hashutosh] HIVE-2681 : SUCESS is misspelled (jonchang via Ashutosh Chauhan)




No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #53)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/53/ to view the results.

Hive-trunk-h0.23.0 - Build # 52 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47

Changes for Build #48
[cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws)


Changes for Build #49

Changes for Build #50

Changes for Build #51

Changes for Build #52



No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #52)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/52/ to view the results.

Hive-trunk-h0.23.0 - Build # 51 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #4
[jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file
(Marek Sapota via John Sichi)

Summary:
Remove property overrides

Run `ant test <del>Dtestcase=TestHiveServer && ant testreport`, the test report
will be empty because not 'TEST</del>*.xml' file was produced by JUnit.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 621

[jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v'
(Carl Steinbach via jvs)


Changes for Build #5
[hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan)

[hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan)


Changes for Build #6

Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47

Changes for Build #48
[cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws)


Changes for Build #49

Changes for Build #50

Changes for Build #51



No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #51)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/51/ to view the results.

Hive-trunk-h0.23.0 - Build # 50 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #1

Changes for Build #2
[jvs] HIVE-2625. Fix maven-build Ant target
(Carl Steinbach via jvs)


Changes for Build #3

Changes for Build #4
[jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file
(Marek Sapota via John Sichi)

Summary:
Remove property overrides

Run `ant test <del>Dtestcase=TestHiveServer && ant testreport`, the test report
will be empty because not 'TEST</del>*.xml' file was produced by JUnit.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 621

[jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v'
(Carl Steinbach via jvs)


Changes for Build #5
[hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan)

[hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan)


Changes for Build #6

Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47

Changes for Build #48
[cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws)


Changes for Build #49

Changes for Build #50



No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #50)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/50/ to view the results.

Hive-trunk-h0.23.0 - Build # 49 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #1

Changes for Build #2
[jvs] HIVE-2625. Fix maven-build Ant target
(Carl Steinbach via jvs)


Changes for Build #3

Changes for Build #4
[jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file
(Marek Sapota via John Sichi)

Summary:
Remove property overrides

Run `ant test <del>Dtestcase=TestHiveServer && ant testreport`, the test report
will be empty because not 'TEST</del>*.xml' file was produced by JUnit.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 621

[jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v'
(Carl Steinbach via jvs)


Changes for Build #5
[hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan)

[hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan)


Changes for Build #6

Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47

Changes for Build #48
[cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws)


Changes for Build #49



No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #49)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/49/ to view the results.

Hive-trunk-h0.23.0 - Build # 48 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #1

Changes for Build #2
[jvs] HIVE-2625. Fix maven-build Ant target
(Carl Steinbach via jvs)


Changes for Build #3

Changes for Build #4
[jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file
(Marek Sapota via John Sichi)

Summary:
Remove property overrides

Run `ant test <del>Dtestcase=TestHiveServer && ant testreport`, the test report
will be empty because not 'TEST</del>*.xml' file was produced by JUnit.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 621

[jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v'
(Carl Steinbach via jvs)


Changes for Build #5
[hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan)

[hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan)


Changes for Build #6

Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47

Changes for Build #48
[cws] HIVE-1877. Add java_method() as a synonym for the reflect() UDF (Zhenxiao Luo via cws)




No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #48)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/48/ to view the results.

Hive-trunk-h0.23.0 - Build # 47 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Changes for Build #1

Changes for Build #2
[jvs] HIVE-2625. Fix maven-build Ant target
(Carl Steinbach via jvs)


Changes for Build #3

Changes for Build #4
[jvs] HIVE-2630 [jira] TestHiveServer doesn't produce a JUnit report file
(Marek Sapota via John Sichi)

Summary:
Remove property overrides

Run `ant test <del>Dtestcase=TestHiveServer && ant testreport`, the test report
will be empty because not 'TEST</del>*.xml' file was produced by JUnit.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 621

[jvs] HIVE-2362. HiveConf properties not appearing in the output of 'set' or 'set -v'
(Carl Steinbach via jvs)


Changes for Build #5
[hashutosh] HIVE-2467 : HA Support for Metastore Server (Thomas Weise via Ashutosh Chauhan)

[hashutosh] HIVE-2622 : Hive POMs reference the wrong Hadoop artifacts (Carl Steinbach via Ashutosh Chauhan)


Changes for Build #6

Changes for Build #7
[heyongqiang] HIVE-1003 [jira] optimize metadata only queries
(Namit Jain via Yongqiang He)

Summary:
testing

Queries like:

select max(ds) from T

where ds is a partitioning column should be optimized.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: njain, heyongqiang

Differential Revision: 105


Changes for Build #8

Changes for Build #9
[heyongqiang] HIVE-2634 [jira] revert HIVE-2566
(Namit Jain via Yongqiang He)

Summary:
HIVE-2634

This is leading to some problems.   

I will upload the offending testcase in a new jira.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 651


Changes for Build #10
[heyongqiang] HIVE-2632 [jira] ignore exception for external jars via reflection
(Namit Jain via Yongqiang He)

Summary:
HIVE-2632



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 639


Changes for Build #11

Changes for Build #12
[heyongqiang] HIVE-2635 [jira] wrong class loader used for external jars
(Namit Jain via Yongqiang He)

Summary:
HIVE-2635



Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 687

[namit] HIVE-2329 Not using map aggregation, fails to execute group-by after
cluster-by with same key (Navis via namit)


Changes for Build #13
[namit] HIVE-2628 move one line log from MapOperator to HiveContextAwareRecordReader
(He Yongqiang via namit)

[namit] HIVE-2520 left semi join will duplicate data
(binlijin via namit)

[jvs] HIVE-1487 [jira] Add ptest script
(Marek Sapota via John Sichi)

Summary: HIVE-1464 speeded up serial runs somewhat - but looks like it's still
too slow. we should use parallel junit or some similar setup to run test queries
in parallel. this should be really easy as well need to just use a separate
warehouse/metadb and potentiall mapred system dir location.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 603


Changes for Build #14

Changes for Build #15

Changes for Build #16

Changes for Build #17
[jvs] Fix executable permissions left out of commit for HIVE-1487.


Changes for Build #18
[jvs] HIVE-2647 [jira] Force Bash shell on parallel test slave nodes
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

[jvs] HIVE-2648 [jira] Parallel tests fail if master directory is not present
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777


Changes for Build #19
[jvs] HIVE-2649 [jira] Allow multiple ptest runs by the same person
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

[jvs] HIVE-2650 [jira] Parallel test commands that include cd fail
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

[jvs] HIVE-2643. Recent patch prevents Hadoop confs from loading in 0.20.204
(Carl Steinbach via jvs)


Changes for Build #20

Changes for Build #21
[jvs] HIVE-1040 [jira] use sed rather than diff for masking out noise in diff-based
tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597


Changes for Build #22

Changes for Build #23
[namit] HIVE-2640 Add alterPartition to AlterHandler interface
(Kevin Wilfong via namit)


Changes for Build #24
[namit] HIVE-2617 Insert overwrite table db.tname fails if partition already exists
(Chinna Rao Lalam via namit)


Changes for Build #25
[namit] HIVE-2611 Make index table output of create index command if
index is table based (Kevin Wilfong via namit)


Changes for Build #26
[heyongqiang] HIVE-2651 [jira] The variable hive.exec.mode.local.auto.tasks.max should be
changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

[cws] HIVE-727. Hive Server getSchema() returns wrong schema for 'Explain' queries (Prasad Mujumdar via cws)


Changes for Build #27

Changes for Build #28
[jvs] HIVE-2657 [jira] builtins JAR is not being published to Maven repo & hive-cli
POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

[namit] HIVE-2654 "hive.querylog.location" requires parent directory to be exist or
          else folder creation fails (Chinna Rao Lalam via namit)


Changes for Build #29
[hashutosh] HIVE-1892 : show functions also returns internal operators (Priyadarshini via Ashutosh Chauhan)


Changes for Build #30

Changes for Build #31

Changes for Build #32
[cws] HIVE-2631. Make Hive work with Hadoop 1.0.0 (Ashutosh Chauhan via cws)


Changes for Build #33
[cws] HIVE-BUILD. Update RELEASE_NOTES.txt with 0.8.0 release information (cws)


Changes for Build #34

Changes for Build #35

Changes for Build #36
[namit] HIVE-2602 add support for insert partition overwrite(...) if not
          exists (Chinna Rao Lalam via namit)


Changes for Build #37

Changes for Build #38
[cws] HIVE-2005. Implement BETWEEN operator (Navis via cws)


Changes for Build #39
[jvs] HIVE-2433. add DOAP file for Hive


Changes for Build #40

Changes for Build #41

Changes for Build #42
[heyongqiang] HIVE-2666 [jira] StackOverflowError when using custom UDF in map join
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

[namit] HIVE-2642 fix Hive-2566 and make union optimization more aggressive
(Yongqiang He via namit)


Changes for Build #43

Changes for Build #44

Changes for Build #45

Changes for Build #46
[heyongqiang] HIVE-2600: Enable/Add type-specific compression for rcfile (Krishna Kumar via He Yongqiang)


Changes for Build #47



No tests ran.

The Apache Jenkins build system has built Hive-trunk-h0.23.0 (build #47)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.23.0/47/ to view the results.