You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (Jira)" <ji...@apache.org> on 2020/02/04 00:27:00 UTC

[jira] [Commented] (HIVE-22589) Add storage support for ProlepticCalendar in ORC, Parquet, and Avro

    [ https://issues.apache.org/jira/browse/HIVE-22589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029392#comment-17029392 ] 

Hive QA commented on HIVE-22589:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12992522/HIVE-22589.05.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/20450/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/20450/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-20450/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2020-02-04 00:25:41.213
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-20450/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2020-02-04 00:25:41.216
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 842fdd2 HIVE-21341 : Sensible defaults : hive.server2.idle.operation.timeout and hive.server2.idle.session.timeout are too high (Ashutosh Chauhan via Thejas Nair)
+ git clean -f -d
Removing standalone-metastore/metastore-server/src/gen/
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 842fdd2 HIVE-21341 : Sensible defaults : hive.server2.idle.operation.timeout and hive.server2.idle.session.timeout are too high (Ashutosh Chauhan via Thejas Nair)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2020-02-04 00:25:41.955
+ rm -rf ../yetus_PreCommit-HIVE-Build-20450
+ mkdir ../yetus_PreCommit-HIVE-Build-20450
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-20450
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-20450/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch
Trying to apply the patch with -p0
fatal: git diff header lacks filename information when removing 0 leading pathname components (line 234)
Trying to apply the patch with -p1
error: cannot apply binary patch to 'data/files/avro_legacy_mixed_dates.avro' without full index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/avro_legacy_mixed_dates.avro' without full index line
error: data/files/avro_legacy_mixed_dates.avro: patch does not apply
error: cannot apply binary patch to 'data/files/avro_legacy_mixed_timestamps.avro' without full index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/avro_legacy_mixed_timestamps.avro' without full index line
error: data/files/avro_legacy_mixed_timestamps.avro: patch does not apply
error: cannot apply binary patch to 'data/files/orc_legacy_mixed_dates.orc' without full index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/orc_legacy_mixed_dates.orc' without full index line
error: data/files/orc_legacy_mixed_dates.orc: patch does not apply
error: cannot apply binary patch to 'data/files/orc_legacy_mixed_timestamps.orc' without full index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/orc_legacy_mixed_timestamps.orc' without full index line
error: data/files/orc_legacy_mixed_timestamps.orc: patch does not apply
error: cannot apply binary patch to 'data/files/parquet_legacy_mixed_dates.parq' without full index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/parquet_legacy_mixed_dates.parq' without full index line
error: data/files/parquet_legacy_mixed_dates.parq: patch does not apply
error: cannot apply binary patch to 'data/files/parquet_legacy_mixed_timestamps.parq' without full index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/parquet_legacy_mixed_timestamps.parq' without full index line
error: data/files/parquet_legacy_mixed_timestamps.parq: patch does not apply
Trying to apply the patch with -p2
fatal: git diff header lacks filename information when removing 2 leading pathname components (line 478)
The patch does not appear to apply with p0, p1, or p2
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-20450
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12992522 - PreCommit-HIVE-Build

> Add storage support for ProlepticCalendar in ORC, Parquet, and Avro
> -------------------------------------------------------------------
>
>                 Key: HIVE-22589
>                 URL: https://issues.apache.org/jira/browse/HIVE-22589
>             Project: Hive
>          Issue Type: Bug
>          Components: Avro, ORC, Parquet
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Major
>             Fix For: 4.0.0, 3.2.0, 3.1.3
>
>         Attachments: HIVE-22589.01.patch, HIVE-22589.02.patch, HIVE-22589.03.patch, HIVE-22589.04.patch, HIVE-22589.05.patch, HIVE-22589.patch, HIVE-22589.patch
>
>
> Hive recently moved its processing to the proleptic calendar, which has created some issues for users who have dates before 1580 AD.
> HIVE-22405 extended the column vectors for times & dates to encode which calendar they are using.
> This issue is to support proleptic calendar in ORC, Parquet, and Avro, when files are written/read by Hive. To preserve compatibility with other engines until they upgrade their readers, files will be written using hybrid calendar by default. Default behavior when files do not contain calendar information in their metadata is configurable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)