You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2018/06/24 08:33:00 UTC
[jira] [Commented] (HIVE-18729) Druid Time column type
[ https://issues.apache.org/jira/browse/HIVE-18729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521446#comment-16521446 ]
Hive QA commented on HIVE-18729:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12928888/HIVE-18729.branch-3.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/12050/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/12050/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-12050/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2018-06-24 08:31:51.414
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-12050/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2018-06-24 08:31:51.420
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 4b7f88a HIVE-19564: Vectorization: Fix NULL / Wrong Results issues in Arithmetic (Matt McCline, reviewed by Teddy Choi)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 4b7f88a HIVE-19564: Vectorization: Fix NULL / Wrong Results issues in Arithmetic (Matt McCline, reviewed by Teddy Choi)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2018-06-24 08:31:53.190
+ rm -rf ../yetus_PreCommit-HIVE-Build-12050
+ mkdir ../yetus_PreCommit-HIVE-Build-12050
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-12050
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-12050/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch
error: a/druid-handler/src/java/org/apache/hadoop/hive/druid/DruidStorageHandlerUtils.java: does not exist in index
error: a/druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDe.java: does not exist in index
error: a/druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDeUtils.java: does not exist in index
error: a/druid-handler/src/java/org/apache/hadoop/hive/druid/serde/HiveDruidSerializationModule.java: does not exist in index
error: a/druid-handler/src/java/org/apache/hadoop/hive/druid/serde/PeriodGranularitySerializer.java: does not exist in index
error: a/itests/src/test/resources/testconfiguration.properties: does not exist in index
error: a/ql/src/java/org/apache/hadoop/hive/ql/optimizer/SortedDynPartitionTimeGranularityOptimizer.java: does not exist in index
error: a/storage-api/src/java/org/apache/hadoop/hive/serde2/io/DateWritable.java: does not exist in index
error: patch failed: druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDe.java:99
Falling back to three-way merge...
Applied patch to 'druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDe.java' with conflicts.
error: patch failed: storage-api/src/java/org/apache/hadoop/hive/serde2/io/DateWritable.java:38
Falling back to three-way merge...
Applied patch to 'storage-api/src/java/org/apache/hadoop/hive/serde2/io/DateWritable.java' cleanly.
Going to apply patch with: git apply -p1
error: patch failed: druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDe.java:99
Falling back to three-way merge...
Applied patch to 'druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDe.java' with conflicts.
error: patch failed: storage-api/src/java/org/apache/hadoop/hive/serde2/io/DateWritable.java:38
Falling back to three-way merge...
Applied patch to 'storage-api/src/java/org/apache/hadoop/hive/serde2/io/DateWritable.java' cleanly.
U druid-handler/src/java/org/apache/hadoop/hive/druid/serde/DruidSerDe.java
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-12050
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12928888 - PreCommit-HIVE-Build
> Druid Time column type
> ----------------------
>
> Key: HIVE-18729
> URL: https://issues.apache.org/jira/browse/HIVE-18729
> Project: Hive
> Issue Type: Task
> Components: Druid integration
> Reporter: slim bouguerra
> Assignee: Jesus Camacho Rodriguez
> Priority: Blocker
> Attachments: HIVE-18729.branch-3.patch, HIVE-18729.patch
>
>
> I have talked Offline with [~jcamachorodriguez] about this and agreed that the best way to go is to support both cases where Druid time column can be Timestamp or Timestamp with local time zone.
> In fact, for the Hive-Druid internal table, this makes perfect sense since we have Hive metadata about the time column during the CTAS statement then we can handle both cases as we do for another type of storage eg ORC.
> For the Druid external tables, we can have a default type and allow the user to override that via table properties.
> CC [~ashutoshc] and [~nishantbangarwa].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)