You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (Jira)" <ji...@apache.org> on 2020/06/08 12:07:00 UTC

[jira] [Commented] (HIVE-21438) HiveStreamingConnection.toString doesn't print transaction batch

    [ https://issues.apache.org/jira/browse/HIVE-21438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17128237#comment-17128237 ] 

Hive QA commented on HIVE-21438:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12962456/0001-HIVE-21348-Add-currentTransactionBatch-and-staticPar.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/22776/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/22776/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-22776/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2020-06-08 12:05:30.483
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-22776/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2020-06-08 12:05:30.486
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at d5fb71f HIVE-23605: 'Wrong FS' error during _external_tables_info creation when staging location is remote(Pravin Kumar Sinha, reviewed by Aasha Medhi)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at d5fb71f HIVE-23605: 'Wrong FS' error during _external_tables_info creation when staging location is remote(Pravin Kumar Sinha, reviewed by Aasha Medhi)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2020-06-08 12:05:31.191
+ rm -rf ../yetus_PreCommit-HIVE-Build-22776
+ mkdir ../yetus_PreCommit-HIVE-Build-22776
+ git gc
+ cp -R . ../yetus_PreCommit-HIVE-Build-22776
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-22776/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh /data/hiveptest/working/scratch/build.patch
Trying to apply the patch with -p0
error: a/streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java: does not exist in index
error: a/streaming/src/java/org/apache/hive/streaming/TransactionBatch.java: does not exist in index
error: a/streaming/src/java/org/apache/hive/streaming/UnManagedSingleTransaction.java: does not exist in index
Trying to apply the patch with -p1
error: patch failed: streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java:146
Falling back to three-way merge...
Applied patch to 'streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java' with conflicts.
Going to apply patch with: git apply -p1
error: patch failed: streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java:146
Falling back to three-way merge...
Applied patch to 'streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java' with conflicts.
U streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-22776
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12962456 - PreCommit-HIVE-Build

> HiveStreamingConnection.toString doesn't print transaction batch
> ----------------------------------------------------------------
>
>                 Key: HIVE-21438
>                 URL: https://issues.apache.org/jira/browse/HIVE-21438
>             Project: Hive
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 3.1.1
>            Reporter: Stig Rohde Døssing
>            Assignee: Stig Rohde Døssing
>            Priority: Minor
>              Labels: pull-request-available
>         Attachments: 0001-HIVE-21348-Add-currentTransactionBatch-and-staticPar.patch
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> HiveStreamingConnection.toString doesn't contain the current transaction state. In hive-hcatalog-streaming, the transaction batch was exposed to the user, which allowed the application to log e.g. transaction id and state when errors occur. Some exceptions from TransactionBatch contain the current transaction id, but many don't.
> It would be nice if HiveStreamingConnection.toString also included the currentTransactionBatch.toString.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)