You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/01/26 03:35:48 UTC
[GitHub] [hudi] lshg opened a new issue #2489: [SUPPORT]
lshg opened a new issue #2489:
URL: https://github.com/apache/hudi/issues/2489
hive (app)> SELECT
> projectid,
> provinceid,
> typeId,
> antistop
> FROM
> app.dwd_recommend_tender_ds
> WHERE
> createTime >= 1608280608479
> AND antistop != '' limit 2;
OK
projectid provinceid typeid antistop
7876350 150000 9 装修#扩建
7876350 150000 9 装修#扩建
Time taken: 0.133 seconds, Fetched: 2 row(s)
it is work !
but !
hive (app)> select count(1) as total from app.dwd_recommend_tender_ds;
Query ID = root_20210126113448_acb65504-b31b-4309-9d65-39c48743326e
Total jobs = 1
Launching Job 1 out of 1
Tez session was closed. Reopening...
Session re-established.
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 container INITIALIZING -1 0 0 -1 0 0
Reducer 2 container INITED 1 0 0 1 0 0
----------------------------------------------------------------------------------------------
VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 0.55 s
----------------------------------------------------------------------------------------------
Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1611208773582_0084_1_00, diagnostics=[Vertex vertex_1611208773582_0084_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: dwd_recommend_tender_ds initializer failed, vertex=vertex_1611208773582_0084_1_00 [Map 1], java.lang.NoSuchMethodError: org.apache.hudi.common.table.timeline.HoodieActiveTimeline.getCommitsTimeline()Lorg/apache/hudi/common/table/HoodieTimeline;
at org.apache.hudi.hadoop.HoodieParquetInputFormat.filterFileStatusForSnapshotMode(HoodieParquetInputFormat.java:238)
at org.apache.hudi.hadoop.HoodieParquetInputFormat.listStatus(HoodieParquetInputFormat.java:110)
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:442)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:561)
at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:196)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
]
Vertex killed, vertexName=Reducer 2, vertexId=vertex_1611208773582_0084_1_01, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1611208773582_0084_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1611208773582_0084_1_00, diagnostics=[Vertex vertex_1611208773582_0084_1_00 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: dwd_recommend_tender_ds initializer failed, vertex=vertex_1611208773582_0084_1_00 [Map 1], java.lang.NoSuchMethodError: org.apache.hudi.common.table.timeline.HoodieActiveTimeline.getCommitsTimeline()Lorg/apache/hudi/common/table/HoodieTimeline;
at org.apache.hudi.hadoop.HoodieParquetInputFormat.filterFileStatusForSnapshotMode(HoodieParquetInputFormat.java:238)
at org.apache.hudi.hadoop.HoodieParquetInputFormat.listStatus(HoodieParquetInputFormat.java:110)
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.addSplitsForGroup(HiveInputFormat.java:442)
at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:561)
at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:196)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269)
at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
]Vertex killed, vertexName=Reducer 2, vertexId=vertex_1611208773582_0084_1_01, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1611208773582_0084_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
hive (app)>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-771411421
@Ishg Do you have any update ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-767390678
It looks like you may be having multiple hudi bundles (or multiple versions) in the classpath of execution. Can you check if this is the case ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash closed issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
n3nash closed issue #2489:
URL: https://github.com/apache/hudi/issues/2489
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan edited a comment on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
nsivabalan edited a comment on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-810437684
gentle ping for response. once you respond, can you please remove "awaiting-user-response" label for the issue. If possible add "awaiting-community-help" label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] ishg commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
ishg commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-825061222
Just FYI this isn't me. The OP is @lshg (with a L, not I) 😄
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-771411421
@Ishg Do you have any update ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] lshg commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
lshg commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-768189870
think you发自我的华为手机-------- 原始邮件 --------主题：Re: [apache/hudi] [SUPPORT] (#2489)发件人：Balaji Varadarajan 收件人：apache/hudi 抄送：李仕辉 ,Author
It looks like you may be having multiple hudi bundles (or multiple versions) in the classpath of execution. Can you check if this is the case ?
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or unsubscribe.
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/apache/hudi/issues/2489#issuecomment-767390678",
"url": "https://github.com/apache/hudi/issues/2489#issuecomment-767390678",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-824525695
@ishg Since we haven't heard from you in over a month, closing this ticket. Please re-open if your issue is unresolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #2489: [SUPPORT]
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2489:
URL: https://github.com/apache/hudi/issues/2489#issuecomment-810437684
gentle ping for response.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org