You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/06/09 16:26:01 UTC
[jira] [Work logged] (HIVE-21776) Replication fails to replicate a
UDF with jar on HDFS during incremental
[ https://issues.apache.org/jira/browse/HIVE-21776?focusedWorklogId=443045&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-443045 ]
ASF GitHub Bot logged work on HIVE-21776:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jun/20 16:25
Start Date: 09/Jun/20 16:25
Worklog Time Spent: 10m
Work Description: github-actions[bot] commented on pull request #642:
URL: https://github.com/apache/hive/pull/642#issuecomment-641143369
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Feel free to reach out on the dev@hive.apache.org list if the patch is in need of reviews.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 443045)
Time Spent: 1h 20m (was: 1h 10m)
> Replication fails to replicate a UDF with jar on HDFS during incremental
> ------------------------------------------------------------------------
>
> Key: HIVE-21776
> URL: https://issues.apache.org/jira/browse/HIVE-21776
> Project: Hive
> Issue Type: Bug
> Affects Versions: 4.0.0
> Reporter: Ashutosh Bapat
> Assignee: Ashutosh Bapat
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21776.01.patch, HIVE-21776.02.patch, HIVE-21776.03.patch, HIVE-21776.04.patch
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> When a UDF with jar on HDFS is replicated, we add the jar path to the dump. The dumped URL of jar has checksum and cmroot added to it. During load, we load the jar on target. ReplCopyTask handles the jar paths separately from the paths in _files and it uses the presence of checksum and cmroot for that decision. (Those two are not present in _files URL). If ReplChangeManager is not initialized during dump, dumped URL of jar does not contain checksum and cmroot and thus ReplCopyTask fails to copy the UDF jar to the target. This fails the repl load since the function can not be created. Fix is to initialize ReplChangeManager always.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)