You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/09/10 22:37:00 UTC
[jira] [Work logged] (GOBBLIN-1543) Set Default for Work Unit Size
to Prevent Exception
[ https://issues.apache.org/jira/browse/GOBBLIN-1543?focusedWorklogId=649506&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-649506 ]
ASF GitHub Bot logged work on GOBBLIN-1543:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 10/Sep/21 22:36
Start Date: 10/Sep/21 22:36
Worklog Time Spent: 10m
Work Description: umustafi opened a new pull request #3394:
URL: https://github.com/apache/gobblin/pull/3394
Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
### JIRA
- [X] My PR addresses the following [Gobblin JIRA](https://issues.apache.org/jira/browse/GOBBLIN/) issues and references them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"
- https://issues.apache.org/jira/browse/GOBBLIN-1543
### Description
- [X] Here are some details about my PR, including screenshots (if applicable):
User encountered exception when summing work units for retention jobs that do not have size associated with it, so I am defaulting to progress reporting in terms of work units for cases that do not have size associated with it.
### Tests
- [X] My PR adds the following unit tests __OR__ does not need testing for this extremely good reason:
Tested manually with retention job with progress reporting turned on.
### Commits
- [X] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "[How to write a good git commit message](http://chris.beams.io/posts/git-commit/)":
1. Subject is separated from body by a blank line
2. Subject is limited to 50 characters
3. Subject does not end with a period
4. Subject uses the imperative mood ("add", not "adding")
5. Body wraps at 72 characters
6. Body explains "what" and "why", not "how"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@gobblin.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 649506)
Remaining Estimate: 0h
Time Spent: 10m
> Set Default for Work Unit Size to Prevent Exception
> ---------------------------------------------------
>
> Key: GOBBLIN-1543
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1543
> Project: Apache Gobblin
> Issue Type: Improvement
> Components: gobblin-service
> Reporter: Urmi Mustafi
> Assignee: Abhishek Tiwari
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Found error when summing work units for retention jobs that do not have size associated with it
>
> 02-09-2021 14:39:52 PDT gobblin-ivy_gobblin-ivy-download INFO - ERROR Failed to launch and run job job_ktwo_k2-cdp-company-features_DateTimeVerFinderBasedRetention_holdem_lasso_multi-hops-1-selfserve-timeaware-file-based-gen2-copy-azure_-809735922_1630618790955 due tonull: java.lang.NumberFormatException: null
> ...
> org.apache.gobblin.runtime.AbstractJobLauncher.lambda$sumWorkUnitsSizes$1(AbstractJobLauncher.java:666)
> 02-09-2021 14:39:52 PDT gobblin-ivy_gobblin-ivy-download INFO - at org.apache.gobblin.runtime.AbstractJobLauncher.sumWorkUnitsSizes(AbstractJobLauncher.java:666)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)