You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@gobblin.apache.org by ap...@gmail.com on 2019/10/17 07:43:27 UTC
Apache Gobblin Gitter messages at 2019/10/17 00:43:26
#### ![](https://avatars0.githubusercontent.com/u/7193733?v=4&s=60) Jin Fu
Xie (xring)
**[2019-10-17T02:26:48.399Z]**
Hi
I'm running Gobblin(0.14.0) in MR mode with Kafka2HDFS task, from Yarn UI the
job has `FINISHED` with `SUCCEEDED` final status, but I got this log in fail
log
{
"job name": "GobblinKafkaQuickStart",
"job id": "job_GobblinKafkaQuickStart_1571220849826",
"job state": "FAILED",
"start time": 1571220852348,
"end time": 1571220867576,
"duration": 15228,
"tasks": 1,
"completed tasks": 0,
"datasetUrn": "",
"task states": [
{
"task id": "task_GobblinKafkaQuickStart_1571220849826_0",
"task state": "PENDING",
"start time": 0,
"end time": 0,
"duration": 0,
"retry count": 0
}
]
}
which led to no data write to HDFS (with config job.commit.policy=successful),
if run with default commit policy an exception
`java.util.concurrent.ExecutionException: java.lang.RuntimeException: Not
committing dataset of job job_gobblin-demo_1571218868242 with commit policy
COMMIT_ON_FULL_SUCCESS and state FAILED` occurred.
any idea how to investigate this issue?
* * *
#### ![](https://avatars1.githubusercontent.com/u/1339772?v=4&s=60) Tamas
Nemeth (treff7es)
**[2019-10-17T06:54:47.098Z]** Could you check the yarn logs for the failing
job?
* * *