You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@gobblin.apache.org by ap...@gmail.com on 2019/10/17 07:43:27 UTC

Apache Gobblin Gitter messages at 2019/10/17 00:43:26

####  ![](https://avatars0.githubusercontent.com/u/7193733?v=4&s=60) Jin Fu
Xie (xring)

**[2019-10-17T02:26:48.399Z]**

Hi  
I'm running Gobblin(0.14.0) in MR mode with Kafka2HDFS task, from Yarn UI the
job has `FINISHED` with `SUCCEEDED` final status, but I got this log in fail
log

    
    
    {
        "job name": "GobblinKafkaQuickStart",
        "job id": "job_GobblinKafkaQuickStart_1571220849826",
        "job state": "FAILED",
        "start time": 1571220852348,
        "end time": 1571220867576,
        "duration": 15228,
        "tasks": 1,
        "completed tasks": 0,
        "datasetUrn": "",
        "task states": [
            {
                "task id": "task_GobblinKafkaQuickStart_1571220849826_0",
                "task state": "PENDING",
                "start time": 0,
                "end time": 0,
                "duration": 0,
                "retry count": 0
            }
        ]
    }

which led to no data write to HDFS (with config job.commit.policy=successful),
if run with default commit policy an exception
`java.util.concurrent.ExecutionException: java.lang.RuntimeException: Not
committing dataset of job job_gobblin-demo_1571218868242 with commit policy
COMMIT_ON_FULL_SUCCESS and state FAILED` occurred.

any idea how to investigate this issue?

* * *

####  ![](https://avatars1.githubusercontent.com/u/1339772?v=4&s=60) Tamas
Nemeth (treff7es)

**[2019-10-17T06:54:47.098Z]** Could you check the yarn logs for the failing
job?

* * *