You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Jay Vyas <ja...@gmail.com> on 2014/03/29 17:33:00 UTC
Jobs fail immediately in local mode ?
Im running a job in local mode, and have found that it returns immediately,
switching job state to FAILURE.
>From the /tmp/hadoop-jay directory, I see that clearly an attempt was made
to run the job , and that some files seem to have been created.... But I
don't see any clues.
├── [ 102] local
│ └── [ 102] localRunner
│ └── [ 170] jay
│ ├── [ 68] job_local1531736937_0001
│ ├── [ 68] job_local218993552_0002
│ └── [ 136] jobcache
│ ├── [ 102] job_local1531736937_0001
│ │ └── [ 102]
attempt_local1531736937_0001_m_000000_0
│ │ └── [ 136] output
│ │ ├── [ 14] file.out
│ │ └── [ 32] file.out.index
│ └── [ 102] job_local218993552_0002
│ └── [ 102]
attempt_local218993552_0002_m_000000_0
│ └── [ 136] output
│ ├── [ 14] file.out
│ └── [ 32] file.out.index
└── [ 136] staging
├── [ 102] jay1531736937
└── [ 102] jay218993552
Any thoughts on how i can further diagnose whats happening and why my job
fails without a stacktrace? Because I dont have hadoop installed on the
system (i.e. im just running a java app that fires up a hadoop client
locally), I cant see anything in /var/log .
--
Jay Vyas
http://jayunit100.blogspot.com