You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by Yexi Jiang <ye...@gmail.com> on 2013/12/02 04:15:05 UTC
Run multiple hama jobs with LocalBSPRunner simultaneously
Hi, All,
I am currently writing the test cases for HAMA-822. I need to launch hama
jobs in two of my test cases (method). I found that when the test cases are
executed in parallel, it will cause error. When I comments any one of the
test case, they other one work properly.
Is it true that the LocalBSPRunner cannot simultaneously execute multiple
jobs?
The error message looks like the following:
-----------------------------------------------------------------------------
13/12/01 22:01:53 WARN fs.FSInputChecker: Problem opening checksum file:
file:/tmp/hama-parts/job_localrunner_0001/part-00000. Ignoring exception:
java.io.EOFException
13/12/01 22:01:53 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
java.io.EOFException
13/12/01 22:01:56 ERROR bsp.BSPJobClient: Error partitioning the input path.
java.io.IOException: Runtime partition failed for the job.
----------------------------------------------------------------------------
Re: Run multiple hama jobs with LocalBSPRunner simultaneously
Posted by Yexi Jiang <ye...@gmail.com>.
Even concurrently reads are not allowed?
I have two test cases read the same file.
2013/12/2 Edward J. Yoon <ed...@apache.org>
> Jobs can run but accessing one file concurrently is impossible.
>
> On Mon, Dec 2, 2013 at 12:15 PM, Yexi Jiang <ye...@gmail.com> wrote:
> > Hi, All,
> >
> > I am currently writing the test cases for HAMA-822. I need to launch hama
> > jobs in two of my test cases (method). I found that when the test cases
> are
> > executed in parallel, it will cause error. When I comments any one of the
> > test case, they other one work properly.
> >
> > Is it true that the LocalBSPRunner cannot simultaneously execute multiple
> > jobs?
> >
> > The error message looks like the following:
> >
> -----------------------------------------------------------------------------
> > 13/12/01 22:01:53 WARN fs.FSInputChecker: Problem opening checksum file:
> > file:/tmp/hama-parts/job_localrunner_0001/part-00000. Ignoring
> exception:
> > java.io.EOFException
> >
> > 13/12/01 22:01:53 ERROR bsp.LocalBSPRunner: Exception during BSP
> execution!
> >
> > java.io.EOFException
> >
> >
> > 13/12/01 22:01:56 ERROR bsp.BSPJobClient: Error partitioning the input
> path.
> >
> > java.io.IOException: Runtime partition failed for the job.
> >
> ----------------------------------------------------------------------------
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>
--
------
Yexi Jiang,
ECS 251, yjian004@cs.fiu.edu
School of Computer and Information Science,
Florida International University
Homepage: http://users.cis.fiu.edu/~yjian004/
Re: Run multiple hama jobs with LocalBSPRunner simultaneously
Posted by "Edward J. Yoon" <ed...@apache.org>.
Jobs can run but accessing one file concurrently is impossible.
On Mon, Dec 2, 2013 at 12:15 PM, Yexi Jiang <ye...@gmail.com> wrote:
> Hi, All,
>
> I am currently writing the test cases for HAMA-822. I need to launch hama
> jobs in two of my test cases (method). I found that when the test cases are
> executed in parallel, it will cause error. When I comments any one of the
> test case, they other one work properly.
>
> Is it true that the LocalBSPRunner cannot simultaneously execute multiple
> jobs?
>
> The error message looks like the following:
> -----------------------------------------------------------------------------
> 13/12/01 22:01:53 WARN fs.FSInputChecker: Problem opening checksum file:
> file:/tmp/hama-parts/job_localrunner_0001/part-00000. Ignoring exception:
> java.io.EOFException
>
> 13/12/01 22:01:53 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
>
> java.io.EOFException
>
>
> 13/12/01 22:01:56 ERROR bsp.BSPJobClient: Error partitioning the input path.
>
> java.io.IOException: Runtime partition failed for the job.
> ----------------------------------------------------------------------------
--
Best Regards, Edward J. Yoon
@eddieyoon