You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Lixiang Ao <ao...@gmail.com> on 2015/04/25 11:43:59 UTC
MapReduce Traces
Hi all,
I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
the characteristics. But I couldn't found any except for SWIM
<https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
contains several traces from Facebook. However, they're incomplete and lack
job output paths information.
Is there any other publicly available Mapreduce traces?
Thanks!
Lixiang
Re: MapReduce Traces
Posted by Lixiang Ao <ao...@gmail.com>.
That looks like some nice sample applications, but I'd like more realistic
and larger scale traces.
Thanks anyway.
On Sat, Apr 25, 2015 at 10:12 PM, Ted Yu <yu...@gmail.com> wrote:
> Have you looked at http://nuage.cs.washington.edu/repository.php ?
>
> Cheers
>
> On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
>
>> Hi all,
>>
>> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
>> the characteristics. But I couldn't found any except for SWIM
>> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
>> contains several traces from Facebook. However, they're incomplete and lack
>> job output paths information.
>>
>> Is there any other publicly available Mapreduce traces?
>>
>> Thanks!
>> Lixiang
>>
>
>
Re: MapReduce Traces
Posted by Lixiang Ao <ao...@gmail.com>.
That looks like some nice sample applications, but I'd like more realistic
and larger scale traces.
Thanks anyway.
On Sat, Apr 25, 2015 at 10:12 PM, Ted Yu <yu...@gmail.com> wrote:
> Have you looked at http://nuage.cs.washington.edu/repository.php ?
>
> Cheers
>
> On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
>
>> Hi all,
>>
>> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
>> the characteristics. But I couldn't found any except for SWIM
>> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
>> contains several traces from Facebook. However, they're incomplete and lack
>> job output paths information.
>>
>> Is there any other publicly available Mapreduce traces?
>>
>> Thanks!
>> Lixiang
>>
>
>
Re: MapReduce Traces
Posted by Lixiang Ao <ao...@gmail.com>.
That looks like some nice sample applications, but I'd like more realistic
and larger scale traces.
Thanks anyway.
On Sat, Apr 25, 2015 at 10:12 PM, Ted Yu <yu...@gmail.com> wrote:
> Have you looked at http://nuage.cs.washington.edu/repository.php ?
>
> Cheers
>
> On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
>
>> Hi all,
>>
>> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
>> the characteristics. But I couldn't found any except for SWIM
>> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
>> contains several traces from Facebook. However, they're incomplete and lack
>> job output paths information.
>>
>> Is there any other publicly available Mapreduce traces?
>>
>> Thanks!
>> Lixiang
>>
>
>
Re: MapReduce Traces
Posted by Lixiang Ao <ao...@gmail.com>.
That looks like some nice sample applications, but I'd like more realistic
and larger scale traces.
Thanks anyway.
On Sat, Apr 25, 2015 at 10:12 PM, Ted Yu <yu...@gmail.com> wrote:
> Have you looked at http://nuage.cs.washington.edu/repository.php ?
>
> Cheers
>
> On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
>
>> Hi all,
>>
>> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
>> the characteristics. But I couldn't found any except for SWIM
>> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
>> contains several traces from Facebook. However, they're incomplete and lack
>> job output paths information.
>>
>> Is there any other publicly available Mapreduce traces?
>>
>> Thanks!
>> Lixiang
>>
>
>
Re: MapReduce Traces
Posted by Ted Yu <yu...@gmail.com>.
Have you looked at http://nuage.cs.washington.edu/repository.php ?
Cheers
On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
> Hi all,
>
> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
> the characteristics. But I couldn't found any except for SWIM
> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
> contains several traces from Facebook. However, they're incomplete and lack
> job output paths information.
>
> Is there any other publicly available Mapreduce traces?
>
> Thanks!
> Lixiang
>
Re: MapReduce Traces
Posted by Ted Yu <yu...@gmail.com>.
Have you looked at http://nuage.cs.washington.edu/repository.php ?
Cheers
On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
> Hi all,
>
> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
> the characteristics. But I couldn't found any except for SWIM
> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
> contains several traces from Facebook. However, they're incomplete and lack
> job output paths information.
>
> Is there any other publicly available Mapreduce traces?
>
> Thanks!
> Lixiang
>
Re: MapReduce Traces
Posted by Ted Yu <yu...@gmail.com>.
Have you looked at http://nuage.cs.washington.edu/repository.php ?
Cheers
On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
> Hi all,
>
> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
> the characteristics. But I couldn't found any except for SWIM
> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
> contains several traces from Facebook. However, they're incomplete and lack
> job output paths information.
>
> Is there any other publicly available Mapreduce traces?
>
> Thanks!
> Lixiang
>
Re: MapReduce Traces
Posted by Ted Yu <yu...@gmail.com>.
Have you looked at http://nuage.cs.washington.edu/repository.php ?
Cheers
On Sat, Apr 25, 2015 at 2:43 AM, Lixiang Ao <ao...@gmail.com> wrote:
> Hi all,
>
> I'm looking for some real-world Mapreduce traces (jobhistory) to analyze
> the characteristics. But I couldn't found any except for SWIM
> <https://github.com/SWIMProjectUCB/SWIM/wiki/Workloads-repository> that
> contains several traces from Facebook. However, they're incomplete and lack
> job output paths information.
>
> Is there any other publicly available Mapreduce traces?
>
> Thanks!
> Lixiang
>