You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Sai Sai <sa...@yahoo.in> on 2014/03/14 10:20:36 UTC
File_bytes_read vs hdfs_bytes_read
Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
which gets displayed in the output of job.
Thanks
Sai
Re: File_bytes_read vs hdfs_bytes_read
Posted by Shahab Yunus <sh...@gmail.com>.
There is some explanation here as well (in case you haven't check that out
yet):
http://stackoverflow.com/questions/16634294/understanding-the-hadoop-file-system-counters
Regards,
Shahab
On Fri, Mar 14, 2014 at 5:32 AM, Vinayakumar B <vi...@huawei.com>wrote:
> Its simple,
>
>
>
> bytes read from local file system: File_bytes_read
>
>
>
> bytes read from HDFS file system: hdfs_bytes_read
>
>
>
> Regards,
>
> Vinayakumar B
>
>
>
> *From:* Sai Sai [mailto:saigraph@yahoo.in]
> *Sent:* 14 March 2014 14:51
> *To:* user@hadoop.apache.org
> *Subject:* File_bytes_read vs hdfs_bytes_read
>
>
>
> Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
>
> which gets displayed in the output of job.
>
> Thanks
>
> Sai
>
Re: File_bytes_read vs hdfs_bytes_read
Posted by Shahab Yunus <sh...@gmail.com>.
There is some explanation here as well (in case you haven't check that out
yet):
http://stackoverflow.com/questions/16634294/understanding-the-hadoop-file-system-counters
Regards,
Shahab
On Fri, Mar 14, 2014 at 5:32 AM, Vinayakumar B <vi...@huawei.com>wrote:
> Its simple,
>
>
>
> bytes read from local file system: File_bytes_read
>
>
>
> bytes read from HDFS file system: hdfs_bytes_read
>
>
>
> Regards,
>
> Vinayakumar B
>
>
>
> *From:* Sai Sai [mailto:saigraph@yahoo.in]
> *Sent:* 14 March 2014 14:51
> *To:* user@hadoop.apache.org
> *Subject:* File_bytes_read vs hdfs_bytes_read
>
>
>
> Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
>
> which gets displayed in the output of job.
>
> Thanks
>
> Sai
>
Re: File_bytes_read vs hdfs_bytes_read
Posted by Shahab Yunus <sh...@gmail.com>.
There is some explanation here as well (in case you haven't check that out
yet):
http://stackoverflow.com/questions/16634294/understanding-the-hadoop-file-system-counters
Regards,
Shahab
On Fri, Mar 14, 2014 at 5:32 AM, Vinayakumar B <vi...@huawei.com>wrote:
> Its simple,
>
>
>
> bytes read from local file system: File_bytes_read
>
>
>
> bytes read from HDFS file system: hdfs_bytes_read
>
>
>
> Regards,
>
> Vinayakumar B
>
>
>
> *From:* Sai Sai [mailto:saigraph@yahoo.in]
> *Sent:* 14 March 2014 14:51
> *To:* user@hadoop.apache.org
> *Subject:* File_bytes_read vs hdfs_bytes_read
>
>
>
> Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
>
> which gets displayed in the output of job.
>
> Thanks
>
> Sai
>
Re: File_bytes_read vs hdfs_bytes_read
Posted by Shahab Yunus <sh...@gmail.com>.
There is some explanation here as well (in case you haven't check that out
yet):
http://stackoverflow.com/questions/16634294/understanding-the-hadoop-file-system-counters
Regards,
Shahab
On Fri, Mar 14, 2014 at 5:32 AM, Vinayakumar B <vi...@huawei.com>wrote:
> Its simple,
>
>
>
> bytes read from local file system: File_bytes_read
>
>
>
> bytes read from HDFS file system: hdfs_bytes_read
>
>
>
> Regards,
>
> Vinayakumar B
>
>
>
> *From:* Sai Sai [mailto:saigraph@yahoo.in]
> *Sent:* 14 March 2014 14:51
> *To:* user@hadoop.apache.org
> *Subject:* File_bytes_read vs hdfs_bytes_read
>
>
>
> Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
>
> which gets displayed in the output of job.
>
> Thanks
>
> Sai
>
RE: File_bytes_read vs hdfs_bytes_read
Posted by Vinayakumar B <vi...@huawei.com>.
Its simple,
bytes read from local file system: File_bytes_read
bytes read from HDFS file system: hdfs_bytes_read
Regards,
Vinayakumar B
From: Sai Sai [mailto:saigraph@yahoo.in]
Sent: 14 March 2014 14:51
To: user@hadoop.apache.org
Subject: File_bytes_read vs hdfs_bytes_read
Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
which gets displayed in the output of job.
Thanks
Sai
RE: File_bytes_read vs hdfs_bytes_read
Posted by Vinayakumar B <vi...@huawei.com>.
Its simple,
bytes read from local file system: File_bytes_read
bytes read from HDFS file system: hdfs_bytes_read
Regards,
Vinayakumar B
From: Sai Sai [mailto:saigraph@yahoo.in]
Sent: 14 March 2014 14:51
To: user@hadoop.apache.org
Subject: File_bytes_read vs hdfs_bytes_read
Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
which gets displayed in the output of job.
Thanks
Sai
RE: File_bytes_read vs hdfs_bytes_read
Posted by Vinayakumar B <vi...@huawei.com>.
Its simple,
bytes read from local file system: File_bytes_read
bytes read from HDFS file system: hdfs_bytes_read
Regards,
Vinayakumar B
From: Sai Sai [mailto:saigraph@yahoo.in]
Sent: 14 March 2014 14:51
To: user@hadoop.apache.org
Subject: File_bytes_read vs hdfs_bytes_read
Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
which gets displayed in the output of job.
Thanks
Sai
RE: File_bytes_read vs hdfs_bytes_read
Posted by Vinayakumar B <vi...@huawei.com>.
Its simple,
bytes read from local file system: File_bytes_read
bytes read from HDFS file system: hdfs_bytes_read
Regards,
Vinayakumar B
From: Sai Sai [mailto:saigraph@yahoo.in]
Sent: 14 March 2014 14:51
To: user@hadoop.apache.org
Subject: File_bytes_read vs hdfs_bytes_read
Just wondering what is the diff between File_bytes_read vs hdfs_bytes_read
which gets displayed in the output of job.
Thanks
Sai