You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by 闫昆 <ya...@gmail.com> on 2013/08/02 02:54:05 UTC
importtsv issure
Hi all
I use importtsv tools load data to HBase ,but I just load data of about 5GB
and HDFS like this
NodeLast
ContactAdmin StateConfigured
Capacity (GB)Used
(GB)Non DFS
Used (GB)Remaining
(GB)Used
(%)Used
(%)Remaining
(%)BlocksBlock Pool
Used (GB)Block Pool
Used (%)> BlocksFailed
Volumeshydra0003<http://hydra0003:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020>
1In Service92.2372.223.9816.0378.3017.39121372.2278.300hydra0004<http://hydra0004:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020>
0In Service92.2369.343.9218.9775.1820.57118369.3475.180hydra0005<http://hydra0005:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020>
2In Service176.6259.9557.6159.0733.9433.4498759.9533.940hydra0006<http://hydra0006:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020>
1In Service92.2367.854.2620.1373.5621.82115367.8573.560hydra0007<http://hydra0007:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020>
1In Service176.6255.718.21112.7131.5463.8195955.7131.540
the 3,4,7 is regionserver local and why the HBase use to mang space ,In my
HDFS just store 5GB data
my hbase table have one column family and 151 column...
who can help me ?
Thanks
Yan
Re: importtsv issure
Posted by 闫昆 <ya...@gmail.com>.
I use hbase-0.94.6-cdh4.3.0
Total about 16Millions rows and data size about 4-5GB
I am sorry my englishi is poor,..
Thanks
Yu
2013/8/2 Ted Yu <yu...@gmail.com>
> By snapshot I meant the status of hdfs, shown in your first email.
>
> Which HBase 0.94 release were you using ?
>
> The 2Millions below refer to number of rows or amount of data ?
>
> On Thu, Aug 1, 2013 at 6:14 PM, 闫昆 <ya...@gmail.com> wrote:
>
> > my hbase 0.94 I am not sure use snapshot my hbase-site.xml not
> > configuration snapshot .
> > this is my first load data to hbase
> > but first load data 2Millions
> > second load data 2Millions
> > three load data 10Millions
> > In same hbase table 'data_rk'
> >
> >
> >
> > 2013/8/2 Ted Yu <yu...@gmail.com>
> >
> > > The following snapshot was taken after the loading, right ?
> > >
> > > Did you happen to take snapshot before the loading ?
> > >
> > > Was the table empty before loading ?
> > >
> > > Cheers
> > >
> > > On Thu, Aug 1, 2013 at 5:54 PM, 闫昆 <ya...@gmail.com> wrote:
> > >
> > > > Hi all
> > > > I use importtsv tools load data to HBase ,but I just load data of
> about
> > > 5GB
> > > > and HDFS like this
> > > >
> > > > NodeLast
> > > > ContactAdmin StateConfigured
> > > > Capacity (GB)Used
> > > > (GB)Non DFS
> > > > Used (GB)Remaining
> > > > (GB)Used
> > > > (%)Used
> > > > (%)Remaining
> > > > (%)BlocksBlock Pool
> > > > Used (GB)Block Pool
> > > > Used (%)> BlocksFailed
> > > > Volumeshydra0003<
> > > >
> > >
> >
> http://hydra0003:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > > >
> > > > 1In Service92.2372.223.9816.0378.3017.39121372.2278.300hydra0004<
> > > >
> > >
> >
> http://hydra0004:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > > >
> > > > 0In Service92.2369.343.9218.9775.1820.57118369.3475.180hydra0005<
> > > >
> > >
> >
> http://hydra0005:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > > >
> > > > 2In Service176.6259.9557.6159.0733.9433.4498759.9533.940hydra0006<
> > > >
> > >
> >
> http://hydra0006:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > > >
> > > > 1In Service92.2367.854.2620.1373.5621.82115367.8573.560hydra0007<
> > > >
> > >
> >
> http://hydra0007:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > > >
> > > > 1In Service176.6255.718.21112.7131.5463.8195955.7131.540
> > > > the 3,4,7 is regionserver local and why the HBase use to mang space
> ,In
> > > my
> > > > HDFS just store 5GB data
> > > > my hbase table have one column family and 151 column...
> > > > who can help me ?
> > > > Thanks
> > > > Yan
> > > >
> > >
> >
>
Re: importtsv issure
Posted by Ted Yu <yu...@gmail.com>.
By snapshot I meant the status of hdfs, shown in your first email.
Which HBase 0.94 release were you using ?
The 2Millions below refer to number of rows or amount of data ?
On Thu, Aug 1, 2013 at 6:14 PM, 闫昆 <ya...@gmail.com> wrote:
> my hbase 0.94 I am not sure use snapshot my hbase-site.xml not
> configuration snapshot .
> this is my first load data to hbase
> but first load data 2Millions
> second load data 2Millions
> three load data 10Millions
> In same hbase table 'data_rk'
>
>
>
> 2013/8/2 Ted Yu <yu...@gmail.com>
>
> > The following snapshot was taken after the loading, right ?
> >
> > Did you happen to take snapshot before the loading ?
> >
> > Was the table empty before loading ?
> >
> > Cheers
> >
> > On Thu, Aug 1, 2013 at 5:54 PM, 闫昆 <ya...@gmail.com> wrote:
> >
> > > Hi all
> > > I use importtsv tools load data to HBase ,but I just load data of about
> > 5GB
> > > and HDFS like this
> > >
> > > NodeLast
> > > ContactAdmin StateConfigured
> > > Capacity (GB)Used
> > > (GB)Non DFS
> > > Used (GB)Remaining
> > > (GB)Used
> > > (%)Used
> > > (%)Remaining
> > > (%)BlocksBlock Pool
> > > Used (GB)Block Pool
> > > Used (%)> BlocksFailed
> > > Volumeshydra0003<
> > >
> >
> http://hydra0003:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > >
> > > 1In Service92.2372.223.9816.0378.3017.39121372.2278.300hydra0004<
> > >
> >
> http://hydra0004:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > >
> > > 0In Service92.2369.343.9218.9775.1820.57118369.3475.180hydra0005<
> > >
> >
> http://hydra0005:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > >
> > > 2In Service176.6259.9557.6159.0733.9433.4498759.9533.940hydra0006<
> > >
> >
> http://hydra0006:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > >
> > > 1In Service92.2367.854.2620.1373.5621.82115367.8573.560hydra0007<
> > >
> >
> http://hydra0007:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > > >
> > > 1In Service176.6255.718.21112.7131.5463.8195955.7131.540
> > > the 3,4,7 is regionserver local and why the HBase use to mang space ,In
> > my
> > > HDFS just store 5GB data
> > > my hbase table have one column family and 151 column...
> > > who can help me ?
> > > Thanks
> > > Yan
> > >
> >
>
Re: importtsv issure
Posted by 闫昆 <ya...@gmail.com>.
my hbase 0.94 I am not sure use snapshot my hbase-site.xml not
configuration snapshot .
this is my first load data to hbase
but first load data 2Millions
second load data 2Millions
three load data 10Millions
In same hbase table 'data_rk'
2013/8/2 Ted Yu <yu...@gmail.com>
> The following snapshot was taken after the loading, right ?
>
> Did you happen to take snapshot before the loading ?
>
> Was the table empty before loading ?
>
> Cheers
>
> On Thu, Aug 1, 2013 at 5:54 PM, 闫昆 <ya...@gmail.com> wrote:
>
> > Hi all
> > I use importtsv tools load data to HBase ,but I just load data of about
> 5GB
> > and HDFS like this
> >
> > NodeLast
> > ContactAdmin StateConfigured
> > Capacity (GB)Used
> > (GB)Non DFS
> > Used (GB)Remaining
> > (GB)Used
> > (%)Used
> > (%)Remaining
> > (%)BlocksBlock Pool
> > Used (GB)Block Pool
> > Used (%)> BlocksFailed
> > Volumeshydra0003<
> >
> http://hydra0003:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > >
> > 1In Service92.2372.223.9816.0378.3017.39121372.2278.300hydra0004<
> >
> http://hydra0004:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > >
> > 0In Service92.2369.343.9218.9775.1820.57118369.3475.180hydra0005<
> >
> http://hydra0005:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > >
> > 2In Service176.6259.9557.6159.0733.9433.4498759.9533.940hydra0006<
> >
> http://hydra0006:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > >
> > 1In Service92.2367.854.2620.1373.5621.82115367.8573.560hydra0007<
> >
> http://hydra0007:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> > >
> > 1In Service176.6255.718.21112.7131.5463.8195955.7131.540
> > the 3,4,7 is regionserver local and why the HBase use to mang space ,In
> my
> > HDFS just store 5GB data
> > my hbase table have one column family and 151 column...
> > who can help me ?
> > Thanks
> > Yan
> >
>
Re: importtsv issure
Posted by Ted Yu <yu...@gmail.com>.
The following snapshot was taken after the loading, right ?
Did you happen to take snapshot before the loading ?
Was the table empty before loading ?
Cheers
On Thu, Aug 1, 2013 at 5:54 PM, 闫昆 <ya...@gmail.com> wrote:
> Hi all
> I use importtsv tools load data to HBase ,but I just load data of about 5GB
> and HDFS like this
>
> NodeLast
> ContactAdmin StateConfigured
> Capacity (GB)Used
> (GB)Non DFS
> Used (GB)Remaining
> (GB)Used
> (%)Used
> (%)Remaining
> (%)BlocksBlock Pool
> Used (GB)Block Pool
> Used (%)> BlocksFailed
> Volumeshydra0003<
> http://hydra0003:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> >
> 1In Service92.2372.223.9816.0378.3017.39121372.2278.300hydra0004<
> http://hydra0004:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> >
> 0In Service92.2369.343.9218.9775.1820.57118369.3475.180hydra0005<
> http://hydra0005:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> >
> 2In Service176.6259.9557.6159.0733.9433.4498759.9533.940hydra0006<
> http://hydra0006:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> >
> 1In Service92.2367.854.2620.1373.5621.82115367.8573.560hydra0007<
> http://hydra0007:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F&nnaddr=192.5.1.50:8020
> >
> 1In Service176.6255.718.21112.7131.5463.8195955.7131.540
> the 3,4,7 is regionserver local and why the HBase use to mang space ,In my
> HDFS just store 5GB data
> my hbase table have one column family and 151 column...
> who can help me ?
> Thanks
> Yan
>