You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by fe...@gmail.com on 2010/03/24 14:22:26 UTC

fuse_dfs_wrapper && fuse_dfs block size

Hello

How to specify not default (64 Mb) block size for fuse_dfs !?

In hdfs-site.xml 32MB:

  <property>
                <name>dfs.block.size</name>
                <value>33554432</value>
  </property>

via command line hadoop dfs -copyFromLocal ...... - all newly created
blocks - 32Mb,

but fuse_dfs after mounting creates blocks with default 64Mb size !

Best regards,
Sergey R.

Re: fuse_dfs_wrapper && fuse_dfs block size

Posted by fe...@gmail.com.

Thanks, you are right. Solved.

2010/3/25 zhuweimin <xi...@tsm.kddilabs.jp>:
> Hi
>
>>
>> How to specify not default (64 Mb) block size for fuse_dfs !?
>>
> Because hdfs-site.xml not in CLASSHPATH in the file of fuse_dfs_wrapper.sh.
> So you need to edit the fuse_dfs_wrapper.sh and add one line
>
> export CLASSPATH=<the directory of your hdfs-site.xml>
>
> before this part
>
> for f in ls $HADOOP_HOME/lib/*.jar $HADOOP_HOME/*.jar ; do
>  export CLASSPATH=$CLASSPATH:$f
> done
>
> I wish it can resolve your question.
>
>
>> -----Original Message-----
>> From: fenix.serega@gmail.com [mailto:fenix.serega@gmail.com]
>> Sent: Wednesday, March 24, 2010 10:22 PM
>> To: hdfs-user@hadoop.apache.org
>> Subject: fuse_dfs_wrapper && fuse_dfs block size
>>
>> Hello
>>
>> How to specify not default (64 Mb) block size for fuse_dfs !?
>>
>> In hdfs-site.xml 32MB:
>>
>>   <property>
>>                 <name>dfs.block.size</name>
>>                 <value>33554432</value>
>>   </property>
>>
>> via command line hadoop dfs -copyFromLocal ...... - all newly created
>> blocks - 32Mb,
>>
>> but fuse_dfs after mounting creates blocks with default 64Mb size !
>>
>> Best regards,
>> Sergey R.
>
>
>

RE: fuse_dfs_wrapper && fuse_dfs block size

Posted by zhuweimin <xi...@tsm.kddilabs.jp>.

Hi

> 
> How to specify not default (64 Mb) block size for fuse_dfs !?
>
Because hdfs-site.xml not in CLASSHPATH in the file of fuse_dfs_wrapper.sh.
So you need to edit the fuse_dfs_wrapper.sh and add one line 

export CLASSPATH=<the directory of your hdfs-site.xml>

before this part 

for f in ls $HADOOP_HOME/lib/*.jar $HADOOP_HOME/*.jar ; do
  export CLASSPATH=$CLASSPATH:$f
done

I wish it can resolve your question.


> -----Original Message-----
> From: fenix.serega@gmail.com [mailto:fenix.serega@gmail.com]
> Sent: Wednesday, March 24, 2010 10:22 PM
> To: hdfs-user@hadoop.apache.org
> Subject: fuse_dfs_wrapper && fuse_dfs block size
> 
> Hello
> 
> How to specify not default (64 Mb) block size for fuse_dfs !?
> 
> In hdfs-site.xml 32MB:
> 
>   <property>
>                 <name>dfs.block.size</name>
>                 <value>33554432</value>
>   </property>
> 
> via command line hadoop dfs -copyFromLocal ...... - all newly created
> blocks - 32Mb,
> 
> but fuse_dfs after mounting creates blocks with default 64Mb size !
> 
> Best regards,
> Sergey R.