You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by xeonmailinglist <xe...@gmail.com> on 2015/03/02 17:57:41 UTC
Copy data from local disc with WebHDFS?
Hi,
1 - I have HDFS running with WebHDFS protocol. I want to copy data from
local disk to HDFS, but I get the error below. How I copy data from the
local disk to HDFS?
|xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE"
HTTP/1.1 100 Continue
HTTP/1.1 405 HTTP method PUT is not supported by this URL
Date: Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Date: Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)
|
|$ netstat -plnet
tcp 0 0 192.168.56.101:8080 0.0.0.0:* LISTEN 1000 587397 8229/java
tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 115 8049 -
tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN 0 8336 -
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7102 -
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 104794 -
tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 1000 588404 8464/java
tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 1000 589155 8464/java
tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 1000 589169 8464/java
tcp 0 0 192.168.56.101:6600 0.0.0.0:* LISTEN 1000 587403 8229/java
tcp6 0 0 :::22 :::* LISTEN 0 7086 -
tcp6 0 0 ::1:631 :::* LISTEN 0 104793 -
|
2 - How I remove the Warning that I am always having every time I launch
a command in YARN?
|xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
|
Re: Copy data from local disc with WebHDFS?
Posted by xeon Mailinglist <xe...@gmail.com>.
1. I am using these 2 commands below to try to copy data from local disk to
HDFS. Unfortunately these commands are not working, and I don't understand
why they are not working. I have configured HDFS to use WebHDFS
protocol. How I copy data from the local disk to HDFS using WebHDfS
protocol?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *hdfs dfs -copyFromLocal ~/input1
webhdfs://192.168.56.101:8080/ <http://192.168.56.101:8080/> *
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might
have disabled stack guard. The VM will try to fix the stack guard now. It's
highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *curl -i -X PUT -T ~/input1
"http://192.168.56.101:8080/?op=CREATE"
<http://192.168.56.101:8080/?op=CREATE>*
HTTP/1.1 100 Continue HTTP/1.1 405 HTTP method PUT is not supported by this
URL Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)
2. Every time I launch a command in YARN I get a java hotspot warning
(warning below). How I remove the Java HotSpotWarning?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal
~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which
might have disabled stack guard. The VM will try to fix the stack
guard now.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.
Thanks,
On Monday, March 2, 2015, xeonmailinglist <xe...@gmail.com> wrote:
> Hi,
>
> 1 - I have HDFS running with WebHDFS protocol. I want to copy data from
> local disk to HDFS, but I get the error below. How I copy data from the
> local disk to HDFS?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
> 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
>
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE" <http://192.168.56.101:8080/?op=CREATE>
> HTTP/1.1 100 Continue
>
> HTTP/1.1 405 HTTP method PUT is not supported by this URL
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Content-Length: 0
> Server: Jetty(6.1.26)
>
> $ netstat -plnet
> tcp 0 0 192.168.56.101:8080 0.0.0.0:* LISTEN 1000 587397 8229/java
> tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 115 8049 -
> tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN 0 8336 -
> tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7102 -
> tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 104794 -
> tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 1000 588404 8464/java
> tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 1000 589155 8464/java
> tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 1000 589169 8464/java
> tcp 0 0 192.168.56.101:6600 0.0.0.0:* LISTEN 1000 587403 8229/java
> tcp6 0 0 :::22 :::* LISTEN 0 7086 -
> tcp6 0 0 ::1:631 :::* LISTEN 0 104793 -
>
> 2 - How I remove the Warning that I am always having every time I launch a
> command in YARN?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
>
>
>
>
>
Re: Copy data from local disc with WebHDFS?
Posted by xeon Mailinglist <xe...@gmail.com>.
1. I am using these 2 commands below to try to copy data from local disk to
HDFS. Unfortunately these commands are not working, and I don't understand
why they are not working. I have configured HDFS to use WebHDFS
protocol. How I copy data from the local disk to HDFS using WebHDfS
protocol?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *hdfs dfs -copyFromLocal ~/input1
webhdfs://192.168.56.101:8080/ <http://192.168.56.101:8080/> *
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might
have disabled stack guard. The VM will try to fix the stack guard now. It's
highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *curl -i -X PUT -T ~/input1
"http://192.168.56.101:8080/?op=CREATE"
<http://192.168.56.101:8080/?op=CREATE>*
HTTP/1.1 100 Continue HTTP/1.1 405 HTTP method PUT is not supported by this
URL Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)
2. Every time I launch a command in YARN I get a java hotspot warning
(warning below). How I remove the Java HotSpotWarning?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal
~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which
might have disabled stack guard. The VM will try to fix the stack
guard now.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.
Thanks,
On Monday, March 2, 2015, xeonmailinglist <xe...@gmail.com> wrote:
> Hi,
>
> 1 - I have HDFS running with WebHDFS protocol. I want to copy data from
> local disk to HDFS, but I get the error below. How I copy data from the
> local disk to HDFS?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
> 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
>
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE" <http://192.168.56.101:8080/?op=CREATE>
> HTTP/1.1 100 Continue
>
> HTTP/1.1 405 HTTP method PUT is not supported by this URL
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Content-Length: 0
> Server: Jetty(6.1.26)
>
> $ netstat -plnet
> tcp 0 0 192.168.56.101:8080 0.0.0.0:* LISTEN 1000 587397 8229/java
> tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 115 8049 -
> tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN 0 8336 -
> tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7102 -
> tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 104794 -
> tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 1000 588404 8464/java
> tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 1000 589155 8464/java
> tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 1000 589169 8464/java
> tcp 0 0 192.168.56.101:6600 0.0.0.0:* LISTEN 1000 587403 8229/java
> tcp6 0 0 :::22 :::* LISTEN 0 7086 -
> tcp6 0 0 ::1:631 :::* LISTEN 0 104793 -
>
> 2 - How I remove the Warning that I am always having every time I launch a
> command in YARN?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
>
>
>
>
>
Re: Copy data from local disc with WebHDFS?
Posted by xeon Mailinglist <xe...@gmail.com>.
1. I am using these 2 commands below to try to copy data from local disk to
HDFS. Unfortunately these commands are not working, and I don't understand
why they are not working. I have configured HDFS to use WebHDFS
protocol. How I copy data from the local disk to HDFS using WebHDfS
protocol?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *hdfs dfs -copyFromLocal ~/input1
webhdfs://192.168.56.101:8080/ <http://192.168.56.101:8080/> *
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might
have disabled stack guard. The VM will try to fix the stack guard now. It's
highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *curl -i -X PUT -T ~/input1
"http://192.168.56.101:8080/?op=CREATE"
<http://192.168.56.101:8080/?op=CREATE>*
HTTP/1.1 100 Continue HTTP/1.1 405 HTTP method PUT is not supported by this
URL Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)
2. Every time I launch a command in YARN I get a java hotspot warning
(warning below). How I remove the Java HotSpotWarning?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal
~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which
might have disabled stack guard. The VM will try to fix the stack
guard now.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.
Thanks,
On Monday, March 2, 2015, xeonmailinglist <xe...@gmail.com> wrote:
> Hi,
>
> 1 - I have HDFS running with WebHDFS protocol. I want to copy data from
> local disk to HDFS, but I get the error below. How I copy data from the
> local disk to HDFS?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
> 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
>
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE" <http://192.168.56.101:8080/?op=CREATE>
> HTTP/1.1 100 Continue
>
> HTTP/1.1 405 HTTP method PUT is not supported by this URL
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Content-Length: 0
> Server: Jetty(6.1.26)
>
> $ netstat -plnet
> tcp 0 0 192.168.56.101:8080 0.0.0.0:* LISTEN 1000 587397 8229/java
> tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 115 8049 -
> tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN 0 8336 -
> tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7102 -
> tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 104794 -
> tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 1000 588404 8464/java
> tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 1000 589155 8464/java
> tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 1000 589169 8464/java
> tcp 0 0 192.168.56.101:6600 0.0.0.0:* LISTEN 1000 587403 8229/java
> tcp6 0 0 :::22 :::* LISTEN 0 7086 -
> tcp6 0 0 ::1:631 :::* LISTEN 0 104793 -
>
> 2 - How I remove the Warning that I am always having every time I launch a
> command in YARN?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
>
>
>
>
>
Re: Copy data from local disc with WebHDFS?
Posted by xeon Mailinglist <xe...@gmail.com>.
1. I am using these 2 commands below to try to copy data from local disk to
HDFS. Unfortunately these commands are not working, and I don't understand
why they are not working. I have configured HDFS to use WebHDFS
protocol. How I copy data from the local disk to HDFS using WebHDfS
protocol?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *hdfs dfs -copyFromLocal ~/input1
webhdfs://192.168.56.101:8080/ <http://192.168.56.101:8080/> *
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might
have disabled stack guard. The VM will try to fix the stack guard now. It's
highly recommended that you fix the library with 'execstack -c <libfile>',
or link it with '-z noexecstack'.
15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000
failed on connection exception: java.net.ConnectException: Connection
refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
xubuntu@hadoop-coc-1:~/Programs/hadoop$ *curl -i -X PUT -T ~/input1
"http://192.168.56.101:8080/?op=CREATE"
<http://192.168.56.101:8080/?op=CREATE>*
HTTP/1.1 100 Continue HTTP/1.1 405 HTTP method PUT is not supported by this
URL Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache Date:
Mon, 02 Mar 2015 16:50:36 GMT
Pragma: no-cache
Content-Length: 0
Server: Jetty(6.1.26)
2. Every time I launch a command in YARN I get a java hotspot warning
(warning below). How I remove the Java HotSpotWarning?
xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal
~/input1 webhdfs://192.168.56.101:8080/
Java HotSpot(TM) Client VM warning: You have loaded library
/home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which
might have disabled stack guard. The VM will try to fix the stack
guard now.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.
Thanks,
On Monday, March 2, 2015, xeonmailinglist <xe...@gmail.com> wrote:
> Hi,
>
> 1 - I have HDFS running with WebHDFS protocol. I want to copy data from
> local disk to HDFS, but I get the error below. How I copy data from the
> local disk to HDFS?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
> 15/03/02 11:50:16 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
> copyFromLocal: Call From hadoop-coc-1/192.168.56.101 to hadoop-coc-1:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
>
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ curl -i -X PUT -T ~/input1 "http://192.168.56.101:8080/?op=CREATE" <http://192.168.56.101:8080/?op=CREATE>
> HTTP/1.1 100 Continue
>
> HTTP/1.1 405 HTTP method PUT is not supported by this URL
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Date: Mon, 02 Mar 2015 16:50:36 GMT
> Pragma: no-cache
> Content-Length: 0
> Server: Jetty(6.1.26)
>
> $ netstat -plnet
> tcp 0 0 192.168.56.101:8080 0.0.0.0:* LISTEN 1000 587397 8229/java
> tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 115 8049 -
> tcp 0 0 127.0.0.1:53 0.0.0.0:* LISTEN 0 8336 -
> tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 0 7102 -
> tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN 0 104794 -
> tcp 0 0 0.0.0.0:50010 0.0.0.0:* LISTEN 1000 588404 8464/java
> tcp 0 0 0.0.0.0:50075 0.0.0.0:* LISTEN 1000 589155 8464/java
> tcp 0 0 0.0.0.0:50020 0.0.0.0:* LISTEN 1000 589169 8464/java
> tcp 0 0 192.168.56.101:6600 0.0.0.0:* LISTEN 1000 587403 8229/java
> tcp6 0 0 :::22 :::* LISTEN 0 7086 -
> tcp6 0 0 ::1:631 :::* LISTEN 0 104793 -
>
> 2 - How I remove the Warning that I am always having every time I launch a
> command in YARN?
>
> xubuntu@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -copyFromLocal ~/input1 webhdfs://192.168.56.101:8080/
> Java HotSpot(TM) Client VM warning: You have loaded library /home/xubuntu/Programs/hadoop-2.6.0/lib/native/libhadoop.so which might have disabled stack guard. The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
>
>
>
>
>