You are viewing the static version of this archive.
For the interactive version, please visit: This page
Hi, As we all known, One Router can forward Rpc to some name services. In the scenario with Router high QPS, if one running NS slow down for some reason(like GC, network delays, packet loss etc), the slower NS will consume all handlers in Router. And the Router will no ability to forward Rpc to...
Hi all, Using Hadoop 2.X (Hadoop 2.7.2). Can anyone give me some idea as to how YARN guarantee the fraction of CPU of one container in Hadoop 2.X. For example, we only have one core, we give one container 0.3 core and we give another container 0.7 core. How this fraction is guaranteed in hadoop ...
Hi all, my first post here. I'm looking for some help with an issue I'm having attempting to format my Namenode. I'm running a HA configuration and have configured Kerberos for authentication. Additionally, I am running Hadoop using Docker Swarm. The issue I'm having is that when I attempt to forma...
Hi all, I'm running unit tests for Hadoop 2.8.5. I had a script that basically repeatedly run command mvn -Dtest=t1,t2,t3,... test with different test selections. And after each test command finishes, I need to get test running stats for other purposes. The problem is that I saw lingering java ...
Hi! I have mounted the HDFS root path over the HDFS NFS Gateway and I'm able to do all kind of file operations. Now I want to read a from a HDFS snapshot using the NFS mount, snapshot in hdfs works and I can see it using hdfs dfs -ls hdfs dfs -ls /data/standard/.snapshot/s20190507...
Hi All, I am trying to read a orc file and perform groupBy operation on it , but When i run it on a large data set we are facing the following error message. Input format of INPUT DATA |178111256| 107125374| |178111256| 107148618| |178111256| 107175361| |178111256| 107189910| schema , int ...
Hi, I'm working with a few clusters of 100+ nodes and I've been wondering how exactly the failover, as well as a cold start, works in respect to the block reports. I sometimes see failover times of 15-45 minutes waiting in the safe mode for all blocks to report in. Datanodes usually send a report...
I can't find error message from logs. I want to know the reason,full log please see the attachments. 2019-05-17 lk_hadoop 发件人："lk_hadoop"<lk_hadoop@163.com> 发送时间：2019-05-17 11:02 主题：Kylin Hive Column Cardinality Job killed by user. 收件人："user"<user@ky...
Hi, I have downloaded libhdfspp from the following link, and compiled it. https://github.com/apache/hadoop I found that some functions like hdfsWrite, hdfsHSync are not defined in this library. Also, when I was trying to replace the old libhdfs.so with this new library I am seeing some exce...
--------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org For additional commands, e-mail: user-help@hadoop.apache.org
Hi, I am designing an elastic rack formed of compute nodes, storage nodes and openstack control nodes. I plan to deploy: - Ceph on bare metal on storage nodes for ceph-osd and control nodes for monitor and metadata. - Openstack to orchestrate resources spanning the compute and storage ...
Hey, I am not sure if this is the correct mailing list for this question, but I will start here. Our client application needs to support accessing S3 buckets from hdfs. We can do this with the Java API using the s3a:// scheme, but also need a way to access the same files in S3 via the HDFS REST AP...