You are viewing the static version of this archive.
For the interactive version, please visit: This page
Hi, I am trying to move an application to Java 10 but I get this error. I can't find it in JIRA, has anyone already seen it Below the error Enrico ava.lang.ExceptionInInitializerError at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:78) at org.apache.hadoop.conf.Configurati...
Hi, Well, Hadoop with authentication works with login/password-pattern Kerberos . However, Kerberos could work with certicate-based authentication too. Is Hadoop supporting Kerberos authentication with certificate? To be more precise (or straight to the point, if you want): is Hadoop working when...
Hi, I used TestDFSIO to test the HDFS’s performance, but I found that I can't run concurrent map task when specifying -nrFiles larger than 1. The command that I used is like this "hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.0.0-tests.jar TestDFSIO -write -nrFiles 4 -file...
Dear Kwak: "BUILDING.txt" in root dir of hadoop source code dir. it contains some ways to build hadoop source code. I suggest you use the way of docker to build hadoop source code. According my experience, you needn't changing java classpath and hadoop configuration parameter, just replace t...
Hello, I want to see JobHistory logs, which can be fed as input to the Rumen<https://hadoop.apache.org/docs/r2.8.3/hadoop-rumen/Rumen.html>. More specifically, I am interested in knowing input format for the Gridmix<https://hadoop.apache.org/docs/r2.8.3/hadoop-gridmix/GridMix.html>. I found this ...
Hi, I'm building a monitoring system for Hadoop and want to set up default alerts (threshold or anomaly) on 2-3 key metrics everyone who uses Hadoop would typically want to alert on, but I don't yet have production-grade experience with Hadoop. Alert rules have to be generally useful, so can't be o...
HiIn hdfs federation mode, when we use a mountable to mount a nonexistent hdfs path to views, it is obviously impossible to put file to this viewfs path as it is not exist. However, if we try to mkdir this viewfs path, it cannot be created because cannot create a folder under InternalDirOfViewfs. Wh...
We currently run journalnodes together with datanodes and they share the same mount point for both the data dir and edits dir. We ran into the issue where this shared mount point volume used for the datanode got full and thus the journal node was unable to start due to insufficient space. How woul...
I want to design an authentication mechanism with the following details. 1. Key information is saved in core-site.xml of the HDFS clients. 2. For request, rpc client send the key to rpc server. 3. The namenode verifies the key when receiving it. My question is, how can the rpc client send the key to...
Hi All, I am following the below guide to setup Docker container run_time but face some non-trivial errors at least for my level. Would you please comment if you have some idea about the root-cause? http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/DockerContainers.html After the ...
Hi, I'm trying to use distcp (org.apache.hadoop.tools.DistCp) out of a simple java program to copy files from HDFS to S3 storage. This works quite fine, except that it is very slow. Copying the files to the local disk is also not much faster. It seems like files are copied sequentially. My unde...