You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Kumar Jayapal <kj...@gmail.com> on 2017/08/03 21:30:51 UTC

HiBenchmark for spark in CDH error

I am not able to run HiBenchmark for spark in CDH cluster. Not able to
understand what is the mistake I am doing. can any one help

[root@hadoop3-main HiBench]#
bin/workloads/micro/wordcount/prepare/prepare.sh
bin/workloads/micro/wordcount/prepare
/u01/HiBench/bin/workloads/micro/wordcount/prepare + current dirctory
/u01/HiBench/bin/workloads/micro/wordcount/prepare/../../../../../ + Root
Directory
/u01/HiBench/bin/workloads/micro/wordcount/prepare/../../../../../conf/workloads/micro/wordcount.conf
patching args=
Parsing conf: /u01/HiBench/conf/hadoop.conf
Parsing conf: /u01/HiBench/conf/hibench.conf
Parsing conf: /u01/HiBench/conf/spark.conf
Parsing conf: /u01/HiBench/conf/workloads/micro/wordcount.conf
Traceback (most recent call last):
  File "/u01/HiBench/bin/functions/load_config.py", line 712, in <module>
    load_config(conf_root, workload_configFile, workload_folder,
patching_config)
  File "/u01/HiBench/bin/functions/load_config.py", line 217, in load_config
    generate_optional_value()
  File "/u01/HiBench/bin/functions/load_config.py", line 636, in
generate_optional_value
    probe_hadoop_examples_test_jars()
  File "/u01/HiBench/bin/functions/load_config.py", line 436, in
probe_hadoop_examples_test_jars
    examples_test_jars_candidate_list, "hibench.hadoop.examples.test.jar")
  File "/u01/HiBench/bin/functions/load_config.py", line 127, in
exactly_one_file
    assert 0, "No files found under certain path(s), please set `" +
config_name + "` manually"
AssertionError: No files found under certain path(s), please set
`hibench.hadoop.examples.test.jar` manually
/u01/HiBench/bin/functions/workload_functions.sh: line 38: .: filename
argument required
.: usage: . filename [arguments]
start HadoopPrepareWordcount bench
bin/workloads/micro/wordcount/prepare/prepare.sh: line 31: INPUT_HDFS:
unbound variable






Thanks
Jay