[jira] [Commented] (IMPALA-9439) Make --scale a mandatory option in single_node_perf_run.py

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049782#comment-17049782 ] 

ASF subversion and git services commented on IMPALA-9439:
---------------------------------------------------------

Commit d3a2d73fda48fde5e35c2c2d92730d4c2c9a3eb9 in impala's branch refs/heads/master from Sahil Takiar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=d3a2d73 ]

IMPALA-9439: Make --scale a mandatory option in single_node_perf_run.py

This makes the --scale option mandatory when running
./bin/single_node_perf_run.py. If the option is not set, the script
attempts to run the workloads against the database
'[workload-name]None_[file-format]', which is typically not what the
user wants.

Makes some minor documentation improvements to the script.

Testing:
* Confirmed that running without the --scale option set causes the
  script to error out with a help message

Change-Id: I9ad13580f8f74388981a37d6960087d95cde574b
Reviewed-on: http://gerrit.cloudera.org:8080/15335
Reviewed-by: Tim Armstrong <ta...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Make --scale a mandatory option in single_node_perf_run.py
> ----------------------------------------------------------
>
>                 Key: IMPALA-9439
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9439
>             Project: IMPALA
>          Issue Type: Improvement
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>            Priority: Major
>
> Running {{bin/single_node_perf_run.py}} with {{--table_formats kudu}} currently fails with the following error:
> {code:java}
> Traceback (most recent call last):
>   File "./bin/run-workload.py", line 257, in <module>
>     workload_runners.append(WorkloadRunner(workload, scale_factor, config))
>   File "./tests/performance/workload_runner.py", line 71, in __init__
>     self._generate_test_vectors()
>   File "./tests/performance/workload_runner.py", line 88, in _generate_test_vectors
>     self._test_vectors.append(TableFormatInfo.create_from_string(dataset, tf))
>   File "./tests/common/test_dimensions.py", line 70, in create_from_string
>     raise ValueError, 'Invalid table format %s' % table_format_string
> ValueError: Invalid table format kudu 
> Traceback (most recent call last):
>   File "./bin/single_node_perf_run.py", line 348, in <module>
>     main()
>   File "./bin/single_node_perf_run.py", line 338, in main
>     perf_ab_test(options, args)
>   File "./bin/single_node_perf_run.py", line 230, in perf_ab_test
>     build(hash_a, options)
>   File "./bin/single_node_perf_run.py", line 111, in build
>     configured_call(buildall)
>   File "./bin/single_node_perf_run.py", line 87, in configured_call
>     return subprocess.check_call(["bash", "-c", cmd])
>   File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
>     raise CalledProcessError(retcode, cmd)
> subprocess.CalledProcessError: Command '['bash', '-c', 'source ./bin/impala-config.sh && ./buildall.sh -notests -release -noclean']' returned non-zero exit status 2{code}
> {{kudu/none}} and {{kudu/none/none}} fail as well with this error:
> {code:java}
> AnalysisException: Database does not exist: tpchNone_kudu {code}
> I think there is some handling of compression types / codecs that aren't applicable for Kudu, which are preventing this from working properly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org