You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@heron.apache.org by GitBox <gi...@apache.org> on 2019/04/28 03:35:49 UTC
[GitHub] [incubator-heron] Vxider opened a new issue #3249: 'No such file or
directory" exception in standalone mode
Vxider opened a new issue #3249: 'No such file or directory" exception in standalone mode
URL: https://github.com/apache/incubator-heron/issues/3249
I have encountered a "No such file or directory" exception when submit job to a standalone mode cluster.
Here is the log:
```
+ CORE_RELEASE_FILE=heron-core.tar.gz
+ CORE_RELEASE_DIR=heron-core
+ TOPOLOGY_PACKAGE_FILE=topology.tar.gz
+ '[' -d /home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2 ']'
+ mkdir -p /home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2
+ cd /home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2
+ '[' false == true ']'
+ ln -s /home/libing/.heron/dist/heron-core heron-core
+ ./heron-core/bin/heron-downloader -u http://dell124:9000/api/v1/file/download/22497968-1ef0-4d80-a33d-bb4a115824e0-topology.tar.gz -f . -m local -p /home/libing/.heron/conf/standalone -d ./heron-core
Apr 27, 2019 10:22:49 PM org.apache.heron.common.config.ConfigReader loadFile
WARNING: Config file name cannot be null
Apr 27, 2019 10:22:49 PM org.apache.heron.common.config.ConfigReader loadFile
WARNING: Config file name cannot be null
+ echo 31441
+ trap 'kill -TERM $PID' TERM INT
+ PID=58578
+ wait 58578
+ ./heron-core/bin/heron-executor --topology-name=WindowedWordCount1 --topology-id=WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17 --topology-defn-file=WindowedWordCount1.defn --state-manager-connection=10Gdell124:2181 --state-manager-root=/heron --state-manager-config-file=./heron-conf/statemgr.yaml --tmaster-binary=./heron-core/bin/heron-tmaster --stmgr-binary=./heron-core/bin/heron-stmgr '--metrics-manager-classpath=./heron-core/lib/metricsmgr/*' '--instance-jvm-opts=""' --classpath=heron-streamlet-examples.jar --heron-internals-config-file=./heron-conf/heron_internals.yaml --override-config-file=./heron-conf/override.yaml --component-ram-map=random-sentences-source:1073741824,flatten-into-individual-words:1073741824,reduce-operation:1073741824,consumer1:1073741824 '--component-jvm-opts=""' --pkg-type=jar --topology-binary-file=heron-streamlet-examples.jar '--heron-java-home=${JAVA_HOME}' --heron-shell-binary=./heron-core/bin/heron-shell --cluster=standalone --role=libing --environment=default '--instance-classpath=./heron-core/lib/instance/*' --metrics-sinks-config-file=./heron-conf/metrics_sinks.yaml '--scheduler-classpath=./heron-core/lib/scheduler/*:./heron-core/lib/packing/*:./heron-core/lib/statemgr/*' --python-instance-binary=./heron-core/bin/heron-python-instance --cpp-instance-binary=./heron-core/bin/heron-cpp-instance '--metricscache-manager-classpath=./heron-core/lib/metricscachemgr/*' --metricscache-manager-mode=disabled --is-stateful=false '--checkpoint-manager-classpath=./heron-core/lib/ckptmgr/*:./heron-core/lib/statefulstorage/*:' --stateful-config-file=./heron-conf/stateful.yaml --checkpoint-manager-ram=1073741824 --health-manager-mode=disabled '--health-manager-classpath=./heron-core/lib/healthmgr/*' --shard=2 --master-port=27612 --tmaster-controller-port=29783 --tmaster-stats-port=24500 --shell-port=29010 --metrics-manager-port=20786 --scheduler-port=23938 --metricscache-manager-master-port=24923 --metricscache-manager-stats-port=28316 --checkpoint-manager-port=24884
Traceback (most recent call last):
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/.bootstrap/_pex/pex.py", line 365, in execute
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/.bootstrap/_pex/pex.py", line 293, in _wrap_coverage
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/.bootstrap/_pex/pex.py", line 325, in _wrap_profiling
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/.bootstrap/_pex/pex.py", line 408, in _execute
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/.bootstrap/_pex/pex.py", line 466, in execute_entry
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/.bootstrap/_pex/pex.py", line 471, in execute_module
File "/usr/lib64/python2.7/runpy.py", line 180, in run_module
fname, loader, pkg_name)
File "/usr/lib64/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1173, in <module>
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1170, in main
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1151, in start
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1098, in start_state_manager_watches
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/statemgrs/src/python/zkstatemanager.py", line 250, in get_packing_plan
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/statemgrs/src/python/zkstatemanager.py", line 266, in _get_packing_plan_with_watch
File "/home/libing/.pex/install/kazoo-1.3.1-py2-none-any.whl.00629d32ec52e32a542cc5a5c9ea17a8cc4c0659/kazoo-1.3.1-py2-none-any.whl/kazoo/recipe/watchers.py", line 123, in __call__
self._get_data()
File "/home/libing/.pex/install/kazoo-1.3.1-py2-none-any.whl.00629d32ec52e32a542cc5a5c9ea17a8cc4c0659/kazoo-1.3.1-py2-none-any.whl/kazoo/recipe/watchers.py", line 22, in wrapper
return func(*args, **kwargs)
File "/home/libing/.pex/install/kazoo-1.3.1-py2-none-any.whl.00629d32ec52e32a542cc5a5c9ea17a8cc4c0659/kazoo-1.3.1-py2-none-any.whl/kazoo/recipe/watchers.py", line 176, in _get_data
self._log_func_exception(data, stat, event)
File "/home/libing/.pex/install/kazoo-1.3.1-py2-none-any.whl.00629d32ec52e32a542cc5a5c9ea17a8cc4c0659/kazoo-1.3.1-py2-none-any.whl/kazoo/recipe/watchers.py", line 135, in _log_func_exception
result = self._func(data, stat)
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/statemgrs/src/python/zkstatemanager.py", line 272, in watch_packing_plan
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1089, in on_packing_plan_watch
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1041, in launch
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 1000, in get_commands_to_run
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 784, in _get_streaming_processes
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 572, in _get_java_instance_cmd
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 597, in _get_jvm_instance_options
File "/home/libing/.herondata/topologies/standalone/libing/WindowedWordCount159f5c1a5-277f-4aa3-8570-56ff55e65f17/container-2/heron-core/bin/heron-executor/heron/executor/src/python/heron_executor.py", line 670, in _get_jvm_version
File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
```
I have checked the "./heron-conf/" folder has all config files
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services