You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by John Omernik <jo...@omernik.com> on 2015/04/29 20:26:51 UTC
Storm Mesos Error
Greetings all,
I got my storm nimbus running, but when I try to run a test topology, the
task enters a "lost" state and I get the below in my stderr on the
sandbox. Note, the URL for the storm.yaml works fine, not sure why it's
causing an issue on the cp.
cp: cannot create regular file `storm-mesos*/conf': No such file or
directory
Full:
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0429 13:20:08.873922 5061 fetcher.cpp:76] Fetching URI
'file:///mapr/brewpot/mesos/storm-mesos-0.9.3.tgz'
I0429 13:20:08.874048 5061 fetcher.cpp:179] Copying resource from
'/mapr/brewpot/mesos/storm-mesos-0.9.3.tgz' to
'/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
I0429 13:20:09.103682 5061 fetcher.cpp:64] Extracted resource
'/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm-mesos-0.9.3.tgz'
into
'/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
I0429 13:20:09.109590 5061 fetcher.cpp:76] Fetching URI '
http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml'
I0429 13:20:09.109658 5061 fetcher.cpp:126] Downloading '
http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml' to
'/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm.yaml'
cp: cannot create regular file `storm-mesos*/conf': No such file or
directory
Re: Storm Mesos Error
Posted by Tim Chen <ti...@mesosphere.io>.
We'll need to fix the README for sure, thanks for reporting!
Tim
On Wed, Apr 29, 2015 at 11:39 AM, John Omernik <jo...@omernik.com> wrote:
> Thanks Tim. That fixed it. I unpacked, renamed to storm-mesos-0.9.3 and
> repacked, copied to hdfs and executed, all is well... that's a bit unclear
> to us n00bs in the audience, but I explained verbose here to help anyone
> else who made the same mistake as me.
>
>
>
> On Wed, Apr 29, 2015 at 1:34 PM, John Omernik <jo...@omernik.com> wrote:
>
>> I used the bin/build-release.sh package
>>
>> and it put in all in a folder named apache-storm-0.9.3... that's probably
>> my problem? :)
>>
>> On Wed, Apr 29, 2015 at 1:30 PM, Tim Chen <ti...@mesosphere.io> wrote:
>>
>>> Hi John,
>>>
>>> Does your storm-mesos tar ball as a folder storm-mesos-0.9.3 in there?
>>>
>>> Tim
>>>
>>> On Wed, Apr 29, 2015 at 11:26 AM, John Omernik <jo...@omernik.com> wrote:
>>>
>>>> Greetings all,
>>>>
>>>> I got my storm nimbus running, but when I try to run a test topology,
>>>> the task enters a "lost" state and I get the below in my stderr on the
>>>> sandbox. Note, the URL for the storm.yaml works fine, not sure why it's
>>>> causing an issue on the cp.
>>>>
>>>>
>>>>
>>>>
>>>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>>>> directory
>>>>
>>>> Full:
>>>>
>>>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>>>> I0429 13:20:08.873922 5061 fetcher.cpp:76] Fetching URI
>>>> 'file:///mapr/brewpot/mesos/storm-mesos-0.9.3.tgz'
>>>> I0429 13:20:08.874048 5061 fetcher.cpp:179] Copying resource from
>>>> '/mapr/brewpot/mesos/storm-mesos-0.9.3.tgz' to
>>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>>>> I0429 13:20:09.103682 5061 fetcher.cpp:64] Extracted resource
>>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm-mesos-0.9.3.tgz'
>>>> into
>>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>>>> I0429 13:20:09.109590 5061 fetcher.cpp:76] Fetching URI '
>>>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml'
>>>> I0429 13:20:09.109658 5061 fetcher.cpp:126] Downloading '
>>>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml' to
>>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm.yaml'
>>>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>>>> directory
>>>>
>>>
>>>
>>
>
Re: Storm Mesos Error
Posted by John Omernik <jo...@omernik.com>.
Thanks Tim. That fixed it. I unpacked, renamed to storm-mesos-0.9.3 and
repacked, copied to hdfs and executed, all is well... that's a bit unclear
to us n00bs in the audience, but I explained verbose here to help anyone
else who made the same mistake as me.
On Wed, Apr 29, 2015 at 1:34 PM, John Omernik <jo...@omernik.com> wrote:
> I used the bin/build-release.sh package
>
> and it put in all in a folder named apache-storm-0.9.3... that's probably
> my problem? :)
>
> On Wed, Apr 29, 2015 at 1:30 PM, Tim Chen <ti...@mesosphere.io> wrote:
>
>> Hi John,
>>
>> Does your storm-mesos tar ball as a folder storm-mesos-0.9.3 in there?
>>
>> Tim
>>
>> On Wed, Apr 29, 2015 at 11:26 AM, John Omernik <jo...@omernik.com> wrote:
>>
>>> Greetings all,
>>>
>>> I got my storm nimbus running, but when I try to run a test topology,
>>> the task enters a "lost" state and I get the below in my stderr on the
>>> sandbox. Note, the URL for the storm.yaml works fine, not sure why it's
>>> causing an issue on the cp.
>>>
>>>
>>>
>>>
>>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>>> directory
>>>
>>> Full:
>>>
>>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>>> I0429 13:20:08.873922 5061 fetcher.cpp:76] Fetching URI
>>> 'file:///mapr/brewpot/mesos/storm-mesos-0.9.3.tgz'
>>> I0429 13:20:08.874048 5061 fetcher.cpp:179] Copying resource from
>>> '/mapr/brewpot/mesos/storm-mesos-0.9.3.tgz' to
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>>> I0429 13:20:09.103682 5061 fetcher.cpp:64] Extracted resource
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm-mesos-0.9.3.tgz'
>>> into
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>>> I0429 13:20:09.109590 5061 fetcher.cpp:76] Fetching URI '
>>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml'
>>> I0429 13:20:09.109658 5061 fetcher.cpp:126] Downloading '
>>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml' to
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm.yaml'
>>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>>> directory
>>>
>>
>>
>
Re: Storm Mesos Error
Posted by Tim Chen <ti...@mesosphere.io>.
I see, the storm scheduler is expecting your untarred archive to have a
storm-mesos folder.
I think we need to fix that script or change how the framework.
Tim
On Wed, Apr 29, 2015 at 11:34 AM, John Omernik <jo...@omernik.com> wrote:
> I used the bin/build-release.sh package
>
> and it put in all in a folder named apache-storm-0.9.3... that's probably
> my problem? :)
>
> On Wed, Apr 29, 2015 at 1:30 PM, Tim Chen <ti...@mesosphere.io> wrote:
>
>> Hi John,
>>
>> Does your storm-mesos tar ball as a folder storm-mesos-0.9.3 in there?
>>
>> Tim
>>
>> On Wed, Apr 29, 2015 at 11:26 AM, John Omernik <jo...@omernik.com> wrote:
>>
>>> Greetings all,
>>>
>>> I got my storm nimbus running, but when I try to run a test topology,
>>> the task enters a "lost" state and I get the below in my stderr on the
>>> sandbox. Note, the URL for the storm.yaml works fine, not sure why it's
>>> causing an issue on the cp.
>>>
>>>
>>>
>>>
>>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>>> directory
>>>
>>> Full:
>>>
>>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>>> I0429 13:20:08.873922 5061 fetcher.cpp:76] Fetching URI
>>> 'file:///mapr/brewpot/mesos/storm-mesos-0.9.3.tgz'
>>> I0429 13:20:08.874048 5061 fetcher.cpp:179] Copying resource from
>>> '/mapr/brewpot/mesos/storm-mesos-0.9.3.tgz' to
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>>> I0429 13:20:09.103682 5061 fetcher.cpp:64] Extracted resource
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm-mesos-0.9.3.tgz'
>>> into
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>>> I0429 13:20:09.109590 5061 fetcher.cpp:76] Fetching URI '
>>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml'
>>> I0429 13:20:09.109658 5061 fetcher.cpp:126] Downloading '
>>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml' to
>>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm.yaml'
>>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>>> directory
>>>
>>
>>
>
Re: Storm Mesos Error
Posted by John Omernik <jo...@omernik.com>.
I used the bin/build-release.sh package
and it put in all in a folder named apache-storm-0.9.3... that's probably
my problem? :)
On Wed, Apr 29, 2015 at 1:30 PM, Tim Chen <ti...@mesosphere.io> wrote:
> Hi John,
>
> Does your storm-mesos tar ball as a folder storm-mesos-0.9.3 in there?
>
> Tim
>
> On Wed, Apr 29, 2015 at 11:26 AM, John Omernik <jo...@omernik.com> wrote:
>
>> Greetings all,
>>
>> I got my storm nimbus running, but when I try to run a test topology, the
>> task enters a "lost" state and I get the below in my stderr on the
>> sandbox. Note, the URL for the storm.yaml works fine, not sure why it's
>> causing an issue on the cp.
>>
>>
>>
>>
>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>> directory
>>
>> Full:
>>
>> WARNING: Logging before InitGoogleLogging() is written to STDERR
>> I0429 13:20:08.873922 5061 fetcher.cpp:76] Fetching URI
>> 'file:///mapr/brewpot/mesos/storm-mesos-0.9.3.tgz'
>> I0429 13:20:08.874048 5061 fetcher.cpp:179] Copying resource from
>> '/mapr/brewpot/mesos/storm-mesos-0.9.3.tgz' to
>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>> I0429 13:20:09.103682 5061 fetcher.cpp:64] Extracted resource
>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm-mesos-0.9.3.tgz'
>> into
>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
>> I0429 13:20:09.109590 5061 fetcher.cpp:76] Fetching URI '
>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml'
>> I0429 13:20:09.109658 5061 fetcher.cpp:126] Downloading '
>> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml' to
>> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm.yaml'
>> cp: cannot create regular file `storm-mesos*/conf': No such file or
>> directory
>>
>
>
Re: Storm Mesos Error
Posted by Tim Chen <ti...@mesosphere.io>.
Hi John,
Does your storm-mesos tar ball as a folder storm-mesos-0.9.3 in there?
Tim
On Wed, Apr 29, 2015 at 11:26 AM, John Omernik <jo...@omernik.com> wrote:
> Greetings all,
>
> I got my storm nimbus running, but when I try to run a test topology, the
> task enters a "lost" state and I get the below in my stderr on the
> sandbox. Note, the URL for the storm.yaml works fine, not sure why it's
> causing an issue on the cp.
>
>
>
>
> cp: cannot create regular file `storm-mesos*/conf': No such file or
> directory
>
> Full:
>
> WARNING: Logging before InitGoogleLogging() is written to STDERR
> I0429 13:20:08.873922 5061 fetcher.cpp:76] Fetching URI
> 'file:///mapr/brewpot/mesos/storm-mesos-0.9.3.tgz'
> I0429 13:20:08.874048 5061 fetcher.cpp:179] Copying resource from
> '/mapr/brewpot/mesos/storm-mesos-0.9.3.tgz' to
> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
> I0429 13:20:09.103682 5061 fetcher.cpp:64] Extracted resource
> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm-mesos-0.9.3.tgz'
> into
> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969'
> I0429 13:20:09.109590 5061 fetcher.cpp:76] Fetching URI '
> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml'
> I0429 13:20:09.109658 5061 fetcher.cpp:126] Downloading '
> http://hadoopmapr1.brewingintel.com:43938/conf/storm.yaml' to
> '/tmp/mesos/slaves/20150402-121212-1644210368-5050-21808-S0/frameworks/20150402-121212-1644210368-5050-21808-0008/executors/myTopo-1-1430331608/runs/8ac24d9e-bb7f-49fe-9519-a07aa6a1d969/storm.yaml'
> cp: cannot create regular file `storm-mesos*/conf': No such file or
> directory
>