You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@predictionio.apache.org by Noelia Osés Fernández <no...@vicomtech.org> on 2017/11/13 15:47:08 UTC
"pio app delete" breaks my PIO installation
Hi,
It has happened several times already that after I execute:
*pio app delete appname*
my PIO installation breaks. Does anybody else have this problem?
Particularly, this time I get the following error during data import:
Traceback (most recent call last):
File "data/import_eventserver.py", line 63, in <module>
import_events(client, args.file)
File "data/import_eventserver.py", line 33, in import_events
properties= { "rating" : float(data[2]) }
File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
line 247, in create_event
event_time).get_response()
File "/usr/local/lib/python2.7/dist-packages/predictionio/connection.py",
line 111, in get_response
self._response = self.rfunc(tmp_response)
File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
line 118, in _acreate_resp
(response.error, response.request))
predictionio.NotCreatedError: Exception happened: timed out for request
POST
/events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY
{'event': 'rate', 'eventTime': '2017-11-13T15:32:24.506+0000',
'entityType': 'user', 'targetEntityId': '31', 'properties': {'rating':
2.5}, 'entityId': '1', 'targetEntityType': 'item'}
/events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY?event=rate&eventTime=2017-11-13T15%3A32%3A24.506%2B0000&entityType=user&targetEntityId=31&properties=%7B%27rating%27%3A+2.5%7D&entityId=1&targetEntityType=item
This app was working this morning. I deleted it, then created it again and
now I have this error and can't make it work.
Furthermore, when I execute
*curl -i -X GET http://localhost:7070 <http://localhost:7070>*
the terminal just hangs there, it doesn't print any output nor error
messages.
Any help is much appreciated,
Noelia
Re: "pio app delete" breaks my PIO installation
Posted by Noelia Osés Fernández <no...@vicomtech.org>.
Hi Donald,
This is the configuration on my pio-env.sh:
PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta
PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=ELASTICSEARCH
PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event
PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE
PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model
PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=LOCALFS
So I guess the answer to your question is HBASE. Everything is running on a
single machine with default configurations (as I'm a newby and I don't have
the expertise to do it any other way).
The way I moved on from this problem was by reinstalling PIO. I could do
that as I hadn't actually developed any proper apps and was using randomly
created sample data. But now that I'm going to start building the app for
my project (so far I was just trying to understand PIO and UR), I have
decided never ever to delete an app again. I just can't run the risk unless
I know for sure how to fix the problem.
Pat, thanks for providing a way to test that everything is running.
Thank you both!!
On 21 November 2017 at 21:14, Pat Ferrel <pa...@occamsmachete.com> wrote:
> I’ve seen this happen on my dev machine (a mac laptop) when I use
> `pio-start-all` which I never use in production.
>
> My test for everything running includes
>
> - pio status: this only tests the metadata service and the main store
> (Elasticsearch and HBase in my case) It by no means examines all services
> needed.
> - hdfs dfs -ls: this tests that the hdfs service is working
> - curl -i -X GET http://localhost:7070; This tests if the pio
> EventServer is listening on the right port
>
>
> Often the curl command hangs so I restart the EventServer but doing
> pio-stop-all, pio-start-all. This actually causes the UR integration test
> to hang if the EventServer is not listening correctly.
>
> Not sure if this is what Donald is talking about because your storage is
> working if pio status works. But restarting the EventService does the trick
> usually for me.
>
>
> On Nov 21, 2017, at 11:44 AM, Donald Szeto <do...@apache.org> wrote:
>
> Hey Noelia,
>
> What event storage backend are you using? Is the backend storage stuck?
> This could happen very often with a local, single-node HBase installation.
>
> Regards,
> Donald
>
> On Mon, Nov 13, 2017 at 7:51 AM, Noelia Osés Fernández <
> noses@vicomtech.org> wrote:
>
>> I forgot to mention that *pio status* reports my system is all ready to
>> go :(
>>
>> but it isn't true. I can't import the data.
>>
>> On 13 November 2017 at 16:47, Noelia Osés Fernández <no...@vicomtech.org>
>> wrote:
>>
>>> Hi,
>>>
>>> It has happened several times already that after I execute:
>>>
>>> *pio app delete appname*
>>>
>>> my PIO installation breaks. Does anybody else have this problem?
>>>
>>> Particularly, this time I get the following error during data import:
>>>
>>> Traceback (most recent call last):
>>> File "data/import_eventserver.py", line 63, in <module>
>>> import_events(client, args.file)
>>> File "data/import_eventserver.py", line 33, in import_events
>>> properties= { "rating" : float(data[2]) }
>>> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
>>> line 247, in create_event
>>> event_time).get_response()
>>> File "/usr/local/lib/python2.7/dist-packages/predictionio/connection.py",
>>> line 111, in get_response
>>> self._response = self.rfunc(tmp_response)
>>> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
>>> line 118, in _acreate_resp
>>> (response.error, response.request))
>>> predictionio.NotCreatedError: Exception happened: timed out for request
>>> POST /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY
>>> {'event': 'rate', 'eventTime': '2017-11-13T15:32:24.506+0000',
>>> 'entityType': 'user', 'targetEntityId': '31', 'properties': {'rating':
>>> 2.5}, 'entityId': '1', 'targetEntityType': 'item'}
>>> /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIM
>>> X3gxluzNlTI6N_M16z_CjjV9zAY?event=rate&eventTime=2017-11-13T
>>> 15%3A32%3A24.506%2B0000&entityType=user&targetEntityId=31&
>>> properties=%7B%27rating%27%3A+2.5%7D&entityId=1&targetEntityType=item
>>>
>>>
>>> This app was working this morning. I deleted it, then created it again
>>> and now I have this error and can't make it work.
>>>
>>> Furthermore, when I execute
>>>
>>>
>>> *curl -i -X GET http://localhost:7070 <http://localhost:7070/>*
>>>
>>> the terminal just hangs there, it doesn't print any output nor error
>>> messages.
>>>
>>> Any help is much appreciated,
>>> Noelia
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>> --
>> <http://www.vicomtech.org/>
>>
>> Noelia Osés Fernández, PhD
>> Senior Researcher |
>> Investigadora Senior
>>
>> noses@vicomtech.org
>> +[34] 943 30 92 30 <+34%20943%2030%2092%2030>
>> Data Intelligence for Energy and
>> Industrial Processes | Inteligencia
>> de Datos para Energía y Procesos
>> Industriales
>>
>> <https://www.linkedin.com/company/vicomtech>
>> <https://www.youtube.com/user/VICOMTech>
>> <ht...@Vicomtech_IK4>
>>
>> member of: <http://www.graphicsmedia.net/> <http://www.ik4.es/>
>>
>> Legal Notice - Privacy policy
>> <http://www.vicomtech.org/en/proteccion-datos>
>>
>
>
>
--
Re: "pio app delete" breaks my PIO installation
Posted by Noelia Osés Fernández <no...@vicomtech.org>.
Hi Pat,
I've followed your suggestion to check all services but I get an error with
hdfs:
$ hdfs dfs -ls
No command 'hdfs' found, did you mean:
Command 'hdfls' from package 'hdf4-tools' (universe)
Command 'hfs' from package 'hfsutils-tcltk' (universe)
hdfs: command not found
Which one is the one I need to use?
Thanks for your help!
On 21 November 2017 at 21:14, Pat Ferrel <pa...@occamsmachete.com> wrote:
> I’ve seen this happen on my dev machine (a mac laptop) when I use
> `pio-start-all` which I never use in production.
>
> My test for everything running includes
>
> - pio status: this only tests the metadata service and the main store
> (Elasticsearch and HBase in my case) It by no means examines all services
> needed.
> - hdfs dfs -ls: this tests that the hdfs service is working
> - curl -i -X GET http://localhost:7070; This tests if the pio
> EventServer is listening on the right port
>
>
> Often the curl command hangs so I restart the EventServer but doing
> pio-stop-all, pio-start-all. This actually causes the UR integration test
> to hang if the EventServer is not listening correctly.
>
> Not sure if this is what Donald is talking about because your storage is
> working if pio status works. But restarting the EventService does the trick
> usually for me.
>
>
> On Nov 21, 2017, at 11:44 AM, Donald Szeto <do...@apache.org> wrote:
>
> Hey Noelia,
>
> What event storage backend are you using? Is the backend storage stuck?
> This could happen very often with a local, single-node HBase installation.
>
> Regards,
> Donald
>
> On Mon, Nov 13, 2017 at 7:51 AM, Noelia Osés Fernández <
> noses@vicomtech.org> wrote:
>
>> I forgot to mention that *pio status* reports my system is all ready to
>> go :(
>>
>> but it isn't true. I can't import the data.
>>
>> On 13 November 2017 at 16:47, Noelia Osés Fernández <no...@vicomtech.org>
>> wrote:
>>
>>> Hi,
>>>
>>> It has happened several times already that after I execute:
>>>
>>> *pio app delete appname*
>>>
>>> my PIO installation breaks. Does anybody else have this problem?
>>>
>>> Particularly, this time I get the following error during data import:
>>>
>>> Traceback (most recent call last):
>>> File "data/import_eventserver.py", line 63, in <module>
>>> import_events(client, args.file)
>>> File "data/import_eventserver.py", line 33, in import_events
>>> properties= { "rating" : float(data[2]) }
>>> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
>>> line 247, in create_event
>>> event_time).get_response()
>>> File "/usr/local/lib/python2.7/dist-packages/predictionio/connection.py",
>>> line 111, in get_response
>>> self._response = self.rfunc(tmp_response)
>>> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
>>> line 118, in _acreate_resp
>>> (response.error, response.request))
>>> predictionio.NotCreatedError: Exception happened: timed out for request
>>> POST /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY
>>> {'event': 'rate', 'eventTime': '2017-11-13T15:32:24.506+0000',
>>> 'entityType': 'user', 'targetEntityId': '31', 'properties': {'rating':
>>> 2.5}, 'entityId': '1', 'targetEntityType': 'item'}
>>> /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIM
>>> X3gxluzNlTI6N_M16z_CjjV9zAY?event=rate&eventTime=2017-11-13T
>>> 15%3A32%3A24.506%2B0000&entityType=user&targetEntityId=31&
>>> properties=%7B%27rating%27%3A+2.5%7D&entityId=1&targetEntityType=item
>>>
>>>
>>> This app was working this morning. I deleted it, then created it again
>>> and now I have this error and can't make it work.
>>>
>>> Furthermore, when I execute
>>>
>>>
>>> *curl -i -X GET http://localhost:7070 <http://localhost:7070/>*
>>>
>>> the terminal just hangs there, it doesn't print any output nor error
>>> messages.
>>>
>>> Any help is much appreciated,
>>> Noelia
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>> --
>> <http://www.vicomtech.org/>
>>
>> Noelia Osés Fernández, PhD
>> Senior Researcher |
>> Investigadora Senior
>>
>> noses@vicomtech.org
>> +[34] 943 30 92 30 <+34%20943%2030%2092%2030>
>> Data Intelligence for Energy and
>> Industrial Processes | Inteligencia
>> de Datos para Energía y Procesos
>> Industriales
>>
>> <https://www.linkedin.com/company/vicomtech>
>> <https://www.youtube.com/user/VICOMTech>
>> <ht...@Vicomtech_IK4>
>>
>> member of: <http://www.graphicsmedia.net/> <http://www.ik4.es/>
>>
>> Legal Notice - Privacy policy
>> <http://www.vicomtech.org/en/proteccion-datos>
>>
>
>
>
--
<http://www.vicomtech.org>
Noelia Osés Fernández, PhD
Senior Researcher |
Investigadora Senior
noses@vicomtech.org
+[34] 943 30 92 30
Data Intelligence for Energy and
Industrial Processes | Inteligencia
de Datos para Energía y Procesos
Industriales
<https://www.linkedin.com/company/vicomtech>
<https://www.youtube.com/user/VICOMTech>
<ht...@Vicomtech_IK4>
member of: <http://www.graphicsmedia.net/> <http://www.ik4.es>
Legal Notice - Privacy policy <http://www.vicomtech.org/en/proteccion-datos>
Re: "pio app delete" breaks my PIO installation
Posted by Pat Ferrel <pa...@occamsmachete.com>.
I’ve seen this happen on my dev machine (a mac laptop) when I use `pio-start-all` which I never use in production.
My test for everything running includes
pio status: this only tests the metadata service and the main store (Elasticsearch and HBase in my case) It by no means examines all services needed.
hdfs dfs -ls: this tests that the hdfs service is working
curl -i -X GET http://localhost:7070; This tests if the pio EventServer is listening on the right port
Often the curl command hangs so I restart the EventServer but doing pio-stop-all, pio-start-all. This actually causes the UR integration test to hang if the EventServer is not listening correctly.
Not sure if this is what Donald is talking about because your storage is working if pio status works. But restarting the EventService does the trick usually for me.
On Nov 21, 2017, at 11:44 AM, Donald Szeto <do...@apache.org> wrote:
Hey Noelia,
What event storage backend are you using? Is the backend storage stuck? This could happen very often with a local, single-node HBase installation.
Regards,
Donald
On Mon, Nov 13, 2017 at 7:51 AM, Noelia Osés Fernández <noses@vicomtech.org <ma...@vicomtech.org>> wrote:
I forgot to mention that pio status reports my system is all ready to go :(
but it isn't true. I can't import the data.
On 13 November 2017 at 16:47, Noelia Osés Fernández <noses@vicomtech.org <ma...@vicomtech.org>> wrote:
Hi,
It has happened several times already that after I execute:
pio app delete appname
my PIO installation breaks. Does anybody else have this problem?
Particularly, this time I get the following error during data import:
Traceback (most recent call last):
File "data/import_eventserver.py", line 63, in <module>
import_events(client, args.file)
File "data/import_eventserver.py", line 33, in import_events
properties= { "rating" : float(data[2]) }
File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py", line 247, in create_event
event_time).get_response()
File "/usr/local/lib/python2.7/dist-packages/predictionio/connection.py", line 111, in get_response
self._response = self.rfunc(tmp_response)
File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py", line 118, in _acreate_resp
(response.error, response.request))
predictionio.NotCreatedError: Exception happened: timed out for request POST /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY {'event': 'rate', 'eventTime': '2017-11-13T15:32:24.506+0000', 'entityType': 'user', 'targetEntityId': '31', 'properties': {'rating': 2.5}, 'entityId': '1', 'targetEntityType': 'item'} /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY?event=rate&eventTime=2017-11-13T15%3A32%3A24.506%2B0000&entityType=user&targetEntityId=31&properties=%7B%27rating%27%3A+2.5%7D&entityId=1&targetEntityType=item
This app was working this morning. I deleted it, then created it again and now I have this error and can't make it work.
Furthermore, when I execute
curl -i -X GET http://localhost:7070 <http://localhost:7070/>
the terminal just hangs there, it doesn't print any output nor error messages.
Any help is much appreciated,
Noelia
--
<http://www.vicomtech.org/>
Noelia Osés Fernández, PhD
Senior Researcher |
Investigadora Senior
noses@vicomtech.org <ma...@vicomtech.org>
+[34] 943 30 92 30 <tel:+34%20943%2030%2092%2030>
Data Intelligence for Energy and
Industrial Processes | Inteligencia
de Datos para Energía y Procesos
Industriales
<https://www.linkedin.com/company/vicomtech> <https://www.youtube.com/user/VICOMTech> <ht...@Vicomtech_IK4>
member of: <http://www.graphicsmedia.net/> <http://www.ik4.es/>
Legal Notice - Privacy policy <http://www.vicomtech.org/en/proteccion-datos>
Re: "pio app delete" breaks my PIO installation
Posted by Donald Szeto <do...@apache.org>.
Hey Noelia,
What event storage backend are you using? Is the backend storage stuck?
This could happen very often with a local, single-node HBase installation.
Regards,
Donald
On Mon, Nov 13, 2017 at 7:51 AM, Noelia Osés Fernández <no...@vicomtech.org>
wrote:
> I forgot to mention that *pio status* reports my system is all ready to
> go :(
>
> but it isn't true. I can't import the data.
>
> On 13 November 2017 at 16:47, Noelia Osés Fernández <no...@vicomtech.org>
> wrote:
>
>> Hi,
>>
>> It has happened several times already that after I execute:
>>
>> *pio app delete appname*
>>
>> my PIO installation breaks. Does anybody else have this problem?
>>
>> Particularly, this time I get the following error during data import:
>>
>> Traceback (most recent call last):
>> File "data/import_eventserver.py", line 63, in <module>
>> import_events(client, args.file)
>> File "data/import_eventserver.py", line 33, in import_events
>> properties= { "rating" : float(data[2]) }
>> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
>> line 247, in create_event
>> event_time).get_response()
>> File "/usr/local/lib/python2.7/dist-packages/predictionio/connection.py",
>> line 111, in get_response
>> self._response = self.rfunc(tmp_response)
>> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
>> line 118, in _acreate_resp
>> (response.error, response.request))
>> predictionio.NotCreatedError: Exception happened: timed out for request
>> POST /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY
>> {'event': 'rate', 'eventTime': '2017-11-13T15:32:24.506+0000',
>> 'entityType': 'user', 'targetEntityId': '31', 'properties': {'rating':
>> 2.5}, 'entityId': '1', 'targetEntityType': 'item'}
>> /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_vFYRYgQIM
>> X3gxluzNlTI6N_M16z_CjjV9zAY?event=rate&eventTime=2017-11-
>> 13T15%3A32%3A24.506%2B0000&entityType=user&targetEntityId
>> =31&properties=%7B%27rating%27%3A+2.5%7D&entityId=1&targetEntityType=item
>>
>>
>> This app was working this morning. I deleted it, then created it again
>> and now I have this error and can't make it work.
>>
>> Furthermore, when I execute
>>
>>
>> *curl -i -X GET http://localhost:7070 <http://localhost:7070>*
>>
>> the terminal just hangs there, it doesn't print any output nor error
>> messages.
>>
>> Any help is much appreciated,
>> Noelia
>>
>>
>>
>>
>>
>>
>>
>>
>
>
> --
> <http://www.vicomtech.org>
>
> Noelia Osés Fernández, PhD
> Senior Researcher |
> Investigadora Senior
>
> noses@vicomtech.org
> +[34] 943 30 92 30 <+34%20943%2030%2092%2030>
> Data Intelligence for Energy and
> Industrial Processes | Inteligencia
> de Datos para Energía y Procesos
> Industriales
>
> <https://www.linkedin.com/company/vicomtech>
> <https://www.youtube.com/user/VICOMTech>
> <ht...@Vicomtech_IK4>
>
> member of: <http://www.graphicsmedia.net/> <http://www.ik4.es>
>
> Legal Notice - Privacy policy
> <http://www.vicomtech.org/en/proteccion-datos>
>
Re: "pio app delete" breaks my PIO installation
Posted by Noelia Osés Fernández <no...@vicomtech.org>.
I forgot to mention that *pio status* reports my system is all ready to go
:(
but it isn't true. I can't import the data.
On 13 November 2017 at 16:47, Noelia Osés Fernández <no...@vicomtech.org>
wrote:
> Hi,
>
> It has happened several times already that after I execute:
>
> *pio app delete appname*
>
> my PIO installation breaks. Does anybody else have this problem?
>
> Particularly, this time I get the following error during data import:
>
> Traceback (most recent call last):
> File "data/import_eventserver.py", line 63, in <module>
> import_events(client, args.file)
> File "data/import_eventserver.py", line 33, in import_events
> properties= { "rating" : float(data[2]) }
> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
> line 247, in create_event
> event_time).get_response()
> File "/usr/local/lib/python2.7/dist-packages/predictionio/connection.py",
> line 111, in get_response
> self._response = self.rfunc(tmp_response)
> File "/usr/local/lib/python2.7/dist-packages/predictionio/__init__.py",
> line 118, in _acreate_resp
> (response.error, response.request))
> predictionio.NotCreatedError: Exception happened: timed out for request
> POST /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_
> vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY {'event': 'rate', 'eventTime':
> '2017-11-13T15:32:24.506+0000', 'entityType': 'user', 'targetEntityId':
> '31', 'properties': {'rating': 2.5}, 'entityId': '1', 'targetEntityType':
> 'item'} /events.json?accessKey=XQewLhG4RfqP1zAMH9y3E5c4wd0_
> vFYRYgQIMX3gxluzNlTI6N_M16z_CjjV9zAY?event=rate&eventTime=
> 2017-11-13T15%3A32%3A24.506%2B0000&entityType=user&
> targetEntityId=31&properties=%7B%27rating%27%3A+2.5%7D&
> entityId=1&targetEntityType=item
>
>
> This app was working this morning. I deleted it, then created it again and
> now I have this error and can't make it work.
>
> Furthermore, when I execute
>
>
> *curl -i -X GET http://localhost:7070 <http://localhost:7070>*
>
> the terminal just hangs there, it doesn't print any output nor error
> messages.
>
> Any help is much appreciated,
> Noelia
>
>
>
>
>
>
>
>
--
<http://www.vicomtech.org>
Noelia Osés Fernández, PhD
Senior Researcher |
Investigadora Senior
noses@vicomtech.org
+[34] 943 30 92 30
Data Intelligence for Energy and
Industrial Processes | Inteligencia
de Datos para Energía y Procesos
Industriales
<https://www.linkedin.com/company/vicomtech>
<https://www.youtube.com/user/VICOMTech>
<ht...@Vicomtech_IK4>
member of: <http://www.graphicsmedia.net/> <http://www.ik4.es>
Legal Notice - Privacy policy <http://www.vicomtech.org/en/proteccion-datos>