You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sdap.apache.org by "Thomas G Loubrieu (Jira)" <ji...@apache.org> on 2020/06/17 00:41:00 UTC
[jira] [Comment Edited] (SDAP-252) concurrent requests squashed
into single response
[ https://issues.apache.org/jira/browse/SDAP-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17138000#comment-17138000 ]
Thomas G Loubrieu edited comment on SDAP-252 at 6/17/20, 12:40 AM:
-------------------------------------------------------------------
While testing that with the python script on a local sdap nexus server (and remote solr/cassandra), I had te following error. I keep it here for documentation purpose, no idea if it is an edge effect of concurrent requests being tested or due to my local deployment (although I never had that before):
HDF5-DIAG: Error detected in HDF5 (1.10.5) thread 123145427341312:
#000: H5F.c line 444 in H5Fcreate(): unable to create file
major: File accessibilty
minor: Unable to open file
#001: H5Fint.c line 1531 in H5F_open(): unable to truncate a file which is already open
major: File accessibilty
minor: Unable to open file
2020-06-16T17:28:32 - nexus - ERROR - Error processing request
Traceback (most recent call last):
File "/Users/loubrieu/Documents/sdap/tools/incubator-sdap-nexus/analysis/webservice/webapp.py", line 59, in run
result = self.do_get(reqObject)
File "/Users/loubrieu/Documents/sdap/tools/incubator-sdap-nexus/analysis/webservice/webapp.py", line 105, in do_get
results = instance.calc(request)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/NexusHandler.py", line 311, in wrapped
return calc_func(*args, **kwargs1)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/algorithms_spark/TimeAvgMapSpark.py", line 266, in calc
self._create_nc_file(a, 'tam.nc', 'val', fill=self._fill)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/NexusHandler.py", line 585, in _create_nc_file
self._create_nc_file_latlon2d(a, fname, varname, **kwargs)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/NexusHandler.py", line 565, in _create_nc_file_latlon2d
rootgrp = Dataset(fname, "w", format="NETCDF4")
File "netCDF4/_netCDF4.pyx", line 2321, in netCDF4._netCDF4.Dataset.__init__
File "netCDF4/_netCDF4.pyx", line 1885, in netCDF4._netCDF4._ensure_nc_success
IOError: [Errno 13] Permission denied: 'tam.nc'
was (Author: tloubrieu):
While testing that with the python script on a local sdap nexus server (and remote solr/cassandra), I had te following error:
HDF5-DIAG: Error detected in HDF5 (1.10.5) thread 123145427341312:
#000: H5F.c line 444 in H5Fcreate(): unable to create file
major: File accessibilty
minor: Unable to open file
#001: H5Fint.c line 1531 in H5F_open(): unable to truncate a file which is already open
major: File accessibilty
minor: Unable to open file
2020-06-16T17:28:32 - nexus - ERROR - Error processing request
Traceback (most recent call last):
File "/Users/loubrieu/Documents/sdap/tools/incubator-sdap-nexus/analysis/webservice/webapp.py", line 59, in run
result = self.do_get(reqObject)
File "/Users/loubrieu/Documents/sdap/tools/incubator-sdap-nexus/analysis/webservice/webapp.py", line 105, in do_get
results = instance.calc(request)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/NexusHandler.py", line 311, in wrapped
return calc_func(*args, **kwargs1)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/algorithms_spark/TimeAvgMapSpark.py", line 266, in calc
self._create_nc_file(a, 'tam.nc', 'val', fill=self._fill)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/NexusHandler.py", line 585, in _create_nc_file
self._create_nc_file_latlon2d(a, fname, varname, **kwargs)
File "/Users/loubrieu/opt/anaconda2/anaconda2/envs/nexus-data-access/lib/python2.7/site-packages/nexusanalysis-1.6-py2.7.egg/webservice/NexusHandler.py", line 565, in _create_nc_file_latlon2d
rootgrp = Dataset(fname, "w", format="NETCDF4")
File "netCDF4/_netCDF4.pyx", line 2321, in netCDF4._netCDF4.Dataset.__init__
File "netCDF4/_netCDF4.pyx", line 1885, in netCDF4._netCDF4._ensure_nc_success
IOError: [Errno 13] Permission denied: 'tam.nc'
> concurrent requests squashed into single response
> -------------------------------------------------
>
> Key: SDAP-252
> URL: https://issues.apache.org/jira/browse/SDAP-252
> Project: Apache Science Data Analytics Platform
> Issue Type: New Feature
> Reporter: Thomas G Loubrieu
> Assignee: Thomas G Loubrieu
> Priority: Major
> Attachments: simple_test.py
>
>
> 2 differents requests are sent at the same time in a parallel or asynchornous mode.
> the responses received for each request are identical and correspond to one or the other of the launched requests.
> The case was produced with javascript code and python.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)