You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sis.apache.org by Martin Desruisseaux <ma...@geomatys.com> on 2016/07/05 22:05:38 UTC
Current GSoC project state?
Hello Hao
I executed the latest version of VNSCweb and this look encouraging! By
the way, the maven.geotoolkit.org repository is back online, so you
should not be blocked anymore by the issue reported last weekend.
Last time I looked in the code, the list of metadata files available in
the catalog was hard-coded (one Landsat and one Modis). Do you still
plan to scan a directory content instead? And if yes, have you chosen
which directory?
Did you started to work on a mapping from ISO 19115 metadata object (as
given by org.apache.sis.metadata.iso.DefaultMetadata) and the
SummaryRecord returned by the CSW? If not, I will give you some links
that may help.
Martin
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
And , I want know , Nomally, when storing data , All file (.txt, .jpg,
.tiff , .iso19115 ) will be stored in 1 folder in system or They will be
stored in the distribution directorydist (ex : landsat metadata folder,
modis metadata folder, image folder ... )?
On Thu, Jul 7, 2016 at 9:04 AM, phuong hao nguyen thi <
nguyenthiphuonghao243@gmail.com> wrote:
> Hello Martin,
> Thanks so much.
> >>Do you have an idea about how to allow such configuration?
> As you suggest , I think I will creat a configue for directory , when the
> programe install on a other computer , It will ask the direction that save
> geotiff, modis , image ... . How do you feel ?
> >>In table 6, we can see that the SummaryRecord title attribute should be
> taken from Metadata.identificationInfo.citation.title. We should modify
> the code so that it follow those recommendations.
> >>I would like to know, how were determined the fields in SummaryRecord
> and in Element (or BoundingBox)? Do they come from those files?
> The present, I set the title is file name :) (I will correct it as ISO
> 19115) but I have to all queryables as in the table or only a few that we
> need ?
> >> The search should be done on the service side. The server may have a
> very large amount of metadata; transfering all of them on the client
> side would be too costly.
> Was it your question? Maybe I misunderstood?
> Yes , It was my question , I have created search on service too,
> suspended : bbox, date, format but I don't know how to combine them ?
> Do you guide me ?
> Thanks
> Hao
>
> On Thu, Jul 7, 2016 at 12:48 AM, Martin Desruisseaux <
> martin.desruisseaux@geomatys.com> wrote:
>
>> Hello Hao
>>
>> Le 06/07/16 à 02:37, phuong hao nguyen thi a écrit :
>> > In my computer, I place the Geotiff file in forder geotiff and Modis
>> file
>> > in forder modis. I use ReadXML and scan all file in 2 directory and read
>> > them .
>>
>> Thanks for the indication. I see that the folder are currently
>> hard-coded to "/home/haonguyen/data/". This is fine for testing purpose,
>> but the final version will of course need to let the user choose his
>> directory. Do you have an idea about how to allow such configuration?
>>
>>
>> > The part, mapping from ISO 19115 metadata and the SummaryRecord
>> returned by
>> > the CSW. I don't understand you. I use ReadXML to read file and set to
>> > SummaryRecord . Can you guide me ?
>>
>> I see that ReadXML extract values from ISO 19115 metadata and gives them
>> to the SummaryRecord constructor. This is the idea, but I suggest the
>> following modifications:
>>
>> * Instead of extracting ISO 19115 values in ReadXML, I suggest to
>> extract them in the SummaryRecord constructor (the constructor would
>> expect an org.opengis.metadata.Metadata object in argument). This
>> would avoid the duplication of code that we currently see in
>> ReadXML.listModis() and ReadXML.listGeotiff() methods.
>> * The Element class should be renamed BoundingBox.
>> * The mapping from ISO 19115 to SummaryRecord should follow the OGC
>> recommendations:
>> o Go on http://www.opengeospatial.org/standards/cat
>> o Download document 07-045 (OGC Catalogue Services Specification
>> 2.0.2 - ISO Metadata Application Profile (1.0.0))
>> o Scroll down to table 6 at page 41.
>>
>> In table 6, we can see that the SummaryRecord title attribute should be
>> taken from Metadata.identificationInfo.citation.title. We should modify
>> the code so that it follow those recommendations.
>>
>> I would like to know, how were determined the fields in SummaryRecord
>> and in Element (or BoundingBox)? Do they come from those files?
>>
>> * http://schemas.opengis.net/csw/2.0.2/record.xsd
>> * http://schemas.opengis.net/ows/1.0.0/owsCommon.xsd
>>
>> For example, owsCommon.xsd define the BoudingBox type with two elements:
>> LowerCorner and UpperCorner. But the Element class in VNSCweb is defined
>> with westBoundLongitude, eastBoundLongitude, etc. Can you give me a link
>> (other than ISO 19115) where those elements were defined?
>>
>>
>> > And the part search, I want know, Will we search in the client or in
>> > service ?
>>
>> The search should be done on the service side. The server may have a
>> very large amount of metadata; transfering all of them on the client
>> side would be too costly.
>>
>> Was it your question? Maybe I misunderstood?
>>
>> Martin
>>
>>
>>
>
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
Hello Martin,
I pushed sis update LansatReader file that Mapping to common returnable
properties in service csw . The test file have a error but I don't know .
Can you help me ?
error:
Line[1] expected:<[ ]├─Language…………………………...> but
was:<[ ]├─Language…………………………...>
Hao
On Sun, Jul 10, 2016 at 4:03 AM, Martin Desruisseaux <
martin.desruisseaux@geomatys.com> wrote:
> Hello Hao
>
> When a query is sent to the CSW server, the server should return a
> document like this example:
>
>
> http://schemas.opengis.net/csw/2.0.2/examples/Clause_6.3.3_Example01_Response.xml
>
> What the current VNSCweb returns? Does VNSCweb returns XML documents
> like above example? By looking at the source code, it seems to me that
> VNSCweb returns slightly different documents.
>
> We also need to start migration of some VNSCweb code to Apache SIS. I
> ported the 'SummaryRecord' and 'BoundingBox' code to Hao's clone of SIS
> through a pull request. I modified the code for making it closer to
> above example. I also added a 'SummaryRecordTest'. By running this test,
> you can see what this proposed new version of 'SummaryRecord' produce.
>
> If this new version of 'SummaryRecord' is fine for you, I suggest that
> you use it instead than the version on VNSCweb. You may need to make the
> class public for that purpose. Please modify the class as you need - the
> only constraint is that the XML must be a valid <csw:Record> as
> described by the OGC standard.
>
> After you become familiar with the new version of 'SummaryRecord', I
> suggest that you add the following fields from table 9 of OGC 07-045
> document:
>
> subject, creator, description, publisher, contributor, date,
> language and rights.
>
> Please see table 9 for instruction about which ISO 19115 metadata to
> read for those fields.
>
> Martin
>
>
> Le 08/07/16 à 16:46, phuong hao nguyen thi a écrit :
> > And the part wcs What would we do ? . (reponse image jsp on interface
> > client ?)
>
>
Re: Current GSoC project state?
Posted by Martin Desruisseaux <ma...@geomatys.com>.
Hello Hao
When a query is sent to the CSW server, the server should return a
document like this example:
http://schemas.opengis.net/csw/2.0.2/examples/Clause_6.3.3_Example01_Response.xml
What the current VNSCweb returns? Does VNSCweb returns XML documents
like above example? By looking at the source code, it seems to me that
VNSCweb returns slightly different documents.
We also need to start migration of some VNSCweb code to Apache SIS. I
ported the 'SummaryRecord' and 'BoundingBox' code to Hao's clone of SIS
through a pull request. I modified the code for making it closer to
above example. I also added a 'SummaryRecordTest'. By running this test,
you can see what this proposed new version of 'SummaryRecord' produce.
If this new version of 'SummaryRecord' is fine for you, I suggest that
you use it instead than the version on VNSCweb. You may need to make the
class public for that purpose. Please modify the class as you need - the
only constraint is that the XML must be a valid <csw:Record> as
described by the OGC standard.
After you become familiar with the new version of 'SummaryRecord', I
suggest that you add the following fields from table 9 of OGC 07-045
document:
subject, creator, description, publisher, contributor, date,
language and rights.
Please see table 9 for instruction about which ISO 19115 metadata to
read for those fields.
Martin
Le 08/07/16 � 16:46, phuong hao nguyen thi a �crit :
> And the part wcs What would we do ? . (reponse image jsp on interface
> client ?)
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
Hello Martin,
Thanks so much ,
And the part wcs What would we do ? . (reponse image jsp on interface
client ?)
Hao
On Fri, Jul 8, 2016 at 5:33 AM, Martin Desruisseaux <
martin.desruisseaux@geomatys.com> wrote:
> Hello Hao
>
> Le 07/07/16 à 13:47, phuong hao nguyen thi a écrit :
> > Martin, thanks so much, I created a class too config the system path(It
> use
> > to edit config.propeties file ) where data storaged and image file I will
> > set to folder image in the path . It's Ok?
>
> This is a good start. Would you be okay with the following proposed
> changes?
>
> * Rename ReadConfiguePath as ConfigurationReader. Tip: "Read" is a
> verb while "Reader" is a noun. In Java, we often use noun for class
> names and verb for method names (often, but not necessarily always).
> * Remove the catch (Exception e), especially since it only print the
> exception to the console. Unless an error is really recoverable, it
> is better to let it propagate or to wrap it in another exception.
> * The InputStream can be local to the getPropValues() method - it does
> not need to be a field in this case.
>
>
> > Today Chinh and me completed the parth config path direction ,
> > search any text and reponse metadata on interface client . The present
> > , we just need get value from home page and complete the mapping path
> > . This is image screenshot from interface client . Do you have suggested?
> I didn't saw the screenshot, I think they can not be posted on Apache
> mailing list. But I was able to run the application, so I could see what
> it looks like. For Apache SIS, an interesting part would be to see an
> example of request sent to the CSW server and the response that we get
> back. Could you post such example? (this is only text or XML).
>
> Thanks,
>
> Martin
>
>
>
Re: Current GSoC project state?
Posted by Martin Desruisseaux <ma...@geomatys.com>.
Hello Hao
Le 07/07/16 � 13:47, phuong hao nguyen thi a �crit :
> Martin, thanks so much, I created a class too config the system path(It use
> to edit config.propeties file ) where data storaged and image file I will
> set to folder image in the path . It's Ok?
This is a good start. Would you be okay with the following proposed changes?
* Rename ReadConfiguePath as ConfigurationReader. Tip: "Read" is a
verb while "Reader" is a noun. In Java, we often use noun for class
names and verb for method names (often, but not necessarily always).
* Remove the catch (Exception e), especially since it only print the
exception to the console. Unless an error is really recoverable, it
is better to let it propagate or to wrap it in another exception.
* The InputStream can be local to the getPropValues() method - it does
not need to be a field in this case.
> Today Chinh and me completed the parth config path direction ,
> search any text and reponse metadata on interface client . The present
> , we just need get value from home page and complete the mapping path
> . This is image screenshot from interface client . Do you have suggested?
I didn't saw the screenshot, I think they can not be posted on Apache
mailing list. But I was able to run the application, so I could see what
it looks like. For Apache SIS, an interesting part would be to see an
example of request sent to the CSW server and the response that we get
back. Could you post such example? (this is only text or XML).
Thanks,
Martin
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
Hello Martin,
Today Chinh and me completed the parth config path direction , search any
text and reponse metadata on interface client . The present , we just need
get value from home page and complete the mapping path . This is image
screenshot from interface client . Do you have suggested?
Thanks so much
Hao
On Thu, Jul 7, 2016 at 6:47 PM, phuong hao nguyen thi <
nguyenthiphuonghao243@gmail.com> wrote:
> Martin, thanks so much, I created a class too config the system path(It
> use to edit config.propeties file ) where data storaged and image file I
> will set to folder image in the path . It's Ok?
>
> On Thu, Jul 7, 2016 at 4:08 PM, Martin Desruisseaux <
> martin.desruisseaux@geomatys.com> wrote:
>
>> Hello Hao
>>
>> Le 07/07/16 à 04:04, phuong hao nguyen thi a écrit :
>> > As you suggest , I think I will creat a configue for directory , when
>> the
>> > programe install on a other computer , It will ask the direction that
>> save
>> > geotiff, modis , image ... . How do you feel ?
>>
>> Do you mean popup a dialog box with Swing or JavaFX?
>>
>> Another possibility is to use a configuration file.
>>
>>
>> > The present, I set the title is file name :) (I will correct it as ISO
>> > 19115) but I have to all queryables as in the table or only a few that
>> we
>> > need ?
>>
>> The table contains only about 10 metadata. I think we can do all of
>> them? (if it was hundred of metadata, we would select only some).
>>
>>
>> > I have created search on service too, suspended
>> > : bbox, date, format but I don't know how to combine them ?
>> > Do you guide me ?
>>
>> Is your question about whether a bounding box and date criterion should
>> be combined with "AND" or "OR" conditions? If so, I suggest to use "AND"
>> conditions for now.
>>
>>
>> > And , I want know , Nomally, when storing data , All file (.txt, .jpg,
>> > .tiff , .iso19115 ) will be stored in 1 folder in system or They will
>> be
>> > stored in the distribution directorydist (ex : landsat metadata folder,
>> > modis metadata folder, image folder ... )?
>> I suggests two policies:
>>
>> 1. Files provided by the user can be in any directory as the user wish.
>> I don't think that the application needs to put constraint here.
>> 2. Files generated by the application (for example the quicklook in PNG
>> formats) should be in a separated directory. In can be for example a
>> "cache" directory.
>>
>> If someone delete de cache directory (2), the application should be able
>> to recreate it from the original files (1).
>>
>> Martin
>>
>>
>>
>
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
Martin, thanks so much, I created a class too config the system path(It use
to edit config.propeties file ) where data storaged and image file I will
set to folder image in the path . It's Ok?
On Thu, Jul 7, 2016 at 4:08 PM, Martin Desruisseaux <
martin.desruisseaux@geomatys.com> wrote:
> Hello Hao
>
> Le 07/07/16 à 04:04, phuong hao nguyen thi a écrit :
> > As you suggest , I think I will creat a configue for directory , when the
> > programe install on a other computer , It will ask the direction that
> save
> > geotiff, modis , image ... . How do you feel ?
>
> Do you mean popup a dialog box with Swing or JavaFX?
>
> Another possibility is to use a configuration file.
>
>
> > The present, I set the title is file name :) (I will correct it as ISO
> > 19115) but I have to all queryables as in the table or only a few that
> we
> > need ?
>
> The table contains only about 10 metadata. I think we can do all of
> them? (if it was hundred of metadata, we would select only some).
>
>
> > I have created search on service too, suspended
> > : bbox, date, format but I don't know how to combine them ?
> > Do you guide me ?
>
> Is your question about whether a bounding box and date criterion should
> be combined with "AND" or "OR" conditions? If so, I suggest to use "AND"
> conditions for now.
>
>
> > And , I want know , Nomally, when storing data , All file (.txt, .jpg,
> > .tiff , .iso19115 ) will be stored in 1 folder in system or They will be
> > stored in the distribution directorydist (ex : landsat metadata folder,
> > modis metadata folder, image folder ... )?
> I suggests two policies:
>
> 1. Files provided by the user can be in any directory as the user wish.
> I don't think that the application needs to put constraint here.
> 2. Files generated by the application (for example the quicklook in PNG
> formats) should be in a separated directory. In can be for example a
> "cache" directory.
>
> If someone delete de cache directory (2), the application should be able
> to recreate it from the original files (1).
>
> Martin
>
>
>
Re: Current GSoC project state?
Posted by Martin Desruisseaux <ma...@geomatys.com>.
Hello Hao
Le 07/07/16 � 04:04, phuong hao nguyen thi a �crit :
> As you suggest , I think I will creat a configue for directory , when the
> programe install on a other computer , It will ask the direction that save
> geotiff, modis , image ... . How do you feel ?
Do you mean popup a dialog box with Swing or JavaFX?
Another possibility is to use a configuration file.
> The present, I set the title is file name :) (I will correct it as ISO
> 19115) but I have to all queryables as in the table or only a few that we
> need ?
The table contains only about 10 metadata. I think we can do all of
them? (if it was hundred of metadata, we would select only some).
> I have created search on service too, suspended
> : bbox, date, format but I don't know how to combine them ?
> Do you guide me ?
Is your question about whether a bounding box and date criterion should
be combined with "AND" or "OR" conditions? If so, I suggest to use "AND"
conditions for now.
> And , I want know , Nomally, when storing data , All file (.txt, .jpg,
> .tiff , .iso19115 ) will be stored in 1 folder in system or They will be
> stored in the distribution directorydist (ex : landsat metadata folder,
> modis metadata folder, image folder ... )?
I suggests two policies:
1. Files provided by the user can be in any directory as the user wish.
I don't think that the application needs to put constraint here.
2. Files generated by the application (for example the quicklook in PNG
formats) should be in a separated directory. In can be for example a
"cache" directory.
If someone delete de cache directory (2), the application should be able
to recreate it from the original files (1).
Martin
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
Hello Martin,
Thanks so much.
>>Do you have an idea about how to allow such configuration?
As you suggest , I think I will creat a configue for directory , when the
programe install on a other computer , It will ask the direction that save
geotiff, modis , image ... . How do you feel ?
>>In table 6, we can see that the SummaryRecord title attribute should be
taken from Metadata.identificationInfo.citation.title. We should modify
the code so that it follow those recommendations.
>>I would like to know, how were determined the fields in SummaryRecord
and in Element (or BoundingBox)? Do they come from those files?
The present, I set the title is file name :) (I will correct it as ISO
19115) but I have to all queryables as in the table or only a few that we
need ?
>> The search should be done on the service side. The server may have a
very large amount of metadata; transfering all of them on the client
side would be too costly.
Was it your question? Maybe I misunderstood?
Yes , It was my question , I have created search on service too, suspended
: bbox, date, format but I don't know how to combine them ?
Do you guide me ?
Thanks
Hao
On Thu, Jul 7, 2016 at 12:48 AM, Martin Desruisseaux <
martin.desruisseaux@geomatys.com> wrote:
> Hello Hao
>
> Le 06/07/16 à 02:37, phuong hao nguyen thi a écrit :
> > In my computer, I place the Geotiff file in forder geotiff and Modis file
> > in forder modis. I use ReadXML and scan all file in 2 directory and read
> > them .
>
> Thanks for the indication. I see that the folder are currently
> hard-coded to "/home/haonguyen/data/". This is fine for testing purpose,
> but the final version will of course need to let the user choose his
> directory. Do you have an idea about how to allow such configuration?
>
>
> > The part, mapping from ISO 19115 metadata and the SummaryRecord returned
> by
> > the CSW. I don't understand you. I use ReadXML to read file and set to
> > SummaryRecord . Can you guide me ?
>
> I see that ReadXML extract values from ISO 19115 metadata and gives them
> to the SummaryRecord constructor. This is the idea, but I suggest the
> following modifications:
>
> * Instead of extracting ISO 19115 values in ReadXML, I suggest to
> extract them in the SummaryRecord constructor (the constructor would
> expect an org.opengis.metadata.Metadata object in argument). This
> would avoid the duplication of code that we currently see in
> ReadXML.listModis() and ReadXML.listGeotiff() methods.
> * The Element class should be renamed BoundingBox.
> * The mapping from ISO 19115 to SummaryRecord should follow the OGC
> recommendations:
> o Go on http://www.opengeospatial.org/standards/cat
> o Download document 07-045 (OGC Catalogue Services Specification
> 2.0.2 - ISO Metadata Application Profile (1.0.0))
> o Scroll down to table 6 at page 41.
>
> In table 6, we can see that the SummaryRecord title attribute should be
> taken from Metadata.identificationInfo.citation.title. We should modify
> the code so that it follow those recommendations.
>
> I would like to know, how were determined the fields in SummaryRecord
> and in Element (or BoundingBox)? Do they come from those files?
>
> * http://schemas.opengis.net/csw/2.0.2/record.xsd
> * http://schemas.opengis.net/ows/1.0.0/owsCommon.xsd
>
> For example, owsCommon.xsd define the BoudingBox type with two elements:
> LowerCorner and UpperCorner. But the Element class in VNSCweb is defined
> with westBoundLongitude, eastBoundLongitude, etc. Can you give me a link
> (other than ISO 19115) where those elements were defined?
>
>
> > And the part search, I want know, Will we search in the client or in
> > service ?
>
> The search should be done on the service side. The server may have a
> very large amount of metadata; transfering all of them on the client
> side would be too costly.
>
> Was it your question? Maybe I misunderstood?
>
> Martin
>
>
>
Re: Current GSoC project state?
Posted by Martin Desruisseaux <ma...@geomatys.com>.
Hello Hao
Le 06/07/16 � 02:37, phuong hao nguyen thi a �crit :
> In my computer, I place the Geotiff file in forder geotiff and Modis file
> in forder modis. I use ReadXML and scan all file in 2 directory and read
> them .
Thanks for the indication. I see that the folder are currently
hard-coded to "/home/haonguyen/data/". This is fine for testing purpose,
but the final version will of course need to let the user choose his
directory. Do you have an idea about how to allow such configuration?
> The part, mapping from ISO 19115 metadata and the SummaryRecord returned by
> the CSW. I don't understand you. I use ReadXML to read file and set to
> SummaryRecord . Can you guide me ?
I see that ReadXML extract values from ISO 19115 metadata and gives them
to the SummaryRecord constructor. This is the idea, but I suggest the
following modifications:
* Instead of extracting ISO 19115 values in ReadXML, I suggest to
extract them in the SummaryRecord constructor (the constructor would
expect an org.opengis.metadata.Metadata object in argument). This
would avoid the duplication of code that we currently see in
ReadXML.listModis() and ReadXML.listGeotiff() methods.
* The Element class should be renamed BoundingBox.
* The mapping from ISO 19115 to SummaryRecord should follow the OGC
recommendations:
o Go on http://www.opengeospatial.org/standards/cat
o Download document 07-045 (OGC Catalogue Services Specification
2.0.2 - ISO Metadata Application Profile (1.0.0))
o Scroll down to table 6 at page 41.
In table 6, we can see that the SummaryRecord title attribute should be
taken from Metadata.identificationInfo.citation.title. We should modify
the code so that it follow those recommendations.
I would like to know, how were determined the fields in SummaryRecord
and in Element (or BoundingBox)? Do they come from those files?
* http://schemas.opengis.net/csw/2.0.2/record.xsd
* http://schemas.opengis.net/ows/1.0.0/owsCommon.xsd
For example, owsCommon.xsd define the BoudingBox type with two elements:
LowerCorner and UpperCorner. But the Element class in VNSCweb is defined
with westBoundLongitude, eastBoundLongitude, etc. Can you give me a link
(other than ISO 19115) where those elements were defined?
> And the part search, I want know, Will we search in the client or in
> service ?
The search should be done on the service side. The server may have a
very large amount of metadata; transfering all of them on the client
side would be too costly.
Was it your question? Maybe I misunderstood?
Martin
Re: Current GSoC project state?
Posted by phuong hao nguyen thi <ng...@gmail.com>.
Hello Martin,
In my computer, I place the Geotiff file in forder geotiff and Modis file
in forder modis. I use ReadXML and scan all file in 2 directory and read
them .
The part, mapping from ISO 19115 metadata and the SummaryRecord returned by
the CSW. I don't understand you. I use ReadXML to read file and set to
SummaryRecord . Can you guide me ?
And the part search, I want know, Will we search in the client or in
service ?
Thanks so much.
Hao
On Wed, Jul 6, 2016 at 5:05 AM, Martin Desruisseaux <
martin.desruisseaux@geomatys.com> wrote:
> Hello Hao
>
> I executed the latest version of VNSCweb and this look encouraging! By
> the way, the maven.geotoolkit.org repository is back online, so you
> should not be blocked anymore by the issue reported last weekend.
>
> Last time I looked in the code, the list of metadata files available in
> the catalog was hard-coded (one Landsat and one Modis). Do you still
> plan to scan a directory content instead? And if yes, have you chosen
> which directory?
>
> Did you started to work on a mapping from ISO 19115 metadata object (as
> given by org.apache.sis.metadata.iso.DefaultMetadata) and the
> SummaryRecord returned by the CSW? If not, I will give you some links
> that may help.
>
> Martin
>
>
>