You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by Piergiorgio Lucidi <pi...@apache.org> on 2017/01/30 20:33:54 UTC
Re: Repositories as Output Connectors
Ok guys,
we have a first implementation of the CMIS Output Connector but I have to
confess that I have worked on this in a very discontinuously way in the
last two months.
We also need to do some debugging of all the code, I hope to spend some
time on this during this week.
I think that I will need your help Rafa ;)
If there is someone that would like to give a hand please drop a message in
the issue.
We have three main tasks to do:
1. Debugging
2. Metadata mapping
3. Integration test
I would like to track this discussion directly on the issue CONNECTORS-1356
[1].
Cheers,
Piergiorgio
[1] - https://issues.apache.org/jira/browse/CONNECTORS-1356
2016-11-28 11:09 GMT+01:00 Piergiorgio Lucidi <pi...@apache.org>:
>
>
> 2016-11-24 10:55 GMT+01:00 Karl Wright <da...@gmail.com>:
>
>> Hi Piergiorgio,
>>
>> Unless you can think of a technical difference between an "output index
>> connector" and an "output content connector", I don't think it makes sense
>> to introduce a new type of connector for this. It's clear by the target
>> whether it's for content or for an index. For example, a CMIS output
>> connector would obviously not be for building indexes.
>>
>> What do you mean by "output blockchain connector"?
>>
>
> I'm wondering if it can makes sense to consider the implementation of a
> connector dedicated to read contents and transactions from a relational
> datasource and then create blockchain records using any BlockChain API
> available in the market today.
>
> I think that it could be very useful because blockchain storage is used as
> a distributed database and probably during the next year a potential use
> case could be migrate an existent datasource against a blockchain provider.
>
> I mean, this is just an idea but probably we will arrive to this later but
> I would like to start a discussion about this or anyway have different
> opinions.
>
> Piergiorgio
>
>
>>
>> Thanks,
>> Karl
>>
>>
>> On Thu, Nov 24, 2016 at 4:31 AM, Piergiorgio Lucidi <
>> piergiorgio@apache.org>
>> wrote:
>>
>> > Hi guys,
>> >
>> > I have to confess that many times I wondered if this use case can make
>> > sense in ManifoldCF.
>> >
>> > I mean at an high level Manifold get contents in input and creates
>> search
>> > indexes as the main output.
>> > So it seems that we are addressing a huge swerve in terms of features.
>> >
>> > I totally agree with Rafa and I would like to start the initial
>> > implementation for the CMIS Output Connector.
>> >
>> > I suggest to add a different naming convention for the output connectors
>> > because we will have at least two different types:
>> >
>> > - Output Index Connector
>> > - Output Content Connector
>> >
>> > Or something similar to these I listed above.
>> >
>> > What do you think also about an eventual new type Output Blockchain
>> > Connector?
>> >
>> > Please share your ideas ^__^
>> >
>> > PJ
>> >
>> > 2016-11-23 23:55 GMT+01:00 Rafa Haro <rh...@apache.org>:
>> >
>> > > Indeed, implementations for each repository would be needed. But I can
>> > > ensure this is a quite common use case. So probably it is worth to
>> start
>> > > contributing repository output connectors
>> > >
>> > > Thanks for sharing your opinion Karl!
>> > > El El mié, 23 nov 2016 a las 23:37, Karl Wright <da...@gmail.com>
>> > > escribió:
>> > >
>> > > > Hi Rafa,
>> > > >
>> > > > This is not crazy but you really do have to have an output connector
>> > for
>> > > > each repository type you want to push documents into. We have done
>> > this
>> > > > for the filesystem but really for nothing much else, so far. But I
>> see
>> > > no
>> > > > reason it could not be done.
>> > > >
>> > > > The code needed to output documents into a repository is, of course,
>> > > > totally different than the code needed to read from one.
>> > > >
>> > > > Security is a problem you'd once again have to figure out on a
>> > repository
>> > > > by repository basis.
>> > > >
>> > > > Thanks,
>> > > > Karl
>> > > >
>> > > >
>> > > > On Wed, Nov 23, 2016 at 5:09 PM, Rafa Haro <rh...@apache.org>
>> wrote:
>> > > >
>> > > > > Hi,
>> > > > >
>> > > > > I just wanted to share an (almost) random thought I have had from
>> > time
>> > > to
>> > > > > time. In the lasts years, I have faced several migrations between
>> > > > different
>> > > > > ECM systems (for example from Alfresco to Nuxeo). Several times I
>> > have
>> > > > > consider the possibility to use ManifoldCF for this, at the end I
>> was
>> > > > > wondering my self "why not?". My main fear is about permissions
>> > > > > replications from different systems.
>> > > > >
>> > > > > Besides that, what do you guys think about that possibility?
>> > > > >
>> > > > > Maybe creating a new type of output connector ....? Am I
>> completely
>> > > > crazy?
>> > > > > Just wanted to hear your opinions
>> > > > >
>> > > > > Cheers!
>> > > > > Rafa
>> > > > >
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > Piergiorgio Lucidi
>> > Technology Evangelist @ Sourcesense
>> > Author and Technical Reviewer @ Packt Publishing
>> > Mentor / PMC Member / Committer @ Apache Software Foundation
>> > Community Star / Wiki Gardener / Forum Moderator / Certified Instructor,
>> > Engineer and Administrator @ Alfresco
>> > Top Community Contributor @ Crafter
>> > Project Leader / Committer @ JBoss
>> > http://www.open4dev.com
>> >
>>
>
>
>
> --
> Piergiorgio Lucidi
> Technology Evangelist @ Sourcesense
> Author and Technical Reviewer @ Packt Publishing
> Mentor / PMC Member / Committer @ Apache Software Foundation
> Community Star / Wiki Gardener / Forum Moderator / Certified Instructor,
> Engineer and Administrator @ Alfresco
> Top Community Contributor @ Crafter
> Project Leader / Committer @ JBoss
> http://www.open4dev.com
>
--
Piergiorgio Lucidi
Technology Evangelist @ Sourcesense
Author and Technical Reviewer @ Packt Publishing
Mentor / PMC Member / Committer @ Apache Software Foundation
Wiki Gardener / Forum Moderator / Certified Instructor, Engineer and
Administrator @ Alfresco
Top Community Contributor @ Crafter
Project Leader / Committer @ JBoss
Technology Advisory Team Member @ Microsoft
http://www.open4dev.com
Re: Repositories as Output Connectors
Posted by Karl Wright <da...@gmail.com>.
Hi Piergiorgio,
Thanks for looking into this!
Karl
On Mon, Jan 30, 2017 at 3:33 PM, Piergiorgio Lucidi <pi...@apache.org>
wrote:
> Ok guys,
>
> we have a first implementation of the CMIS Output Connector but I have to
> confess that I have worked on this in a very discontinuously way in the
> last two months.
>
> We also need to do some debugging of all the code, I hope to spend some
> time on this during this week.
>
> I think that I will need your help Rafa ;)
>
> If there is someone that would like to give a hand please drop a message in
> the issue.
>
> We have three main tasks to do:
> 1. Debugging
> 2. Metadata mapping
> 3. Integration test
>
> I would like to track this discussion directly on the issue CONNECTORS-1356
> [1].
>
> Cheers,
> Piergiorgio
>
> [1] - https://issues.apache.org/jira/browse/CONNECTORS-1356
>
> 2016-11-28 11:09 GMT+01:00 Piergiorgio Lucidi <pi...@apache.org>:
>
> >
> >
> > 2016-11-24 10:55 GMT+01:00 Karl Wright <da...@gmail.com>:
> >
> >> Hi Piergiorgio,
> >>
> >> Unless you can think of a technical difference between an "output index
> >> connector" and an "output content connector", I don't think it makes
> sense
> >> to introduce a new type of connector for this. It's clear by the target
> >> whether it's for content or for an index. For example, a CMIS output
> >> connector would obviously not be for building indexes.
> >>
> >> What do you mean by "output blockchain connector"?
> >>
> >
> > I'm wondering if it can makes sense to consider the implementation of a
> > connector dedicated to read contents and transactions from a relational
> > datasource and then create blockchain records using any BlockChain API
> > available in the market today.
> >
> > I think that it could be very useful because blockchain storage is used
> as
> > a distributed database and probably during the next year a potential use
> > case could be migrate an existent datasource against a blockchain
> provider.
> >
> > I mean, this is just an idea but probably we will arrive to this later
> but
> > I would like to start a discussion about this or anyway have different
> > opinions.
> >
> > Piergiorgio
> >
> >
> >>
> >> Thanks,
> >> Karl
> >>
> >>
> >> On Thu, Nov 24, 2016 at 4:31 AM, Piergiorgio Lucidi <
> >> piergiorgio@apache.org>
> >> wrote:
> >>
> >> > Hi guys,
> >> >
> >> > I have to confess that many times I wondered if this use case can make
> >> > sense in ManifoldCF.
> >> >
> >> > I mean at an high level Manifold get contents in input and creates
> >> search
> >> > indexes as the main output.
> >> > So it seems that we are addressing a huge swerve in terms of features.
> >> >
> >> > I totally agree with Rafa and I would like to start the initial
> >> > implementation for the CMIS Output Connector.
> >> >
> >> > I suggest to add a different naming convention for the output
> connectors
> >> > because we will have at least two different types:
> >> >
> >> > - Output Index Connector
> >> > - Output Content Connector
> >> >
> >> > Or something similar to these I listed above.
> >> >
> >> > What do you think also about an eventual new type Output Blockchain
> >> > Connector?
> >> >
> >> > Please share your ideas ^__^
> >> >
> >> > PJ
> >> >
> >> > 2016-11-23 23:55 GMT+01:00 Rafa Haro <rh...@apache.org>:
> >> >
> >> > > Indeed, implementations for each repository would be needed. But I
> can
> >> > > ensure this is a quite common use case. So probably it is worth to
> >> start
> >> > > contributing repository output connectors
> >> > >
> >> > > Thanks for sharing your opinion Karl!
> >> > > El El mié, 23 nov 2016 a las 23:37, Karl Wright <daddywri@gmail.com
> >
> >> > > escribió:
> >> > >
> >> > > > Hi Rafa,
> >> > > >
> >> > > > This is not crazy but you really do have to have an output
> connector
> >> > for
> >> > > > each repository type you want to push documents into. We have
> done
> >> > this
> >> > > > for the filesystem but really for nothing much else, so far. But
> I
> >> see
> >> > > no
> >> > > > reason it could not be done.
> >> > > >
> >> > > > The code needed to output documents into a repository is, of
> course,
> >> > > > totally different than the code needed to read from one.
> >> > > >
> >> > > > Security is a problem you'd once again have to figure out on a
> >> > repository
> >> > > > by repository basis.
> >> > > >
> >> > > > Thanks,
> >> > > > Karl
> >> > > >
> >> > > >
> >> > > > On Wed, Nov 23, 2016 at 5:09 PM, Rafa Haro <rh...@apache.org>
> >> wrote:
> >> > > >
> >> > > > > Hi,
> >> > > > >
> >> > > > > I just wanted to share an (almost) random thought I have had
> from
> >> > time
> >> > > to
> >> > > > > time. In the lasts years, I have faced several migrations
> between
> >> > > > different
> >> > > > > ECM systems (for example from Alfresco to Nuxeo). Several times
> I
> >> > have
> >> > > > > consider the possibility to use ManifoldCF for this, at the end
> I
> >> was
> >> > > > > wondering my self "why not?". My main fear is about permissions
> >> > > > > replications from different systems.
> >> > > > >
> >> > > > > Besides that, what do you guys think about that possibility?
> >> > > > >
> >> > > > > Maybe creating a new type of output connector ....? Am I
> >> completely
> >> > > > crazy?
> >> > > > > Just wanted to hear your opinions
> >> > > > >
> >> > > > > Cheers!
> >> > > > > Rafa
> >> > > > >
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Piergiorgio Lucidi
> >> > Technology Evangelist @ Sourcesense
> >> > Author and Technical Reviewer @ Packt Publishing
> >> > Mentor / PMC Member / Committer @ Apache Software Foundation
> >> > Community Star / Wiki Gardener / Forum Moderator / Certified
> Instructor,
> >> > Engineer and Administrator @ Alfresco
> >> > Top Community Contributor @ Crafter
> >> > Project Leader / Committer @ JBoss
> >> > http://www.open4dev.com
> >> >
> >>
> >
> >
> >
> > --
> > Piergiorgio Lucidi
> > Technology Evangelist @ Sourcesense
> > Author and Technical Reviewer @ Packt Publishing
> > Mentor / PMC Member / Committer @ Apache Software Foundation
> > Community Star / Wiki Gardener / Forum Moderator / Certified Instructor,
> > Engineer and Administrator @ Alfresco
> > Top Community Contributor @ Crafter
> > Project Leader / Committer @ JBoss
> > http://www.open4dev.com
> >
>
>
>
> --
> Piergiorgio Lucidi
> Technology Evangelist @ Sourcesense
> Author and Technical Reviewer @ Packt Publishing
> Mentor / PMC Member / Committer @ Apache Software Foundation
> Wiki Gardener / Forum Moderator / Certified Instructor, Engineer and
> Administrator @ Alfresco
> Top Community Contributor @ Crafter
> Project Leader / Committer @ JBoss
> Technology Advisory Team Member @ Microsoft
> http://www.open4dev.com
>