You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Davor Bonaci <da...@google.com.INVALID> on 2016/03/24 06:26:40 UTC
[HEADS UP] Directory reorganization
Hi everyone,
We pushed a pull request [1] that somewhat reorganizes directories in the
repository. This is the first step towards the organization proposed in the
document we shared a few weeks ago. Also, JB's pull request [2] changing
Maven coordinates got merged too.
I apologize for the unfortunate impact to the pending PRs.
We pushed it quickly to avoid complicated merges later on. This shouldn't
prevent feedback -- please keep it coming -- we'll address such feedback in
a follow-up commit.
This is the first step only. There are many things that are incomplete,
including:
- A few things are still at the top-level, like contrib directory or
checkstyle.xml that should go elsewhere.
- Some READMEs may now become out-of-date.
- We need a few more aggregator pom.xml files; they are not added yet.
There's nothing in this pull request that renames Dataflow to Beam; it just
moves files around without changing the content.
Thanks!
[1] https://github.com/apache/incubator-beam/pull/72
[2] https://github.com/apache/incubator-beam/pull/46
Re: [HEADS UP] Directory reorganization
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Great, let me move forward on this.
Thanks,
Regards
JB
On 03/24/2016 05:19 PM, Davor Bonaci wrote:
> No doubt; that's the direction we are heading into. TextIO and AvroIO will
> stay in core; but GCP-related IOs like BigQuery go out.
>
> On Thu, Mar 24, 2016 at 12:01 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
>
>> Hi Davor,
>>
>> It's a great move ! Thanks !
>>
>> I propose to create the io module and first move "contrib" into io (and so
>> remove contrib after). I'm not sure it makes sense to move the "core" IO
>> (TextIO, etc) outside of the SDK, but for sure, new IOs (kafka, mqtt, JMS,
>> etc) should come into io.
>>
>> Thoughts ?
>>
>> Regards
>> JB
>>
>>
>> On 03/24/2016 06:26 AM, Davor Bonaci wrote:
>>
>>> Hi everyone,
>>> We pushed a pull request [1] that somewhat reorganizes directories in the
>>> repository. This is the first step towards the organization proposed in
>>> the
>>> document we shared a few weeks ago. Also, JB's pull request [2] changing
>>> Maven coordinates got merged too.
>>>
>>> I apologize for the unfortunate impact to the pending PRs.
>>>
>>> We pushed it quickly to avoid complicated merges later on. This shouldn't
>>> prevent feedback -- please keep it coming -- we'll address such feedback
>>> in
>>> a follow-up commit.
>>>
>>> This is the first step only. There are many things that are incomplete,
>>> including:
>>> - A few things are still at the top-level, like contrib directory or
>>> checkstyle.xml that should go elsewhere.
>>> - Some READMEs may now become out-of-date.
>>> - We need a few more aggregator pom.xml files; they are not added yet.
>>>
>>> There's nothing in this pull request that renames Dataflow to Beam; it
>>> just
>>> moves files around without changing the content.
>>>
>>> Thanks!
>>>
>>> [1] https://github.com/apache/incubator-beam/pull/72
>>> [2] https://github.com/apache/incubator-beam/pull/46
>>>
>>>
>> --
>> Jean-Baptiste Onofré
>> jbonofre@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
>
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: [HEADS UP] Directory reorganization
Posted by Davor Bonaci <da...@google.com.INVALID>.
No doubt; that's the direction we are heading into. TextIO and AvroIO will
stay in core; but GCP-related IOs like BigQuery go out.
On Thu, Mar 24, 2016 at 12:01 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi Davor,
>
> It's a great move ! Thanks !
>
> I propose to create the io module and first move "contrib" into io (and so
> remove contrib after). I'm not sure it makes sense to move the "core" IO
> (TextIO, etc) outside of the SDK, but for sure, new IOs (kafka, mqtt, JMS,
> etc) should come into io.
>
> Thoughts ?
>
> Regards
> JB
>
>
> On 03/24/2016 06:26 AM, Davor Bonaci wrote:
>
>> Hi everyone,
>> We pushed a pull request [1] that somewhat reorganizes directories in the
>> repository. This is the first step towards the organization proposed in
>> the
>> document we shared a few weeks ago. Also, JB's pull request [2] changing
>> Maven coordinates got merged too.
>>
>> I apologize for the unfortunate impact to the pending PRs.
>>
>> We pushed it quickly to avoid complicated merges later on. This shouldn't
>> prevent feedback -- please keep it coming -- we'll address such feedback
>> in
>> a follow-up commit.
>>
>> This is the first step only. There are many things that are incomplete,
>> including:
>> - A few things are still at the top-level, like contrib directory or
>> checkstyle.xml that should go elsewhere.
>> - Some READMEs may now become out-of-date.
>> - We need a few more aggregator pom.xml files; they are not added yet.
>>
>> There's nothing in this pull request that renames Dataflow to Beam; it
>> just
>> moves files around without changing the content.
>>
>> Thanks!
>>
>> [1] https://github.com/apache/incubator-beam/pull/72
>> [2] https://github.com/apache/incubator-beam/pull/46
>>
>>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
Re: [HEADS UP] Directory reorganization
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Davor,
It's a great move ! Thanks !
I propose to create the io module and first move "contrib" into io (and
so remove contrib after). I'm not sure it makes sense to move the "core"
IO (TextIO, etc) outside of the SDK, but for sure, new IOs (kafka, mqtt,
JMS, etc) should come into io.
Thoughts ?
Regards
JB
On 03/24/2016 06:26 AM, Davor Bonaci wrote:
> Hi everyone,
> We pushed a pull request [1] that somewhat reorganizes directories in the
> repository. This is the first step towards the organization proposed in the
> document we shared a few weeks ago. Also, JB's pull request [2] changing
> Maven coordinates got merged too.
>
> I apologize for the unfortunate impact to the pending PRs.
>
> We pushed it quickly to avoid complicated merges later on. This shouldn't
> prevent feedback -- please keep it coming -- we'll address such feedback in
> a follow-up commit.
>
> This is the first step only. There are many things that are incomplete,
> including:
> - A few things are still at the top-level, like contrib directory or
> checkstyle.xml that should go elsewhere.
> - Some READMEs may now become out-of-date.
> - We need a few more aggregator pom.xml files; they are not added yet.
>
> There's nothing in this pull request that renames Dataflow to Beam; it just
> moves files around without changing the content.
>
> Thanks!
>
> [1] https://github.com/apache/incubator-beam/pull/72
> [2] https://github.com/apache/incubator-beam/pull/46
>
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com