You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Chris Nauroth <cn...@apache.org> on 2025/08/13 18:20:21 UTC

[DISCUSS] Merge HADOOP-19343 (GCS FileSystem)

Hello everyone,

I'd like to start a discussion on merging the HADOOP-19343 branch (GCS
FileSystem) to trunk for inclusion in the 3.5.0 release.

Summary:

   - Issue HADOOP-19343 contains the original proposal and discussion.
   - Development has proceeded according to that proposal, primarily driven
   by Arunkumar Chacko <ar...@google.com> with code reviews and
   commits by me.
   - This is largely a port of the existing Apache-licensed GCS FileSystem
   codebase, which has been running successfully in production environments
   for multiple years.
   - We think we've reached a feature-complete state for 3.5.0 with
   integration test coverage and documentation. Subsequent enhancements can
   target future releases.
   - I've opened a pull request for the merge to see how pre-commit likes
   it.
   - I think we still need reviews and updates of license information
   before we proceed with the merge.

Please let us know your feedback. If there are no objections raised for a
few days, I'll proceed to a [VOTE].

Chris Nauroth

Re: [DISCUSS] Merge HADOOP-19343 (GCS FileSystem)

Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
+1 . Yes this will be great!

On Thu, Aug 21, 2025 at 7:31 PM Chris Nauroth <cn...@apache.org> wrote:

> Sounds good! I have a few small patches remaining on the feature branch
> that need committer reviews. Once these are reviewed and committed, I'll
> refresh the full merge PR and start the [VOTE] thread.
>
> https://github.com/apache/hadoop/pull/7874
> https://github.com/apache/hadoop/pull/7877
> https://github.com/apache/hadoop/pull/7883
> https://github.com/apache/hadoop/pull/7891
>
> Chris Nauroth
>
>
> On Thu, Aug 14, 2025 at 3:47 AM Steve Loughran <stevel@cloudera.com.invalid
> >
> wrote:
>
> > I'm in favour of that merge...if there are problems we can fix in the
> repo.
> > Having it merged is the way to get a broader test environment and so find
> > those problems.
> >
> > Steve
> >
> > (who has the google 3.1.3 branch open in an IDE right now)
> >
> > On Wed, 13 Aug 2025 at 19:21, Chris Nauroth <cn...@apache.org> wrote:
> >
> > > Hello everyone,
> > >
> > > I'd like to start a discussion on merging the HADOOP-19343 branch (GCS
> > > FileSystem) to trunk for inclusion in the 3.5.0 release.
> > >
> > > Summary:
> > >
> > >    - Issue HADOOP-19343 contains the original proposal and discussion.
> > >    - Development has proceeded according to that proposal, primarily
> > driven
> > >    by Arunkumar Chacko <ar...@google.com> with code reviews and
> > >    commits by me.
> > >    - This is largely a port of the existing Apache-licensed GCS
> > FileSystem
> > >    codebase, which has been running successfully in production
> > environments
> > >    for multiple years.
> > >    - We think we've reached a feature-complete state for 3.5.0 with
> > >    integration test coverage and documentation. Subsequent enhancements
> > can
> > >    target future releases.
> > >    - I've opened a pull request for the merge to see how pre-commit
> likes
> > >    it.
> > >    - I think we still need reviews and updates of license information
> > >    before we proceed with the merge.
> > >
> > > Please let us know your feedback. If there are no objections raised
> for a
> > > few days, I'll proceed to a [VOTE].
> > >
> > > Chris Nauroth
> > >
> >
>

Re: [DISCUSS] Merge HADOOP-19343 (GCS FileSystem)

Posted by Chris Nauroth <cn...@apache.org>.
Sounds good! I have a few small patches remaining on the feature branch
that need committer reviews. Once these are reviewed and committed, I'll
refresh the full merge PR and start the [VOTE] thread.

https://github.com/apache/hadoop/pull/7874
https://github.com/apache/hadoop/pull/7877
https://github.com/apache/hadoop/pull/7883
https://github.com/apache/hadoop/pull/7891

Chris Nauroth


On Thu, Aug 14, 2025 at 3:47 AM Steve Loughran <st...@cloudera.com.invalid>
wrote:

> I'm in favour of that merge...if there are problems we can fix in the repo.
> Having it merged is the way to get a broader test environment and so find
> those problems.
>
> Steve
>
> (who has the google 3.1.3 branch open in an IDE right now)
>
> On Wed, 13 Aug 2025 at 19:21, Chris Nauroth <cn...@apache.org> wrote:
>
> > Hello everyone,
> >
> > I'd like to start a discussion on merging the HADOOP-19343 branch (GCS
> > FileSystem) to trunk for inclusion in the 3.5.0 release.
> >
> > Summary:
> >
> >    - Issue HADOOP-19343 contains the original proposal and discussion.
> >    - Development has proceeded according to that proposal, primarily
> driven
> >    by Arunkumar Chacko <ar...@google.com> with code reviews and
> >    commits by me.
> >    - This is largely a port of the existing Apache-licensed GCS
> FileSystem
> >    codebase, which has been running successfully in production
> environments
> >    for multiple years.
> >    - We think we've reached a feature-complete state for 3.5.0 with
> >    integration test coverage and documentation. Subsequent enhancements
> can
> >    target future releases.
> >    - I've opened a pull request for the merge to see how pre-commit likes
> >    it.
> >    - I think we still need reviews and updates of license information
> >    before we proceed with the merge.
> >
> > Please let us know your feedback. If there are no objections raised for a
> > few days, I'll proceed to a [VOTE].
> >
> > Chris Nauroth
> >
>

Re: [DISCUSS] Merge HADOOP-19343 (GCS FileSystem)

Posted by Steve Loughran <st...@cloudera.com.INVALID>.
I'm in favour of that merge...if there are problems we can fix in the repo.
Having it merged is the way to get a broader test environment and so find
those problems.

Steve

(who has the google 3.1.3 branch open in an IDE right now)

On Wed, 13 Aug 2025 at 19:21, Chris Nauroth <cn...@apache.org> wrote:

> Hello everyone,
>
> I'd like to start a discussion on merging the HADOOP-19343 branch (GCS
> FileSystem) to trunk for inclusion in the 3.5.0 release.
>
> Summary:
>
>    - Issue HADOOP-19343 contains the original proposal and discussion.
>    - Development has proceeded according to that proposal, primarily driven
>    by Arunkumar Chacko <ar...@google.com> with code reviews and
>    commits by me.
>    - This is largely a port of the existing Apache-licensed GCS FileSystem
>    codebase, which has been running successfully in production environments
>    for multiple years.
>    - We think we've reached a feature-complete state for 3.5.0 with
>    integration test coverage and documentation. Subsequent enhancements can
>    target future releases.
>    - I've opened a pull request for the merge to see how pre-commit likes
>    it.
>    - I think we still need reviews and updates of license information
>    before we proceed with the merge.
>
> Please let us know your feedback. If there are no objections raised for a
> few days, I'll proceed to a [VOTE].
>
> Chris Nauroth
>