You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/01/05 02:28:40 UTC
[GitHub] [flink] liufangqi commented on pull request #18059: [FLINK-25224][filesystem] Bump Hadoop version to 2.8.4
liufangqi commented on pull request #18059:
URL: https://github.com/apache/flink/pull/18059#issuecomment-1005329107
> Hi @liufangqi, there have been no objections from the community [1] and there is a consensus on making 2.8.5 the minimal supported version.
>
> We should remove the 2.4.x cron build as it's no longer necessary.
>
> Can you please double checked that the version is updated in all places, I can still see some left-overs in documentation, ...
>
> ```shell
> $ git grep '2\.8\.3'
> azure-pipelines.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12 -Darchunit.freeze.store.default.allowStoreUpdate=false"
> azure-pipelines.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12 -Darchunit.freeze.store.default.allowStoreUpdate=false"
> docs/content.zh/docs/deployment/filesystems/gcs.md:We have tested with `flink-shared-hadoop2-uber` version >= `2.8.3-1.8.3`.
> docs/content.zh/docs/dev/dataset/hadoop_compatibility.md: <version>2.8.3</version>
> docs/content/docs/connectors/dataset/formats/hadoop.md: <version>2.8.3</version>
> docs/content/docs/connectors/datastream/formats/hadoop.md: <version>2.8.3</version>
> docs/content/docs/deployment/filesystems/gcs.md:We have tested with `flink-shared-hadoop2-uber` version >= `2.8.3-1.8.3`.
> docs/content/docs/dev/dataset/hadoop_map_reduce.md: <version>2.8.3</version>
> flink-end-to-end-tests/test-scripts/docker-hadoop-secure-cluster/README.md:* Hadoop 2.8.3
> flink-jepsen/src/jepsen/flink/flink.clj:(def hadoop-dist-url "https://archive.apache.org/dist/hadoop/common/hadoop-2.8.3/hadoop-2.8.3.tar.gz")
> flink-yarn-tests/README.md:* There is a known problem causing test instabilities due to our usage of Hadoop 2.8.3 executing the
> tools/azure-pipelines/build-apache-repo.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12"
> tools/azure-pipelines/build-apache-repo.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12"
> tools/azure-pipelines/build-apache-repo.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12 -Djdk11 -Pjava11-target"
> tools/azure-pipelines/build-apache-repo.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12 -Penable-adaptive-scheduler"
> tools/azure-pipelines/build-apache-repo.yml: environment: PROFILE="-Dhadoop.version=2.8.3 -Dinclude_hadoop_aws -Dscala-2.12"
> ```
>
> [1] https://lists.apache.org/thread/81fhnwfxomjhyy59f9bbofk9rxpdxjo5
>
> Thanks for the patience, I think this was worth the wait to make sure that we don't break anyone.
@dmvk THX for your effort, I saw it. My understand may be wrong that I thought just change some place is OK. I will check all the hadoop version in the flink to make sure all the version (maven pom / azure yml / markdown file etc) was bumped to 2.8.5 in the next commit.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org