You are viewing the static version of this archive.
For the interactive version, please visit: This page
Historically, Hadoop developers create patches and attache them to JIRA, andthen the Yetus bot runs precommit against the patch in the JIRA. The Github PR is more convenient for code review and less hassle for committers to merge a commit. I am proposing for the community to prefer Github PR over t...
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1207/ [Jul 23, 2019 3:07:55 AM] (ayushsaxena) HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during [Jul 23, 2019 9:24:07 AM] (stevel) HADOOP-16443. Improve help text for setfacl --set option. [Ju...
The last 2.8 release (2.8.4) was made in the last May, more than a year ago. https://hadoop.apache.org/old/releases.html How do folks feel about the fate of branch-2.8? During the last community meetup in June, it sounds like most users are still on 2.8 or even 2.7, so I don't think we want to aban...
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?pli=1# Attendees: Wei-Chiu (Cloudera), Ekanth (Uber), Craig (Target), Fabbri Fabric: mostly mentoring folks. Ad-hoc, self initiating. Google's Summer of Code is too much overhead. meeting every 2-4 weeks. Target...
Hi folks, Now we are slowly migrating from JUnit4 to JUnit5. https://issues.apache.org/jira/browse/HADOOP-14693 However, as Steve commented [1], if we are going to migrate the existing tests, the backporting cost will become too expensive. Therefore, I'd like to recommend using JUnit5 for new test...
I am using this jira filter to find jiras with patch available but unassigned. https://issues.apache.org/jira/issues/?filter=12346814&jql=project%20in%20(HADOOP%2C%20HDFS%2CYARN%2CMAPREDUCE%2CHDDS%2CSUBMARINE)%20AND%20status%20%3D%20%22Patch%20Available%22%20AND%20assignee%20%3D%20EMPTY%20ORDER%20BY...
Hello! For this week's community online sync (English, Wednesday 9am US Pacific Time), we will have CR Hota from Uber to talk about the latest update in Router Based Federation. He will touch upon the following topics: 1. Security (Development and zookeeper scale testing learnings) 2. Isolation fo...
There are a bunch of stuff that can use some attention to improve HDFS At Rest Encryption (aka Data Transparent Encryption). Here's a spreadsheet of features, bug fixes, improvements https://docs.google.com/spreadsheets/d/13oeUy0Mvmq6Ngvw9IjkY9KXiQyoRIcRlijKXG1YqGug/edit?usp=sharing I am planning ...
Very happy to have CR from Uber leading today's discussion. Here's today's sync meeting notes. https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit 8/5/2019 CR Hota (Uber) gave an update on Router Based Federation Attendee: Cloudera (Weichiu, Adam), Uber (CR Hota) a...
The Hadoop community welcome your patch contribution, and like increasingly patches are submitted via GitHub Pull Requests. That is great, as it reduces the friction to review code & commit code. However, please make sure to file a jira for your PR, as described in the How to Contribute <https://c...
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1223/ [Aug 8, 2019 12:37:50 PM] (ericp) YARN-9685: NPE when rendering the info table of leaf queue in [Aug 8, 2019 1:41:04 PM] (weichiu) YARN-9711. Missing spaces in NMClientImpl (#1177) Contributed by Charles [Aug...
Hi all, Hope this email finds you well I want to hear your thoughts about what should be the release plan for 2019. In 2018, we released: - 1 maintenance release of 2.6 - 3 maintenance releases of 2.7 - 3 maintenance releases of 2.8 - 3 releases of 2.9 - 4 releases of 3.0 - 2 releases of 3.1 Tot...
Heads up, My bad. This is becoming a mess. For the context, HDFS-12914 in branch-2 has a test failure, so I reverted it. But HDFS-13898 used a helper method (BlockManager#setBlockManagerForTesting()) added by HDFS-12914, so the revert breaks the build. Here's what I propose: (1) File a new Jira ...
Dear Submarine developers, My name is Xun Liu, I am a member of the Hadoop submarine development team. I'm one of the major contributor of Submarine since June 2018. I want to hear your thoughts about creating a separate GitHub repo under Apache to do submarine development. This is an independent ...
Hi folks, Want to hear your thoughts about what we should do to make some branches EOL. We discussed a couple of times before in dev lists and PMC list. However, we couldn't get a formal process of EOL. According to the discussion. It is hard to decide it based on time like "After 1st release, EOL ...
Hi! There are currently a few areas where there is a lack of expertise, and therefore bug reports and patches are left unreviewed. These areas include: (1) NFS gateway (2) libhdfs (3) Misc. file systems, like SFTPFileSystem Are there other areas where you have a patch that's never reviewed because...
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1231/ [Aug 16, 2019 6:33:04 AM] (sammichen) HDDS-1894. Add filter to scmcli listPipelines. (#1286) [Aug 16, 2019 6:52:09 AM] (snemeth) YARN-9749. TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk. [Aug 1...
I received some feedbacks that the bi-weekly storage online sync that happens Wednesday 9AM US pacific time (GMT-8) is too early for west coast folks, and the fact is that the majority of Hadoop developers are in the US. Would it make sense to move it to a later time to allow more US west coast par...
For this week, We will have Konstantin and the LinkedIn folks to discuss a recent project that's been baking for quite a while. This is an exciting project as it has the potential to improve NameNode's throughput by 40%. HDFS-14703 <https://issues.apache.org/jira/browse/HDFS-14703> NameNode Fine-Gr...
Hello folks, It's been more than six month Hadoop-3.2.0 is released i.e 16th Jan,2019. We have several important fixes landed in branch-3.2 (around 48 blockers/critical https://s.apache.org/ozd6o). I am planning to do a maintenance release of 3.2.1 in next few weeks i.e around 1st week of Septembe...
Hi all, This is a vote thread to mark any versions smaller than 2.7 (inclusive), and 3.0 EOL. This is based on discussions of [1] This discussion runs for 7 days and will conclude on Aug 28 Wed. Please feel free to share your thoughts. Thanks, Wangda [1] http://mail-archives.apache.org/mod_mbox...
Hi folks, We have Apache Hadoop 3.1.2 released on Feb 2019. It's been more than 6 months passed and there're 246 fixes[1]. 2 blocker and 4 critical Issues [2] (As Wei-Chiu Chuang mentioned, HDFS-13596 will be another blocker) I propose my plan to do a maintenance release of 3.1.3 in the next f...
I am reverting HDFS-14476 from trunk, branch-3.2, branch-3.1, branch-2, branch-2.9, branch-2.8. This commit caused test failures as reported in HDFS-14751 <https://issues.apache.org/jira/browse/HDFS-14751> by Lisheng Sun. Sorry for the inconvenience.