You are viewing a plain text version of this content. The canonical link for it is here.
Posted to infrastructure-dev@apache.org by Git at Apache <gi...@git.apache.org> on 2012/07/14 09:56:29 UTC
hadoop-hdfs pull request: glose_Fb
GitHub user AndisthermalFindLasthree opened a pull request:
https://github.com/apache/hadoop-hdfs/pull/2
glose_Fb
$ git commit -m "Fixing all of the bugs"
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/AndisthermalFindLasthree/hadoop-hdfs HDFS-1073
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hadoop-hdfs/pull/2.patch
----
commit e733714c470789e8d0b5a0fd1e38d156f8893906
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-28T22:53:50-07:00
Branching for development on HDFS-1073 (simpler model for NameNode FSImage and edit logs)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1086482 13f79535-47bb-0310-9956-ffa450edef68
commit a11f1ecdbe9b115520575779855073e502616c4a
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-28T22:58:46-07:00
Add separate CHANGES files for HDFS-1073 branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1086485 13f79535-47bb-0310-9956-ffa450edef68
commit 72decf95cb78bc337ff3a8a846e3ce8436d1af91
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-28T23:01:47-07:00
HDFS-1521. Persist transaction ID on disk between NN restarts. Contributed by Ivan Kelly and Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1086487 13f79535-47bb-0310-9956-ffa450edef68
commit b12fc7b8c803c6047ead23a50fc749c73e995c17
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-30T10:12:58-07:00
HDFS-1538. Refactor more startup and image loading code out of FSImage. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1087020 13f79535-47bb-0310-9956-ffa450edef68
commit e3a88ea7d36c24cacb219a1d127a2ce9f0067c43
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-30T18:54:21-07:00
HDFS-1792. Add code to detect valid length of an edits file. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1087156 13f79535-47bb-0310-9956-ffa450edef68
commit aa518b8c6bccb1aaf5ea8fb29e20dfcab7be1e9d
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-31T20:46:39-07:00
HDFS-1793. Add code to inspect a storage directory with txid-based filenames. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1087573 13f79535-47bb-0310-9956-ffa450edef68
commit 89a1361948b4570bdc525eaf92c4c19d0ca18388
Author: Todd Lipcon <to...@apache.org>
Date: 2011-03-31T20:50:38-07:00
HDFS-1794. Add code to list which edit logs are available on a remote NN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1087574 13f79535-47bb-0310-9956-ffa450edef68
commit 675e2acabc56c92b6d5cae78aa85508ac2a90681
Author: Todd Lipcon <to...@apache.org>
Date: 2011-04-06T21:46:32-07:00
HDFS-1799. Refactor log rolling and filename management into a JournalManager interface. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1089737 13f79535-47bb-0310-9956-ffa450edef68
commit 564b20a8370c4a87b141331ae6bdcbd02d56c170
Author: Todd Lipcon <to...@apache.org>
Date: 2011-04-07T13:30:15-07:00
Revert HDFS-1799 from r1089737 - Ivan has split this work into three smaller patches to be committed instead.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1089992 13f79535-47bb-0310-9956-ffa450edef68
commit e239864a3c9c2bfc5ee2b04bca0e98fe1cf0abaf
Author: Todd Lipcon <to...@apache.org>
Date: 2011-04-19T19:28:19-07:00
Merge HDFS trunk r1095235 into HDFS-1073 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1095253 13f79535-47bb-0310-9956-ffa450edef68
commit d7022fdb1d9cffd04ddd02f706a7069b74715bd9
Author: Todd Lipcon <to...@apache.org>
Date: 2011-04-21T22:33:05-07:00
HDFS-1858. Add state management variables to FSEditLog. Contributed by Todd Lipcon and Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1095867 13f79535-47bb-0310-9956-ffa450edef68
commit deb245b90af49582301e8772aab6aaef5f4fc68f
Author: Todd Lipcon <to...@apache.org>
Date: 2011-04-21T22:39:04-07:00
HDFS-1859. Add some convenience functions to iterate over edit log streams. Contributed by Ivan Kelly and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1095868 13f79535-47bb-0310-9956-ffa450edef68
commit d7b87db2d3b9909d1a3d505c028a127e82be4931
Author: Todd Lipcon <to...@apache.org>
Date: 2011-04-28T20:03:25-07:00
Merge trunk as of r1097329 into HDFS-1073
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1097671 13f79535-47bb-0310-9956-ffa450edef68
commit a2eec314d6b91a36e3869aac491d8b29f692081b
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-04T19:19:55-07:00
Amend HDFS-1792. Address review feedback from Eli to rename one local variable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1099667 13f79535-47bb-0310-9956-ffa450edef68
commit 37f2dff7462774da9d293984d19994def9aa7e6a
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-04T22:32:35-07:00
HDFS-1894. Add constants for LAYOUT_VERSIONs in edits log branch. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1099686 13f79535-47bb-0310-9956-ffa450edef68
commit 00a63cd8f4cca1818de0f60e790feff0e9118dfa
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-04T22:40:07-07:00
Merge trunk (including federation) into HDFS-1073 branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1099687 13f79535-47bb-0310-9956-ffa450edef68
commit 6822704771fcb5c877aee1b1d27157af75f7e414
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-05T11:32:10-07:00
HDFS-1892. Fix EditLogFileInputStream.getValidLength to be aware of OP_INVALID filler. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1099911 13f79535-47bb-0310-9956-ffa450edef68
commit fec4f2f68b716ea2fd5f4b52ffef138c499d495a
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-05T15:33:16-07:00
HDFS-1799. Refactor log rolling and filename management out of FSEditLog. Contributed by Ivan Kelly and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1099986 13f79535-47bb-0310-9956-ffa450edef68
commit 7e18a6526253f154f54f5d048f9c6a7cbd617c0d
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-05T17:57:13-07:00
Amend previous merge to update EditsLoaderCurrent with new LAYOUT_VERSION value
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1100010 13f79535-47bb-0310-9956-ffa450edef68
commit e2308c6efacf64d1a5c4bcc3fff0adee28066295
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-08T16:57:31-07:00
Address minor review feedback from eli on HDFS-1793.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1100841 13f79535-47bb-0310-9956-ffa450edef68
commit 5606b244bfd104b9c1a936ebc9fd6496c7047dec
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-08T17:03:54-07:00
Merge HDFS trunk into HDFS-1073 branch to fix broken unit tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1100842 13f79535-47bb-0310-9956-ffa450edef68
commit 69bc97c65190659b791fd4d474ba5e1a38b61f15
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-08T17:11:52-07:00
Fix one more usage of NameNode.format which was broken due to federation changes merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1100845 13f79535-47bb-0310-9956-ffa450edef68
commit 04f547d5ef34c0178345be0eb4f8af49d1a06c41
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-08T17:32:22-07:00
HDFS-1801. Remove use of timestamps to identify checkpoints and logs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1100847 13f79535-47bb-0310-9956-ffa450edef68
commit 0c7b4a6440fac79ddce53c6ef2d0c2728716a2ca
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-12T16:34:50-07:00
Merge trunk into HDFS-1073.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1102509 13f79535-47bb-0310-9956-ffa450edef68
commit 3337f9d937c6e9b44a679d518ba51f4674218b66
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-12T16:45:02-07:00
HDFS-1930. TestDFSUpgrade failing in HDFS-1073 branch. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1102512 13f79535-47bb-0310-9956-ffa450edef68
commit 351383f31734043e8eb327c06f295066a74b0c48
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-12T20:33:42-07:00
HDFS-1800. Extend image checksumming to function with multiple fsimage files per directory. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1102556 13f79535-47bb-0310-9956-ffa450edef68
commit 6101fcf35ba3674a56683046510d8bb34e8ee0d4
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-18T11:48:31-07:00
HDFS-1725. Set storage directories only at FSImage construction. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1124376 13f79535-47bb-0310-9956-ffa450edef68
commit 82905acb1cc54dbd7c4d850ba80345e019c496f8
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-18T16:44:23-07:00
Merge trunk into HDFS-1073
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1124466 13f79535-47bb-0310-9956-ffa450edef68
commit e1481fcae2218dffead690e86d5e43b29e1da8e4
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-18T19:37:37-07:00
HDFS-1926. Remove references to StorageDirectory from JournalManager interface. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1124518 13f79535-47bb-0310-9956-ffa450edef68
commit ab71b1a3cf4a8ab314021a91d55a38e99eaa8fb3
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-22T18:19:49-07:00
HDFS-1893. Change edit logs and images to be named based on txid
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1126286 13f79535-47bb-0310-9956-ffa450edef68
commit c0c54079c02a449295ca575337b5b8bf5200610a
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-22T18:42:31-07:00
Merge trunk into HDFS-1073.
Temporarily disabled the test case for HDFS-1952 (added a TODO)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1126291 13f79535-47bb-0310-9956-ffa450edef68
commit a09d1889e0ac13696dbb38695d639e310478e66e
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-23T18:03:30-07:00
HDFS-1985. Clean up image transfer servlet. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1126817 13f79535-47bb-0310-9956-ffa450edef68
commit 8cece0ab733c05be1e68651bb7761116985f096f
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-24T18:00:20-07:00
HDFS-1984. Enable multiple secondary namenodes to run simultaneously. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1127345 13f79535-47bb-0310-9956-ffa450edef68
commit 032204d59028dd0025829af452019d42d71ddb42
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-24T18:01:25-07:00
HDFS-1987. Re-enable TestCheckpoint.testSecondaryImageDownload which was not running previously. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1127346 13f79535-47bb-0310-9956-ffa450edef68
commit 3e9850f909de2ae7db582026ea5cc71d0552881c
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-24T18:10:42-07:00
HDFS-1993. TestCheckpoint needs to clean up between cases. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1127353 13f79535-47bb-0310-9956-ffa450edef68
commit 647f5ef2e8141028159b8b18d61758334ac011c1
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-24T18:13:28-07:00
HDFS-1992. Remove vestiges of NNStorageListener. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1127354 13f79535-47bb-0310-9956-ffa450edef68
commit f8c07aaa495a2f24c5e1a9903715d38d3a61e7ce
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-26T11:55:44-07:00
HDFS-1991. Some refactoring of Secondary NameNode to be able to share more code with the BackupNode or CheckpointNode. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1128032 13f79535-47bb-0310-9956-ffa450edef68
commit 371520f9332397b92fa2af6b2067d184c5538d21
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-27T13:44:16-07:00
HDFS-1994. Fix race conditions when running two rapidly checkpointing Secondary NameNodes. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1128450 13f79535-47bb-0310-9956-ffa450edef68
commit d23ce5fd853a60abe8ea956f7953aa804fb58698
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-27T13:48:26-07:00
HDFS-2001. Remove use of previous.checkpoint and lastcheckpoint.tmp directories. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1128452 13f79535-47bb-0310-9956-ffa450edef68
commit 6155c000504934f9d99ef1c353dac1e1273d2535
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-27T14:12:02-07:00
Merge trunk into HDFS-1073
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1128459 13f79535-47bb-0310-9956-ffa450edef68
commit 18c0be75dd9136e2d3c2c6a31350f31ca5e1d35a
Author: Todd Lipcon <to...@apache.org>
Date: 2011-05-31T14:56:18-07:00
HDFS-2015. Remove checkpointTxId from VERSION file. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1129935 13f79535-47bb-0310-9956-ffa450edef68
commit 95694655c40308a6f0a7a450a86422c5d929cd72
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-06T18:11:15-07:00
Merge trunk into HDFS-1073. Some TODOs left for usage of the new LayoutVersion improvements
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1132846 13f79535-47bb-0310-9956-ffa450edef68
commit d41031ff493a71665d333ce0bf995fecc0fa7309
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-06T18:24:48-07:00
Cleanup post-merge to use LayoutVersion class instead of constants for 1073 version checks
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1132852 13f79535-47bb-0310-9956-ffa450edef68
commit 852e95bf9903d192e6745edc004b9c039c2530f2
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-07T15:30:25-07:00
HDFS-2016. Add infrastructure to remove or archive old and unneeded storage files within the name directories. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1133183 13f79535-47bb-0310-9956-ffa450edef68
commit 3ac87f42b513ee91e0cfdd52183092b8015ee70d
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-09T15:50:45-07:00
HDFS-2047. Improve TestNamespace and TestEditLog in HDFS-1073 branch. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1134123 13f79535-47bb-0310-9956-ffa450edef68
commit cbf8c04835f99e466cea18c3a74b3a2940d46274
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-09T15:56:43-07:00
HDFS-2048. Add upgrade tests and fix upgrade from 0.22 with corrupt image. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1134125 13f79535-47bb-0310-9956-ffa450edef68
commit 30f0e99a99fc180b0af01bf94305c62bfff75d3e
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-09T15:57:50-07:00
HDFS-2027. Image inspector should return finalized logs before unfinalize logs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1134127 13f79535-47bb-0310-9956-ffa450edef68
commit b65cdfc6cf3ad31cfe349d1e496bb3e87ff0b052
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-09T17:11:32-07:00
Merge trunk into HDFS-1073. Needs a few edits post-merge due to inclusion of HDFS-2003.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1134137 13f79535-47bb-0310-9956-ffa450edef68
commit b3fe2429fc709d5a6084d77a12f5179266fe6cbd
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-09T18:05:58-07:00
Update FSEditLogOp to include LOG_SEGMENT ops after merge with trunk and HDFS-2003.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1134161 13f79535-47bb-0310-9956-ffa450edef68
commit a425c4f0c1a633b31a5a22a4b2a5e4aa85512a10
Author: Todd Lipcon <to...@apache.org>
Date: 2011-06-09T18:23:36-07:00
Fix TestFSEditLogLoader for new layout. (trivial fixup)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hdfs/branches/HDFS-1073@1134166 13f79535-47bb-0310-9956-ffa450edef68
commit 025c234443425895d029efe2731a1711d8aeaeb8
Author: AndisthermalFindLasthree <ba...@gmail.com>
Date: 2012-07-14T00:55:39-07:00
Update HDFS-1073
----