You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flume.apache.org by mp...@apache.org on 2013/06/25 02:19:56 UTC
git commit: FLUME-2108. Corrections to CHANGELOG for 1.4.0 release.
Updated Branches:
refs/heads/trunk 3450859af -> cda3bd10c
FLUME-2108. Corrections to CHANGELOG for 1.4.0 release.
(Mike Percy)
Project: http://git-wip-us.apache.org/repos/asf/flume/repo
Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/cda3bd10
Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/cda3bd10
Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/cda3bd10
Branch: refs/heads/trunk
Commit: cda3bd10c61514d4b489edb088b2be4c83cfd898
Parents: 3450859
Author: Mike Percy <mp...@apache.org>
Authored: Mon Jun 24 17:18:55 2013 -0700
Committer: Mike Percy <mp...@apache.org>
Committed: Mon Jun 24 17:18:55 2013 -0700
----------------------------------------------------------------------
CHANGELOG | 100 +++------------------------------------------------------
1 file changed, 4 insertions(+), 96 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/flume/blob/cda3bd10/CHANGELOG
----------------------------------------------------------------------
diff --git a/CHANGELOG b/CHANGELOG
index 00b95b4..edbc482 100644
--- a/CHANGELOG
+++ b/CHANGELOG
@@ -1,47 +1,23 @@
Release Notes - Flume - Version v1.4.0
** New Feature
- * [FLUME-917] - Thrift Support
* [FLUME-924] - Implement a JMS source for Flume NG
* [FLUME-997] - Support secure transport mechanism
* [FLUME-1170] - Create a framework for transaction listeners
- * [FLUME-1249] - Add start/stop script
- * [FLUME-1485] - FileChannel should support checksum
* [FLUME-1502] - Support for running simple configurations embedded in host process
* [FLUME-1516] - FileChannel Write Dual Checkpoints to avoid replays
* [FLUME-1632] - Persist progress on each file in file spooling client/source
- * [FLUME-1669] - Add support for columnar event serializer in HDFS
- * [FLUME-1715] - OpenTSDB Sink
+ * [FLUME-1735] - Add support for a plugins.d directory
* [FLUME-1894] - Implement Thrift RPC
* [FLUME-1917] - FileChannel group commit (coalesce fsync)
- * [FLUME-1941] - Support defaults or inheritance in configs
- * [FLUME-1988] - Add Support for Additional Deserializers for SpoolingDirectorySource
- * [FLUME-1998] - FlumeRESTClient - A HTTP Client for Interacting with REST Servers
- * [FLUME-1999] - GooglePlusSource - An EventDrivenSource for for Streaming In Data from Google+
- * [FLUME-2000] - EmailSource - An EventDrivenSource for Streaming In Events from POP/IMAP Mailboxes
- * [FLUME-2001] - TwitterSource - An EventDrivenSource for Streaming In Data from Twitter
* [FLUME-2004] - Need to capture metrics on the Flume exec source such as events received, rejected, etc.
* [FLUME-2010] - Support Avro records in Log4jAppender and the HDFS Sink
* [FLUME-2048] - Avro container file deserializer
+ * [FLUME-2070] - Add a Flume Morphline Solr Sink
** Improvement
- * [FLUME-841] - Generate javadoc from NG build
- * [FLUME-890] - Add unit tests for flume ng channels
- * [FLUME-1033] - Create system tests for flume
- * [FLUME-1071] - Evaluate performance of AVRO source with multiple clients
- * [FLUME-1076] - SInk batch sizes vary wildy
- * [FLUME-1081] - Load testing tool for Avro source
+ * [FLUME-1076] - Sink batch sizes vary wildy
* [FLUME-1100] - HDFSWriterFactory and HDFSFormatterFactory should allow extension
- * [FLUME-1141] - Avro compression unit test should fail if compression does not work
- * [FLUME-1159] - Add reconfigurability support to components
- * [FLUME-1178] - Improve performance of SyslogTcpSource
- * [FLUME-1209] - Support file name extension for HDFS sink
- * [FLUME-1237] - Refactor configuration and add more tests.
- * [FLUME-1274] - Clarify semantics of uncaught runtime exceptions thrown from configure() method
- * [FLUME-1278] - Flume hot-reconfiguration specification
- * [FLUME-1413] - Document of Channel (especially FileChannel) and Transaction
- * [FLUME-1497] - Make the TestFileChannel.testInOut() more deterministic
- * [FLUME-1521] - Document the StressSource
* [FLUME-1571] - Channels should check for positive capacity and transaction capacity values
* [FLUME-1586] - File Channel should support verifying integrity of individual events.
* [FLUME-1652] - Logutils.getLogs could NPE
@@ -49,16 +25,11 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-1677] - Add File-channel dependency to flume-ng-node's pom.xml
* [FLUME-1699] - Make the rename of the meta file platform neutral
* [FLUME-1702] - HDFSEventSink should write to a hidden file as opposed to a .tmp file
- * [FLUME-1722] - License file corrections
- * [FLUME-1735] - Add support for a plugins.d directory
* [FLUME-1740] - Remove contrib/ directory from Flume NG
* [FLUME-1745] - FlumeConfiguration Eats Exceptions
* [FLUME-1756] - Avro client should be able to use load balancing RPC
* [FLUME-1757] - Improve configuration of hbase serializers
- * [FLUME-1759] - make file and dirname of flume log tweakable in log4j
- * [FLUME-1760] - an extra hdfs. prefix feels redundant in HDFS sink configuration
* [FLUME-1762] - File Channel should recover automatically if the checkpoint is incomplete or bad by deleting the contents of the checkpoint directory
- * [FLUME-1764] - File_roll type Sink how to achieve according to multiple files dynamically generated directory, and the file on the corresponding directory
* [FLUME-1768] - Multiplexing channel selector should allow optional-only channels
* [FLUME-1769] - Replicating channel selector should support optional channels
* [FLUME-1770] - Flume should have serializer which supports serializer the headers to a simple string
@@ -66,7 +37,6 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-1790] - Commands in EncryptionTestUtils comments require high encryption pack to be installed
* [FLUME-1794] - FileChannel check for full disks in the background
* [FLUME-1800] - Docs for spooling source durability changes
- * [FLUME-1801] - Configurable batch size for spooling client
* [FLUME-1808] - ElasticSearchSink is missing log4.properties
* [FLUME-1821] - Support configuration of hbase instances to be used in AsyncHBaseSink from flume config
* [FLUME-1847] - NPE in SourceConfiguration
@@ -83,7 +53,6 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-1926] - Optionally timeout Avro Sink Rpc Clients to avoid stickiness
* [FLUME-1940] - Log a snapshot of Flume metrics on shutdown
* [FLUME-1945] - HBase Serializer allow key from regular expression group
- * [FLUME-1961] - Enhancements to the Channel interface
* [FLUME-1976] - JMS Source document should provide instruction on JMS implementation jars
* [FLUME-1977] - JMS Source connectionFactory property is not documented
* [FLUME-1992] - ElasticSearch dependency is marked optional
@@ -97,47 +66,24 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-2049] - Compile ElasticSearchSink with elasticsearch 0.90
* [FLUME-2062] - make it possible for HBase sink to deposit event headers into corresponding column qualifiers
* [FLUME-2063] - Add Configurable charset to RegexHbaseEventSerializer
- * [FLUME-2070] - Add a Flume Morphline Solr Sink
+ * [FLUME-2076] - JMX metrics support for HTTP Source
* [FLUME-2093] - binary tarball that is created by flume's assembly shouldn't contain sources
* [FLUME-2100] - Increase default batchSize of Morphline Solr Sink
* [FLUME-2105] - Add docs for MorphlineSolrSink
** Bug
- * [FLUME-981] - Unify sink failure behavior, throwing EventDeliveryException
- * [FLUME-1000] - Properties validator misses an invalid config
- * [FLUME-1086] - duplicate lib in Flume's lib dir
- * [FLUME-1093] - HDFSEventSink gives no indication of failure when Hadoop jars aren't in the classpath
* [FLUME-1110] - HDFS Sink throws IllegalStateException when flume-daemon shuts down
- * [FLUME-1115] - project "flume-ng-node" should depends on "flume-recoverable-memory-channel"
- * [FLUME-1152] - flume-ng script has issue with hadoop 0.23 script
* [FLUME-1153] - flume-ng script is missing some agent options in help output
- * [FLUME-1161] - Logging output says name:null after initiating agent shutdown
- * [FLUME-1165] - Separate the component factories into pools which hold state and factories which simply create the new components
* [FLUME-1175] - RollingFileSink complains of Bad File Descriptor upon a reconfig event
- * [FLUME-1203] - Hbase Sink needs to check for partial failures.
- * [FLUME-1206] - Hbase sink should pull in dependencies based on profiles
- * [FLUME-1233] - HDFS Sink has problem with %c escape sequence in bucket path
* [FLUME-1262] - Move doc generation to a different profile
- * [FLUME-1283] - Flume HDFS Sink can't generate file name containing space and : which mentioned by %c
* [FLUME-1285] - FileChannel has a dependency on Hadoop IO classes
- * [FLUME-1291] - FileChannel log close calls interrupt on current thread and does not kill worker thread immediately
* [FLUME-1296] - Lifecycle supervisor should check if the monitor service is still running before supervising
- * [FLUME-1308] - HDFS Sink throws DFSOutputStream when exception when maxOpenFiles=1
- * [FLUME-1321] - BasicTransactionSemantics should never throw from close()
- * [FLUME-1378] - Sink falls into infinite lifecycle with EventDeliveryException
- * [FLUME-1403] - File channel throws logFile is null exception in channel.take
- * [FLUME-1411] - Add average events per second params to MBeans
- * [FLUME-1481] - Custom component may not support dynamic configuration
* [FLUME-1511] - Scribe-source doesn't handle zero message request correctly.
- * [FLUME-1551] - Create a home for custom Flume components
- * [FLUME-1623] - Add more info about failover sink processor
* [FLUME-1676] - ExecSource should provide a configurable charset
* [FLUME-1688] - Bump AsyncHBase version to 1.4.1
* [FLUME-1709] - HDFS CompressedDataStream doesn't support serializer parameter
* [FLUME-1720] - LICENSE file contain entry for protobuf-<version>.jar, however proper artifact name is protobuf-java-<version>.jar
- * [FLUME-1721] - SpoolDirectorySource stop should shutdown executor
* [FLUME-1731] - SpoolableDirectorySource should have configurable support for deleting files it has already completed instead of renaming
- * [FLUME-1732] - Build is failing due to netty problems
* [FLUME-1741] - ElasticSearch tests leave directory data/elasticsearch/nodes/ lying around
* [FLUME-1748] - HDFS Sink should check if the thread is interrupted before performing any HDFS operations
* [FLUME-1755] - Load balancing RPC client has issues with downed hosts
@@ -158,7 +104,6 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-1803] - Generated dist tarball is missing flume-ng-embedded-agent
* [FLUME-1804] - JMS source not included in binary dist
* [FLUME-1805] - Embedded agent deps should be specified in dependencyManagement section of pom
- * [FLUME-1815] - File Channel auto-recovery when checkpoint is bad should be optional
* [FLUME-1818] - Support various layouts in log4jappender
* [FLUME-1819] - ExecSource don't flush the cache if there is no input entries
* [FLUME-1820] - Should not be possible for RPC client to block indefinitely on close()
@@ -190,7 +135,6 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-1911] - Add deprecation back to the legacy thrift code
* [FLUME-1916] - HDFS sink should poll for # of active replicas. If less than required, roll the file.
* [FLUME-1918] - File Channel cannot handle capacity of more than 500 Million events
- * [FLUME-1919] - Consider adding areYouOK() RPC calls to Avro & Thrift RPC mechanisms
* [FLUME-1922] - HDFS Sink should optionally insert the timestamp at the sink
* [FLUME-1924] - Bug in serializer context parsing in RollingFileSink
* [FLUME-1925] - HDFS timeouts should not starve other threads
@@ -198,11 +142,9 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-1930] - Inflights should clean up executors on close.
* [FLUME-1931] - HDFS Sink has a commons-lang dependency which is missing in pom
* [FLUME-1932] - no-reload-conf command line param does not work
- * [FLUME-1936] - Configure max rolls for under-replicated blocks
* [FLUME-1937] - Issue with maxUnderReplication in HDFS sink
* [FLUME-1939] - FlumeEventQueue must check if file is open before setting the length of the file
* [FLUME-1943] - ExecSource tests failing on Jenkins
- * [FLUME-1944] - parameterising the dependency variables in pom file.
* [FLUME-1948] - plugins.d directory(ies) should be separately overridable, independent of FLUME_HOME
* [FLUME-1949] - Documentation for sink processor lists incorrect default
* [FLUME-1955] - fileSuffix does not work with compressed streams
@@ -233,7 +175,6 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-2054] - Support Version Info on Windows and fix failure of TestVersionInfo
* [FLUME-2057] - Failures in FileChannel's TestEventQueueBackingStoreFactory on Windows
* [FLUME-2060] - Failure in TestLog.testReplaySucceedsWithUnusedEmptyLogMetaDataFastReplay test on Windows
- * [FLUME-2068] - File Channel issue - recovering from BadCheckpoint exception on Windows
* [FLUME-2072] - JMX metrics support for HBase Sink
* [FLUME-2081] - JMX metrics support for SpoolDir
* [FLUME-2082] - JMX support for Seq Generator Source
@@ -241,14 +182,7 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-2098] - Make Solr sink depend on the CDK version of morphlines
** Documentation
- * [FLUME-1014] - Agent Config docs are out of date
- * [FLUME-1022] - Update Flume NG Getting Started Guide to mention pulling from trunk instead of flume-728
- * [FLUME-1144] - Update Flume User Guide with a section on Flume properties such as flume.called.from.service
- * [FLUME-1592] - Remove appendTimeout from HDFS sink docs
- * [FLUME-1594] - Document JMX options
* [FLUME-1621] - Document new MemoryChannel parameters in Flume User Guide
- * [FLUME-1624] - Docs could be more consistent when giving examples of types
- * [FLUME-1833] - Embedded Agent docs are missing from website
* [FLUME-1910] - Add thrift RPC documentation
* [FLUME-1953] - Fix dev guide error that says sink can read from multiple channels
* [FLUME-1962] - Document proper specification of lzo codec as lzop in Flume User Guide
@@ -256,42 +190,16 @@ Release Notes - Flume - Version v1.4.0
* [FLUME-2030] - Documentation of Configuration Changes JMSSource, HBaseSink, AsyncHBaseSink and ElasticSearchSink
** Task
- * [FLUME-813] - Build Flume site from Maven
- * [FLUME-1051] - Configuration System
- * [FLUME-1618] - Make Flume NG build and tests work with Hadoop 2.0
* [FLUME-1686] - Exclude target directories & Eclipse files from rat checks
- * [FLUME-2076] - JMX metrics support for HTTP Source
* [FLUME-2094] - Remove the deprecated - Recoverable Memory Channel
** Sub-task
- * [FLUME-731] - Create NG internal diagrams
- * [FLUME-732] - Create NG developer code tour docs
- * [FLUME-733] - Define NG master interfaces and classes
- * [FLUME-738] - Create NG system configuration component
- * [FLUME-749] - Add support for monitoring APIs
- * [FLUME-1056] - AvroSource configuration
- * [FLUME-1057] - AvroSink configuration
- * [FLUME-1058] - Exec source configuration
- * [FLUME-1059] - failover sink configuration
- * [FLUME-1060] - Hdfs sink configuration
- * [FLUME-1061] - jdbc channel configuration
- * [FLUME-1062] - Memory Channel configuration
- * [FLUME-1063] - Miscellanous changes related to imports and minor changes related to config changes
- * [FLUME-1064] - Channel selector configuration
- * [FLUME-1065] - netcat source configuration
- * [FLUME-1066] - PseudoTxnMemoryChannel configuration
- * [FLUME-1067] - RollingFileSink configuration
- * [FLUME-1068] - syslog source configuration
- * [FLUME-1069] - FileChannel configuration
* [FLUME-1626] - Support Hbase security in Hbase sink
* [FLUME-1630] - Flume configuration code could be improved
* [FLUME-1674] - Documentation / Wiki
* [FLUME-1896] - Implement Thrift RpcClient
* [FLUME-1897] - Implement Thrift Sink
* [FLUME-1898] - Implement Thrift Source
- * [FLUME-1989] - Source Code and Unit Tests for org.apache.flume.serialization.RegexDelimiterDeSerializer
- * [FLUME-1990] - Source Code and Unit Tests for org.apache.flume.serialization.CharSequenceDelimiterDeSerializer
- * [FLUME-1991] - Documentation for New Deserializers for SpoolingDirectorySource
* [FLUME-2102] - Update LICENSE file for Flume 1.4.0
----