You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@storm.apache.org by bo...@apache.org on 2017/08/03 18:58:45 UTC
[1/2] storm git commit: Remove CHANGELOG.md and update DEVELOPER.md
to reflect the change
Repository: storm
Updated Branches:
refs/heads/master cfa2f15f7 -> 37205df2b
Remove CHANGELOG.md and update DEVELOPER.md to reflect the change
Project: http://git-wip-us.apache.org/repos/asf/storm/repo
Commit: http://git-wip-us.apache.org/repos/asf/storm/commit/59f0f187
Tree: http://git-wip-us.apache.org/repos/asf/storm/tree/59f0f187
Diff: http://git-wip-us.apache.org/repos/asf/storm/diff/59f0f187
Branch: refs/heads/master
Commit: 59f0f1872c691446c6474ea92105880796b3d4e2
Parents: 3f386c9
Author: Jungtaek Lim <ka...@gmail.com>
Authored: Wed Aug 2 07:09:46 2017 +0900
Committer: Jungtaek Lim <ka...@gmail.com>
Committed: Wed Aug 2 07:09:46 2017 +0900
----------------------------------------------------------------------
CHANGELOG.md | 995 ------------------------------------------------------
DEVELOPER.md | 11 +-
2 files changed, 3 insertions(+), 1003 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/storm/blob/59f0f187/CHANGELOG.md
----------------------------------------------------------------------
diff --git a/CHANGELOG.md b/CHANGELOG.md
deleted file mode 100644
index 71f8e29..0000000
--- a/CHANGELOG.md
+++ /dev/null
@@ -1,995 +0,0 @@
-## 2.0.0
- * STORM-2655: Log user cannot view worker.log on Storm UI on secure cluster
- * STORM-2654: preserve the formatting of the exception stacktrace on UI
- * STORM-2653: PaceMaker code improvement
- * STORM-2497: Let Supervisor enforce memory and add in support for shared memory regions
- * STORM-2626: Provided a template for drpc-auth-acl.yaml
- * STORM-1280: port backtype.storm.daemon.logviewer to java
- * STORM-2644: Show message when result not found on deep search page
- * STORM-2643: Add a confirmation dialog for profiling and debugging actions on Storm UI
- * STORM-2641: Make storm.py print output from subprocess on error on Windows, make storm.ps1 return the right exit code
- * STORM-2638: Add in maximum object size for Pacemaker Thrift objects
- * STORM-2542: Remove storm-kafka-client KafkaConsumer.subscribe API option, make KafkaConsumer.assign the default
- * STORM-2133: add page-rendered-at timestamp on the UI
- * STORM-2622: Add owner resource summary on storm UI
- * STORM-2634: Apply new code style to storm-sql-runtime
- * STORM-2633: Apply new code style to storm-sql-redis
- * STORM-2632: Apply new code style to storm-sql-kafka
- * STORM-2631: Apply new code style to storm-sql-mongodb
- * STORM-2630: Apply new code style to storm-sql-hdfs
- * STORM-2589: Apply new code style to storm-mongodb
- * STORM-2594: Apply new code style to storm-rocketmq
- * STORM-2615: Add topology readonly user configuration
- * STORM-2093: Fix permissions in multi-tenant, secure mode
- * STORM-2610: Fixed throttle metrics
- * STORM-2609: Simple command line DRPC Client
- * STORM-2613: Tuples that aren't sampled shouldn't be considered for execute latency calculations
- * STORM-2421: support lists of childopts in DaemonConfig
- * STORM-2558: Port storm.sh to Powershell and remove outdated batch scripts
- * STORM-2559: There are three configurations in defaults.yaml haven't been used in storm
- * STORM-2598: Add proxy server option for dependency resolver
- * STORM-2562: Use stronger key size for blow fish key generator and remove printStackTrace
- * STORM-2506: Print mapping between Task ID and Kafka Partitions
- * STORM-2556: Break down AutoCreds implementations into two kinds of classes
- * STORM-1290: port backtype.storm.local-state-test to java
- * STORM-1642: Rethrow exception on serialization error and kill worker
- * STORM-2515: Fix most checkstyle violations in storm-kafka-client
- * STORM-2543: Let Topology query if blobs have changed
- * STORM-2532: Remove uses of Utils.getAvailablePort where possible
- * STORM-2535: Replace test-reset-timeout with a more reliable test
- * STORM-2537: Resolved checkstyle violations for storm-webapp module
- * STORM-2503: Restore comparator logic in `DefaultResourceAwareStrategy`
- * STORM-2516: Fix timing issues with testPrepareLateTupleStreamWithoutBuilder
- * STORM-2489: Overlap and data loss on WindowedBolt based on Duration
- * STORM-2206: replacing visualization with viz.js
- * STORM-2527: Initialize java.sql.DriverManager earlier to avoid deadlock
- * STORM-2525: Fix flaky integration tests
- * STORM-2526: Revert changes mistakenly made to generated files
- * STORM-2524: Add the option to set client.id to storm-kafka
- * STORM-2448: Add in Storm and JDK versions when submitting a topology.
- * STORM-2503: Fix lgtm.com alerts on equality and comparison operations.
- * STORM-2499: Add Serialization plugin for EventHub System Properties
- * STORM-2511: Submitting a topology with name containing unicode getting failed
- * STORM-2510: update checkstyle configuration to lower violations
- * STORM-2479: Fix port assignment race condition in storm-webapp tests
- * STORM-2495: Integrate checkstyle check during build
- * STORM-2486: Prevent cd from printing target directory to avoid breaking classpath
- * STORM-2468: Remove clojure from storm-client
- * STORM-2490: Lambda support
- * STORM-2349: Add one RocketMQ plugin for the Apache Storm
- * STORM-2481: Upgrade Aether version to resolve Aether bug BUG-451566
- * STORM-2480: principle should be modified to principal
- * STORM-2371: Replace existing AMQP eventhub client with the lastest one from Microsoft eventhubs
- * STORM-2475: Fix parsing of host:port to deal with IPv6 addresses
- * STORM-832: Allow config validation to be used by plugins/etc.
- * STORM-2471: Add metric for thread count
- * STORM-1114: Race condition in trident zookeeper zk-node create/delete
- * STORM-2469: fix integration-test dependencies issue
- * STORM-2455: Expose the window start and end timestamp in TupleWindow
- * STORM-2435: Logging levels and consistency with console.log etc
- * STORM-2465: modify storm-redis's README.md and update storm-redis.md
- * STORM-2464: update storm-mongodb.md
- * STORM-2463: fix DRPCTest.testDequeueAfterTimeout test failure
- * STORM-2447: add in storm local to avoid having server on worker classpath
- * STORM-2458: Kafka Spout should allow hooking up custom logic when retries have exhanusted
- * STORM-2461: modify storm-hdfs's READEME.md and update storm-hdfs.md
- * STORM-2454: the default returned value of this method which named "isConsumerAutoCommitMode" in KafkaSpoutConfig.java should be false
- * STORM-2457: update and modify storm/hbase/README.md and storm-hbase.md
- * STORM-2453: Move non-connectors into the top directory
- * STORM-2363: Provide configuration to set the number of RollingWindow
- * STORM-2058: Fix Maven warnings about missing reporting.plugins.plugin.version
- * STORM-1369: Add MapState implementation to storm-cassandra
- * STORM-2427: Fix event logger enable disable UI buttons
- * STORM-2425: Storm Hive Bolt not closing open transactions
- * STORM-2409: Storm-Kafka-Client KafkaSpout Support for Failed and NullTuples
- * STORM-2423: Join Bolt should use explicit instead of default window anchoring for emitted tuples
- * STORM-2411: Setting topology.eventlogger.executors=0 in defaults.yaml
- * STORM-2422: Reduce the size of a serialized trident topology
- * STORM-2412: Nimbus isLeader check while waiting for max replication
- * STORM-2240: PMML Bolt - Add Support to Load Models from Blob Store
- * STORM-2333: CGroup memory and CPU metrics
- * STORM-2374: Storm Kafka Client Test Topologies Must be Serializable
- * STORM-2372: Pacemaker client doesn't clean up heartbeats properly
- * STORM-2334: Join Bolt implementation
- * STORM-2367: Documentation for streams API
- * STORM-2365: Support for specifying output stream in event hubs spout
- * STORM-2250: Kafka Spout Refactoring to Increase Modularity and Testability
- * STORM-2346: Files with unapproved licenses: download-rc-directory.sh verify-release-file.sh
- * STORM-2350: Storm-HDFS's listFilesByModificationTime is broken
- * STORM-1961: Stream api for storm core use cases
- * STORM-2327: Introduce ConfigurableTopology
- * STORM-2323: Precondition for Leader Nimbus should check all topology blobs and also corresponding dependencies.
- * STORM-2305: STORM-2279 calculates task index different from grouper code
- * STORM-1292: port backtype.storm.messaging-test to java
- * STORM-2271: ClosedByInterruptException should be handled in few cases and removing a confusing debug statement
- * STORM-2272: don't leak simulated time
- * STORM-2275: Nimbus crashed during state transition of topology
- * STORM-2243: adds ip address to supervisor id
- * STORM-2214: add in cacheing of the Kerberos Login
- * STORM-2203: Add a getAll method to KeyValueState interface
- * STORM-1239: port backtype.storm.scheduler.IsolationScheduler to java
- * STORM-2217: Finish porting drpc to java
- * STORM-1308: port backtype.storm.tick-tuple-test to java
- * STORM-2245: integration-test constant compilation failure
- * STORM-1607: Add MongoMapState for supporting trident's exactly once semantics
- * STORM-2104: More graceful handling of acked/failed tuples after partition reassignment
- * STORM-1281: LocalCluster, testing4j and testing.clj to java
- * STORM-2226: Fix kafka spout offset lag ui for kerberized kafka
- * STORM-1276: line for line translation of nimbus to java
- * STORM-2224: Exposed a method to override in computing the field from given tuple in FieldSelector
- * STORM-2220: Added config support for each bolt in Cassandra bolts, fixed the bolts to be used also as sinks.
- * STORM-1886: Extend KeyValueState iface with delete
- * STORM-2193: Fix FilterConfiguration parameter order
- * STORM-2209: Update documents adding new integration for some external systems
- * STORM-2212: Remove Redundant Declarations in Maven POM Files
- * STORM-2195: Clean up some of worker-launcher code
- * storm-2205: Racecondition in getting nimbus summaries while ZK connections are reconnected
- * STORM-1278: Port org.apache.storm.daemon.worker to java
- * STORM-2192: Add a new IAutoCredentials plugin to support SSL files
- * STORM-2185: Storm Supervisor doesn't delete directories properly sometimes
- * STORM-2188: Interrupt all executor threads before joining in executor shutdown
- * STORM-203: Adding paths to default java library path
- * STORM-2175: fix double close of workers
- * STORM-1985: Provide a tool for showing and killing corrupted topology
- * STORM-2012: Upgrade Kafka to 0.8.2.2
- * STORM-2142: ReportErrorAndDie runs suicide function only when InterruptedException or InterruptedIOException is thrown
- * STORM-2134: improving the current scheduling strategy for RAS
- * STORM-2131: Add blob command to worker-launcher, make stormdist directory not writeable by topo owner
- * STORM-2144: Fix Storm-sql group-by behavior in standalone mode
- * STORM-1546: Adding Read and Write Aggregations for Pacemaker to make it HA compatible
- * STORM-2124: show requested cpu mem for each component
- * STORM-2109: Treat Supervisor CPU/MEMORY Configs as Numbers
- * STORM-2122: Cache dependency data, and serialize reading of the data
- * STORM-2117: Supervisor V2 with local mode extracts resources directory to the wrong directory
- * STORM-2110: strip out empty String in worker opts
- * STORM-2100: Fix Trident SQL join tests to not rely on ordering
- * STORM-2018: Supervisor V2
- * STORM-2098: DruidBeamBolt: Pass DruidConfig.Builder as constructor argument
- * STORM-2067: Fix "array element type mismatch" from compute-executors in nimbus.clj
- * STORM-2054: DependencyResolver should be aware of relative path and absolute path
- * STORM-2052: Kafka Spout New Client API - Log Improvements and Parameter Tuning for Better Performance
- * STORM-2045: fixed SpoutExecutor NPE
- * STORM-2041: Make Java 8 as minimum requirement for 2.0 release
- * STORM-1256: port backtype.storm.utils.ZookeeperServerCnxnFactory-test to java
- * STORM-1251: port backtype.storm.serialization.SerializationFactory-test to java
- * STORM-1240: port backtype.storm.security.auth.authorizer.DRPCSimpleACLAuthorizer-test to java
- * STORM-1234: port backtype.storm.security.auth.DefaultHttpCredentialsPlugin-test to java
- * STORM-2037: debug operation should be whitelisted in SimpleAclAuthorizer.
- * STORM-2036: Fix minor bug in RAS Tests
- * STORM-2026: Inconsistency between (SpoutExecutor, BoltExecutor) and (spout-transfer-fn, bolt-transfer-fn)
- * STORM-1277: port backtype.storm.daemon.executor to java
- * STORM-2020: Stop using sun internal classes.
- * STORM-2021: Fix license.
- * STORM-2022: fix FieldsTest
- * STORM-1285: port backtype.storm.command.get-errors to java
- * STORM-2010: port org.apache.storm.command.heartbeats.clj to Java
- * STORM-2009: port org.apache.storm.blobstore.clj and org.apache.storm.command.blobstore.clj to Java
- * STORM-1876: Option to build storm-kafka and storm-kafka-client with different kafka client version
- * STORM-2000: Package storm-opentsdb as part of external dir in installation
- * STORM-1962: support python 3 and 2 in multilang
- * STORM-1964: Unexpected behavior when using count window together with timestamp extraction
- * STORM-1890: ensure we refetch static resources after package build
- * STORM-1966: Expand metric having Map type as value into multiple metrics based on entries
- * STORM-1737: storm-kafka-client has compilation errors with Apache Kafka 0.10
- * STORM-1910: One topology cannot use hdfs spout to read from two locations
- * STORM-1916: Add ability for worker-first classpath
- * STORM-1954: Large Trident topologies can cause memory issues due to DefaultResourceDeclarer object reading config
- * STORM-1913: Additions and Improvements for Trident RAS API
- * STORM-1959: Add missing license header to KafkaPartitionOffsetLag
- * STORM-1249: port backtype.storm.security.serialization.BlowfishTupleSerializer-test to java
- * STORM-1238: port backtype.storm.security.auth.ThriftServer-test to java
- * STORM-1237: port backtype.storm.security.auth.ThriftClient-test to java
- * STORM-1236: port backtype.storm.security.auth.SaslTransportPlugin-test to java
- * STORM-1235: port backtype.storm.security.auth.ReqContext-test to java
- * STORM-1229: port backtype.storm.metric.testing to java
- * STORM-1228: port backtype.storm.fields-test to java
- * STORM-1233: Port AuthUtilsTest to java
- * STORM-1920: version of parent pom for storm-kafka-monitor is set 1.0.2-SNAPSHOT in master branch
- * STORM-1896: Remove duplicate code from HDFS spout
- * STORM-1909: Update HDFS spout documentation
- * STORM-1705: Cap number of retries for a failed message
- * STORM-1884: Prioritize pendingPrepare over pendingCommit
- * STORM-1575: fix TwitterSampleSpout NPE on close
- * STORM-1874: Update logger private permissions
- * STORM-1865: update command line client document
- * STORM-1771. HiveState should flushAndClose before closing old or idle Hive connections
- * STORM-1882: Expose TextFileReader public
- * STORM-1873: Implement alternative behaviour for late tuples
- * STORM-1878: Flux can now handle IStatefulBolts
- * STORM-1864: StormSubmitter should throw respective exceptions and log respective errors forregistered submitter hook invocation
- * STORM-1766: A better algorithm server rack selection for RAS
- * STORM-1859: Ack late tuples in windowed mode
- * STORM-1851: Fix default nimbus impersonation authorizer config
- * STORM-1848: Make KafkaMessageId and Partition serializable to support event logging
- * STORM-1862: Flux ShellSpout and ShellBolt can't emit to named streams
- * Storm-1728: TransactionalTridentKafkaSpout error
- * STORM-1850: State Checkpointing Documentation update
- * STORM-1674: Idle KafkaSpout consumes more bandwidth than needed
- * STORM-1842: Forward references in storm.thrift cause tooling issues
- * STORM-1676: Filter null executor stats from worker heartbeat map
- * STORM-1672: Stats not get class cast exception
- * STORM-1739: update the minor JAVA version dependency in 0.10.0 and above
- * STORM-1733: Flush stdout before calling "os.execvp" to prevent log loss
- * STORM-1535: Make sure hdfs key tab login happens only once for multiple components
- * STORM-1544: Document Debug/Sampling of Topologies
- * STORM-1681: Bug in scheduling cyclic topologies when scheduling with RAS
- * STORM-1679: add storm Scheduler documents
- * STORM-1687: divide by zero in StatsUtil
- * STORM-1464: storm-hdfs support for multiple file outputs
- * STORM-515: Clojure documentation and examples
- * STORM-1279: port backtype.storm.daemon.supervisor to java
- * STORM-1668: Flux silently fails while setting a non-existent property.
- * STORM-1271: Port backtype.storm.daemon.task to java
- * STORM-822: Kafka Spout New Consumer API
- * STORM-1663: Stats couldn't handle null worker HB.
- * STORM-1665: Worker cannot instantiate kryo
- * STORM-1666: Kill from the UI fails silently
- * STORM-1610: port pacemaker_state_factory_test.clj to java
- * STORM-1611: port org.apache.storm.pacemaker.pacemaker to java
- * STORM-1268: port builtin-metrics to java
- * STORM-1648: drpc spout reconnect on failure
- * STORM-1631: Storm CGroup bugs
- * STORM-1616: Add RAS API for Trident
- * STORM-1623: nimbus.clj's minor bug
- * STORM-1624: Add maven central status in README
- * STORM-1232: port backtype.storm.scheduler.DefaultScheduler to java
- * STORM-1231: port backtype.storm.scheduler.EvenScheduler to java
- * STORM-1523: util.clj available-port conversion to java
- * STORM-1252: port backtype.storm.stats to java
- * STORM-1250: port backtype.storm.serialization-test to java
- * STORM-1605: use '/usr/bin/env python' to check python version
- * STORM-1618: Add the option of passing config directory
- * STORM-1269: port backtype.storm.daemon.common to java
- * STORM-1270: port drpc to java
- * STORM-1274: port LocalDRPC to java
- * STORM-1590: port defmeters/defgauge/defhistogram... to java for all of our code to use
- * STORM-1529: Change default worker temp directory location for workers
- * STORM-1543: DRPCSpout should always try to reconnect disconnected DRPCInvocationsClient
- * STORM-1528: Fix CsvPreparableReporter log directory
- * STORM-1561: Supervisor should relaunch worker if assignments have changed
- * STORM-1283: port backtype.storm.MockAutoCred to java
- * STORM-1592: clojure code calling into Utils.exitProcess throws ClassCastException
- * STORM-1579: Fix NoSuchFileException when running tests in storm-core
- * STORM-1244: port backtype.storm.command.upload-credentials to java
- * STORM-1245: port backtype.storm.daemon.acker to java
- * STORM-1545: Topology Debug Event Log in Wrong Location
- * STORM-1254: port ui.helper to java
- * STORM-1571: Improvment Kafka Spout Time Metric
- * STORM-1569: Allowing users to specify the nimbus thrift server queue size.
- * STORM-1564: fix wrong package-info in org.apache.storm.utils.staticmocking
- * STORM-1267: Port set_log_level
- * STORM-1266: Port rebalance
- * STORM-1265: Port monitor
- * STORM-1572: throw NPE when parsing the command line arguments by CLI
- * STORM-1273: port backtype.storm.cluster to java
- * STORM-1479: use a simple implemention for IntSerializer
- * STORM-1255: port storm_utils.clj to java and split Time tests into its
- * STORM-1566: Worker exits with error o.a.s.d.worker [ERROR] Error on initialization of server mk-worker
- * STORM-1558: Utils in java breaks component page due to illegal type cast
- * STORM-1553: port event.clj to java
- * STORM-1262: port backtype.storm.command.dev-zookeeper to java.
- * STORM-1243: port backtype.storm.command.healthcheck to java.
- * STORM-1246: port backtype.storm.local-state to java.
- * STORM-1516: Fixed issue in writing pids with distributed cluster mode.
- * STORM-1253: port backtype.storm.timer to java
- * STORM-1258: port thrift.clj to Thrift.java
- * STORM-1336: Evalute/Port JStorm cgroup support and implement cgroup support for RAS
- * STORM-1511: min/max operators implementation in Trident streams API.
- * STROM-1263: port backtype.storm.command.kill-topology to java
- * STORM-1260: port backtype.storm.command.activate to java
- * STORM-1261: port backtype.storm.command.deactivate to java
- * STORM-1264: port backtype.storm.command.list to java
- * STORM-1272: port backtype.storm.disruptor to java
- * STORM-1248: port backtype.storm.messaging.loader to java
- * STORM-1538: Exception being thrown after Utils conversion to java
- * STORM-1242: migrate backtype.storm.command.config-value to java
- * STORM-1226: Port backtype.storm.util to java
- * STORM-1436: Random test failure on BlobStoreTest / HdfsBlobStoreImplTest (occasionally killed)
- * STORM-1476: Filter -c options from args and add them as part of storm.options
- * STORM-1257: port backtype.storm.zookeeper to java
- * STORM-1504: Add Serializer and instruction for AvroGenericRecordBolt
- * STORM-1524: Add Pluggable daemon metrics Reporters
- * STORM-1521: When using Kerberos login from keytab with multiple bolts/executors ticket is not renewed in hbase bolt.
- * STORM-1769: Added a test to check local nimbus with notifier plugin
- * STORM-2379: ElasticSearch connector changes to use new APIs.
-
-## 1.2.0
- * STORM-2520: AutoHDFS should prefer cluster-wise hdfs kerberos principal
- * STORM-2519: Modify AbstractAutoCreds to look for configKeys in both nimbus and topology configs
- * STORM-2493: update documents to reflect the changes
- * STORM-2191: shorten classpaths by using wildcards
- * STORM-2194: Stop ignoring socket timeout error from executor
- * STORM-2640: Deprecate KafkaConsumer.subscribe API option, make KafkaConsumer.assign the default
- * STORM-2650: Expand property substitution test for Flux to cover non-string properties
- * STORM-2642: Storm-kafka-client spout cannot be serialized when using manual partition assignment
- * STORM-2541: Fix storm-kafka-client manual subscription not being able to start consuming
- * STORM-2548: Simplify KafkaSpoutConfig to avoid duplicating KafkaConsumer configuration parameters
- * STORM-2491: Adding extra Cassandra configuration parameters
- * STORM-2383: [storm-hbase] Support HBase as state backend
- * STORM-2601: add the timeout parameter to the method of getting the nimbus client
- * STORM-2369: [storm-redis] Use binary type for State management
- * STORM-2599: Fix BasicContainer wildcard classpath on Windows
- * STORM-2598: Add proxy server option for dependency resolver
- * STORM-2555: handle impersonation properly for HBase delegation token
- * STORM-2551: Thrift client socket timeout
- * STORM-2553: Add support for password in JedisCluster
- * STORM-2484: Add Flux support for bolt+spout memory configuration
- * STORM-2536: excludes jersey 1.x from storm-autocreds
- * STORM-2501: Auto populate Hive Credentials
- * STORM-2512: Make constructor public and add one more builder constructor
- * STORM-2482: Refactor the Storm auto credential plugins to be more usable
-
-## 1.1.2
- * STORM-2616: Documentation for built in metrics
-
-## 1.1.1
- * STORM-2659: Add daemon.name variable to storm.cmd to fix log4j logging
- * STORM-2652: fix error in open method of JmsSpout
- * STORM-2645: Update storm.py to be python3 compatible
- * STORM-2621: add tuple_population metric
- * STORM-2639: Kafka Spout incorrectly computes numCommittedOffsets due to voids in the topic (topic compaction)
- * STORM-2544: Fixing issue in acking of tuples that hit retry limit under manual commit mode
- * STORM-2618: Add TridentKafkaStateUpdater for storm-kafka-client
- * STORM-2608: Remove any pending offsets that are no longer valid
- * STORM-2478: Fix BlobStoreTest.testDeleteAfterFailedCreate on Windows
- * STORM-2602: storm.zookeeper.topology.auth.payload doesn't work even you set it
- * STORM-2597: Don't parse passed in class paths
- * STORM-2564: We should provide a template for storm-cluster-auth.yaml
- * STORM-2568: Fix getTopicsString
- * STORM-2563: Remove the workaround to handle missing UGI.loginUserFromSubject
- * STORM-2552: KafkaSpoutMessageId should be serializable
- * STORM-2562: Use stronger key size than default for blow fish key generator and get rid of stack trace
- * STORM-2557: A bug in DisruptorQueue causing severe underestimation of queue arrival rates
- * STORM-2449: Ensure same key appears only once in State iterator
- * STORM-2516: Fix timing issues with testPrepareLateTupleStreamWithoutBuilder
- * STORM-2489: Overlap and data loss on WindowedBolt based on Duration
- * STORM-2528: Bump log4j version to 2.8.2
- * STORM-2527: Initialize java.sql.DriverManager earlier to avoid deadlock
- * STORM-2413: Make new Kafka spout respect tuple retry limits
- * STORM-2518: Handles empty name for "USER type" ACL when normalizing ACLs
- * STORM-2511: Submitting a topology with name containing unicode getting failed
- * STORM-2496: Dependency artifacts should be uploaded to blobstore with READ permission for all
- * STORM-2505: Spout to support topic compaction
- * STORM-2498: Fix Download Full File link
- * STORM-2486: Prevent cd from printing target directory to avoid breaking classpath
- * STORM-2488: The UI user Must be HTTP.
- * STORM-2481: Upgrade Aether version to resolve Aether bug BUG-451566
- * STORM-2435: Logging in storm.js inconsistent to console.log and does not support log levels
- * STORM-2315: New kafka spout can't commit offset when ack is disabled
- * STORM-2467: Use explicit charset when decoding from array backed buffer
- * STORM-1114: Race condition in trident zookeeper zk-node create/delete
- * STORM-2448: Add in Storm and JDK versions when submitting a topology
- * STORM-2343: Fix new Kafka spout stopping processing if more than maxUncommittedOffsets tuples fail at once
- * STORM-2431: the default blobstore.dir is storm.local.dir/blobs which is different from distcache-blobstore.md
- * STORM-2429: Properly validate supervisor.scheduler.meta
- * STORM-2451: windows storm.cmd does not set log4j2 config file correctly by default
- * STORM-2450: Write resources into correct local director
- * STORM-2440: Kill process if executor catches `java.net.SocketTimeoutException`
- * STORM-2432: Storm-Kafka-Client Trident Spout Seeks Incorrect Offset With UNCOMMITTED_LATEST Strategy
-
-## 1.1.0
- * STORM-2416: Release Packaging Improvements
- * STORM-2407: KafkaTridentSpoutOpaque Doesn't Poll Data From All Topic-Partitions When Parallelism Hint Not a Multiple Total Topic-Partitions.
- * STORM-2414: Skip checking meta's ACL when subject has write privileges for any blobs
- * STORM-2038: Disable symlinks with a config option
- * STORM-2408: build failed if storm.kafka.client.version = 0.10.2.0
- * STORM-2403: Fix KafkaBolt test failure: tick tuple should not be acked
- * STORM-2361: Kafka spout - after leader change, it stops committing offsets to ZK
- * STORM-2353: Replace kafka-unit by kafka_2.11 and kafka-clients to test kafka-clients:0.10.1.1
- * STORM-2387: Handle tick tuples properly for Bolts in external modules
- * STORM-2345: Type mismatch in ReadClusterState's ProfileAction processing Map
- * STORM-2400: Upgraded Curator to 2.12.0 and made respective API changes
- * STORM-2396: setting interrupted status back before throwing a RuntimeException
- * STORM-1772: Adding Perf module with topologies for measuring performance
- * STORM-2391: Move HdfsSpoutTopology from storm-starter to storm-hdfs-examples
- * STORM-2389: Avoid instantiating Event Logger when topology.eventlogger.executors=0
- * STORM-2386: Fail-back Blob deletion also fails in BlobSynchronizer.syncBlobs.
- * STORM-1363: TridentKafkaState should handle null values from TridentTupleToKafkaMapper.getMessageFromTuple()
- * STORM-2381: Add logging of JDBC connection string in storm-jdbc integration for debugging failures.
- * STORM-2340: fix AutoCommitMode issue in KafkaSpout
- * STORM-2344: Flux YAML File Viewer for Nimbus UI
- * STORM-2281: Running Multiple Kafka Spouts (Trident) Throws Illegal State Exception
- * STORM-2296: Kafka spout no dup on leader changes
- * STORM-2014: New Kafka spout duplicates checking if failed messages have reached max retries
- * STORM-1443: [Storm SQL] Support customizing parallelism in StormSQL
- * STORM-2148: [Storm SQL] Trident mode: back to code generate and compile Trident topology
- * STORM-2331: Emitting from JavaScript should work when not anchoring.
- * STORM-2320: DRPC client printer class reusable for local and remote DRPC.
- * STORM-2225: change spout config to be simpler.
- * STORM-2330: Fix storm sql code generation for UDAF with non standard sql types
- * STORM-2298: Don't kill Nimbus when ClusterMetricsConsumer is failed to initialize
- * STORM-2301: [storm-cassandra] upgrade cassandra driver to 3.1.2
- * STORM-1446: Compile the Calcite logical plan to Storm Trident logical plan
- * STORM-2303: [storm-opentsdb] Fix list invariant issue for JDK 7
- * STORM-2295: KafkaSpoutStreamsNamedTopics should return output fields with predictable ordering
- * STORM-2300: [Flux] support list of references
- * STORM-2297: [storm-opentsdb] Support Flux for OpenTSDBBolt
- * STORM-2294: Send activate and deactivate command to ShellSpout
- * STORM-2236: Kafka Spout with manual partition management.
- * STORM-2280: Upgrade Calcite version to 1.11.0
- * STORM-2278: Allow max number of disruptor queue flusher threads to be configurable
- * STORM-2277: Add shaded jar for Druid connector
- * STORM-2274: Support named output streams in Hdfs Spout
- * STORM-2204: Adding caching capabilities in HBaseLookupBolt
- * STORM-2267: Use user's local maven repo. directory to local repo.
- * STORM-2254: Provide Socket time out for nimbus thrift client
- * STORM-2200: [Storm SQL] Drop Aggregate & Join support on Trident mode
- * STORM-2244: Some shaded jars doesn't exclude dependency signature files
- * STORM-2266: Close NimbusClient instances appropriately
- * STORM-2257: Add built in support for sum function with different types
- * STORM-2082: add sql external module storm-sql-hdfs
- * STORM-2190: reduce contention between submission and scheduling
- * STORM-2239: Handle InterruptException in new Kafka spout
- * STORM-2238: Add Timestamp extractor for windowed bolt
- * STORM-2235: Introduce new option: 'add remote repositories' for dependency resolver
- * STORM-2215: validate blobs are present before submitting
- * STORM-2170: [Storm SQL] Add built-in socket datasource to runtime
- * STORM-2087: storm-kafka-client - tuples not always being replayed.
- * STORM-2182: Refactor Storm Kafka Examples Into Own Modules.
- * STORM-1694: Kafka Spout Trident Implementation Using New Kafka Consumer API.
- * STORM-2173: [SQL] Support CSV as input / output format
- * STORM-2177: [SQL] Support TSV as input / output format
- * STORM-2172: [SQL] Support Avro as input / output format
- * STORM-2103: [SQL] Introduce new sql external module: storm-sql-mongodb
- * STORM-2109: Under supervisor V2 SUPERVISOR_MEMORY_CAPACITY_MB and SUPERVISOR_CPU_CAPACITY must be Doubles
- * STORM-2110: in supervisor v2 filter out empty command line args
- * STORM-2117: Supervisor V2 with local mode extracts resources directory to topology root directory instead of temporary directory
- * STORM-2131: Add blob command to worker-launcher, make stormdist directory not writeable by topo owner
- * STORM-2018: Supervisor V2
- * STORM-2139: Let ShellBolts and ShellSpouts run with scripts from blobs
- * STORM-2072: Add map, flatMap with different outputs (T->V) in Trident
- * STORM-2125: Use Calcite's implementation of Rex Compiler
- * STORM-1444: Support EXPLAIN statement in StormSQL
- * STORM-2099: Introduce new sql external module: storm-sql-redis
- * STORM-2097: Improve logging in trident core and examples
- * STORM-2066: make error message in IsolatedPool.java more descriptive
- * STORM-1870: Allow FluxShellBolt/Spout set custom "componentConfig" via yaml
- * STORM-2126: fix NPE due to race condition in compute-new-sched-assign…
- * STORM-2089: Replace Consumer of ISqlTridentDataSource with SqlTridentConsumer
- * STORM-2118: A few fixes for storm-sql standalone mode
- * STORM-2105: Cluster/Supervisor total and available resources displayed in the UI
- * STORM-2078: enable paging in worker datatable
- * STORM-1664: Allow Java users to start a local cluster with a Nimbus Thrift server.
- * STORM-1872: Release Jedis connection when topology shutdown
- * STORM-1837: Fix complete-topology and prevent message loss
- * STORM-2092: optimize TridentKafkaState batch sending
- * STORM-1979: Storm Druid Connector implementation.
- * STORM-2057: Support JOIN statement in Storm SQL
- * STORM-1970: external project examples refator
- * STORM-2074: fix storm-kafka-monitor NPE bug
- * STORM-1459: Allow not specifying producer properties in read-only Kafka table in StormSQL
- * STORM-2050: [storm-sql] Support User Defined Aggregate Function for Trident mode
- * STORM-1434: Support the GROUP BY clause in StormSQL
- * STORM-2016: Topology submission improvement: support adding local jars and maven artifacts on submission
- * STORM-1994: Add table with per-topology & worker resource usage and components in (new) supervisor and topology pages
- * STORM-2023: Add calcite-core to dependency of storm-sql-runtime
- * STORM-1839: Storm spout implementation for Amazon Kinesis Streams.
- * STORM-1988: Kafka Offset not showing due to bad classpath.
- * STORM-1950: Change response json of "Topology Lag" REST API to keyed by spoutId, topic, partition.
- * STORM-1833: Simple equi-join in storm-sql standalone mode
- * STORM-1866: Update Resource Aware Scheduler Documentation
- * STORM-1930: Kafka New Client API - Support for Topic Wildcards
- * STORM-1924: Adding conf options for Persistent Word Count Topology
- * STORM-1956: Disabling Backpressure by default
- * STORM-1934: Fix race condition between sync-supervisor and sync-processes
- * STORM-1919: Introduce FilterBolt on storm-redis
- * STORM-1945: Fix NPE bugs on topology spout lag for storm-kafka-monitor
- * STORM-1719: Introduce REST API: Topology metric stats for stream
- * STORM-1941: Nimbus discovery can fail when zookeeper reconnect happens
- * STORM-1888: add description for shell command
- * STORM-1902: add a simple & flexible FileNameFormat for storm-hdfs
- * STORM-1914: Storm Kafka Field Topic Selector
- * STORM-1925: Remove Nimbus thrift call from Nimbus itself
- * STORM-1907: PartitionedTridentSpoutExecutor has incompatible types that cause ClassCastException
- * STORM-1136: Command line module to return kafka spout offsets lag and display in storm ui.
- * STORM-1911: IClusterMetricsConsumer should use seconds to timestamp unit
- * STORM-1893: Support OpenTSDB for storing timeseries data.
- * STORM-1723: Introduce ClusterMetricsConsumer
- * STORM-1700: Introduce 'whitelist' / 'blacklist' option to MetricsConsumer
- * STORM-1698: Asynchronous MetricsConsumerBolt
- * STORM-1887: Fixed help message for set_log_level command
- * STORM-1709: Added group by support in storm sql standalone mode
- * STORM-1720: Support GEO in storm-redis
- * STORM-1868: Modify TridentKafkaWordCount to run in distributed mode
-
-## 1.0.4
- * STORM-2627: Update docs for storm.zookeeper.topology.auth.scheme
- * STORM-2597: Don't parse passed in class paths
- * STORM-2450: Write resources into correct local director
- * STORM-2038: No symlinks for local cluster
-
-## 1.0.3
- * STORM-2197: NimbusClient connectins leak due to leakage in ThriftClient
- * STORM-2321: Handle blobstore zk key deletion in KeySequenceNumber.
- * STORM-2324: Fix deployment failure if resources directory is missing in topology jar
- * STORM-2335: Fix broken Topology visualization with empty ':transferred' in executor stats
- * STORM-2336: Close Localizer and AsyncLocalizer when supervisor is shutting down
- * STORM-2338: Subprocess exception handling is broken in storm.py on Windows environment
- * STORM-2337: Broken documentation generation for storm-metrics-profiling-internal-actions.md and windows-users-guide.md
- * STORM-2325: Logviewer doesn't consider 'storm.local.hostname'
- * STORM-1742: More accurate 'complete latency'
- * STORM-2176: Workers do not shutdown cleanly and worker hooks don't run when a topology is killed
- * STORM-2293: hostname should only refer node's 'storm.local.hostname'
- * STORM-2246: Logviewer download link has urlencoding on part of the URL
- * STORM-1906: Window count/length of zero should be disallowed
- * STORM-1841: Address a few minor issues in windowing and doc
- * STORM-2268: Fix integration test for Travis CI build
- * STORM-2283: Fix DefaultStateHandler kryo multithreading issues
- * STORM-2279: Unable to open bolt page of storm ui
- * STORM-2264: OpaqueTridentKafkaSpout failing after STORM-2216
- * STORM-2276: Remove twitter4j usages due to license issue (JSON.org is catalog X)
- * STORM-2095: remove any remaining files when deleting blobstore directory
- * STORM-2251: Integration test refers specific version of Storm which should be project version
- * STORM-2234: heartBeatExecutorService in shellSpout don't work well with deactivate
- * STORM-2216: Favor JSONValue.parseWithException
- * STORM-2208: HDFS State Throws FileNotFoundException in Azure Data Lake Store file system (adl://)
- * STORM-2213: ShellSpout has race condition when ShellSpout is being inactive longer than heartbeat timeout
- * STORM-2210: remove array shuffle from ShuffleGrouping
- * STORM-2198: perform RotationAction when stopping HdfsBolt
- * STORM-2196: A typo in RAS_Node::consumeCPU
- * STORM-2189: RAS_Node::freeCPU outputs incorrect info
- * STORM-2184: Don't wakeup KafkaConsumer on shutdown
- * STORM-2018: Supervisor V2
- * STORM-2145: Leave leader nimbus's hostname to log when trying to connect leader nimbus
- * STORM-2127: Storm-eventhubs should use latest amqp and eventhubs-client versions
- * STORM-2040: Fix bug on assert-can-serialize
- * STORM-2017: ShellBolt stops reporting task ids
- * STORM-2119: bug in log message printing to stdout
- * STORM-2120: Emit to _spoutConfig.outputStreamId
- * STORM-2101: fixes npe in compute-executors in nimbus
- * STORM-2090: Add integration test for storm windowing
- * STORM-2003: Make sure config contains TOPIC before get it
- * STORM-1567: in defaults.yaml 'topology.disable.loadaware' should be 'topology.disable.loadaware.messaging'
- * STORM-1987: Fix TridentKafkaWordCount arg handling in distributed mode.
- * STORM-1969: Modify HiveTopology to show usage of non-partition table.
- * STORM-1849: HDFSFileTopology should use the 3rd argument as topologyName
- * STORM-2086: use DefaultTopicSelector instead of creating a new one
- * STORM-2079: Unneccessary readStormConfig operation
- * STORM-2081: create external directory for storm-sql various data sources and move storm-sql-kafka to it
- * STORM-1344: Remove sql command from storm-jdbc build
- * STORM-2070: Fix sigar native binary download link
- * STORM-2056: Bugs in logviewer
- * STORM-1646: Fix ExponentialBackoffMsgRetryManager test
- * STORM-2039: Backpressure refactoring in worker and executor
- * STORM-2064: Add storm name and function, access result and function to log-thrift-access
- * STORM-2063: Add thread name in worker logs
- * STORM-2047: Add note to add logviewer hosts to browser whitelist
- * STORM-2042: Nimbus client connections not closed properly causing connection leaks
- * STORM-2032: removes warning in case more than one metrics tuple is received
- * STORM-1594: org.apache.storm.tuple.Fields can throw NPE if given invalid field in selector
- * STORM-1995: downloadChunk in nimbus.clj should close the input stream
-
-## 1.0.2
- * STORM-1976: Remove cleanup-corrupt-topologies!
- * STORM-1977: Restore logic: give up leadership when elected as leader but doesn't have one or more of topology codes on local
- * STORM-1939: Frequent InterruptedException raised by ShellBoltMessageQueue.poll
- * STORM-1928: ShellSpout should check heartbeat while ShellSpout is waiting for subprocess to sync
- * STORM-1922: Supervisor summary default order by host
- * STORM-1895: blobstore replication-factor argument
- * STORM-118: Docs: typo in transactional-commit-flow.png
- * STORM-1633: Document blobstore to command-line-client.md
- * STORM-1899: Release HBase connection when topology shutdown
- * STORM-1844: Some tests are flaky due to low timeout
- * STORM-1946: initialize lastHeartbeatTimestamp before starting heartbeat task
- * STORM-1937: Fix WindowTridentProcessor cause NullPointerException
- * STORM-1924: Add a config file parameter to HDFS test topologies
- * STORM-1861: Storm submit command returns exit code of 0 even when it fails.
- * STORM-1755: Revert the kafka client version upgrade in storm-kafka module
- * STORM-1853: Replace ClassLoaderObjectInputStream with ObjectInputStream
- * STORM-1730: LocalCluster#shutdown() does not terminate all storm threads/thread pools.
- * STORM-1745: Add partition to log output in PartitionManager
- * STORM-1735: Nimbus should log that replication succeeded when min replicas was reached exactly
- * STORM-1835: add lock info in thread dump
- * STORM-1764: Pacemaker is throwing some stack traces
- * STORM-1761: Storm-Solr Example Throws ArrayIndexOutOfBoundsException in Remote Cluster Mode
- * STORM-1756: Explicitly null KafkaServer reference in KafkaTestBroker to prevent out of memory on large test classes.
- * STORM-1750: Ensure worker dies when report-error-and-die is called.
- * STORM-1715: using Jedis Protocol.DEFAULT_HOST to replace DEFAULT_HOST
- * STORM-1713: Replace NotImplementedException with UnsupportedOperationException
- * STORM-1661: Introduce a config to turn off blobstore acl validation in insecure mode
- * STORM-1773: Utils.javaDeserialize() doesn't work with primitive types
-
-## 1.0.1
- * STORM-1725: Kafka Spout New Consumer API - KafkaSpoutRetryExponentialBackoff method should use HashMap instead of TreeMap not to throw Exception
- * STORM-1749: Fix storm-starter github links
- * STORM-1678: abstract batch processing to common api `BatchHelper`
- * STORM-1704: When logviewer_search.html opens daemon file, next search always show no result
- * STORM-1714: StatefulBolts ends up as normal bolts while using TopologyBuilder.setBolt without parallelism
- * STORM-1683: only check non-system streams by default
- * STORM-1680: Provide configuration to set min fetch size in KafkaSpout
- * STORM-1649: Optimize Kryo instaces creation in trident windowing
- * STORM-1696: status not sync if zk fails in backpressure
- * STORM-1693: Move stats cleanup to executor shutdown
- * STORM-1670: LocalState#get(String) can throw FileNotFoundException which results in not removing worker heartbeats and supervisor is kind of stuck and goes down after some time.
- * STORM-1677: Test resource files are excluded from source distribution, which makes logviewer-test failing
- * STORM-1585: Add DDL support for UDFs in storm-sql
-
-## 1.0.0
- * STORM-2223: PMML Bolt
- * STORM-1671: Enable logviewer to delete a dir without yaml
- * STORM-1673: log4j2/worker.xml refers old package of LoggerMetricsConsumer
- * STORM-1669: Fix SolrUpdateBolt flush bug
- * STORM-1573: Add batch support for MongoInsertBolt
- * STORM-1660: remove flux gitignore file and move rules to top level gitignore
- * STORM-1634: Refactoring of Resource Aware Scheduler
- * STORM-1030: Hive Connector Fixes
- * STORM-676: Storm Trident support for sliding/tumbling windows
- * STORM-1630: Add guide page for Windows users
- * STORM-1655: Flux doesn't set return code to non-zero when there's any exception while deploying topology to remote cluster
- * STORM-1537: Upgrade to kryo3 in master
- * STORM-1654: HBaseBolt creates tick tuples with no interval when we don't set flushIntervalSecs
- * STORM-1625: Move storm-sql dependencies out of lib folder
- * STORM-1556: nimbus.clj/wait-for-desired-code-replication wrong reset for current-replication-count-jar in local mode
- * STORM-1636: Supervisor shutdown with worker id pass in being nil
- * STORM-1602: Blobstore UTs are failed on Windows
- * STORM-1629: Files/move doesn't work properly with non-empty directory in Windows
- * STORM-1549: Add support for resetting tuple timeout from bolts via the OutputCollector
- * STORM-971: Metric for messages lost due to kafka retention
- * STORM-1483: add storm-mongodb connector
- * STORM-1608: Fix stateful topology acking behavior
- * STORM-1609: Netty Client is not best effort delivery on failed Connection
- * STORM-1620: Update curator to fix CURATOR-209
- * STORM-1469: Adding Plain Sasl Transport Plugin
- * STORM-1588: Do not add event logger details if number of event loggers is zero
- * STORM-1606: print the information of testcase which is on failure
- * STORM-1601: Check if /backpressure/storm-id node exists before requesting children
- * STORM-1574: Better handle backpressure exception etc.
- * STORM-1587: Avoid NPE while prining Metrics
- * STORM-1570: Storm SQL support for nested fields and array
- * STORM-1576: fix ConcurrentModificationException in addCheckpointInputs
- * STORM-1488: UI Topology Page component last error timestamp is from 1970
- * STORM-1552: Fix topology event sampling log dir
- * STORM-1542: Remove profile action retry in case of non-zero exit code
- * STORM-1540: Fix Debug/Sampling for Trident
- * STORM-1522: REST API throws invalid worker log links
- * STORM-1541: Change scope of 'hadoop-minicluster' to test
- * STORM-1532: Fix readCommandLineOpts to parse JSON correctly in windows
- * STORM-1539: Improve Storm ACK-ing performance
- * STORM-1519: Storm syslog logging not confirming to RFC5426 3.1
- * STORM-1520: Nimbus Clojure/Zookeeper issue ("stateChanged" method not found)
- * STORM-1531: Junit and mockito dependencies need to have correct scope defined in storm-elasticsearch pom.xml
- * STORM-1526: Improve Storm core performance
- * STORM-1517: Add peek api in trident stream
- * STORM-1455: kafka spout should not reset to the beginning of partition when offsetoutofrange exception occurs
- * STORM-1505: Add map, flatMap and filter functions in trident stream
- * STORM-1518: Backport of STORM-1504
- * STORM-1510: Fix broken nimbus log link
- * STORM-1503: Worker should not crash on failure to send heartbeats to Pacemaker/ZK
- * STORM-1176: Checkpoint window evaluated/expired state
- * STORM-1494: Add link to supervisor log in Storm UI
- * STORM-1496: Nimbus periodically throws blobstore-related exception
- * STORM-1484: ignore subproject .classpath & .project file
- * STORM-1478: make bolts getComponentConfiguration method cleaner/simpler
- * STORM-1499: fix wrong package name for storm trident
- * STORM-1463: added file schema to log4j config files for windows env
- * STORM-1485: DRPC Connectivity Issues
- * STORM-1486: Fix storm-kafa documentation
- * STORM-1214: add javadoc for Trident Streams and Operations
- * STORM-1450: Fix minor bugs and refactor code in ResourceAwareScheduler
- * STORM-1452: Fixes profiling/debugging out of the box
- * STORM-1406: Add MQTT Support
- * STORM-1473: enable log search for daemon logs
- * STORM-1472: Fix the errorTime bug and show the time to be readable
- * STORM-1466: Move the org.apache.thrift7 namespace to something correct/sensible
- * STORM-1470: Applies shading to hadoop-auth, cleaner exclusions
- * STORM-1467: Switch apache-rat plugin off by default, but enable for Travis-CI
- * STORM-1468: move documentation to asf-site branch
- * STORM-1199: HDFS Spout Implementation.
- * STORM-1453: nimbus.clj/wait-for-desired-code-replication prints wrong log message
- * STORM-1419: Solr bolt should handle tick tuples
- * STORM-1175: State store for windowing operations
- * STORM-1202: Migrate APIs to org.apache.storm, but try to provide some form of backwards compatability
- * STORM-468: java.io.NotSerializableException should be explained
- * STORM-1348: refactor API to remove Insert/Update builder in Cassandra connector
- * STORM-1206: Reduce logviewer memory usage through directory stream
- * STORM-1219: Fix HDFS and Hive bolt flush/acking
- * STORM-1150: Fix the authorization of Logviewer in method authorized-log-user?
- * STORM-1418: improve debug logs for some external modules
- * STORM-1415: Some improvements for trident map StateUpdater
- * STORM-1414: Some improvements for multilang JsonSerializer
- * STORM-1408: clean up the build directory created by tests
- * STORM-1425: Tick tuples should be acked like normal tuples
- * STORM-1432: Spurious failure in storm-kafka test
- * STORM-1449: Fix Kafka spout to maintain backward compatibility
- * STORM-1458: Add check to see if nimbus is already running.
- * STORM-1462: Upgrade HikariCP to 2.4.3
- * STORM-1457: Avoid collecting pending tuples if topology.debug is off
- * STORM-1430: ui worker checkboxes
- * STORM-1423: storm UI in a secure env shows error even when credentials are present
- * STORM-702: Exhibitor support
- * STORM-1160: Add hadoop-auth dependency needed for storm-core
- * STORM-1404: Fix Mockito test failures in storm-kafka.
- * STORM-1379: Removed Redundant Structure
- * STORM-706: Clarify examples README for IntelliJ.
- * STORM-1396: Added backward compatibility method for File Download
- * STORM-695: storm CLI tool reports zero exit code on error scenario
- * STORM-1416: Documentation for state store
- * STORM-1426: keep backtype.storm.tuple.AddressedTuple and delete duplicated backtype.storm.messaging.AddressedTuple
- * STORM-1417: fixed equals/hashCode contract in CoordType
- * STORM-1422: broken example in storm-starter tutorial
- * STORM-1429: LocalizerTest fix
- * STORM-1401: removes multilang-test
- * STORM-1424: Removed unused topology-path variable
- * STORM-1427: add TupleUtils/listHashCode method and delete tuple.clj
- * STORM-1413: remove unused variables for some tests
- * STORM-1412: null check should be done in the first place
- * STORM-1210: Set Output Stream id in KafkaSpout
- * STORM-1397: Merge conflict from Pacemaker merge
- * STORM-1373: Blobstore API sample example usage
- * STORM-1409: StormClientErrorHandler is not used
- * STORM-1411: Some fixes for storm-windowing
- * STORM-1399: Blobstore tests should write data to `target` so it gets removed when running `mvn clean`
- * STORM-1398: Add back in TopologyDetails.getTopology
- * STORM-898: Add priorities and per user resource guarantees to Resource Aware Scheduler
- * STORM-1187: Support windowing based on tuple ts.
- * STORM-1400: Netty Context removeClient() called after term() causes NullPointerException.
- * STORM-1383: Supervisors should not crash if nimbus is unavailable
- * STORM-1381: Client side topology submission hook.
- * STORM-1376: Performance slowdown due excessive zk connections and log-debugging
- * STORM-1395: Move JUnit dependency to top-level pom
- * STORM-1372: Merging design and usage documents for distcache
- * STORM-1393: Update the storm.log.dir function, add doc for logs
- * STORM-1377: nimbus_auth_test: very short timeouts causing spurious failures
- * STORM-1388: Fix url and email links in README file
- * STORM-1389: Removed creation of projection tuples as they are already available
- * STORM-1179: Create Maven Profiles for Integration Tests.
- * STORM-1387: workers-artifacts directory configurable, and default to be under storm.log.dir.
- * STORM-1211: Add trident state and query support for cassandra connector
- * STORM-1359: Change kryo links from google code to github
- * STORM-1385: Divide by zero exception in stats.clj
- * STORM-1370: Bug fixes for MultitenantScheduler
- * STORM-1374: fix random failure on WindowManagerTest
- * STORM-1040: SQL support for Storm.
- * STORM-1364: Log storm version on daemon start
- * STORM-1375: Blobstore broke Pacemaker
- * STORM-876: Blobstore/DistCache Support
- * STORM-1361: Apache License missing from two Cassandra files
- * STORM-756: Handle taskids response as soon as possible
- * STORM-1218: Use markdown for JavaDoc.
- * STORM-1075: Storm Cassandra connector.
- * STORM-965: excessive logging in storm when non-kerberos client tries to connect
- * STORM-1341: Let topology have own heartbeat timeout for multilang subprocess
- * STORM-1207: Added flux support for IWindowedBolt
- * STORM-1352: Trident should support writing to multiple Kafka clusters.
- * STORM-1220: Avoid double copying in the Kafka spout.
- * STORM-1340: Use Travis-CI build matrix to improve test execution times
- * STORM-1126: Allow a configMethod that takes no arguments (Flux)
- * STORM-1203: worker metadata file creation doesn't use storm.log.dir config
- * STORM-1349: [Flux] Allow constructorArgs to take Maps as arguments
- * STORM-126: Add Lifecycle support API for worker nodes
- * STORM-1213: Remove sigar binaries from source tree
- * STORM-885: Heartbeat Server (Pacemaker)
- * STORM-1221: Create a common interface for all Trident spout.
- * STORM-1198: Web UI to show resource usages and Total Resources on all supervisors
- * STORM-1167: Add windowing support for storm core.
- * STORM-1215: Use Async Loggers to avoid locking and logging overhead
- * STORM-1204: Logviewer should graceful report page-not-found instead of 500 for bad topo-id etc
- * STORM-831: Add BugTracker and Central Logging URL to UI
- * STORM-1208: UI: NPE seen when aggregating bolt streams stats
- * STORM-1016: Generate trident bolt ids with sorted group names
- * STORM-1190: System Load too high after recent changes
- * STORM-1098: Nimbus hook for topology actions.
- * STORM-1145: Have IConnection push tuples instead of pull them
- * STORM-1191: bump timeout by 50% due to intermittent travis build failures
- * STORM-794: Modify Spout async loop to treat activate/deactivate ASAP
- * STORM-1196: Upgrade to thrift 0.9.3
- * STORM-1155: Supervisor recurring health checks
- * STORM-1189: Maintain wire compatability with 0.10.x versions of storm.
- * STORM-1185: replace nimbus.host with nimbus.seeds
- * STORM-1164: Code cleanup for typos, warnings and conciseness.
- * STORM-902: Simple Log Search.
- * STORM-1052: TridentKafkaState uses new Kafka Producer API.
- * STORM-1182: Removing and wrapping some exceptions in ConfigValidation to make code cleaner
- * STORM-1134. Windows: Fix log4j config.
- * STORM-1127: allow for boolean arguments (Flux)
- * STORM-1138: Storm-hdfs README should be updated with Avro Bolt information
- * STORM-1154: SequenceFileBolt needs unit tests
- * STORM-162: Load Aware Shuffle Grouping
- * STORM-1158: Storm metrics to profile various storm functions
- * STORM-1161: Add License headers and add rat checks to builds
- * STORM-1165: normalize the scales of CPU/Mem/Net when choosing the best node for Resource Aware Scheduler
- * STORM-1163: use rmr rather than rmpath for remove worker-root
- * STORM-1170: Fix the producer alive issue in DisruptorQueueTest
- * STORM-1168: removes noisy log message & a TODO
- * STORM-1143: Validate topology Configs during topology submission
- * STORM-1157: Adding dynamic profiling for worker, restarting worker, jstack, heap dump, and profiling
- * STORM-1123: TupleImpl - Unnecessary variable initialization.
- * STORM-1153: Use static final instead of just static for class members.
- * STORM-817: Kafka Wildcard Topic Support.
- * STORM-40: Turn worker garbage collection and heapdump on by default.
- * STORM-1152: Change map keySet iteration to entrySet iteration for efficiency.
- * STORM-1147: Storm JDBCBolt should add validation to ensure either insertQuery or table name is specified and not both.
- * STORM-1151: Batching in DisruptorQueue
- * STORM-350: Update disruptor to latest version (3.3.2)
- * STORM-697: Support for Emitting Kafka Message Offset and Partition
- * STORM-1074: Add Avro HDFS bolt
- * STORM-566: Improve documentation including incorrect Kryo ser. framework docs
- * STORM-1073: Refactor AbstractHdfsBolt
- * STORM-1128: Make metrics fast
- * STORM-1122: Fix the format issue in Utils.java
- * STORM-1111: Fix Validation for lots of different configs
- * STORM-1125: Adding separate ZK client for read in Nimbus ZK State
- * STORM-1121: Remove method call to avoid overhead during topology submission time
- * STORM-1120: Fix keyword (schema -> scheme) from main-routes
- * STORM-1115: Stale leader-lock key effectively bans all nodes from becoming leaders
- * STORM-1119: Create access logging for all daemons
- * STORM-1117: Adds visualization-init route previously missing
- * STORM-1118: Added test to compare latency vs. throughput in storm.
- * STORM-1110: Fix Component Page for system components
- * STORM-1093: Launching Workers with resources specified in resource-aware schedulers
- * STORM-1102: Add a default flush interval for HiveBolt
- * STORM-1112: Add executor id to the thread name of the executor thread for debug
- * STORM-1079: Batch Puts to HBase
- * STORM-1084: Improve Storm config validation process to use java annotations instead of *_SCHEMA format
- * STORM-1106: Netty should not limit attempts to reconnect
- * STORM-1103: Changes log message to DEBUG from INFO
- * STORM-1104: Nimbus HA fails to find newly downloaded code files
- * STORM-1087: Avoid issues with transfer-queue backpressure.
- * STORM-893: Resource Aware Scheduling (Experimental)
- * STORM-1095: Tuple.getSourceGlobalStreamid() has wrong camel-case naming
- * STORM-1091: Add unit test for tick tuples to HiveBolt and HdfsBolt
- * STORM-1090: Nimbus HA should support `storm.local.hostname`
- * STORM-820: Aggregate topo stats on nimbus, not ui
- * STORM-412: Allow users to modify logging levels of running topologies
- * STORM-1078: Updated RateTracker to be thread safe
- * STORM-1082: fix nits for properties in kafka tests
- * STORM-993: include uptimeSeconds as JSON integer field
- * STORM-1053: Update storm-kafka README for new producer API confs.
- * STORM-1058: create CLI kill_workers to kill workers on a supervisor node
- * STORM-1063: support relative log4j conf dir for both daemons and workers
- * STORM-1059: Upgrade Storm to use Clojure 1.7.0
- * STORM-1069: add check case for external change of 'now' value.
- * STORM-969: HDFS Bolt can end up in an unrecoverable state.
- * STORM-1068: Configure request.required.acks to be 1 in KafkaUtilsTest for sync
- * STORM-1017: If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.
- * STORM-1054: Excessive logging ShellBasedGroupsMapping if the user doesn't have any groups.
- * STORM-954: Toplogy Event Inspector
- * STORM-862: Pluggable System Metrics
- * STORM-1032: Add generics to component configuration methods
- * STORM-886: Automatic Back Pressure
- * STORM-1037: do not remove storm-code in supervisor until kill job
- * STORM-1007: Add more metrics to DisruptorQueue
- * STORM-1011: HBaseBolt default mapper should handle null values
- * STORM-1019: Added missing dependency version to use of org.codehaus.mojo:make-maven-plugin
- * STORM-1020: Document exceptions in ITuple & Fields
- * STORM-1025: Invalid links at https://storm.apache.org/about/multi-language.html
- * STORM-1010: Each KafkaBolt could have a specified properties.
- * STORM-1008: Isolate the code for metric collection and retrieval from DisruptorQueue
- * STORM-991: General cleanup of the generics (storm.trident.spout package)
- * STORM-1000: Use static member classes when permitted
- * STORM-1003: In cluster.clj replace task-id with component-id in the declaration
- * STORM-1013: [storm-elasticsearch] Expose TransportClient configuration Map to EsConfig
- * STORM-1012: Shading jackson.
- * STORM-974: [storm-elasticsearch] Introduces Tuple -> ES document mapper to get rid of constant field mapping (source, index, type)
- * STORM-978: [storm-elasticsearch] Introduces Lookup(or Query)Bolt which emits matched documents from ES
- * STORM-851: Storm Solr connector
- * STORM-854: [Storm-Kafka] KafkaSpout can set the topic name as the output streamid
- * STORM-990: Refactored TimeCacheMap to extend RotatingMap
- * STORM-829: Hadoop dependency confusion
- * STORM-166: Nimbus HA
- * STORM-976: Config storm.logback.conf.dir is specific to previous logging framework
- * STORM-995: Fix excessive logging
- * STORM-837: HdfsState ignores commits
- * STORM-938: storm-hive add a time interval to flush tuples to hive.
- * STORM-964: Add config (with small default value) for logwriter to restrict its memory usage
- * STORM-980: Re-include storm-kafka tests from Travis CI build
- * STORM-960: HiveBolt should ack tuples only after flushing.
- * STORM-951: Storm Hive connector leaking connections.
- * STORM-806: use storm.zookeeper.connection.timeout in storm-kafka ZkState when newCurator
- * STORM-809: topology.message.timeout.secs should not allow for null or <= 0 values
- * STORM-847: Add cli to get the last storm error from the topology
- * STORM-864: Exclude storm-kafka tests from Travis CI build
- * STORM-477: Add warning for invalid JAVA_HOME
- * STORM-826: Update KafkaBolt to use the new kafka producer API
- * STORM-912: Support SSL on Logviewer
- * STORM-934: The current doc for topology ackers is outdated
- * STORM-160: Allow ShellBolt to set env vars (particularly PATH)
- * STORM-937: Changing noisy log level from info to debug
- * STORM-931: Python Scripts to Produce Formatted JIRA and GitHub Join
- * STORM-924: Set the file mode of the files included when packaging release packages
- * STORM-799: Use IErrorReport interface more broadly
- * STORM-926: change pom to use maven-shade-plugin:2.2
- * STORM-942: Add FluxParser method parseInputStream() to eliminate disk usage
- * STORM-67: Provide API for spouts to know how many pending messages there are
- * STORM-918: Storm CLI could validate arguments/print usage
- * STORM-859: Add regression test of STORM-856
- * STORM-913: Use Curator's delete().deletingChildrenIfNeeded() instead of zk/delete-recursive
- * STORM-968: Adding support to generate the id based on names in Trident
- * STORM-845: Storm ElasticSearch connector
- * STORM-988: supervisor.slots.ports should not allow duplicate element values
- * STORM-975: Storm-Kafka trident topology example
- * STORM-958: Add config for init params of group mapping service
- * STORM-949: On the topology summary UI page, last shown error should have the time and date
- * STORM-1142: Some config validators for positive ints need to allow 0
- * STORM-901: Worker Artifacts Directory
- * STORM-1144: Display requested and assigned cpu/mem resources for schedulers in UI
- * STORM-1217: making small fixes in RAS
-
-## 0.10.3
- * STORM-2158: Fix OutOfMemoryError in Nimbus' SimpleTransportPlugin
-
-## 0.10.2
- * STORM-1834: Documentation How to Generate Certificates For Local Testing SSL Setup
- * STORM-1754: Correct java version in 0.10.x storm-starter
- * STORM-1750: Ensure worker dies when report-error-and-die is called.
- * STORM-1739: update the minor JAVA version dependency in 0.10.0 and above
- * STORM-1733: Flush stdout and stderr before calling "os.execvp" to prevent log loss
-
-## 0.10.1
- * STORM-584: Fix logging for LoggingMetricsConsumer metrics.log file
- * STORM-1596: Do not use single Kerberos TGT instance between multiple threads
- * STORM-1481: avoid Math.abs(Integer) get a negative value
- * STORM-1121: Deprecate test only configuraton nimbus.reassign
- * STORM-1180: FLUX logo wasn't appearing quite right
- * STORM-1482: add missing 'break' for RedisStoreBolt
-
-## 0.10.0
- * STORM-1096: Fix some issues with impersonation on the UI
- * STORM-581: Add rebalance params to Storm REST API
- * STORM-1108: Fix NPE in simulated time
- * STORM-1099: Fix worker childopts as arraylist of strings
- * STORM-1094: advance kafka offset when deserializer yields no object
- * STORM-1066: Specify current directory when supervisor launches a worker
- * STORM-1012: Shaded everything that was not already shaded
- * STORM-967: Shaded everything that was not already shaded
- * STORM-922: Shaded everything that was not already shaded
- * STORM-1042: Shaded everything that was not already shaded
- * STORM-1026: Adding external classpath elements does not work
- * STORM-1055: storm-jdbc README needs fixes and context
- * STORM-1044: Setting dop to zero does not raise an error
- * STORM-1050: Topologies with same name run on one cluster
- * STORM-1005: Supervisor do not get running workers after restart.
- * STORM-803: Better CI logs
- * STORM-1027: Use overflow buffer for emitting metrics
- * STORM-1024: log4j changes leaving ${sys:storm.log.dir} under STORM_HOME dir
- * STORM-944: storm-hive pom.xml has a dependency conflict with calcite
- * STORM-994: Connection leak between nimbus and supervisors
- * STORM-1001: Undefined STORM_EXT_CLASSPATH adds '::' to classpath of workers
- * STORM-977: Incorrect signal (-9) when as-user is true
- * STORM-843: [storm-redis] Add Javadoc to storm-redis
- * STORM-866: Use storm.log.dir instead of storm.home in log4j2 config
- * STORM-810: PartitionManager in storm-kafka should commit latest offset before close
- * STORM-928: Add sources->streams->fields map to Multi-Lang Handshake
- * STORM-945: <DefaultRolloverStrategy> element is not a policy,and should not be putted in the <Policies> element.
- * STORM-857: create logs metadata dir when running securely
- * STORM-793: Made change to logviewer.clj in order to remove the invalid http 500 response
- * STORM-139: hashCode does not work for byte[]
- * STORM-860: UI: while topology is transitioned to killed, "Activate" button is enabled but not functioning
- * STORM-966: ConfigValidation.DoubleValidator doesn't really validate whether the type of the object is a double
- * STORM-742: Let ShellBolt treat all messages to update heartbeat
- * STORM-992: A bug in the timer.clj might cause unexpected delay to schedule new event
-
-## 0.10.0-beta1
- * STORM-873: Flux does not handle diamond topologies
-
-## 0.10.0-beta
- * STORM-867: fix bug with mk-ssl-connector
- * STORM-856: use serialized value of delay secs for topo actions
- * STORM-852: Replaced Apache Log4j Logger with SLF4J API
- * STORM-813: Change storm-starter's README so that it explains mvn exec:java cannot run multilang topology
- * STORM-853: Fix upload API to handle multi-args properly
- * STORM-850: Convert storm-core's logback-test.xml to log4j2-test.xml
- * STORM-848: Shade external dependencies
- * STORM-849: Add storm-redis to storm binary distribution
- * STORM-760: Use JSON for serialized conf
- * STORM-833: Logging framework logback -> log4j 2.x
- * STORM-842: Drop Support for Java 1.6
- * STORM-835: Netty Client hold batch object until io operation complete
- * STORM-827: Allow AutoTGT to work with storm-hdfs too.
- * STORM-821: Adding connection provider interface to decouple jdbc connector from a single connection pooling implementation.
- * STORM-818: storm-eventhubs configuration improvement and refactoring
- * STORM-816: maven-gpg-plugin does not work with gpg 2.1
- * STORM-811: remove old metastor_db before running tests again.
- * STORM-808: allow null to be parsed as null
- * STORM-807: quote args to storm.py correctly
- * STORM-801: Add Travis CI badge to README
- * STORM-797: DisruptorQueueTest has some race conditions in it.
- * STORM-796: Add support for "error" command in ShellSpout
- * STORM-795: Update the user document for the extlib issue
- * STORM-792: Missing documentation in backtype.storm.generated.Nimbus
- * STORM-791: Storm UI displays maps in the config incorrectly
- * STORM-790: Log "task is null" instead of let worker died when task is null in transfer-fn
- * STORM-789: Send more topology context to Multi-Lang components via initial handshake
- * STORM-788: UI Fix key for process latencies
- * STORM-787: test-ns should announce test failures with 'BUILD FAILURE'
- * STORM-786: KafkaBolt shoul
http://git-wip-us.apache.org/repos/asf/storm/blob/59f0f187/DEVELOPER.md
----------------------------------------------------------------------
diff --git a/DEVELOPER.md b/DEVELOPER.md
index 9eb140d..d1cad5c 100644
--- a/DEVELOPER.md
+++ b/DEVELOPER.md
@@ -214,14 +214,9 @@ To pull in a merge request you should generally follow the command line instruct
$ git pull <remote_repo_url> <remote_branch>
You can use `./dev-tools/storm-merge.py <pull-number>` to produce the above command most of the time.
-4. Assuming that the pull request merges without any conflicts:
- Update the top-level `CHANGELOG.md`, and add in the JIRA ticket number (example: `STORM-1234`) and ticket
- description to the change log. Make sure that you place the JIRA ticket number in the commit comments where
- applicable.
+4. Run any sanity tests that you think are needed.
-5. Run any sanity tests that you think are needed.
-
-6. Once you are confident that everything is ok, you can merge your local test branch into your local `master` branch,
+5. Once you are confident that everything is ok, you can merge your local test branch into your local `master` branch,
and push the changes back to the official Apache repo.
# Pull request looks ok, change log was updated, etc. We are ready for pushing.
@@ -233,7 +228,7 @@ To pull in a merge request you should generally follow the command line instruct
# automatically a short while after you have pushed to the Apache repo.
$ git push origin master
-7. The last step is updating the corresponding JIRA ticket. [Go to JIRA](https://issues.apache.org/jira/browse/STORM)
+6. The last step is updating the corresponding JIRA ticket. [Go to JIRA](https://issues.apache.org/jira/browse/STORM)
and resolve the ticket. Be sure to set the `Fix Version/s` field to the version you pushed your changes to.
It is usually good practice to thank the author of the pull request for their contribution if you have not done
so already.
[2/2] storm git commit: Merge branch 'remove-changelog-master' of
https://github.com/HeartSaVioR/storm into PULL-2253
Posted by bo...@apache.org.
Merge branch 'remove-changelog-master' of https://github.com/HeartSaVioR/storm into PULL-2253
Remove CHANGELOG.md and update DEVELOPER.md to reflect the change
This closes #2253
Project: http://git-wip-us.apache.org/repos/asf/storm/repo
Commit: http://git-wip-us.apache.org/repos/asf/storm/commit/37205df2
Tree: http://git-wip-us.apache.org/repos/asf/storm/tree/37205df2
Diff: http://git-wip-us.apache.org/repos/asf/storm/diff/37205df2
Branch: refs/heads/master
Commit: 37205df2b795c0ad00eaa01c4a368763d90724e9
Parents: cfa2f15 59f0f18
Author: Robert Evans <ev...@yahoo-inc.com>
Authored: Thu Aug 3 13:57:18 2017 -0500
Committer: Robert Evans <ev...@yahoo-inc.com>
Committed: Thu Aug 3 13:57:18 2017 -0500
----------------------------------------------------------------------
CHANGELOG.md | 998 ------------------------------------------------------
DEVELOPER.md | 11 +-
2 files changed, 3 insertions(+), 1006 deletions(-)
----------------------------------------------------------------------