You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by nk...@apache.org on 2019/01/24 10:36:30 UTC
[flink] branch release/1.5.6-spring-ms-1.openssl created (now
0aaec35)
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a change to branch release/1.5.6-spring-ms-1.openssl
in repository https://gitbox.apache.org/repos/asf/flink.git.
at 0aaec35 Update version to daplatform specification
This branch includes the following new commits:
new 3b88e30 test
new eb6b141 test
new 86b95a0 more test
new e37e804 t
new 3a524ad Merge branch 'master' of https://www.stratosphere.eu/stratosphere
new d94c5ee test
new 0a26ac2 Merge branch 'master' of https://www.stratosphere.eu/stratosphere
new aa474b9 new test
new f164e85 new test
new 1baf078 new test
new e69f85d new test
new 597523c test
new e4b4adc test
new 0b3faff test
new c603326 test
new 75e67a7 Initial checkin.
new d847b7a - remove stratosphere/src folder
new d6e20ba - Added .gitignore file
new 62f30af - Fixed webfrontend preview bug
new 944511c Cleanup and clustermanager bug fix.
new 1dfad89 - pact modules are builed with tests - removed println statements from test - improved pact examples (K-Means and WordCount)
new 717a377 - Added support for local filesystems to test setup - Refactored contract tests - Updated contract test configurations
new 7ddfb16 - moved filesystem classes into designated package
new 4cdb771 Removed compiler error check in PactConnection#setShipStrategy
new ffbc7e1 - updated contract tests - moved pact program tests - fixed tpch-3 program test - fixed LocalFSProvider
new 54ee5fa - added WordCountTest based on WordCount example job - updated pact program tests - removed old wordcount tests
new d0ceb1e - cleaned-up maven plugins in pom-files - added source distribution assembly - added javadocs to distributions - renamed binary distribution assembly
new 8804d51 - continued maven pom-file clean-up and assembly configuration
new e5a3a59 - fixed PACT Webfrontend start bug
new fcf2afe - fixed JavaDoc warnings
new 7412154 Merge branch 'fhueske'
new 6654045 Mering Again
new e91190f Initial checkin.
new 2494368 - remove stratosphere/src folder
new 033b03a - Added .gitignore file
new 8163694 - Fixed webfrontend preview bug
new b843f18 - pact modules are builed with tests - removed println statements from test - improved pact examples (K-Means and WordCount)
new 5cf06bd Removed compiler error check in PactConnection#setShipStrategy
new 03ce192 Added javadoc comments and changed the thresholds for the doc, rank and visit filter
new 290c6a9 Improved java doc
new 3d19b6c Improved java doc
new d224c48 Improved java doc
new 8e8644d Merge branch 'fhueske'
new 9f065f8 added ignore
new 6f52786 refactored misspelled method name getminumum
new 78cee55 Fixed bug in split assignment for unspecified number of subtasks
new 6b360eb Improved style and robustness of job manager end-to-end test
new 0558b39 Cleanup in FileLineReader, removed HDFSProvider.java
new 9ecd4da Merge branch 'casp'
new ade23c2 Removed superfluous files
new ad802ef Removed System.out.println commands from the Nephele code
new 19b933c Improved shut down of task manager
new 058f5ec Removed unnecessary sleep times from execution graph test
new b5e2119 Removed System.out.println from ByteBufferedChannelManager
new 33eda2a Refactored *Notifiable to *Listener
new 2f8a5a4 Implemented check for cycles in the instance sharing dependency chain
new 40bbce2 Improved handling of I/O errors and javadoc for outgoing network connections
new 5c46e10 Removed sequence number checking from incoming connection class
new ad3a3d6 Unified API for incoming data from the network and recovery checkpoints
new a9cd8d1 Improved shutdown behavior of RPC server
new c32ad03 Added debug message for job manager shutdown
new 991844b Files of 0 bytes size now result in one input split
new 94afc4b Restructured Nephele end-to-end test
new af9289d Clean up for job manager test
new 8164cf9 Clean up for channel lookup protocol
new d377efc Clean up for file line reader
new db604f7 Clean up for deserialization buffer
new 106566c Added test for serialization of transfer envelopes
new 5a906de - fixed pact-test/pom.xml - removed unused imports in contract tests - updated TestBase.java
new 7e39e68 Merge branch 'fhueske'
new a790a6b - deleted old code from pact-tests
new 4db616f - Minor fix
new c6bd2eb Reformatted ChannelCheckpoint.java according to code style rules
new 1da26c6 Merge branch 'fhueske'
new 332270e - Decreased memory requirement for check in TestBase.java to 192 MB
new d89ffca - Added JavaDocs to PACT base types in pact-common
new fcf12fc Merge branch 'fhueske'
new ff6ce7a - Improved JavaDoc in pact-common
new 0656dc7 Fixes startup problem with bash 4.1 in cluster mode
new c9f1e5e Fixes package name of default instance manager in cluster mode
new a6bc505 Merge branch 'fhueske'
new 937c81b Fixes several broken javadoc references in the Nephele server module
new bda4f93 Added JavaDoc for example TPCHQuery3.java
new 296a57a Merge branch 'master' of https://stratosphere.eu/ringwald
new 7ddf336 Updated JavaDoc for TPCH3 Query to new filter constraints
new 7d071fd Merge branch 'dima'
new 71f23de Fixes broken javadoc references in the Nephele management module
new cde31a6 Merge branch 'sewen'
new d0ede27 Reduces memory allocation of memory manager during Nephele end-to-end tests
new ce0325c - Added JavaDoc to pact-common contracts - Improve JavaDoc in pact-common
new f06f195 Adds support for hardware descriptions
new fc128de Refactores instance type as a preparation for the new instance description interface
new d864723 Adds method to query the available instance types to the management interface
new b91c819 Finishes implementation of instance hardware description
new dd6162c Removes deprecated assignment of file names for file channels
new 4e00ad5 Removes Google collections from the build dependencies
new d428958 Merge branch 'fhueske'
new 49db2ba Removes Google collections and modifies tests accordingly
new 778a2f2 Merge branch 'master' of https://www.stratosphere.eu/warneke
new 9d1c38e Changed ByteBufferedManager to use more smaller buffers.
new b0d5729 Fixes bugs in the cluster manager and improves unit tests
new a6a1af4 Adds new test classes and improves java doc
new db4ee72 Changes behavior of local instance manager according to interface description and adds unit test
new 9e12c3c Added instance awareness in the compiler.
new 0044046 Merge branch 'warneke'
new 2a3e681 Fixed WebLogAnalysis (including WebLogGenerator) example and added missing Javadoc tags.
new 02a3331 Changed javadoc generation from compile to install phase
new f1ba0b8 Changed javadoc plugin execution phase to "site"
new 0a3132e Adds style checks according to code guidelines and fixes respective maven plugin configuration
new 9d39e96 Removed magic number and hidden field check from code style check
new 797d3da added PowerMock,Mockito in pom.xml, new Tests
new e50e1ec Fixed some bugs in nephele-common as reported by FindBugs
new f56fb85 Fixed bugs as reported by FindBugs in nephele-management
new 7285c70 Removed DesignedForExtension check from checkstyle template
new 7c10d42 Improved javadoc and style of nephele-management component
new d44963c added some tests and the hamcrest dependancy
new 8d3861f Compiler handles plans with multiple outputs.
new 777f7ae renamed some tests and added missing plugin configrations
new 33252df Improved javadoc and code style of nephele-management module
new f850e77 Fixed bug in equals method of SingleInstanceProfilingEvent
new d9a2914 Fixed bug in equals method of ThreadProfilingEvent
new a3f98ee Wrote unit tests for management module
new dbde461 - Added execution mode to bin/pact-start.sh
new 6035b3d - Refactored test names in pact-common/../type/base
new 6099a23 - Fixed JavaDocs in pact-common/../type/base/PactDouble.java
new a5de6cd added failsafe plugin and hamcrest as dependancy to stratosphere/pom.xml
new b7da564 Fixed non deterministic behavior of management graph serialization
new 558f8e8 Fixed bug in management graph iterator implementation
new a962be0 Improved javadoc for management attachment
new 62e9820 Added unit tests for the management graph and its components
new 964b1ee Merge branch 'master' into dima
new cc7c321 - Adapted CrossTest.java and MatchTest.java to test for objects which are changed in the user code
new 0218296 - minor fix on debug statements in MapTest.java
new 7c7bf51 Merge branch 'master' of https://stratosphere.eu/dima
new 0ab06d2 Fixed minor flaw in source code format of Environment.java
new 25bf5dc Added several unit tests for the execution package
new c59afdf Improved javadoc and renamed name of test class
new f51cd18 Added unit tests for event.task package in nephele-common module
new 23c0a87 Removed superfluous event list implementation and modified code that still used it
new a4ec025 Added unit tests for event.job package in nephele-common module
new d7b20e9 Merge branch 'stratosphere'
new cb1e778 - Removed println statement in TestBase.java
new 59a383c - Added unit test for IntTupleDataInFormat.java - Added unit test for Tuple.java - Added JavaDocs to Tuple.java - Fixed bugs in Tuple.java
new affe3c2 Merge branch 'fhueske'
new f90d057 - Move time and memory intensive tests to integration tests in pact modules - Removed log level fixing from pact sort tests - Changed info logs to debug logs in pact-runtime tests - Removed invalid character from WebLogGenerator.java
new f32d3ca Sorting operates directly on memory managers backing arrays.
new d4e9af3 Slight modification to sorting test to measure sort time.
new 098e753 current changes from dima repository
new f05dc53 Completed commenst for memory manager and partly for sorting code.
new 54ae3f4 Merge branch 'mem-manager'
new 43dca46 Merge branch 'dima'
new d5c7493 Removed attached test jar again to avoid build problems
new ae11045 Added files missing from last commit
new ba9f776 Merge branch 'dima'
new 890705e Commented additional plugin repositories to speed up compile process
new 041f4b9 Removed working directory for queue manager's test configuration
new 1d908cb Changed job client interface to throw an exception in case of a job error or abort
new c54d769 - Added clean up for WordCount integration test
new 3b219b1 Description of task errors are now propagated to the job client
new 38cc917 Removed old code
new 47e2ecc Added comments to all public and protected functions
new 813cb25 Merge branch 'master' of https://stratosphere.eu/warneke
new f412988 fixed the regexp in InstanceProfile; fixed #19
new 84c13e9 merges
new a95dd4a The local and the queue scheduler now checks resource availability before accepting a job
new 4ef753d Fixed network channel problem for vertices with different channel types
new cfe9e45 Merge branch 'master' of https://stratosphere.eu/warneke into dima
new 016e2c8 Minor improvements in the local and the queue scheduler
new 1fe9360 Fixed bug in SerializableHashMap.java
new ab960f2 Fixed getType method in PACT compiler
new 49075c2 Merge branch 'master' of https://stratosphere.eu/warneke
new f4efd99 - Fixed triangle enumeration pact program EnumTriangles.java - Added JavaDocs to EnumTriangles.java - Fixed EnumTriangleITCase.java - Removed exclude for EnumTriangleITCase from pact-tests/pom.xml
new 5dcf6f4 Cleaned up execution graph unit tests
new bdc5e5d RPC server now deserializes to actual type of a call parameter, no longer the type given in the signature
new daecab8 Checkpoints created by file channels are now deleted after successful job execution
new 8cc3443 Fixed start scripts in cluster mode
new 2e700e9 - Improved EnumTriangles example - Improved EnumTrianglesITCase
new 1761b5c - Fixed All-2-All Shortest Path example PACT program - Added JavaDocs to All-2-All Shortest Path example PACT program - Fixed All2AllSPITCase - Removed exclude for All2AllSPITCase
new e01366a more generic detection of tenured space + Mac OS support
new c8c2a2a Merge branch 'dima'
new 1f1d293 added tests for nepehle.configurations
new bb6be13 added test coverage for nephele.configuration
new 2170154 pom.xml merge needed manual fix
new 7ae2933 Merge branch 'casp'
new a3c110c Minor test modifications and changes to the code style/java doc
new 93c2ef1 Added first unit tests for Nephele client package
new bd5b40e - Unified Pact example program parameter handling - Remove Triangle data set generator
new def589f - added packaging for All2All Shortest Path example program - cleaned up pact-examples/pom.xml
new 9aa4253 - fixed clean up after Pact graph example jobs
new e2291d4 - fixed WebLogAnalysis Pact example program - improved JavaDoc in WebLogAnalysis Pact example program - fixed WebLogAnalysis integration test - removed exclude for WebLogAnalysis integration test
new 73f60f0 Merge branch 'master' of https://stratosphere.eu/stratosphere
new 5c5e5a3 Merge branch 'stratosphere'
new 453291f Transformed JobManagerTest into an integration test
new b914aac Fixed some bugs as reported by FindBugs in Nephele's server module
new e62a943 Fixed some bugs as reported by FindBugs in Nephele's visualization module
new 3f5fe5e Merge branch 'hu' into unittests
new dcebe41 Added unit test for ChannelCheckpoint
new 320367f Added unit test for EphemeralCheckpoint class
new 6a9f5ce Added TODO for IO and memory manager clean up
new 6867efb changed TextInputFormat to use any String as delimiter, Testcase also created; Ticket #20
new 2f5f706 Merged unittests branch to master branch
new ea7547b Merge branch 'master' of https://stratosphere.eu/stratosphere
new 3a2bb02 Added unit tests for nephele.fs
new 1f83abb Added unit test for direct channel manager
new 9567c62 - removed example job launchers, use pact-clients instead
new cf6cabf - Renamed TestNepheleMiniCluster to NepheleMiniClusterITCase
new f11a8b7 Changed ChannelSelector interface to avoid memory allocation for every record sent
new 5417575 - Renamed class in NepheleMiniClusterITCase
new 849039b Merge branch 'master' of https://stratosphere.eu/stratosphere
new 47798dd - removed old SpillingResettableIteratorTest
new ec8c2af - added lastReturned() method to ResettableIterator interface - adapted interface implementations
new 73f3101 - renamed SpillingResettableIteratorTest2 to SpillingResettableIteratorTest - extended SpillingResettableIteratorTest
new 6dc2121 Merge branch 'casp'
new 9061811 Minor changes to LocalFileSystemTest
new 7196a09 Added unit tests for basic Nephele types
new c284803 Merge branch 'dima'
new 33cd836 - Split up ResettableIterator interface - Fixed multi input bug for CrossTask
new bfbdf48 - Added SerializationCopier - Adapted CrossTask to use SerializationCopier
new bb9ddb9 - Fixed value multi input bug for MatchTask - Moved run() method from MatchStub to MatchTask and renamed to crossValues() - added ValueDeserializer - TODO: Fix MatchStubTest, clean up MatchTask, comment ValueDeserializer, create KeyDeserializer
new 42a5129 removed changes.tgz
new ee3996d added tests for QueueScheduler classes
new d1e225c Added json, sequential, and splitting input and output format Added Format utilities Added PactJsonObject
new 2efdb7a Added test harness
new 048fdf4 Added jackson dependency
new 60b9d80 little changes for robustness
new 22caf31 little changes for robustness
new 700c39b merge with warneke
new 8fb2306 - Added JavaDoc to new classes
new 8f90075 added proxy
new 7fd9521 added buffersortable with memory guarantees
new 3201229 - extended OutputCollector to send out deep-copies for marked RecordWriters - added Unit test for OutputCollector (must be extended) - Adapted task classes to specify which RecordReaders must be fed with deep-copies
new 1c1e82e Merge remote branch 'origin/master'
new bd003d2 Added negative tests for TestPlan
new 33c84a5 Fixed negative tests
new b467c4c deep clone performanc test added
new 77285c2 ...
new 1dd3ee6 ...
new dfb9b1f Added junit dependency
new 08627ab Fixed maven poms
new 0863619 - moved run() methods from MapStub and ReduceStub to MapTask and ReduceTask - changed map() method in MapStub from private to public - adapted MapStub implementation in examples to change in MapStub - move iterator interfaces from pact-common to pact-runtime - adapted runtime classes to iterator refactoring - move stub tests from pact-common to pact-runtime
new ca197e6 FileChannel, FileLineReadWriter Tests and changed Test for QueueScheduler
new 6ae6602 Nephele now also starts without configuration in local mode
new 9c4d6ff - Smaller modifications to the PACT examples
new 4bc41ed added one test InstanceProfiler
new 63d296c Merge branch 'marrus'
new 5200135 Merge branch 'dima'
new df55350 added html as cobertura output
new 3924a8e fixed bug in InstanceProfilerTest
new c72d88c Tasks release memory segments - part 1
new 2086ca1 Merge branch 'stratosphere'
new f4a4851 Merge branch 'fhueske'
new 4fe75a1 - added framework for standalone tests on tasks (TaskTestBase.java and MockEnvironment.java). Framework must be extended, e.g. IOManager & MemoryManager - added test draft for MapTask -
new dc4d67f Combine, Reduce, Match and CoGroup correctly deallocate their memory.
new a4eabdb OuputEmitter reuses arrays.
new d5dd8af Reverted changes to ChannelSelector interface
new ec3b9bd Fixed critical bug in QueueScheduler (ticket #55)
new a18b968 Fixed possible NullPointerException during JobManager startup (ticket #56)
new 9478bc5 Minor correction to log message
new 8869526 Changed path to visualization resources
new a33c722 Fixed profiling bug which led to NullPointerException in the visualization component (ticket #53)
new 2555823 Merge branch 'stratosphere'
new 544285e Fixed Bug in OutputEmitter
new 2fd7f45 Merge branch 'stratosphere'
new 0ab6c3f minor test change
new c047f3f Merge branch 'current'
new b4731cf added a test to reproduce the NegativeArraySizeException in ticket #62
new ac0bae3 added jvm params for surefire to execute pact-test/unit tests in a hudson environment
new 891b7fd fixed typo
new a298515 Add support for retrieving the physical memory size on FreeBSD
new 93f0fae Only read the sysctl that is used on Mac OS X
new a6fb07d Merge remote branch 'STRATOSPHERE-MAIN/master'
new c3629a9 - added TaskTests
new 1f6e9fc - Added UnitTests and IntegrationTests for PACT Tasks
new b027113 - follow-up on previous commit
new 453e31b Merge branch 'master' into dima
new 3f177b3 - Removed output of tests or set it to debug level
new 3d2af2f - removed test tmp files
new 35a239b - added framework for standalone tests on tasks (TaskTestBase.java and MockEnvironment.java). Framework must be extended, e.g. IOManager & MemoryManager - added test draft for MapTask -
new 9aed076 - added TaskTests
new 8380b7b - Added UnitTests and IntegrationTests for PACT Tasks
new a9f4885 - follow-up on previous commit
new 6053d3a - improved task tests
new 611ba4e Merge branch 'stratosphere'
new e070297 TPC-H Q9 initially created.
new 66347ba Add copyright statement
new d1f3648 Add a note that the output's ordering is still missing.
new acba2b6 Test coverage for direct channels and gates
new 2cd9d80 flushing for direct channels
new 3fbd838 Add dummy test case for the TPC-H query 9. Doesn't work yet.
new f7a10f8 Merge remote branch 'STRATOSPHERE-MAIN/master'
new 1dedcaf Copy & Paste error: This is TPC-H Q9
new 5d38b92 Test configuration for TPC-H Q3,Q9 was missing
new 75f3856 Moved compilation logic from pact program to client.
new 19b7829 Merge branch 'fhueske'
new 48798c6 Locking Bug fixed in MemoryManager, Match Hash Strategies currently not selected by optimizer, Client Test adapted to changes.
new 5627cd0 JobManager/TaskManager stdout/stderr now goes to a file (ticket #58)
new 7dcddf9 - fixed bug #65
new 4cbfcdd - fixed bug #63
new f34c9d6 - temp files of minicluster are written to system's temp dir
new c65e928 Fixes Nephele freeze-up when exception occurs in registerInputOutput (ticket #60)
new ec6ef39 - fixed bug #67 - improved MatchTask by reducing the number of object instanciations in crossValues() method
new 963e3c4 Merge branch 'dima'
new 59a53f1 Deactivated Integration Tests for hash-match strategies.
new def00be Merge branch 'dima'
new 666849a Merge branch 'stratosphere'
new cba7ccb - fixed bug in OutputCollector - extended OutputCollectorTest
new e547e0c Merge branch 'master' of https://stratosphere.eu/stratosphere into stratosphere
new 42249a0 Fixed issues described in tickets #57 and #71
new 85e59c2 Missing file from last commit
new 65faafe Merge branch 'stratosphere'
new 6e81614 Fixes bug #72
new 37ce8dd Memory manager can release memory allocated to a task (first part)
new 41031d2 Merge branch 'master' of https://stratosphere.eu/stratosphere into dschneid
new cd9abb0 - added finally-clause to release memory in crossValues() method
new 4fd5480 - set temp dir in NepheleMiniClusterITCase to system's tmp dir - removed println statements in NepheleMiniClusterITCase
new f0783f8 - solved bug #50
new a7de161 Merge branch 'master' into stratosphere
new 5ed4098 Memory Manager allows to deallocate memory by task (part 2), Enhancement of tests to check more thoroughly for memory leaks.
new aec2ce7 Merge branch 'dima'
new 616a86a - fixed memory release bugs for Cross and Combine in case task failure because of stub exceptions
new 687e68d Added VertexAssignmentEvent and corresponding unit test
new 257a364 Fixed bug #42
new cad3a7c Merge branch 'stratosphere'
new 34757ff Removed obsolete files
new 016d307 Merge from stratosphere
new e214c7e Forgot to change references to TPCHQuery3 to TPCHQuery9, reduced parallelism until further problems are resolved.
new 6c9715f Ignore pact-tests' tmp directory contents
new 445a262 Merge branch 'master' of https://stratosphere.eu/dschneid
new 84bc38b Improved style and java doc
new ff775de Fix TPCHQuery9 so that it is working.
new 600ed29 Update copyright
new 1efe9ba Forgot to add the TPC-H Q9 output formatter
new d9857d9 Merge branch 'master' of https://stratosphere.eu/stratosphere into dschneid
new 5bdb4c0 Fixed Integration Tests fort Sort-Modules
new 54a645f - NepheleMiniClusterITCase brings down Nephele and MiniDFS after test - Removed clearFS() method for security reasons - Removed deprecated numTaskTrackers argument from NepheleMiniCluster
new c0f4d06 - fixed PowerMock-Log4J issue in pact-runtime TaskTests
new aa6dd4a Merge branch 'master' into dima
new 4df3622 - removed enforced debug logger configuration
new 2d0c3a5 Changed IO Manager to more report exceptions back to the readers/writers and to do proper threadsafe shutdown.
new 73e06e1 Added files required by the Apache License
new 89033a9 - removed obsolete files in stratosphere-distribution
new 05502b7 Fixed IO Manager exception reporting (part 2)
new a65acee Merge branch 'fhueske'
new 3f2db14 Merge branch 'sewen'
new e101fff MemoryManager.release is now called after task has finished
new 5e2cb9a IO manager and sort code bug fixed.
new 215cd50 Fixed #64, #73 and #75
new c077135 Merge branch 'warneke'
new 2417f34 Fixed #36
new c21a7e1 Removed obsolete dependencies from nephele-profiling
new 0f43d64 - Fixed copy-and-paste mistake in exception statement
new f51ad0a - replaced constant value by already defined final static field in SpillingResettableIteratorTest
new 83e2433 - fixed CrossTaskExternalITCase to actually go to disk
new 1508071 - fixed double close of SpillingResettableIterator in CrossTask - fixed unneccessary reset of SpillingResettableIterator in CrossTask
new 12f1e98 Merge branch 'stratosphere' into dima
new 2929f2b Merge branch 'stratosphere'
new 51c5fdb Merge branch 'warneke' (Conflicts: pact/pact-compiler/src/main/java/eu/stratosphere/pact/compiler/PactCompiler.java)
new b3b2f56 Merge branch 'fhueske'
new 7947d78 SpillingResettableIterator deletes its file after operation. Added apache header to RequestQueue.
new f39950c Integrated Sortable Buffers with space guarantees.
new 8ac3fc0 Merge branch 'stratosphere' into dima
new e1e7a22 Introduced TaskManager specific construction of Java classpath
new 89eeb3b - fixed null pointer bug in SortMergeMatchIteratorITCase
new b0e0d3d Merge branch 'master' into dima
new db790d1 added TPCH Query 10
new f8a4612 Fixed #59
new a388d92 Merge branch 'stratosphere'
new 0dcbb22 Fixed #62
new 9b9212e Visualization component now ignores the client's job and vertex events
new 0f70dd3 Java heap size can now be additionally assigned through an environment variable
new a585210 - fix #90 - set jvm heap space fix to 512MB for pact-tests unit and integration tests - a separate JVM is forked for each test case in pact-tests integration tests
new 13ade4b Merge branch 'master' into stratosphere
new 4b07f44 Merge branch 'stratosphere' into dima
new 3069821 QueueSchedulerTest fixed
new db96188 Merge remote-tracking branch 'warneke/master'
new b597265 - set heap space for all tests (unit and integration tests) globally to 512MB
new a54f429 Merge branch 'master' into dima
new 5a29a2e Modifications to DiscoveryService
new 3e4a21e removed exception printing in tests
new b89402d Worked on IO manager tests, fixed performance bug in match/co-group
new 6255733 Merge branch 'fhueske'
new d16e703 Merge branch 'fhueske'
new 4829ffe TPCH Q10
new 351fbde TPCH Q10
new 8e73a08 TPCH Q 10
new fbd006e Inproved I/O Manager performance.
new f6adb53 Merge branch 'master' of https://stratosphere.eu/stratosphere
new 5d7c562 removed printStackTrace()n calls
new 7e54854 changes in StringRecordTest
new 084b005 merge with stratosphere master
new cbb57f8 Fixed error in QueueSchedulerTest
new d6b7493 KMeansIterationITCase: fixed problem with decimal representation
new 2dc7456 Merge branch 'ricos-changes'
new 1d781d3 Merge branch 'dschneid'
new 403168e Fixed I/O manager implications on runtime.
new 40bd1b4 Merge branch 'master' of https://stratosphere.eu/warneke
new e1e5d4e Fixed bug in match it case.
new 3cd1eda Merge branch 'master' of https://stratosphere.eu/stratosphere into stratosphere
new 3407072 DiscoveryService now works if JobManager and TaskManager are in different subnets
new 906e625 First step towards multicast channel implementation
new a1ad043 Merge branch 'dima'
new a809322 - extended DefaultMemoryManagerTest
new 1b02d7e Exception consolidation in SortMerging components.
new 49e699d - set log config for PACT CLI client in pact-run.sh script
new 506b150 - PACT CLI client output goes to std-out
new fc5fe78 - fixed java heap size setting bug for local mode in nephele jobmanager script nephele-jobmanager.sh
new f2d758b Fixed potential source for deadlocks in case of task errors
new 54ca0e0 Minor modification to generation of random filenames
new 7d4e1ee - workaround fix for bug #96
new bbc8c3c - JobManager is shutdown if initialization of TaskManager fails in local execution mode - Improved logging of errors during TaskManager initialization
new 845cd6e Merge branch 'sewen'
new c881796 Fixed bug in equals method of IncomingConnectionID
new 5128882 Removed debugging output from DiscoveryService
new 7715a53 OutgoingConnections are no longer closed immediately but after being idle for 3 sec.
new aff72d3 Simplified state model of file buffer manager
new 2421ef2 Merge branch 'warneke'
new 8537532 Renames TPCH Query 9 to be not match the integration name pattern, because it is broken.
new 629de93 Merge branch 'warneke'
new 2ae5f73 Merge branch 'hu-branch'
new e75d779 Removed warnings
new 54a9683 Merge branch 'marrus'
new 067bf73 Merge branch 'casp'
new 80ff2b0 Merge branch 'master' into experimental
new 6f1db57 Improved behavior of NIO threads when connection is idle
new 0e50a57 - Added tests for handling of failing programs - Added TPCHQuery9ITCase to exclusions of pact/pact-tests/pom.xml
new 9152015 - follow up on last commit
new 7d58791 Merge branch 'master' into dima
new 2039456 Introduced cancel method to safely shut down user code
new cb7a0e8 Changed spelling of execution states to American English
new f71f051 added segment cache / conditional materialization
new 9a868da Improved shut down behavior when task was canceled
new cb9ccde - removed dependency of EnumTriangles example to pact-compiler - changed pact/pact-examples/pom.xml and remove maven dependency to pact-compiler - added maven dependency of pact-examples to pact-runtime with test scope
new cbf6ad8 Changed job status names to correct American English spelling
new b1f8a31 - Added exclusions for failing unit tests in nephele-server - Added catch clause to LocalInstanceManagerTest to test whether the LocalInstanceManager was started correctly
new f8cef27 Introduced extended job status modell to deal with task failures
new d50ce6d Reformatting and removed obsolete includes
new efc8e14 Merge branch 'master' into experimental
new a7a4054 Introduced broadcast record writer
new 5f5f8df added test for TPCHQuery4 and modified the other IT cases to remove the test data in case of assertion failures
new 0bd0545 Merge branch 'current'
new 3eaeb6a Merge branch 'master' of https://stratosphere.eu/dschneid into dschneid
new af7fbff Merge branch 'dschneid'
new f77cd24 Added auxiliary class to create jar files
new aa49018 Added broadcast example job
new e897179 Merge branch 'master' into dima
new 35caa77 Refactored input/output gates
new 141e550 Modified QueueSchedulerTest to match new state model
new fd2d28a Merge branch 'master' into experimental
new 7591dbe Introduced isBroadcastChannel method in AbstractOutputChannel
new 0103408 Added simple and sopremo packages
new df5d0e0 Finished implementation of optimized broadcast in output gate
new 18e70c7 finalized cache logic
new d2a28e6 beautified code
new 0a6b2e2 - added fine-grained logging - fixed caching bug
new a3e2205 - fixed in-cache sort path bug (missed sentinel) - found potential memory leak
new 0cf3b16 addes SortMerger.close() invocations to unit-test
new 5f69dce unit-test -> more useful logging level
new cb7e8e6 Refactored byte buffered channel manager
new 945ff09 Added buffer provider
new 6cb2434 Refactored byte buffered channel manager
new 1ff63b1 Merge branch 'master' of https://stratosphere.eu/stratosphere
new 0b0707c Merge branch 'master' of https://stratosphere.eu/rico
new dcc0b93 Merge branch 'warneke'
new ff18e20 Started implementation of multi-receiver transport layer
new 83f3b68 - added tests to MapTaskTest for task cancelling - added cancel handling to MapTask - added util classes for task cancel tests
new 4625795 - excluded failing unit test ClusterManagerTest in nephele/nephele-clustermanager/pom.xml
new 524ee1e Merge branch 'stratosphere'
new 12d428e Merge branch 'current'
new b57d5a8 Added method to Client to submit jobs and wait.
new 33b2639 Merge branch 'fhueske'
new b8f114a Work on Range partitioner
new 41613ae Added new histogram stub files
new f933fd5 Added clean shutdown to Reduce Task, Match Task and CoGroup task.
new 11b7297 Merge branch 'master' of https://stratosphere.eu/stratosphere
new dfda2e0 Merge branch 'master' of https://stratosphere.eu/warneke
new d85c143 Merge branch 'experimental' of https://stratosphere.eu/warneke into experimental
new 579b6b0 test commit.. experimental
new 77d976d Cleaned up Simple + Sompremo
new 30188cb Added simple files
new 0957ecd Merge branch 'master' of https://stratosphere.eu/stratosphere
new 2d2ce8a Fixed PactNull Serialization.
new 9aeb917 - Added tests for ReduceTask canceling - Added cancel() method to all tasks
new c75fca4 Fixed #94
new 9f75677 Removed superfluous imports
new c190a70 Fixed problem with InterruptedException in direct channels when task is canceled
new e44ad0f Merge branch 'stratosphere'
new e7ac5f5 Merge branch 'master' of https://stratosphere.eu/rico
new e3318e5 Removed invalid test for incorrectly canceled map task.
new 8d584e3 Fixed task abortion for jobs with more than one stage
new c11c4ec Merge branch 'stratosphere'
new 2c9bbf4 - added unit tests for correct cancel behavior of Map, Reduce, Cross, Match, CoGroup, and Combine tasks - fixed cancel behavior of Map, Reduce, Cross, Match, CoGroup, and Combine tasks
new 409e078 Merged Pair und KeyValuePair in pact-common (Ticke #4). Pair is not referenced anymore directly in the project and can be deleted later.
new 9441c68 - fixed canceling behavior of TempTask, DataSourceTask, and DataSinkTask
new 3fa6f4e Merge branch 'stratosphere'
new 8152008 Merge branch 'master' into dima
new b3c90b1 Fixed #99 - Removed potential null pointer access - Don't show cause message for ErrorInPlanAssemblerException as it gets already included when EIPA exception is thrown.
new d65f094 Forgot unsaved changes in the last commit
new d2faae2 Fixed #48 - Replaced used hadoop classes by compatible ones provided by nephele
new 5ee3280 initial multicast implementation
new 5816f71 Continued multicast implementation
new 810d651 Merge branch 'casp_exp' into experimental
new 9604b53 Implemented event processing in output channels
new 9e3914c - added job manager host and port to default nephele-user.xml - added task manager port to default nephele-user.xml - fixes #103
new a733182 Fixed issue #101
new 3202f95 Merge branch 'master' into dima
new a1022b2 Merge branch 'fhueske'
new a91e2ea Merge branches 'warneke' and 'master'
new 93e8b9b Merge branch 'sewen'
new 20c7daf Fixed possible deadlock in OutgoingConnectionThread
new e8524a7 Merge branch 'stratosphere'
new d5efeb9 Added logging output for different transfer envelope receivers
new f581757 Fixed bug in regular expression used to parse network topology
new 3e2f7e9 Temporarily disabled spilling
new ebfe519 Changed configuration of broadcast test job
new 8dbf35f Fixed bug in environment
new b7525b1 Merge branch 'casp_exp' into experimental
new 7921bb3 Added logging output
new 16781dd Reduced size of broadcast buffer
new eeac9fc Continued implementation towards broadcast channels
new 02e3608 Fixed concurrent modification of hash map in OutgoingConnectionThread
new 0cc0219 Fixed bug concerning varying degrees of parallelism and local forwarding strategies.
new f33e439 Added Unit test for Bug concerning local forward strategy and changing degree of parallelism.
new c358371 Merge branch 'stratosphere'
new 942ee1e Fixed problem with concurrent incoming connections
new 606e3d5 Implemented log methods for buffer utilization
new 864ad6a Added test case for PactNull datatype
new e1e5de5 manual merge with stratosphere main repo
new 913eafb Added missing interface implementation
new 9fc5f98 Protected state model against asynchronous changes
new 3bcfe94 Merge branch 'warneke'
new 1010bb3 Merge branch 'master' of https://stratosphere.eu/stratosphere into stratosphere
new f906d60 Merge with Warneke, excluded IO Manager Perfomance Tests from Integration tests
new b4ffc7b Fixed issue #111
new e06f497 - fixed double-closing-SpillingResettableIterator bug in MatchTask
new 17dc9af - removed obsolete code from EnumTriangle example pact program
new a5a7e1a - fixed bug #113, PACT integration tests produce failures if exceptions occur during compilation and execution
new b7f1fdb - fixed bug #112
new 2357971 Merge branch 'stratosphere'
new 613b896 - renamed RuntimeExceptionFailureITCase to TaskFailureITCase
new 05ca709 fixed multicast tree implementation
new 3286b0d Merge branch 'master' into dima
new 61389ed Merge branch 'stratosphere'
new b064489 manual merge for SpillingResettableIteratorTest
new 9788c0d - fixed ticket #116
new c578434 Merge branch 'master' into dima
new 388328a Merge branch 'stratosphere'
new 9b2c2fe Removed old code
new aaa5fb5 - fixed canceling behavior of DataSinkTask and DataSourceTask
new 393436b Merge branch 'master' of https://stratosphere.eu/stratosphere
new 0f14f3e Merge branch 'master' into dima
new f37f441 Removed GPL files from tree
new c0c3a74 Fixed #102
new c8e1ba9 1) Memory assignement from compiler and job-graph generator is a single value, which is split into I/O and sort memory by the tasks and the sortcomponents individually. 2) All sort and spilling/resettable components use the new memory allocation method, which can return multiple smaller buffers in the presence of fragmentation. 3) Memory access speed test is no longer an integration test. 4) Configuration supports long numbers. 5) Hash strategies are removed from the rep [...]
new 9bd66c5 Suppressed type warnings in Environment.java
new 5808488 Changed file split API to better integrate lazy assignment in the future
new 12f8e37 Merge branch 'stratosphere'
new 8c8161c Adopted Tests for resettable iterators to new memory requirements.
new 7d1da7b Style improvements for file channel tests
new 528e38f Added unit test for #115
new 75b4982 Adapted code in combining unilateral sort-merger and associated test case.
new aa1aeb5 - Added NepheleReaderIterator to wrap Nephele Readers by an Iterator
new 9780ca4 - Added missing licence headers to source files in pact/pact-runtime
new e31fe4e - added missing licence headers to source files in pact/pact-tests
new 58ed7fd Fixed div by zero bug in Unilateral sort-merger.
new 90eaca2 - added missing licence header to files in pact/pact-compiler
new aca768c - commented out incomplete tests from ContextCheckerTest
new 4036530 Merge branch 'sewen'
new aa40ebb Merge branch 'master' of https://stratosphere.eu/stratosphere
new c283373 TPCH Q 9 again
new 9c7aec3 Fixed #119
new cb9a016 Added unit test for job with two connections between tasks
new 41d7ea6 Fixed bug in PactConnection, Reengineered BlockResettableIterator for correct shutdown.
new 06b91f1 Fixed double connection bug
new cb09f91 - performance fix in CrossTask - removed ContextCheckerTest
new 4de8e47 - added local sort-merge strategies SORT_BOTH_MERGE, SORT_FIRST_MERGE, SORT_SECOND_MERGE, MERGE to reuse existing orders in Match and CoGroup - adapted PactCompiler to set new sort-merge strategies - extended cost estimators for new sort-merge strategies - extended JSONGenerator and JobGraphGenerator for new sort-merge strategies - adapted MatchTask and SortMergeMatchTaskIterator to support new sort-merge strategies - extended SortMergeMatchIteratorITCase to test new sor [...]
new 2673a69 added TPCH Q9 again
new 7cd63e2 Merge branch 'sewen'
new 253bd10 Merge branch 'stratosphere'
new 02d5c4b Merge branch 'master' into dima
new 3ce748e - extended TempTask rules for LocalStrategies SORT_FIRST_MERGE and SORT_SECOND_MERGE - added inline documentation for LocalStrategies
new 50b869d merged TPCH Q9 ITCase
new ee07cbb Finished implementation of buffer utilization log
new 4e8d3f67 Merge branch 'master' of https://stratosphere.eu/stratosphere
new bc41f0f Fixed #109
new 53ffab2 Merge branch 'stratosphere'
new 093dfd7 Merge remote branch 'origin/master'
new aa9f8ba Added basic throtteling mechanism
new 584d1fb Improved style and performance of queue scheduler
new 0579273 Fixed #105
new f34f283 Fixed problem with forwarding strategy and changing number of used instances. Cross selects non-blocked strategies only in the presence of estimates.
new 0374555 Removed final modifier from QueueScheduler class
new 0465f81 Fixed #115
new 4f02a2e Removed obsolete code
new f239924 Minor format changes
new 835acc6 Modified unit test after having removed dead code
new 720d074 - edited Nephele visualizer color scheme: Finishing tasks changed from orange to light blue, Canceled tasks changed from red to orange.
new a532e51 - fixed NullPointerException in cancel behavior of SpillingResettableIterator
new cbca60c - fixed NullPointerException bug in shutdown of TempTask
new 245b7d1 - TempTask handling in compiler: correct placement, consideration of Nephele's network spilling, memory allocation - Compiler's memory assignment sensitive for number of memory consumers of local strategy
new ec0ba19 Merge branch 'stratosphere'
new c452764 Merge branch 'master' into dima
new d98abc0 Added memory allocation strategy that works in pace of fragmentation across multiple chunks.
new 847a14f Merge branch 'stratosphere'
new f4002d6 - extended compiler hints are used for Reduce, Match, and CoGroup
new 8f5c25b - extended compiler hints for local strategies SORT_BOTH_MERGE, SORT_FIRST_MERGE; SORT_SECOND_MERGE, MERGE, and COMBININGSORT - improved deadlock resolving: temp placement and data source duplication
new 8732623 - adapted compiler hints in CoGroup and Match integration tests
new 6aa5582 Merge branch 'master' of https://stratosphere.eu/dima into dima
new fd7874d Merge branch 'master' of https://stratosphere.eu/stratosphere into stratosphere
new 576cbf3 Merge branch 'dima'
new e6b763d Merge branch 'stratosphere'
new b9f10e9 - fixed exception message
new cb8788f - fixed comments in MapTask and ReduceTask
new 63864e7 Fixed possible deadlock in OutgoingConnectionThread (possible fix for #95)
new 08a004f - improved task cancel behavior
new 0acf33a Merge branch 'stratosphere'
new 6ff49d2 - extended PACT task unit tests
new 249b02d - added SelfMatchTask - added unit test for SelfMatchTest
new 1b794c9 Merge branch 'warneke'
new c4054ce Fixed position integer overflow bug in Memory Segments and their Views. Channel Readers and Writers tollerate asynchronously released memory segments.
new 2bb48b1 Merge branch 'stratosphere'
new aac27b0 - added local strategies for self match: SORT_SELF_NESTEDLOOPS, SELF_NESTEDLOOPS - extended JSONGenerator to handle new local strategies - extended JobGraphGenerator to handle new local strategies
new 1ef856f Fixed #95
new d430b5b Merge branch 'stratosphere'
new edc42db Added missing file
new efe03e7 - applied new local strategies to SelfMatchTask
new bbfa1c4 - fixed bug in JobGraphGenerator
new 6a31c67 - added new local strategies to compiler hints
new 779f6a2 - added cost estimations for new local strategies SORT_SELF_NESTEDLOOP and SELF_NESTEDLOOP
new 3dc4dec - adapted plan enumeration for new local strategies SORT_SELF_NESTEDLOOP and SELF_NESTEDLOOP for self match tasks
new 77095de - improved cancel behavior of DataSourceTask and DataSinkTask: files are now closed in case of task canceling
new 6d59202 - fixed bug in InputFormat - revisited DataSourceTask cancel code
new 08c22a9 Fixed #134
new de1a0a8 - added DataSourceTaskTest and DataSinkTaskTest - adapted task test utils for DataSourceTaskTest and DataSinkTaskTest - renamed configs of DataSourceTask and DataSinkTask
new 42efe27 - removed unused imports in DataSourceTaskTest and DataSinkTaskTest
new be3a2ab Merge branch 'master' into dima
new 6d2f9bb Merge branch 'stratosphere'
new 044054c Merge branch 'dima'
new 770aa42 Merge branch 'master' into selfMatch
new 50a4b00 Fixed illegal monitor state exception
new 71eed0e Fixed #131
new 1cd6008 Merge branch 'stratosphere'
new 1062105 - fixed bug in SelfMatchTaskTest - improved SelfMatchTask with value buffer
new 2b21c23 Removed final modifier from FileBufferManager class
new 2096b3e Fixed #132
new f08dfcd - fixed bug in SpillingResettableIterator hasNext() method - added constructor for SpillingResettableIterator to support Iterator as well
new 1bb3212 - improved SelfMatchTask - adapted SelfMatchTaskTest
new e906775 - replaced Reduce Pact in EnumTriangles with Match
new 024741c Fixed internal state of FileBufferManagerEntry
new b707c2f Increased idle time until TCP connection is closed to 10 sec.
new 5ba3ca9 Merge branch 'master' of https://stratosphere.eu/stratosphere into stratosphere
new 6830b16 Merge branch 'master' of https://stratosphere.eu/stratosphere into stratosphere
new ed5178e Merge branch 'stratosphere' into dima
new fa57ccd Merge branch 'master' into stratosphere
new 2fbd8dd Merge branch 'dima' into stratosphere
new 999562e - reduced classpath of PACT webfrontend in start script
new 9675c95 - refined classpath in PACT CLI client script (pact-run.sh)
new 3bb054d Sorter closing is synchronized.
new 0e6bf32 - improved SelfMatchTask
new 0df9a69 - fixed bug in SortMergeMatchIterator: calling hasNext() twice without next() caused lost tuples
new 3e7d259 - added buffer to MatchTask for n-n matches
new c972391 - improved MatchTask with BlockResettableIterator crossing instead of streaming
new d1aa650 Removed API for direct access to input channels
new b5f00cf Fixed #38
new 248181f Fixed #95
new 3018ecb Merge branch 'stratosphere'
new cb87bb4 Fixed merge conflicts
new a633bce Bug fix in Compiler.
new 43c3e71 Improved style and javadoc
new ff20d8a Fixed #85
new c5e704b - fixed bug in pact-run.sh script
new 3569562 - moved PACT testing code and tests from pact-test to pact-client - adapted pom.xml files in pact-client and pact-test
new ce2cfb6 - fixed memory requirements checks in PACT tasks
new f7d9b82 Merge branch 'stratosphere'
new cc1a2ee - adapted Pact task tests to new minimum memory requirements
new a94d715 Fixed #120 and improved clean-up in case of errors or cancel operations
new b9156c3 Merge branch 'stratosphere'
new 3587cd0 Changed IO manager to allow block writers.
new e75b06a - fixed #137
new 3b43ab0 Fixed race condition in UnilateralSortMerger shutdown.
new 875d79b Added menu to visualization and removed automatic logging of buffer utilization
new cbe96af First piece of the Hybrid Hash Join: Partitions and partition spilling.
new bc3787b - fixed bug in SortMergeMatchIterator (corrected iterator behavior)
new b25a688 - restructured value crossing code
new 6a7ee9b - fixed bug in CrossTask (streaming strategy was not correctly used) - refactored crossing code in CrossTask
new 898a22a - fixed bug in MatchTask
new e3b214b Merge branch 'master' into stratosphere
new 5de2040 Merge branch 'stratosphere'
new 6d0249f - generalized NepheleReaderIterator - added IteratorNepheleReader
new 2152f74 - refactored MatchTask code
new f852caf Merge branch 'master' of https://stratosphere.eu/dima into dima
new b808114 Merge branch 'stratosphere'
new b819c68 Merge branch 'dima'
new 4f36be1 Fixed #124
new 5d51642 Moved abstract compression classes to server module
new acd39b4 Removed nephele-compression from nephele pom file
new adde30f Hash join incremental development.
new d8c31b2 Merge branch 'stratosphere'
new 94d193c Split compression module into separate modules
new 303cf24 Removed files which are not under the Apache license from the LZMA compression module
new 80ebf6b Added README
new c450fea Removed files which are not under the Apache license from the bzip2 compression module
new 232e6bf Added README
new 765ac6c Removed superfluous files from zlib compression library
new d63a2db Modified zlib Makefile
new 8bcf22a Removed files which are not under the Apache license from the zlib compression module
new 5f3e056 Added README
new f81f68c Merge branch 'master' into stratosphere
new 3f485d8 Removed some old, outdated code
new 1e603c4 Removed some old, outdated code
new 9437135 Removed some old, outdated code
new abb2c8d Changed default settings for compression libraries
new 8a9e0da Improved debugging for compression problems
new 4594869 Merge branch 'stratosphere'
new 2ed8061 - added replication factor to PactConnection - adapted cost estimators to consider replication factor
new b16f803 - replaced compiler hint "Selectivity" by "AvgRecordsEmittedPerStubCall" - adapted size estimations to new compiler hint - adapted JSONGenerator to new compiler hint - Adapted examples to new compiler hint
new fe604eb Added parsing for selection, projection, (join)
new 08fc960 Added missing files
new d50bd11 - extended PACT CLI client - renamed pact-run.sh to pact-client.sh
new e4242e0 - improved PACT CLI client output
new 24eae26 - improved argument error handling in PACT CLI client
new 1d33e71 - added suppressWarning annotation in PACT CLI client
new 90e8f62 - extended pact-tests TestBase - Added DeltaComparator to KMeansIterationITCase
new 5f4a8e9 Small fix to CompressionLoader
new 2ffc8f6 Improved clean-up behavior for compression
new c0b2786 - fixed JSON plan bug in PACT CLI client - improved PACT CLI client
new 24a4f57 Added Apache header to bzip2 compression library
new a12e1c4 Added Apache header to native zlib compression library files
new fc61fb3 Added Apache header to native files LZMA compression library wrapper
new 6fbde34 Added menu item to cancel job to visualization
new 544950f Fixed #139
new 2ed1db2 - added wait flag for program execution in PACT CLI client
new 67f0445 Merge branch 'stratosphere'
new accff26 Removed incomplete hashjoin code
new a99fec0 Merge branch 'stratosphere'
new 3d07ba9 Hash Join bucket array structure
new 4d8e98a Hash Join Test V0.1
new 5ad44d6 Task interfaces changes to support a spilling threshold.
new 138f267 Added two auxiliary classes to improve shut down behavior
new 053712a Improved javadoc
new e8fa78a Improved javadoc
new ec6bcab Buffer implementation is now robust against multiple calls of the recycling method
new 59f9981 Fixed #139
new 4f49fc2 Removed final keyword from class Buffer to fix unit test
new 6178dc4 Reduced logging and fixed possible NullPointerException in FileBufferManager
new a58be72 Removed semicolon
new b7f2f83 Fixed logging of state transitions in the profiling component
new 1e61e92 Corrected code style of OutgoingConnection.java
new dd1d22b Fixed channel target lookup mechanism
new 2e2e3f1 Fixed #140
new ce737c4 multicast cluster implementation continued
new 0eadd80 Merge branch 'master' of https://stratosphere.eu/warneke
new 2a492f1 Fixed problem with outdated management graph information after visualization has been shut down
new 134d745 Improved robustness of user API
new 26ec54a Added unit test for #141
new 9c6125f - fixed compiler hint in TPCHQuery3
new 6c3d313 Merge branch 'warneke'
new 23f44e6 Fixed #141
new 9a44ac6 Removed final identifier from AbstractInvokable.getEnvironment()
new 8bc11eb - fixed list action in PACT CLI Client
new d8d4c61 Merge branch 'warneke'
new ca55d79 Typo fix in IOManager
new 5b6eb1e Merge branch 'warneke'
new 32026fe added sortmerger cache to latest code-base
new 283b039 - fixed bug in PACT CLI client
new 8ca2983 Merge branch 'erik'
new fe1cc8c Fixed #77
new ebf1633 Fixed #146
new 1f421be Removed buggy clean-up optimization
new 1682d90 Fixed bug in file buffers which caused IOExceptions when task is canceled
new dc690a6 - added Asterix TPCH query example and integration test
new 735621f - fixed invalid compiler hint in WebLogAnalysis example query
new db4214a Merge branch 'stratosphere'
new 5dc0df5 Constructor fix in sort-merger testcase.
new bc96960 Data Source Task robustness to canceling improved.
new 8399dd5 - improved TPCHQuery4 by removing unnecessary object instanciations and static objects - moved TPCHQuery4 classes to a single file
new e7b670c Merge branch 'master' of https://fhueske@stratosphere.eu/stratosphere into sewen
new e127573 Merge branch 'sewen'
new aa1ff3d Reworked and improved Sort buffers and comparators.
new e4f4f51 In-memory sorts where possible with fine grained threshold definable.
new 62d08f9 Merge branch 'fhueske'
new 3c7deea Fixed spurious error message for buffer recycling
new 9c64037 Combine Task now operates only in-memory and pushes out results early.
new 3a45f84 Fixed erroneous test case assertion.
new f796b93 Merge branch 'stratosphere'
new aa284b7 Added tests for Jaql parsing
new b3e029d - removed empty class TPCHQuery4Launcher - updated Asterix TPC-H example query
new 73fdf29 Merge branch 'mkaufmann'
new 8ceed55 - replaced HDFS's API classes by Nephele's API
new c2ee881 Merge branch 'sewen'
new ab80779 Merge branch 'master' of https://fhueske@stratosphere.eu/stratosphere into stratosphere
new cda3abb Merge branch 'master' into stratosphere
new 250ad2b Fixed close bug for broadcast channels
new 3733ee8 Added test for multilevel hash function
new 077d050 Fixed #117
new 9ad9c2d Fixed typo in JavaDoc
new b587f2a Fixed #149
new e355a4d Minor modification to output message
new b298b97 Modified JavaDoc
new 56713d3 Fixed #144
new a89a69e Fixed Cost estimation Bug for Cross and Removed FallbackCostEstimator
new db283ea Merge branch 'stratosphere'
new eb44c8c - moved TPCH-Queries to pact-tests
new e815f0a - Updated pact-example/pom.xml - Renamed All2AllSP to PairwiseSP
new bb21cde Merge branch 'master' of https://fhueske@stratosphere.eu/stratosphere into stratosphere
new 945036d Merge branch 'stratosphere'
new 98c888c Merge branch 'sewen'
new 6d19035 - added stub configuration to TPCHQuery3 example
new 4462c85 - added missing Apache Headers
new bc3d7bc Merge branch 'master' into stratosphere
new e0e457a Merge branch 'master' of https://fhueske@stratosphere.eu/dima into dima
new 83024e7 - Moved SequentialInput/OutputFormat and JSONInput/OutputFormat to pact-client/testing
new d1cd9a1 - Adapted WebLogGenerator
new 7a6afe0 Merge branch 'master' of https://fhueske@stratosphere.eu/stratosphere into stratosphere
new 2708e15 Merge branch 'stratosphere'
new f0d8693 - added reference to Apache Hadoop licence to code that originated from Hadoop
new 6c397cf - excluded source build from Maven - added JavaDoc build to Maven
new 44ce30f Added tests for JAQL operators filter, group, transform, and join
new e6d8126 - pom.xml: moved javaDoc building to site target
new 2f8d93a - Added licencing headers
new 36a170e Reworked block resettable iterator to exclude asynchronous thread.
new 1290fba Merge branch 'master' into hashjoin
new 5652126 Merge branch 'stratosphere'
new b4168a8 Merged Random AccessView and MemorySegment into one structure.
new f93493c Merge branch 'master' of https://stratosphere.eu/stratosphere
new f105552 Merge branch 'master' into range
new 76a2157 Working prototyp for SOPREMO projection
new 892ab60 Added sopremo expressions
new 0bc10c8 - Adapted Stratosphere start scripts for MacOS compatibility
new e33eb35 add a testfile
new 5331229 remove test file
new 9e4a08a Merge branch 'master' of https://fhueske@stratosphere.eu/fhueske
new a13b7f3 testfile
new 8292601 remove testfile
new 9a04c6b Added sopremo operators & tests for selection, projection, aggregation, and joins
new 2a2b3bf Added some more scenarios to MultiLevelHashTest
new d6308d7 Added a tolerance setting for differences in PactDouble values for the TestPlan class.
new b21ffd4 Hash Join Next step
new 4a1b42d MultiLevelHashTest is now integration test
new e3060a0 Fixed basic operators and added function registry
new 1bfeeae Fixed Serialization Bug in PactString
new d37edba Fixed bug #154 and #155 Generalized fuzzy double matching problem by allowing users to specify a custom matcher and similarity measure for key value pairs. Merge branch 'master' of https://stratosphere.eu/stratosphere
new 967a2ea - moved TPCH-Queries to pact-tests
new 0e9a53e - Updated pact-example/pom.xml - Renamed All2AllSP to PairwiseSP
new ad0a2a0 - added stub configuration to TPCHQuery3 example
new 4b78f54 - added missing Apache Headers
new 90f5a1d - Moved SequentialInput/OutputFormat and JSONInput/OutputFormat to pact-client/testing
new ac0dbd4 - Adapted WebLogGenerator
new aac112d - added reference to Apache Hadoop licence to code that originated from Hadoop
new 54eb0ec - excluded source build from Maven - added JavaDoc build to Maven
new b101e33 - pom.xml: moved javaDoc building to site target
new c9029a0 - Added licencing headers
new 6557df9 - Adapted Stratosphere start scripts for MacOS compatibility
new c021ab3 Merge branch 'master' of https://fhueske@stratosphere.eu/fhueske
new d62951a Merge branch 'master' of https://fhueske@stratosphere.eu/dima
new 6c636c9 Added evaluation context to employ registered functions
new 2178e05 Added missing files
new 282c047 Hash Join In-Memory functionality
new a601548 Fixed Hash Join Buck consering overflock buckets, extended test
new 7562fa5 Merge branch 'ringwald_hash' into hashjoin
new 7fa16bb Merge branch 'master' into hashjoin
new a3b4773 Refactoring
new e5ab8c4 Refactoring: removed unnecessary reflection in TypeSpecificHandler
new dafa4a3 Adapted Hash Function Test and included HashJoin probing for spilled partitions.
new e4cd793 Cancelling correctly removes partial temporary files.
new 21a70ad Refactored eu.stratosphere.dag package
new 3c0bbd6 Reworked IO Manager to correctly abstract IO requests for buffers and Memory Segments
new e52bb2b Added new iterator for mutable objects.
new bb1bb4f Cleaning and commenting I/O Manager + Hashjoin incremental progress.
new 3cfcdab Added union operator and refactored
new c25f114 Refactoring and documentation
new afcfd7c Fixed JavaFunction bug
new 4d5cae8 Refactoring
new 684989a Merge branch 'master' of https://stratosphere.eu/stratosphere
new e9995aa Moved all json types from pact to sopremo
new 392da77 Added set operators
new cec094a Fixed test cases in pact.testing
new e82b86e Added missing files
new 1ee022b Cleaning and commenting I/O Manager + Hashjoin incremental progress.
new cbc9739 Hash Join Cleanup
new 4cbe896 Refactored PactModule, added SopremoModule and shared base class
new 2186302 Added n-way join and test case for equi join
new 14071d9 Support for recursions, still fixed number of buckets.
new d8d2990 Finished Hash Join, Adopted Match Task Iterators, ensured SortMatch will stay in-memory for N:M, if possible, cleaned iterator interfaces.
new e40abd7 Allow sort iterators to take AbstractInvokables instead of AbstractTasks.
new cf081de Implement local sorting for data sink task
new 26443e1 Initial work on job status display
new e17a257 Initial work on job status web interface part 2
new 6e86845 Initial implementation of range partitioner
new fd3ffd9 Merge branch 'master' into range
new 29d732e Finished reworking SortMergeMatch Iterator.
new 153b575 Merge branch 'master' into hashjoin
new 8101970 Merge branch 'hashjoin' of https://stratosphere.eu/sewen into hashjoin
new a1d814d Propely integrated range partitioning into memory calculation
new 2481402 Removed hack used to set the partition borders
new 42d2e9f -Properly forward order information
new c0301c2 Partitioning obeys order
new 5f6136c Added HashMatchIterators and extended Tests. Full HashMatch support.
new 904c247 Memory Manager Strict allocation for small page collections.
new 070741d Modified LibraryCacheManager to work on Windows
new 2ad6072 Added Exception to mutable object iterator interface.
new 8466b14 Added CheckpointProfilingdata. Changes in Checkpointing
new e3d0b6c Added detection of physical memory for Windows
new e46f9ae Support for nested jar files in pact jars.
new 0081fd4 Fixed possible NullPointerException in DiscoveryService
new ba2ad3f Minor reformat
new b73f878 Increased code coverage of expressions
new 19090dd Changed Input Split Logic so it can be overridden.
new 2b96b46 First steps towards Amazon S3 binding
new e3e80a0 Intermediate commit (does not compile and breaks tests!)
new 24ce203 Initial stubbing of api classes for new datamodel in extra packages.
new d0bfde2 Nested Jars contained in subdirectories are now supported.
new 556f697 Nephele rework to make input splits more generic and user definable.
new 66b2642 Removed pull based scheduler model to reduce deployment latency
new 45842e9 Minor reformatting
new 54a31cb Added javadoc
new 7e531fa Removed static split assignment, prepared code for lazy split assignment
new 8e32232 Implemented first dummy version of lazy split assignment (must be replaced by more sophisticated version)
new a4c9876 Improved documentation of <code>mkdirs/<code> method
new ca578bb Worked on S3 file system implementation
new 8227a01 Merge branch 'master' of https://stratosphere.eu/mjsax
new ed9258c Added integration test for global sorting / partitioning. Fixed DataSinkTask if no order is set
new e697b56 Added generic input task.
new 46c5bf2 Worked on getFileStatus method for S3 file system
new cb005d1 Merge branch 'sewen'
new 43e5148 Adapted PACT runtime test to new lazy split assignment
new 62e4d46 Changed signature of computeSplits method
new 285f29a Temporarily disabled TestPlanTest to avoid build problem on Jenkins
new 2668f6c Even more refactoring
new 1e17928 Replaced dummy split assignment code with final input split manager
new 21c7e34 Temporarily removed file input split assigner from default configuration
new b27a112 Implemented S3DataOutputStream featuring HTTP multi part upload
new ed4922e Added implementation for S3 input streams plus tests and javadoc improvements
new a00c038 Initial draft of New Datamodel API.
new bd7120a Finished implementation of S3 file system support
new fcc291c S3 tests now finish successfully if no AWS keys are found
new 3e4d4d1 Fixed two warnings in nephele-common
new 61fdb82 Reenabled FileInputSplitAssigner as default assigner for FileInputSplits
new 333db26 Implemented distance computation between network nodes and added respective unit tests
new 6b0563f Finished implementation for topology-aware file input split assignment
new 202c8a7 First steps towards TeraSort PACT example
new 673d9e1 Fixed QueueSchedulerTest
new f217aa3 Merge branch 'master' into terasort
new 3289d2d Fixed misleading log statement in FileInputSplitAssigner
new 6e2baf4 Worked on TeraSort PACT job
new 8f042fa Finished implementation of TeraSort PACT example
new 9cd90d0 Fixed concurrency bug in both local and queue scheduler
new 5931694 Merge branch 'master' of https://stratosphere.eu/warneke
new 7f85316 Fixed potential concurrency problem
new 1d099da Added composite operators
new 1938891 Merge branch 'stage1'
new 69a7ea7 Temporarily disabled CrossITCase since it seems to lock up in an infinite loop
new 61dc0cd Improved error handling when compression library is not on classpath
new 456c810 Rewrote compression resource management
new 37cde19 Reorganized class hierarchy
new 81e6f55 Fixed possible memory leak in JNI resources
new b8cd18c Fixed bug in compressor/decompressor cache
new 29aff5d Adapted bzip2, lzma, and zlib wrapper to new compression resource management
new ca00762 Initial stub for snappy wrapper
new 011d9cf Worked on snappy compression wrapper
new ba5ff58 Minor modification
new b89af84 Modified Makefile to match snappy directory structure
new 3cbdeb6 Increased coverage of sopremo.common.base
new a74e941 Corrected calculation of buffer size
new 4566930 Changed visibility of SIZE_LENGTH member
new 5c67990 Several fixes to JNI code and Makefiles
new d266d49 Increased coverage of sopremo package
new 2b979fd Increased coverage of sopremo package
new e7bb3e8 Fixed TempTask sharing #171
new 0e7e77f Fix: PARTITION_LOCAL_HASH is now also accepted by JobGraphGenerator + Test (ticket #170)
new cd8b6ce Workarounds for OOM
new bea8e83 Merge branch 'stage1'
new 41744a6 Fixed memory leaks caused by TestPairs#iterator
new 74f7925 Refactoring, coverage
new 4af1d2e Merge branch 'master' into terasort
new f454715 Modified TeraSort example to use PACT global order option
new 7f4efec Nested JAR file feature of PACT layer causes problems, disabled the feature temporarily
new 1b7a876 Fixed critical bugs in graph iterator classes
new 0cae1dd Fixed bug in PartitionTask distribution pattern
new 30cac4b Trying to reproduce bug #158, not yet possible
new 4d67d34 Used correct shipping strategy for reading data in partitioner
new a3a7c54 Added temp vertex to avoid blocking when using range partitioner
new 609a6b2 Sampling finishes after 100 KV pairs
new 41d51bd Merge branch 's3' into terasort
new c9a7871 Fixed problem with character encoding in URL user info
new e071f06 Added nephele-s3 to stratosphere distribution
new 2a18458 Added support for S3 Reduced Redundancy Storage
new 4446995 Reworked input formats and source/sink tasks to be - more generic - support non-file inputs - allow user defined splits - allow user defined statistics gathering
new 97416ff Added the option to set a user defined data distribution on the receiver side for partitioning. This than skips sampling
new e075253 Fixed bug that sink tasks did not use the correct degree of parallelism to decide whether to create the target directory.
new 0e9fd5d Only nested libraries contained in the "lib/" directory in the pact jar are added.
new de4a3f4 Forgot to include several files in last commit -.-
new 99cc185 Fixed Bug that cross with empty inner input hangs.
new 4edd6b0 Merge branch 'mkaufmann' into s3
new 6bf5915 Reformatting PartitionTask
new 6dfb786 Reverted changes to sample task
new cec508f Merge branch 'compressionfix' into s3
new 8bb9d8a Merge branch 'snappy' into s3
new 0d00e77 Fixed warning in execution graph
new 19df75b Reformatting ExecutionGraph
new 7b70bd9 Added Test Case for empty cross task
new 894795a Fixed bug that nested jar files in subdirectories are not supported.
new 0fb3aee cloud manager amazon API (EXPERIMENTAL)
new a847319 Added user-defined data distribution to TeraSort
new 4a9aa74 Added required S3 libraries to classpath
new 6537398 Added commons-codec to classpath
new a877207 Modified data distribution for TeraSort
new 375b245 Refactored and restructured
new 739a578 Fixed bug in Path implementation
new f6a7e5f Replaced "/" with Path.SEPARATOR
new 636e93e Moved ContractUtilTest to test package
new a194e5e Changed LZMA wrapper to reflect new package structure
new 80b4d71 Fixed bug in LZMA compressor
new 38daa8d Fixed Typo in comment.
new 1189ca8 Fixed assignment bug in ClusterManager
new 97b09ab Merge branch 'master' into datamodel
new 5765bcd Added remaining contract classes for new data model. Adopted KMeansIteration to new Data Model.
new cff417c Existing files output files removed before program execution starts, to prevent overwrite errors
new b49beb4 Added key columns for new datamodel contracts.
new d06f46c Merge branch 'datamodel' into staging_datamodel
new e748458 Removed getDecompressor test since compression is not enabled in standard setup anyway
new 4b2eed2 Added Operator test cases
new dee05a4 Merge branch 'master' of https://stratosphere.eu/warneke
new 7da68ec Tasks submissions are now bundled in groups to reduce deployment latency
new 1863c2a Increased version number from 0.1 to 0.1.1
new 8df4a39 Took care of warnings in various PACT classes
new bd50637 Addition of TPCH Q3 with new datamodel interfaces and smaller refinements on utility classes.
new 587e89e Merge branch 'datamodel' into staging_datamodel
new daa64b4 cloudmanager EC2 implementation continued
new 8381b18 removed old typica library
new 9f7550a Fixed shutdownHook bug in Nephele JobClient
new a473860 Merge branch 'stage1'
new f224fcd Merge branch 'stage1'
new 09082d4 Merge branch 'bugfixes'
new d43e66b Fixed test cases Fixed temp task (didn't work if preceding task was input task)
new a3ef45a Merge branch 'marrus'
new 19d4e34 Merge branch 'experimental'
new bcf9fd3 Fixed compilation problems in nephele-common
new 781e2c0 cloudmgr continued
new 255ed17 Started to integrated new buffer concept
new b19e1bc cloudmgr fix (still experimental)
new e5414d0 cloudmgr continue (fixed QueueScheduler call, floating instances)
new 990bebd Removed direct channels
new a74a194 Some bug fixes
new 490d89a cloud manager working
new 88f9532 Implemented partitioning of global buffer pool
new cafb105 Worked on new checkpointing implementation
new 95e25a7 Implemented serializing in-memory channels
new ac05a71 cloudmgr blacklist/exception handling
new 8768bdc Reintegrated multicast transmissions
new 483ada7 example fix
new 9bd019f Changed version from 0.1.1 to 0.2
new 1b58678 Progress on Data Model Evolution
new 13b9f3b Fixed multicast bug
new 8979043 Improved performance of receiver list lookup
new eb02d5b Added implementation for serializable hash set
new 074c503 Worked on lazy deployment
new bdfea47 Merge branch 'version011' into version02
new fff3a93 Modified some tests to match new internal components
new aa3f9f8 Worked on new instance manager interface
new cd96f25 Added InstanceRequestMap to make specification of required instances for a job more elastic
new 0d5f543 Fixed bugs in byte buffered channel manager
new ae0e46f Fixed bug in output channel context
new 25cebe6 Integrated new event to activate output channels
new a6f76e5 Added batch aggregation Added record linkage implementation and unit tests
new 754a3b9 Merge branch 'master' of https://stratosphere.eu/arvid
new 791303f Implemented delayed replay of a channel's data
new ab0f9b8 Implemented additional consistency checks for buffers
new e065b6b Implemented filebuffer to memory copy
new f716e70 Simplified Nephele's internal state model
new d3d09dd Adapted schedulers to new state model
new 745bf2d Removed two final modifiers, so PowerMock does not complain anymore
new 17db9ad Introduced state STARTING to know when a task is currently deployed
new 70f1cd6 Refactored class hierarchy for scheduler related classes
new 12fd863 Added check for instance type when instances are reused outside of the same task group
new 070f93f Fixed minor bug in task manager logging
new 35f0816 Modified instance assignment in cluster manager according to new request concept
new 2abe0e5 Relocated activation of input channels to user code thread
new 146fa82 Added additional check for execution state of vertices
new 8a825b7 New Datamodel runtime integration - adopted hash join
new c5c49e5 Adapted file resource layer to support buffer duplication
new 986f457 Fixed bug in copyBuffer method of FileBuffer and adapted FileBufferManager accordingly
new 9371843 Fixed bug in FileBuffer
new f361b05 Fixed bugs in FileBufferManager
new 31ead70 Temporarily disabled lazy task deployment
new 67044d0 support for orphaned instances
new f2da12f Re-enabled lazy task deployment
new 12a65fe ReadableSpillingFile does not block anymore when the file is already locked
new 496bf2d Merge branch 'version011' into version02
new 1ed0287 Changed interface to handle callbacks of allocated resources
new 66c6f5c Pact Record fixes.
new 05e40b4 Fixed merge
new 0db457b Fixed bugs in buffer implementations
new 243050d Merge branch 'warneke' into staging
new 85e9720 - Unified and improved output estimates of PACT compiler
new 77d59fa - added compiler hints to WebLogAnalysis PACT example job
new f8154f7 Added global enumeration
new 58eebcd Merge remote branch 'warneke/master'
new dfdd5bf Merge branch 'stage1'
new c16e9e5 Implemented MutableRecordReader
new d451da7 Replaced synchronized HashMap by ConcurrentHashMap to improve performance
new 89ed3a6 cloudmanager cleaned, refactored
new 3d45d25 Merge branch 'stage1' into version011
new aaec5bf Hash Iterator Adoption First Adoption of sorting code
new 929b8f4 Merge branch 'version011' into version02
new 43f27ac Worked on diagnosis method logBufferUtilization
new 68307c1 Fixed possible deadlock problems which occurred with new buffering concept
new 4aaed2f Merge branch 'casp_version02' into version02
new 04d17cd Minor changes to the EC2 cloud manager
new 2c49649 Fixed RPC problem in EC2 cloud manager
new 671529a - excluded performance test from build tests
new b74623f Merge branch 'master' of https://stratosphere.eu/stage1 into stage1
new 2392cd6 Added method to estimate HardwareDescription of different cloud instance types
new 7d2f903 Added missing Stratosphere header
new 1c47a63 Removed old code to handle canceled channels
new 29115a2 - Added PACT PlanConfiguration - PlanConfig can be used to delegate Nephele JobGraph Parameters
new 2f28b2f Cleaned up Nephele Grep example
new 2c20a9f Minor corrections in EC2 cloud manager
new 8f13e6a Adoption of sort components to new data model, part 1.
new 167d096 Added missing Stratosphere headers
new abfb5a8 Added missing Stratosphere headers
new 009a804 Merge branch 'fhueske' into version011
new a48c862 Fixed bug #181
new 05cc978 Updated status message
new 32c97b0 Corrected code style
new 4d80ce3 Fixed default configuration for Nephele cloud mode
new bf3613f Re-enabled CrossITCase
new baa340c Fixed bug in byte buffered input channel with prevented unconsumed channel from closing
new c34a8d8 Corrected message in getLogString of various PACT tasks
new 3df30f6 Minor correction to previous input channel bugfix
new 5975c13 - Added UnitTest for DefaultDataInputView and DefaultDataOutputView - Fixed Bug in DefaultDataOutputView
new 4965721 - renamed method in PlanConfiguration
new 85baafd Merge branch 'master' into version02
new a17f89a Added missing import
new 42a2ef0 - renamed access method in PlanConfiguration
new 9dff0fa started scrubbing operations
new 5440aad Merge branch 'master' of https://stratosphere.eu/arvid
new dc7559d Redirected output of input split assigner from stdout to standard logging
new 2140316 Merge branch 'master' of https://stratosphere.eu/stage1 into stage1
new 4f0aa15 Merge branch 'stage1'
new b383953 Merge branch 'master' into version02
new c5bb11b Added scrubbing operations
new 729dee0 Improved error logging in task manager
new 4f89107 Improved logging of buffer utilization
new c48cf24 Sort Runtime classes (except sort-merge-match) adopted to new data model.
new 5f9157f Reduced visibility of task context methods
new d316f38 Started to implement blocking in-memory channels
new f7e30e2 Backported EC2 cloud manager from Stratosphere 0.2 to 0.1.1
new b08350a Adopted Sort Matching and Sort Co-Grouping
new a4ebc04 Added transitive closure, enhanced schema mapping
new a434627 - Fixed bug in JobGraphGenerator for TempTask inserts
new bc229c6 Refactored iterators, adopted sort merging logic.
new 116c07d Increased robustness of initial execution graph creation
new e195b1b Re-enabled extraction of nested jar files in PACT jobs
new a7f0985 Tried other mutable iterator model
new ba74fe7 Changed toString method of InstanceType
new 48f1f6f Renamed cloud manager to reflect dependence on Amazon EC2
new d113bda Removed old files
new eb31f42 Unified configuration of EC2 cloud manager with the one of the cluster manager
new 647f28a Removed superfluous library from classpath
new 3bde8c1 Added Amazon EC2 standard instance types to default configuration
new b1e5e81 Improved robustness of EC2 cloud manager
new a1a425c Merge branch 'master' of https://stratosphere.eu/stage1
new c6b9e6c Improved logging in EC2 cloud manager
new f6f8181 Added required parameters to TPCHQuery3 to run on Amazon EC2
new a3b6714 Added check concerning illegal arguments to EC2 client factory
new 28b1cf9 Improved robustness of EC2 cloud manager
new f36048b Improved logging for input split generation
new 3806fb7 Corrected logging in EC2 cloud manager
new ea1a308 Improved log message in EC2 cloud manager
new fd644c7 Added quick workaround to ensure correct calculation of intra-node-parallelism in PACT compiler
new 3270aef Added support for availability zones on Amazon EC2
new a27be63 Added additional check for Amazon image ID in the job configuration
new 9a60689 Added support to pass an SSH key pair argument to TPCH query 3
new c1ec22c Fixed possible NullPointerException when cloud instances are reused
new f1c04ae Adoptes Hash and Sort components to new iterator model.
new 32ad8e5 Fixed NullPointerException due to missing topology information
new 04fcf65 Added support for user-defined lease periods
new fc0082e Finalized Sorting, Hashing and Resettable logic. Baseline performance passed.
new 4330094 Removed deprecated code
new 1f99ba4 Adopted first set of task classes to new data model and mutable objects.
new 5b61df4 still problems with correct writing/reading of chekcpoints
new 85a33ff Created AbstractPactTask with common control flow Adopted Map Task to new Data Model. Adopted Reduce Task to new Data Model.
new fbdb7bd Merge branch 'datamodel' into staging_datamodel
new b013bd8 Added fusion operator
new 8234b0a Adopted Task config and Match task for new data model.
new 7107b3f Merge branch 'datamodel' into staging_datamodel
new 9b70429 Merge branch 'stage1'
new f93d327 Fixed character error
new d25fab5 Deleted bug reproduction file
new 9d8c096 Testing cobertura ignore
new 4ec28e3 Added union record reader to support union operations on higher layers
new e0de1e2 Added sample Nephele job which exploits the new union record reader
new 570da82 Added test for catching NullPointerException which occurs when tasks have no name
new 8abb5f2 Fixed #188
new 47f7d2e Adopted runtime tests and partly runtime classes to new data model
new ac8b18f Implemented SpillingResettableMutableObjectsIterator
new e59e9f9 Fixed #186
new 2b34f8a Refactored job vertex class hierarchy
new e033238 Improved code style and javadoc
new 7e1bb09 Improved code style
new 663a28f Fixed transitive closure
new 36f3296 Improved code style
new fdb16ef Fixed code style
new c2a21ba Fixed queue scheduler test
new c1aae15 Improved code style
new 9d4d644 Merge branch 'master' of https://stratosphere.eu/stage1 into stage1
new 9dced6c Improved code style
new a309755 Improved code style
new d6f4f52 Improved code style
new 51ca409 Renamed class to reflect abstract character
new d0c21f4 Improved code style
new 5df886e Merge branch 'master' into version02
new 713d006 Renamed ID to AbstractID
new 4742c2c - Fixed bug in CrossTask: Ensured all channels are fully consumed
new d7ea6bf Added missing file
new 440d5eb Merge branch 'master' into version02
new 2c4c346 Manually repaired some merge problems
new 4d743f0 Merge branch 'stage1'
new 8ad9f53 Merge branch 'master' into version02
new a993107 Updated from powermock dependency from 1.4.7 to 1.4.9
new a474fbe Merge branch 'master' into version02
new 4f3d134 Appled Arvid's patch to prevent deadlocks for short-running tasks
new e34a141 Improved code style
new d30aabc Added testcases for OR-Expression.
new 3d14d8b added Test for OrExpression.java
new 5103eed - Fixed #156 for now - deadlock resolving strategy should be refined in a future release
new ca2bb24 - Added and modified task names for data source and data sinks in Pact example programs
new 6959962 added new Test for ComparativeExpression
new b82bd6b Formatted OrExpressionTest, Added test for And-Expression and ElementInSetExpression, added hashCode and equals methode in ElementInSetExpression
new c07e88f Improved hash code calculation of StringRecord
new 58e53f7 Started to implement sender-side spilling
new 1593726 Temporarily removed automatic flushing of output buffers
new e7f0e3c made ComparativeExpressionTest to a parametrisized Test to include more TestCases
new e55c119 refactored record linkage
new f9502b2 Added Tests for NumberCastingExpression, added hash and equals methode in NumberCastingExpression
new 06501f4 Enhanced record linkage
new b5df52a Merge branch 'hpi'
new c2a9cba extended ComparativeExpression Test
new 7e5edac Added hash and equals methode in CoerceExpression, added testcases for CoerceExpression, added new testcase for NumberCastingExpression
new 498e2e0 added ArrayMergerTest
new c44f3da Merge branch 'master' into hpi
new b62c92d Generalized concept for ownership of file buffers
new aa4f82f Merge branch 'master' of https://stratosphere.eu/stage1
new 7a4d356 Added testcase for PathExpression
new 5cf7e44 Fixed possible capacity exceeding of file buffers
new 5a17b0d - Added FixedLengthInputFormat for efficient input of fixed length records - Added Test for FixedLengthInputFormat - Extracted FileBaseStatistics from TextInputFormat and adapted test accordingly - Updated JavaDoc of FileInputFormat
new 8edac82 Implemented equals and hashCode for TransferEnvelope class
new a3bae58 Event lists are now instantiated in a lazy fashion
new 588333a Implemented and tested intra source RL
new b0dabfb Modified transfer envelope serializer/deserializer to handle with non-existing event lists properly
new 88c05b8 Added new assignment strategy for arriving instances which works better with lazy task assignment
new bb2f254 Removed debug output from AbstractScheduler
new 95cc225 Fixed bug in computation of the initial active channel set
new e592eb8 Added new type of queue which capable of spilling
new 9a23ec0 Fixed bug in profiling which occurred together with lazy task deployment
new bd43630 Implemented and tested inter source record linkage
new 8d9f949 Merge branch 'master' of https://stratosphere.eu/hpi
new 4d178b4 Renamed sopremo relational to sopremo base
new bd43b5a Started with GovWild integration project
new f984819 Reduced sleep interval to poll for closed output channels
new a5772a4 Added testcases. Modified ObjectCreation constructor.
new ce89358 Merge branch 'master' of https://stratosphere.eu/hpi
new 1e55141 Removed superfluous import
new 48981ad Removed automatic spilling in SpillingQueue
new 1e811c8 Working on GovWild usecase
new 26dc791 Merge branch 'master' of https://stratosphere.eu/hpi
new 7b1cec0 Added execution callback when task has initially run out of execution resources
new 2afa138 Modified implementation of ExecutionGraph to fix compilation error
new b2f194c Added missing method to match new EnvironmentListener interface
new 8685e35 Implemented tracking of channel utilization
new dd1a689 Added implementation of resource utilization snapshots which capture the channel utilization at a specific point in time
new 074fd47 Govwild usecase
new cca74c4 Added testcases for ErroneousExpression and TernaryExpression, hash and equal methode added in TernaryExpression, additional testcases for BuiltinFunctions
new 8402586 Notification about initial resource exhaustion is now propagated to the JobManager
new aa34c44 - Added new InputFormats that read from stdout of external processes - Moved input and output formats into separate packages (many files affected by this) - Renamed GenericDataSource and GenericDataSink into GenericDataSourceContract and GenericDataSinkContract - Fixed bug in Compiler to handle GenericDataSourceContracts and GenericDataSinkContracts - Fixed bug in FixedLengthFileInputFormat
new fc8753a - Added FifoInputSplitAssigner which serves splits in original order (first request receives first split, and so on)
new 47af572 - Fixed bug in ExternalProcessFixedLengthInputFormatTest
new 6bea6a0 - added SkewRecordCount job
new fb914cd added simple possibility for csv input, which gets transformed to json
new 691429a More GovWild usecase
new 014042f modified csvinput, included libary for reading csv files
new 4625a6a Merge branch 'hpi'
new 3d8b3fa Changed spilling queue to report amount of reclaimed main memory
new 978ee94 Implemented support for asynchronous events in buffer management
new 0fb9454 remodified csv Inputformat to remove BOM symbol in front of the first character
new 701b3a0 deleted files used for testing csv to json parser
new 3f9e923 fix for BOM symbol in headers of csv-reader
new f212dbe added csv to json paring for gov experiment
new 04ad622 Implemented task manager's response to initial exhaustion of execution resources
new 5d58890 Modified Nephele job client to show overall job duration after job has successfully finished
new 9f622aa Introduced additional execution state to enable lazy task deployment
new 7f2a38d Corrected source code comment
new 73e4e36 Implemented lazy task deployment
new 6408c08 Removed Key from CoGroupStub, adapted last tests for runtime to new datamodel
new ea7a4f6 - Additional log statements in UnilateralSortMerger
new b68a1f6 Merge branch 'warneke/version02' into loadBalancing
new af53872 Several issues with cluster
new b87142e Fixed #192
new 6a51ed3 Finished integration of US Spending
new 9f43ae7 GovWild
new 5b98f8f Merge branch 'master' into version02
new 3730b06 Changed local buffer distribution model to prevent deadlocks
new 894ef9c Simplified buffer provider API
new 59fc904 Changed debugging statement in ByteBufferedChannelManager
new 7a4298c Improved performance of zipf-distributed random number generator
new 10d4570 Nesed Jar Files are also added to class path for assembler instantiation.
new be42fbe Merge branch 'master' of https://stratosphere.eu/stage1 into staging
new d4e71b8 Fixed bug in selfmatch task after adapting to new datamodel
new bd0b838 Fixed canceling behavior
new 9ac7a4a Increased memory for BlockResettableIterators due to higher MinBufferSize
new b88c4d5 Removed library check code to improve latency behaviour
new 66f7bac Fixed bug concerning missing close ack for in-memory channels
new 03b67fc Prepared task deployment for routing hints
new 5b5d75f Removed old debugging output
new 726b61a Added routing hints for in-memory channels to reduce latency
new bd1587e Changed Nephele job client to reflect proper execution time in milliseconds
new 3796968 Fixed bug concerning file channel implementation
new 7c61d0e Simplified naming scheme of file buffers
new 966283f Worked on Nephele fault tolerance
new 3b6ad14 Worked on Nephele's fault tolerance mechanisms
new d3dcd9d Worked on Nephele's fault tolerance features
new 5f346a9 Fixed bug in resource deallocation
new 00c19b7 Improved robustness of lookup protocol
new 22896f9 Unified deserializer with serializer interface
new 617df95 Worked on checkpointing implementation
new 27fa26b fixed serialization error, still issues in restarting
new 267fca0 fixed missing method
new f3d580d fixed checkpoint tests
new db4ec18 Worked on fault tolerance
new cf43da8 Fixed GovWild use case
new 8d6e355 Fixed test cases
new 9b1af51 Removed csv converter hack
new c367c1b Introduced new enumeration for the checkpoint state and integrated it into the management classes
new b0cbaf2 Integrated checkpoint state change event in visualization
new 6651d55 Merged new datamodel with version02
new 30abfd2 Checked in files with merge conflicts
new 1f89d7d Implemented listener mechanism for checkpoint state changes
new f3a073e added AggregateExpressionTest and FunctionCallExpressionTest ->therefore moved BuiltinFunction.java from sopremo-base to sopremo-common
new ab0d9ae Merge branch 'hpi'
new 898313c added ErroneousExpressionTest and BatchAggregationExpressionTest
new 5028152 Refactored Environment class
new 964aede Added missing files
new 5707a51 Removed superfluous class
new 04fa48b Improved thread safety of environment/invokable classes
new 7da09a9 Adapted junit test to new serialization format
new f19fddc Fixed bug in refactored state concept and adapted unit test accordingly
new 8b22919 Removed final modifier for the sake of the PACT tests
new 567a110 Merge branch 'hpi'
new bf3504c Implemented propagation of checkpoint state changes
new 86ccb3d Completed propagation of checkpoint state changes
new bf2170d Redesigned locking concept for execution graph
new aa63b55 Adapted scheduler to new locking concept and fixed bug in state model
new 011fec3 Fixed instance leak bug in case of canceled jobs
new 233ae24 Fixed possible NullPointerException in Environment
new 54730fc Improved java doc of EventCollector
new 3951013 Added unit test for ticket #198
new 27ddfd0 Minor fix to instance sharing unit test
new f4a8809 Additional modifications to instance sharing unit test
new beb9f91 new DuplicateDetection with Sopremo refacetored SopremoTest, moved some functions to JsonUtil -> reorganized Imports
new 6bef404 Merge branch 'hpi'
new df64dc3 moved Test for BuiltinFunctions
new 27405a8 fix for merge branch
new 14f6925 Fixed #194
new f2fd76a Fixed Runtime Bugs for new DataModel Runtime
new 6858c0b Created Nephele Version of Word Count with new runtime classes.
new bbcb83a implemented base nodes for json data model
new 89dc133 Worked on propagation of checkpointing decision
new af0b9ca Manual merge with warneke_v2
new 7bae93f Implemented coordinated checkpoint decision
new cb3f757 Completed propagation of checkpoint state to the visualization
new 3ac190b New Datamodel Dummy Optimizer
new d9ef095 Sorter with normalized keys, part 1
new 7e23536 Fixed minor formatting flaw in stratosphere-dist xml file
new 9c05463 Merge branch 'stage1' into version02
new 610082d reverted broken merge
new 1e6f8f3 merged with daniel
new 16feb03 fixed some errors caused by merging
new effaff4 Fixed unit test after merge with stage1
new 743d358 Implemented method to remotely kill task managers
new 5c0719e Fixed PACT unit test
new f0413e3 Moved JVM shutdown to timer thread and improved logging
new 24cace0 Added new Nodetypes
new 8b4fa3e serialization methodes implemented for all node types
new 35e2349 added teststubs
new d937f4b added Tests for some JsonNode types + generic JsonNode tests
new 28a67d8 added testcases for serialize methodes, added canonicalize methode
new 7b83590 Merge branch 'michael'
new 0f4e6d8 Parsed first small jaql scripts
new fc59b12 Added example scripts
new a8fad47 Adopted optimizer test classes to new datamodel.
new cda3f37 Manual forward of waneke v2 into datamodel.
new c3a601e Merge branch 'warneke_v2' into datamodel_merge
new 6c44729 initial refactoring for replacing jackson lib
new f621308 continued refactoring
new faf8cbb more refactoring...
new 21bc2bf more refactoring
new 0b113ff Merge branch 'datamodel' into normalkey_sort
new b5e57b2 refactoring...
new 0b62293 more refactoring
new c8acac6 more refactoring
new f25a4dc Unified Mutable Object Iterators First Part of Normalized Key Sorter
new 8675ef4 Refactored sopremo; enhanced simple jaql parser
new ada6af6 Small serialization improvment for PactRecord.
new 0247220 Added code for comparison of records in binary buffers.
new 33d4b3e Fix in BufferSortableGuaranteed and more modular tests for it.
new d16a372 Normalized-Key-Sorter sort finished and test added.
new 01328cc still problems in recovery
new e8d41ed Continued refactoring
new b9d5075 More refactoring
new 3299b40 coercer refactoring
new 69e1d78 more coerce refactoring
new 2435b11 for now last coerce refactoring
new a069d07 added additional getters in numeric node
new 54f528b Merge branch 'michael'
new ef10e09 fixed ec2 floating instance request bug
new f1db126 before testing, final numeric node refactoring finished
new 0ff4969 New Datamodel API adoptions for compilation.
new 10eca13 Refactoring...
new 3c76bfb ObjectMapper implemented
new 54e33fd stubs for JsonParser and JsonGenerator added
new a557d0d Finished refactoring
new 58dfc6a Replaced Output with JsonStream in inputs and outputs of an Operator
new 2eaf119 started implementation of JsonParser
new 2b89806 Added Stratosphere Header to PlanConfiguration
new a534bf0 Added correct usage of plan-wide default parallelism.
new 8568950 Temporarily removed non-compiling classes from testing package.
new e5bec6e Fixed User Type serialization bug.
new aaa7b81 Improved normalized key logic.
new 593bb45 Improved WordCount to operate completely on mutable objects only.
new 3914e68 Added normalized key generation to PactString.
new e868a9e Bug fix in PactString constructors and minor adaptions in Normlized Key based sorter.
new 6dc64d0 Disabled Checkpointing by default.
new bc972d3 added primitive paser into jsonparser
new 0485447 Removed Test for no longer preset ProbeSideIterator
new eda2d7d Slight adaption of PactString Modified TestData to use new PactString
new 0c5c6ee Made PactLong a normalizable key.
new 91485e1 parser now parses arrays and primitives
new 776b9ee refactored parser with handler
new b8ea9c4 Fixed Bug that looses Memory Buffer in HashJoin.
new 88a670a Bug Fix in NormalizedKeySorter.
new e327c28 In-memory sort operational with normal-key-sort.
new 2211646 finished parser, but not working for all cases
new 8ed101f Cleaned up sort-merger test.
new 7eb3e85 first working version of jsonparser. checkEnd does not work yet
new e790119 Enhanced simple
new 3d9e40e Added file-backed DataInputView and DataOutputView.
new 6de9761 First version of sort-merger cannel fixes.
new 45ec125 Added MathUtility function
new 749ed98 Finished UnilateralSortMerger to work block block-channel backed views to allow arbitraily sized records.
new ede3e72 Fixed in CombiningUnilateralSortMerger and UnilateralSortMerger.
new b937843 Added Nephele Version of WordCount
new 3986243 Minor cleanup.
new 3cb9ad3 Merge branch 'datamodel' into staging_datamodel
new 27fce64 removed PactJson
new c8d666b fixed some problems
new 8ecf7d4 fixed JsonInputFormat Testcase
new be0fa78 Unified dynamic method and ctor resolution
new ddd2e49 introduced JsonNodeWrapper for serialization
new f3173e8 submitAndWait (JobClient) now returns the job duration in milliseconds
new d7f8281 configurable multicast
new 9a2df7f Enhanced parser
new afdaeb8 Fixed zombie tasks in test plans when exceptions are thrown
new 8727f88 Merge branch 'master' of https://stratosphere.eu/stage1
new 40076bb commit
new 3ce54d4 solved deserialization problem. still some error in recovery.
new 9c7d081 finished refactoring for package sopremo-base and sopremo-common
new acfa5db Worked on broadcast example job
new 8cdc05a Merge branch 'version02' of https://stratosphere.eu/warneke into version02
new 082f89a finished refactoring for sopremo-cleansing, ignored InterSourceRecordLinkageTest>>shouldAddSingleClusters and IntraSourceRecordLinkageTest>>shouldAddSingleClusters
new 9b08d70 Fixed broadcast evaluation job
new 0c4e37b Merge branch 'casp_version02' into version02
new 5874164 Added java code generator for sopremo trees that have been parsed with SimpleParser (should ease test development)
new 2976be5 Fixed bug in checkpoint (de)serializer
new 147574c Temporarily disabled checkpoints
new 440fce0 Merge branch 'master' of https://stratosphere.eu/hpi
new d9b6c13 Temporarily removed testing package classes.
new 286c92d Changed IOManager to use multiple directories for the reading thread.
new 927699e Added prefetching for the first blocks in ChannelReaderInputView as used by UnilateralSortMerger.
new babe6b5 Fixed Bug in PactRecord.
new ab2dd07 Added code to correctly carry key positions and types forward to the runtime for MATCH.
new f629365 Fixed calculation of throughput and added output for job duration
new 3dfc560 Fixed ObjectNode.compareTo and RL test cases
new cfc9579 Removed deprecated optimization interface and introduced advanced plugin architecture
new dcd9d29 Implemented parser for plugin configuration
new cf35afa Added hooks for plugins in the job manager
new b703fe3 Added hooks for task manager plugins
new 35eba7b Removed superfluous import
new bb6aad0 Added sample plugin implementation for SCORE
new aa717fa Merge branch 'marrus' into version02
new b508545 Merge branch 'master' of https://stratosphere.eu/stage1
new 9490b71 Resolved merge conflicts
new 121fe0f Fixed some merge problems
new 7101911 Merge with stage1
new 05a908c Refactored test cases
new f93f058 Removed JsonNodeComparator
new 3124a84 Merge branch 'master' into stage1
new 06a23be Enabled checkpoints by default
new ef6105e Wrote integration test to check Nephele's fault tolerance mechanisms
new d49db9c starting recovery for failed tasks
new a7a85e6 changes TaskManager methods to IORadWritable parameters
new 7ebff77 removed unregistration of failed task and some debug-output
new 8dd6660 Revert "changes TaskManager methods to IORadWritable parameters"
new 9c62039 started implementation of an alternative parallel transitive closure
new 6e23433 Added auto-boxing support for java functions
new 30e6756 Merge branch 'version02' of https://stratosphere.eu/warneke into version02
new e321d78 Merge branch 'warneke_v2' into pact v2 branch
new 3f85151 fixed issues in recovery
new 3d6fa95 Added Trinagle Enumeration Program for IBM dataset.
new fd9a589 Fixed problem with mutable records in input channels
new 5b61ab6 Removed redundant version of nephele wordcount version
new 31fe060 Fixed Wordcount IT Case
new d4cf5fb Merge branch 'warneke_v2' into datamodel
new ba907dc Refactored resources for transitive closure, added methode to add nodes to specific positions into ArrayNodes
new 1665554 Fixed comments and combiner in wordcount example.
new 8ba0b90 Merge branch 'datamodel' into staging_datamodel
new 71df266 Merge branch 'version02' into checkpointing
new 3208230 Input channels now ignore envelopes which are sent more than once
new e7b9152 Added more thorough test for primitive DataTypes (Fixed #205)
new 31a5e60 Merge branch 'datamodel' of https://stratosphere.eu/sewen into datamodel
new c115479 changed restarts to predecessors without checkpoints. changed recovery to one call of checkpoint replay per instance.
new fa95c3d fixed taskmanager mock
new 2b7e30c Increased robustness of envelope routing in presence of execution failures
new c08b74f Replay task now ignores partial checkpoint files which are still written at the same time
new cf9b370 Fixed bug in sequence number check
new 6e15331 Fixed bug with sign-bit in NormalizableKey for PactLong and PactInteger
new a11e233 Merge branch 'staging_datamodel' of https://stratosphere.eu/stage1 into datamodel
new 58af4e1 Increased logging interval for latency measurement
new 661f93c Fixed #210
new 0a4a043 added User CPU to Utilization snapshot an checkpoint decision
new 3e68c63 Merge branch 'stage1' into version02
new 74939e9 Added two more integration tests for the fault tolerance features
new c1bb8d7 Added another integration test to check Nephele's fault tolerance capabilities
new f6bd131 Merge branch 'version02' into checkpointing
new 1248062 Implemented support for Hadoop-style elasticity in ClusterManager
new d753f4f Improved javadoc and code style of ClusterManager
new fccd0e1 Added unit test for new pending requests data structure
new cccacdd Merge branch 'version02' into checkpointing
new 70fae17 Merge branch 'checkpointing' of https://www.stratosphere.eu/warneke into checkpointing
new f55a488 changed recovery to recover from completed checkpoints
new 068bdf4 Merge branch 'warneke_v2' into datamodel
new 37aebf2 Merge branch 'master' of https://stratosphere.eu/stage1
new 4d7b977 commit due to branch switch
new f822ffa fixed and refactored some queue related tests
new eba6516 fixed recovery for successively failing tasks
new f5d9b35 further implementation of parallel transitiv closure computing, bug: Projection dont uses specified key/value transformations
new 1800afe Fixes to PactRecord and SortMergeMatchIteratorITCase
new 4ce2e43 Merge branch 'staging_datamodel' of https://stratosphere.eu/stage1 into new_datamodel
new 3966ab1 check-in due to branch switch
new d58c2ae Adapted ITCases for contracts to new datamodel
new 6480ebe Fix CombiningUnilateralSortMerger (for ReduceExternalITCase)
new afaa9a4 Deactive sorting tests for data sink
new da1a116 branch switch
new b768a4d - Finished RecordOutputFormat - MovedBinaryIntInputFormat - Minor Cleanup in other formats
new 37fda17 Added Method STubs to PactRecord
new eaa8863 Added substring methods to PactString
new 76a96e4 Added Pigmix queries and ported L2 query.
new bd8ce16 Merge branch 'datamodel' into staging_datamodel
new 9d0d7bc branch switch
new 31dfe40 included Daniel Warnekes UnionRecordReader
new b599bbf Removed OutputCollector test
new a8175c0 Converted input formats for tpch tests
new 14b8537 Converted tpch1 program (currently not run in tests, so not tested)
new 2aa88e6 Adapted IntTupleDataInFormatTest to the new api
new 5d24bf1 Fixed WebLogAnalysis example to work with the new datamodel
new 5887df7 Merge branch 'datamodel' into triangles
new d90ff31 Converted graph examples
new 5434df8 Converted TPCHQuery4
new e980cab Converted TPCH Query4
new 5748b6f Merge branch 'staging_datamodel' of https://stratosphere.eu/stage1 into new_datamodel
new c2ed8eb Merge branch 'datamodel' of https://stratosphere.eu/ringwald into new_datamodel
new 28e04e2 Merge branch 'new_datamodel' of https://stratosphere.eu/cbruecke into new_datamodel
new 6ffabda Adapted TaskFailureITCase to new datamodel
new 7f1e4d0 Added corrent toString and JSON output for Data Sinks.
new 2fe5d91 implemented Phase1 of parallel transitive closure
new 6e26eeb Fixed incorrectly passes key positions.
new fd838de Fixed bug related to push-based transfer model
new a248471 Fixed deserialization bug in PactRecord accessors.
new c18f634 Fixed bug in PactRecord serialization.
new de79237 Reworked Triangle Enumeration.
new bdd688e Fixed EnumTriangles example, works now with local test case
new 9f507d8 Converted TeraSort to new API -- ATTENTION: Will probably not work, not tested!
new 09fd9b3 Removed unused and deprecated file formats
new d84f71e Finnished porting TPCHQUery3 and replaced the deprecated class by the new one -- untested
new 6da5290 Merge branch 'new_datamodel' of ../repo into datamodel
new f39c3d0 Adapted TPCH9+10+Asterix to new datamodel. Everything is compiling, but not yet tested
new 371296c Merge branch 'staging_datamodel' of https://stratosphere.eu/stage1 into datamodel
new e3f45c2 Switched order of parameters in ReduceContract
new 85fcf61 Fixed inputformat
new 5f40ee9 fixed recovery for a repeatedly failing vertex
new fd00762 Merge remote branch 'remotes/cbruecke/new_datamodel' into release0-2
new 4151df2 Fused cleanse rules with expressions
new c1518d9 Fixed some tests and some bugs after adapting to new datamodel
new 600a023 Merge branch 'new_datamodel' of https://stratosphere.eu/cbruecke into datamodel
new eb70474 Fixed bug in Outputformat for WebLogAnalysis
new d7b0efc Fix: Invalid records appear in SortMergeMatchIterator
new 1e9eb92 Fixed Outputformat for KMeans
new 157161c Enhanced parser for cleansing tasks
new a05419e Fixed string parsing error
new 8492b29 Ignored cleanse tests for the time being
new 74e1aad implemented removing of checkpoints
new 7453b49 Merge branch 'michael'
new 079b3d6 Fixes in fault tolerance test
new f8c987d UnitTest for UnionRecordReader (bug #212)
new 7e9135b fixed computation of phase1, changed BinarySparseMatrix to a subclass of JsonNode
new 55758dd Fixed test cases and Boolean/NullNode deserialization
new 4414bb3 branch switch
new 36bc651 Added the concept of execution pipelines to simplify scheduling
new 1b3f9b7 Implemented construction of execution pipelines
new c2713ae Implemented pipeline based deployment
new e28da64 Class ExecutionVertex is now thread-safe.
new 3aad78e Concurrency fixes for ExecutionVertex class
new 99b26b0 Class ExecutionGroupVertex is now thread-safe
new 7277d07 Class ExecutionStage is now thread-safe
new 1c80b69 Class ExecutionPipeline is now thread-safe
new b6d14c9 Class ExecutionGroupEdge is now thread-safe
new ab938e6 Class ExecutionGraph is now thread-safe
new 3ebd051 JobConfiguration is now a final property of ExecutionGraph
new fd7087a Switched back to more fine-grained locking in JobManager
new cd38548 Switched schedulers back to more fine-grained locking scheme
new d40e337 Removed coarse-grained locking from CheckpointDecisionCoordinator
new 2becebd Switched abstract scheduler to more fine-grained locking model
new ec751da Minor fix
new 977c974 Switched to more fine-grained locking model in class AbstractionExecutionListener
new 90ada70 commit to push
new 0a0fc17 added basic networkchannel test
new c7a4aba added Phase 2 of parallel Warshall and replaced mapstubs with SopremoMaps
new f14254a Fixed bug in ExecutionGroupVertex
new 91a9c35 branch switch
new 1ce7d22 finished Phase2 (testcase is missing)
new 046d17e Moved allocatedResourcesDied into AbstractScheduler
new 04de702 implemented annotaions for tasks
new cb3b50f Improved performance of execution graph compilation
new d65a81b Removed some debug output
new d6a42db Removed debug output in ExecutionGroupVertex
new d2d3a4e Prepared tracking of assigned vertices in class AllocatedResource
new 25b1032 union integration phase finished
new 24a4ae2 bug fix for eu.stratosphere.pact.test.pactPrograms.EnumTrianglesITCase
new 06e8bba Parses all cleansing scripts now
new 20afeef clean up
new db0bc68 More precise exception message during deserialization error.
new 7bf9c84 Fixed Exception Forwarding in AsynchronousPartialSorter
new f75f607 Temporarily disabled test for failing tasks.
new 36994e3 Fixed TPCH Query 3 and Test case.
new af6006f bug fix
new 7721800 Fixed read val len logic in PactRecord for values > 0x7f
new 69ee4d7 Fixed KMeans example
new a61c668 Fixed TPCHQuery 10
new 92a10ef Commented out GlobalSortingITCase as long as it is not supported
new 42c8186 Reverted graph examples to previous version
new 94e4f38 Merge branch 'datamodel' of https://stratosphere.eu/ringwald into datamodel
new 74751be Commented out WordCountNephele due to problems with dependencies
new 6d73037 QueueSchduler tests now work without mocking
new d58a931 Improved JavaDoc
new 0efb814 Merge branch 'version02' into stage1_version02
new e50e6b8 Fixed #204
new e305570 Merge branch 'master' into version02_wo_dm
new fbddde3 Fixed spurious error message for state transition from CREATED to ASSIGNED
new fe5d171 Merge branch 'version02_wo_dm' into version02
new 0eebf25 Fixed Pact Web Servlet to produce plan description output, even when no plan preview can be created.
new a467e56 branch switch
new f183140 Implemented first version of chaining for combiner and mapper.
new 9755247 fixed too early closevent for large records
new 1f10dff changed restarting. added new test with annotations
new f2148f2 Added configurable number of input splits to FileInputFormat
new ed22033 Added logging for multicast experiments
new 2d2a66c Added hostname of remote receiver to log output
new fb67780 Changed compiler and parameters to enable handling of default degree of parallelism.
new 90464c0 Temporarily reduced verbosity of System.out logging
new dfcd91b Added parameters to conif for ease of adoption.
new 4eb1ce4 Introduced config variable to control merging of spilled buffers
new 27bee4a Explored nonsymmetric matrix
new b883ab4 phase 2 of parallel transitive closure now working, some testcases missing
new 1787b8a Added rule rewriter for cleansing expression
new 7441a9a Added comments to PactString. Added startsWith() methods to PactString.
new 9e159f7 Fixed PactCompiler to re-enable plan preview.
new 7b37583 Merge branch 'multicast' of https://stratosphere.eu/warneke into multicast
new f79c4eb Removed unused legacy class.
new fd17243 Fixed data race problem in FileInputFormat.
new 1b8c57a Changed NepheleMinicluster to work localhost loopback interface. That way, the tests work also if the system as no external IP Adress assigned.
new 4330fb2 Fixed typo and inconsistent naming in TaskConfig.
new 7cce6b7 Fixed bug in AsynchronousPartialSorterCollector that causes undesired spawning of a reading thread.
new 078a6b4 Fixed bugs in ChainedCombineTask.
new 0d3bed3 Enabled general chaining logic in AbstractPactTask. Chaining now works for - any Mapper - any combiner that is attached to its predecessor via a forward connection and has the same degree of parallelism.
new cd9a85e Improved some error messages in teh case of null key fields.
new 8ea11c1 Slight improvement of Wordcount Code style.
new f808702 Added fix in pact compiler to fall back to a default parallelism when nothing else is specified.
new f454522 Bugfixing in ported Pact Programs
new cfd8890 Fixing expression rewriter
new 03a4b9b Fixed Scrubbing and some test cases
new ac04ce6 Merge branch 'master' of https://stratosphere.eu/stage1 into union2
new 924498f cleanup
new 6e9d765 Merge branch 'master' of https://stratosphere.eu/stage1
new 5cc7da5 fixed .setCosts() in Single- and TwoInputNode
new b3538ae started phase3, nothing done yet
new a6798a0 branch switch
new 0570cfd Improved robustness of spilling queue implementation
new 4825b10 Merge branch 'version02_wo_dm' into multicast
new c0338bc multicast topology-awareness + output for visualization
new 4ecfeaf Extended debugging output in ByteBufferedChannelManager
new 5be8825 Merge branch 'casp_multicast' into multicast
new 9acd0a3 added new methods for backwards compatibility and convenience
new 8214eb7 fixed properties propagation: instead of using a property blindly in the union case, it is dropped TODO: figure out when properties can be keept in the union case
new 1a7bbd8 SpillingQueue implementation is now thread-safe
new 81326ba Added methods to register and unregister spilling queues with a network connection
new b83fe8c Switched to TransferEnvelopeQueue for network queue management
new 7231d2a Changed close mechanism of output gate to improve performance of lazy deployment
new e391da3 Changed implementation of LocalBufferPool not to response to asyncronous events for non-blocking operations
new e2bff18 Moved connection check in class OutgoingConnection to separate method
new c3eae10 Implemented method to copy file buffers in spilling queue back to main memory
new d33b025 Implemented asynchronous transfer of file buffers back to main memory in spilling queues
new 80cd919 Added size limitations for spilling queue elements and fixed bug related to file -> memory transfer
new 20f96fa Improved thread-safety of spilling queue
new eabd74b Removed superfluous methods to unregister spiling queues
new e39efae Minor performance improvement for transfer envelope queue
new 7b97ad4 Merge branch 'version02_wo_dm' into version02
new 047cd16 Merge branch 'stratosphere' into union
new 4932dac Added new unit test for ticket #212
new 0ddd201 Fixed #212
new 70816f5 Re-enabled integration test
new b7df03f Merge branch 'union' of https://stratosphere.eu/warneke into union2 Daniel's fix for UnionRecordReader
new d89f1ec Added byte-counting for ByteBufferedInputChannel
new 266a63e Switched back to old structure of OutputChannelContext
new 3648627 Implemented debugging function for spilling state of queues
new 64e2e9b Temporary fix to transfer end of queues to hard disk
new abf0f98 Merge branch 'version02_wo_dm' into version02
new 3e50642 branch clean up
new 5c735d9 Refined locking granularity and improved memory consumption of spilling queue
new 98801f6 Merge branch 'version02_wo_dm' into version02
new 7363193 Integrated task annotation from Mareike's branch
new d88e224 Added convenience class to check a set of task class properties
new 385614d Minor correction to previous commit
new 87f0551 Fixed errors in ported PACT examples
new 3af6a31 Fixed bug in KMeans concerning object reusage
new 31e83d7 Extracted SJaql tests
new 0e42f57 Merge branch 'score' into streaming
new 67d1511 Introduced Nephele streaming plugin
new 39a0943 Added JobManager and TaskManager components of streaming plugin
new 8d485ba Added taggable record type
new 9defcef Extended plugin interfaces
new fc67fa6 Implemented streaming input and output listeners
new 06e16c1 added javanature and builder to streaming project
new 04bb4d7 Fixing Simple test cases
new 26ebd70 Started to implement communication infrastructure for Nephele plugins
new d7a45a0 Finished implementation of the job manager part of the plugin communication infrastructure
new 9167028 Implemented thread to asynchronously handle communication between the streaming plugin's components
new a734ce6 Improved javadoc
new 4eba42f Merge remote-tracking branch 'remotes/origin/streaming' into streaming
new a8934f8 Implemented streaming tag and integrated it
new a2651e0 Moved instantiation of plugins to early point during the job manager instantion to prevent problems in local mode
new 277ce38 Revised multi output functions to operator
new 2485e7d Improved javadoc
new 1147122 Implemented propagation of path latency information from task manager to job manager
new ba452fb Extended abstract instance to support plugin communication
new a169e82 Finished implementation of plugin communication from job manager to task maangers
new 15b8a0c some extensions to the nephele management api (untested)
new 42adabe first sketch of the latency graph structures (untested)
new 4556b9c Merge remote-tracking branch 'remotes/origin/streaming' into streaming
new f45bdbe Refactored environment class to support encapsulation of tasks by monitor tasks
new 927790d added .project that define a java-nature for the projects
new 22f54d3 Refactored input/output gates
new a525864 Changed calculation of path latencies
new ba08b5e Merge branch 'streaming' of https://stratosphere.eu/warneke into streaming
new 20715f4 Merge remote-tracking branch 'warneke/streaming' into streaming
new 641587c Merge branch 'streaming' into streaming_test
new b105def Finished refactoring of input and output gates
new d85b8f0 integration between latency model and jobmanager plugin (untested)
new bcdd97d * fixed some bugs (endless recursion in latency path construction, some NPEs) * added some toString() functions
new 49d2f9c simplifications to management graph structures due to multigraph-DAG problem (management graph and streaming plugin cannot deal with multigraph-DAGs currently)
new cc4ef25 latency values from task managers are now written into latency model
new 8812d00 Refactored input and output gates to support plugins
new d0b38e4 Added computation of task latency and propagation thereof to the job manager
new 7a2cae9 Fixed several POM file-related warnings reported by the eclipse maven plugin
new 0d50ae2 Added default wrapper for input and output gates
new 70e705c Added default implementation for environment wrapper
new 3a2aaf1 Removed deprecated methods from input and output gate listener interfaces
new 9e3c103 Improved javadoc
new 8b96769 Cleaned up ChannelSelector interface
new 4dfcb18 Both task and job configuration are now accessible at the task managers at runtime
new 53a61c2 Added new wrapper classes for Nephele streaming plugin
new c42372b Worked on streaming plugin
new 54412a4 Merge branch 'streaming_test' into streaming
new 5017885 Fixed problem with inconsistent view on input/output gates
new 341b8a2 Removed superfluous import
new 336b334 Finished rewrite of JobGraph by Nephele streaming plugin
new baa563e Worked on task manager implementation of Nephele streaming plugin
new 11a76db Finished implementation of channel throughput measurements
new dd76c68 Made optimizer able to handle subclass contracts.
new 1a6e5d7 Fixed stream listener implementation
new e95dfcb Simplified stream listener logic
new a50ab1b Phase 3 implemented but not tested yet, fixed Tests with old BSM
new 4963076 Added graph utility class for DAG rewriting
new 4c79e7a Fixed Instance Profiler to exclude local host interface.
new ab9c50a Fixed #218
new f48beeb Merge branch 'master' into streaming
new d67ea53 Merge branch 'master' into version02_wo_dm
new cee1edb Merge branch 'stratosphere'
new 674ee8b Reset file permissions
new 254de1b Merge nephel2 v2 changes with pact changes.
new f20ce37 Combiner thread in chained combiner registers at profiling component.
new 9098c56 merge with warneke/streaming
new e790e48 refactored ManagementEdge identification scheme
new 2693043 addendum to last commit
new 0ab7e9b Implemented mapping from receiver vertex to source channel IDs
new 67b3c6a added value statistics (median, min, max, avg) to stream profiling data model
new a996083 added processing of task latency back in
new 1317341 Implemented method to adjust channel buffer size limits from job manager
new 0a7a2aa Refactored actions the Nephele streaming plugin can take to achieve latency and throughput goals
new bbf35d6 Fixed deserialization problems with the plugin ID
new 8b2accd Implemented queue for pending actions inside the task manager component of the Nephele streaming plugin
new 50892e3 Fixed serialization problem with the buffer size limit action
new d5c490c Finished implementation to adapt buffer limits during runtime
new be7938b Fixed Late Memory Release in chained Combiner.
new 5691781 Bug fix in Sort Input data Collector
new cce6834 Implemented callback to calculate the latency introduced by the output buffers
new fcad7e0 Introduced new type for output buffer latency
new affd2e1 Implemented propagation of buffer latencies to job manager component of the Nephele streaming plugin
new 7b08f7f * refactored most of the LatencyXYZ to ProfilingXYZ classes * implemented logging of profiling values * profiling paths (formerly known as LatencyPaths) can now start and end at edges
new 7b1bc20 renamed streaming.latency package to streaming.profiling
new 74de0c3 * log entries now contain proper edge numbering * log entries now contain timestamp
new a5553c0 Implemented belief resolution and other fusion features
new b2b82b6 Merge branch 'streaming_bjoern' into streaming
new 7e45834 Removed .project files from repository
new 45d5302 Merge branch 'streaming' of https://www.stratosphere.eu/warneke into streaming
new ba39af7 fixed RuntimeException due to bug that caused violation of Comparable vs equals contract
new 29fc6b6 Merge branch 'streaming_bjoern' into streaming
new d331ff7 Merge branch 'streaming' of https://www.stratosphere.eu/warneke into streaming
new 010a038 Added log message in task manager component of Nephele streaming plugin
new 6e372f8 Added Nephele streaming plugin to distribution
new ae9914b * fix for edge id lookup problem * workarounds to deal with broken profiling data (identical source and channel ids, NaNs)
new ba7d6fe Implemented custom read logic in StreamingInputGate
new 682f338 Merge branch 'streaming_bjoern' into streaming
new ace61a5 Redesigned implementation to calculate buffer latencies
new 9701a49 Added entity extraction parsing
new d9f472d Fixed bug in custom streaming read logic
new c6daabd included output buffer latency in profiling data
new f8c28b8 Decreased NIO sleep time from 500 to 50 ms
new 9a0ffc4 Introduced mapper class to facilitate dynamic task chaining
new 47dc219 Introduced API to construct stream chains
new 5d99889 Added latex slide generator
new 9890b1b Removed check that executionResourcesExhausted call must be from environment thread to enable chained tasks. Check is overly restrictive, since the only condition is that the output gate is always accessed by the same thread.
new 8a55215 Finished implementation of stream chaining
new b17995d Temporarily disabled thread-safety check
new f5527cf Integrated statistics collection in stream chaining
new f5ca670 Added code to trigger chaining event
new 7fca447 implemented and tested first sketch of buffer size optimization
new 21752ac Merge branch 'streaming_bjoern' into streaming
new 3aeafb5 fix for excess buffer size increase bug
new c81b9c5 Merge branch 'streaming_bjoern' into streaming
new 07eb8a3 Reduced NIO timed waiting interval to 10 ms
new cbf9d56 Added custom equals to rules
new f078fa3 Extended job manager plugin interface to expose possible profiling dependency
new 3079401 JobManager now considers profiling dependencies of plugins
new 99d9948 Plugins can now return custom profiling listeners
new e8a9c9c Fixed extraction tests
new 11bac4d fixed issue in phase 2, mirrored matrix computed by warshall was nor emitted correctly
new 011c21e Extended SelfMatchTask with triangle crosses and added testcases for these
new ce82bd4 Added lost commit 5103eedb36483f14eb72b40615eeb0b8eeb1044e again: "Fixed #156 for now"
new 5fa1549 added lost commit ca2bb244e477bbc03253de6292ec04f0f989fc7d again: "Added and modified task names for data source and data sinks in Pact example programs"
new c8339a2 - added additional tests for empty inputs of CrossTask - cleaned up inline comments of CrossTask
new 2b49176 - added input format to start and read from external processes - added unit tests for external process input formats - fixed comment in FixedLengthInputFormat
new 36725fd Merge branch 'myV02'
new a197363 Made HashJoinTest an integration testcase
new b6846af Renamed class as well...
new ae24d24 removed System.out.println statements from unit tests.
new b272261 Records are now copied among different mappers
new c64a125 - Added unit test for FixedLengthInputFormat - Fixed bugs in FixedLengthInputFormat
new f1a05b8 extracted decision method
new 0c9fbb9 - fixed java doc in FileInputFormat.java
new 7282e13 removed Amazon EC2 parameters from TPCHQuery3 example program
new 9958569 Merge branch 'master' into version02_wo_dm
new 38ad0ec Merge branch 'union' into version02_wo_dm
new 44793e1 Minor modifications to the union record reader and related classes
new b9ee037 Added mutable union record reader implementation
new 439bd6c Removed final modifier again to fix problem with PowerMock tests Removed final modifier again to fix problem with PowerMock tests
new 51ecc2e Merge branch 'version02_wo_dm' into version02
new 3775fdc Merge branch 'stage1_version02' into version02
new 22e0284 - added FixedLengthInputFormat and Test - extracted FileBaseStatistic inline class from TextInputFormat
new 6b9a3c3 sequel to previous commit...
new f1525ec multicast fix + support for penalties
new 20274e2 Fixed #196
new 73fac1a Fixed problems with event inlinening
new 8f4835d Merge branch 'master' into stage1
new 641e4509 Fixed #222 error with running indices
new 594c6ff55 - added patch to fix #222
new f252788 Merge branch 'stratosphere' into version02_wo_dm
new f714df6 Merge branch 'version02_wo_dm' into version02
new 1b340f8 Merge branch 'stage1_version02' into version02
new fbe5550 Fixed testCheckExitCode to work on MacOS too
new 5884f00 Merge branch 'bugfix'
new 43abbc4 Reworked output estimates for new data model
new 1728939 Merge branch 'version02' of https://stratosphere.eu/git/stage1 into unionNewDM
new 0bf4a3e merge stage1/version2
new 686350c Merge branch 'version02_wo_dm' into checkpointing
new 42c13bd First steps towards implementation of scripted job failure patterns
new 9f4543e compilation error fix. added missing file.
new 276cd61 Revert "compilation error fix. added missing file."
new 4e0e1f1 compilation error fix: added missing file bug fix (error after merging)
new 2f2d7fb bug fix for union case
new d1b1d76 Merge branch 'version02' of https://stratosphere.eu/git/stage1 into unionNewDM
new 9fae000 Worked on job failure pattern manager
new 0b31e3b new aproach for fixing Phase3, therfore more preprocessing steps -> empty blocks are filled-up with empty BinarySparseMatrix
new b066245 Changed version number in pom files from 0.1.1 to 0.1.2
new 6be5691 added profile for nightly builds
new 6decf7e Merge branch 'version02'
new e20fbdf changed pom
new dea556c fixed column bug in phase 2 added selection in phase 3 and after computation union added method to transpose BinarySparseMatrix
new 5f56a78 3 BSP-Warshall should work now -> Phase 3 is working now
new 41c50cc9 - stub configuration enriched with parallel task count and id, and task name
new 451f66b Merge branch 'version02'
new fc093c0 - minor fix of exception string
new 9c30667 - added RecordInputFormat + UnitTest - added FieldParser interface - added DecimalTextIntParser + UnitTest
new 973c627 - added DecimalTextDoubleParser + UnitTest - added negative values to DecimalTextIntParser
new 88cc551 - added DecimalTextLongParser + UnitTest
new ccbdf44 - added Fixed and Variable Length String Parsers + UnitTests
new 772075f - adapted StringFieldParser Unittests
new b98a7c0 Merge branch 'tupleInputFormat'
new 8c752f9 - added check for too short input in RecordInputFormat and adapted unittest
new 3b22e55 refactored transitiveClosure.java -> source preprocessing and emitting out
new 302fb44 Added missing classes to wordcount jar
new 896111e Worked on GUI extension to simulate execution failures
new 2497c7c Merge branch 'stage1_version02' into streaming
new ebb085b Reintegrated union code
new e4f65f0 Added stacktrace to the errorlog
new fa435f4 First compilable version of the old pact-compiler ported to the new data model
new b3b677c Implemented a combo box with auto-completion features in SWT
new 3b5be46 Fixed problem with auto-completion combo box
new b5a0004 Added possibility to add key listener to combo box with auto-completion
new 0d01c46 Implemented dialog to create new failure pattern
new 1caca31 Ported testing framework to new data model
new 58d6a67 Removed merge files
new b226ff3 Excluded sopremo from build
new ad9a593 Worked on failure patten manager
new 9225e9e Fixed #233
new 5ca860d Fixed logging problem in visualization component
new 9d1f798 - updated to new StubAnnotations (former OutputContracts) - adapted some example queries (more work needed here)
new 7af23c0 - changed method name in StubAnnotationConfigurable
new c31caab - fixed #230
new 61ac3d0 - fixed #230
new f10cba2 Fixed #200 und #201
new ce2191d Fixed #200 und #201 for version 0.2
new 1383229 Merge branch 'version02' of https://stratosphere.eu/git/stage1 into version02
new b4a2837 - ported fix for #197 from version 0.2 code base to 0.1.1
new 790f416 Fix #200 & #201 (followup)
new 1ccbb9f Merge branch 'master' of https://stratosphere.eu/git/stage1 into staging
new a248099 Merge branch 'master' into staging
new 0d33251 Merge branch 'version02' into annotations
new be306c6 inserted partitioning for transitiveClosure and bug fixing
new d762d97 fixed test failure
new b8a06ea Merge branch 'version02' of https://stratosphere.eu/git/stage1
new dd4f8f9 Started to implement failure event editor
new d72382b - extended OptimizerNodes to hold new StubAnnotations - PactCompiler reads StubAnnotations and adds them to OptimizerNodes
new 54045f9 Merge branch 'bugfix' of https://stratosphere.eu/git/cbruecke into bugfix_v02
new 0b24ebb Finished implementation of failure event editor
new 8012a61 Implemented sorting for failure event table
new 8df9557 Refactored failure patterns editor
new f8b7014 Improved robustness of failure manager
new d2a671f Implemented keyboard control
new 94dfd46 - inverted StubAnnotation UpdateSet to ConstantSet
new 5b12417 - updated JavaDocs of StubAnnotation
new 52b0c9e Merge branch 'version02' of https://stratosphere.eu/git/stage1
new 85bc64b Restored original pact files that where modified during merge
new 788cf15 - added OutputSchemaProvider interface for input formats to specify the schema of records they produce - implemented OutputSchemaProvider interface for RecordInputFormat and extended unit test - extended PactOptimizer to derive output schema for optimizer nodes
new dc02e89 Merge branch 'version02' into annotations
new 51d6611 Added first Set of PactRecord Tests (written by Christoph Bruecke) Minor cleanup and fix in Pact Record.
new 817dc42 Merge branch 'version02' of https://stratosphere.eu/git/stage1 into version02
new b8ba478 - added getOutputSchema method to OptimizerNode - added keysets to SingleInputNode and TwoInputNode
new bab2df1 Refactored failure event table
new 70afa38 Updated year in about dialog
new 82a5b64 Merge branch 'stage1'
new 5d454e4 Added icons to failure event table
new 29e2e7a Finished I/O operations of failure patterns manager
new 23c7329 Minor corrections and bug fixes
new c9aee78 Implemented name suggestions
new f3ff1f8 Implemented scheduling of failure events
new bbc9e84 Merge branch 'master' into version02
new 0ca4fc6 Merge branch 'stage1_version02' into version02
new 19e3e28 Merge branch 'version02' into checkpointing
new 6f41883 Fixed pom file
new 36e3b19 Merge branch 'version02' into checkpointing
new 774c15f Merge branch 'marrus_checkpointing' into checkpointing
new f91e1f6 Finished implementation to support task failures programmatically
new 6b61a24 Reintroduced set for recently removed channel ID in order to make cancelling of tasks more robust
new 10af839 Minor fix to improve robustness of byte-buffered channel manager
new 447149a Fixed problem with job lock-up as a result of user cancel request
new d81ad1f Removed cancel job from callback to ensure proper interaction with recovery mechanisms
new 265280f Improved robustness of checkpoint replay manager
new 43bef07 Added names for recovery threads
new 4eb771f ticket 209, 219
new 4fd8f64 Merge branch 'version02' of https://stratosphere.eu/stage1 into version02
new 7ea09c0 added asyn partial sorter it test
new 81d91f6 merge with version2 head
new 2f75455 ticket 209, 219
new 0db9086 Revert "ticket 209, 219"
new 21af867 added (failing) unit-test for task chaining
new 7b9a0c3 added forced group vertex checkpoint
new 767f174 merged with daniel
new 0d049af Merge old compiler with union with new compiler for new data model
new 5123805 - added setDifference method to FieldSetOperations and extended unit test
new 80200e1 - improved handling of stub annotations in optimizer nodes (copy in clone constructor, constant set mode, etc.)
new 07c5dea - removed unnecessary TODO flag in CombinerNode
new 9a8fafb Merge branch 'version02' into annotations
new cbe9d34 - disabled failing test case and opened ticket for fix
new 90cd0de Merge branch 'erik02'
new cab0d77 - fixed MatchTaskExternalITCase - disabled failing tests and added TRAC ticket for fixes
new 7a87a3a - added check for null names in pact tasks
new a4f5e35 Better comparison between outputs.
new 30254e6 - reduce memory for AsynchonousPartialSorterITCase
new b9e3665 - fixed TPCHQuery3
new eac66fe - fixed PactRecord.updateBinaryRepresentation for tailing null fields - added test case
new b994b9d Merge branch 'bugfix'
new 5b2fb7c Finished restructuring of parallel transitive closure algorithm.
new 3beba6b see last commit
new 8d84c8f - fixed TPCHQ3 for reorder feature
new 98e0941 - forward exception in PactRecord.updateBinaryRepresentation()
new a625c31 - extended RecordOutputFormat for record position definition and added unit test
new 6e5a00e - extended JavaDoc of RecordOutputFormat
new b6c791c Merge branch 'version02'
new 8059956 - added Ignore annotation to AsynchonousPartialSorterITCase since it does not terminate on Jenkins - added Trac Ticket to enable and fix test
new d671f7d broadcast added hard-coded tree...
new c3edb99 - Fixed check for partitioning (field numbers are now checked) - Couple of small bug fixes
new e65ca60 - updated stub annotation set handling in optimizer nodes
new 6ecef8b Fixed small bugs in optimizer
new c9d59b5 Merge branch 'version02' of https://stratosphere.eu/stage1 into version02
new 419e324 Added record iterator wrapper
new dc19544 Check constantsets as well as updatesets for checking which keys remain unchanged
new ed40548 Merge branch 'version02' of https://stratosphere.eu/git/stage1
new 596918b Fix of UnilateralSortMerger?
new 6a54544 Fixed small bugs in Compiler (NPE, Maximal Costs of IP, Cloning of IPs)
new 99678d3 Started port of sopremo-common
new f303964 Fixed Pact Record and adopted tests.
new 3fcda6f Merge with version02 staging branch
new f641d88 Fixed wrong initial costs for interesting properties in reduce node
new ba61b9a Some refactoring in OptimizerNode
new 5a97f90 Fixed filterByNodesConstantSet in LocalProperties
new 55d69e5 Minor Bugfix in PactRecord.
new 4b141cc Fixed Test for DataSinkTask.
new 46fa1e5 Cleaned up Imports and warnings.
new 127d15f Corrected typo in checkpointing annotations
new a9971c7 Fixed TPCH-Query 10 (adopted to new datamodel, plus beautified) Fixed TPCH-Query 10 (erroneous test)
new ff8fe52 Fixed Bug #236 (applied Arvid's Patch)
new b643f04 Removed superfluous execution state RESTARTING
new 9658b70 Fixed bug in PactRecord (case columns % 8 == 0)
new 81b4754 - yet another PactRecord fix (indexOutOfBounds if serializer.memory too small for direct copy)
new a3e12d5 - annotation sets are available from all optimizer nodes
new 0c8437c Merge branch 'master' into annotation
new b068333 Solved compilation errors in sopremo-common
new 26056ff Merge branch 'master' of https://stratosphere.eu/git/arvid
new 61e5971 Merge branch 'hpi'
new 4c62986 merge fixes
new fce75a1 Introduced priorities for execution listeners
new 6f34552 Improved javadoc of execution listener interface
new 8af9877 Removed old obsolete Array Util
new 1e7b7db Minor cleanup for Warnings
new 241818d Added massive blackbox tests to PactRecordTest Implemented unionFields Method in PactRecord.
new d2b569a Removes Mockito dependencies from compile scope in PactClient.
new 9f3cb3d Merge branch 'version02' into annotation
new 70fea7d first implementation of ObjectSchema
new 409d1a0 Introduced new method to keep track if execution retries in a thread-safe manner
new f2a508a Moved content of class RecoveryThread to class RecoveryLogic
new a27de67 - fixed job graph generator: Reducer gets key columns and classes for local strategy NONE
new c873fbc Moved code to handle dead hosts from queue scheduler to abstract base class
new ca39de3 Fixed minor bug in method to cancel job
new 5749044 Fixed flaw in execution state listener of the execution graph
new 177478a Marked restartTask method as deprecated
new be11aa2 Minor fix to recovery logic
new c0a4f75 uncommented sequenznumber error log
new c6c845b Merge remote-tracking branch 'stage1/version02' into checkpointing
new 9cf89dd fixed PactProgram constructor
new 340c305 Check if the existing partitioning is on only a subset of the key
new eca7376 Fixed filtering by constant sets
new 23b613b Fix: Partitioned fields are now ordered list and not a set
new a536eb6 Set partitioning for other side of dual input contracts to the same as the other if there exists one
new 66d27b7 Fixed duplicate registration of execution vertex listener
new 4cb840f - applied Mareike's patch to fix #238
new a06950d Fixed problem with instance assignment update event in event collector
new 01676eb Added Stratosphere header to DefaultDeserializer.java
new d308645 Improved robustness of network transfers when receiver has already died
new 138c138 - OutputEmitter throws specific exceptions in case of problems to read the key - moved OutputEmitterTest to correct package and extended it - changed PartitionFunction interface and HistogramPartitionFunction
new f072714 - added serialization test to OutputEmitterTest
new 44e2c15 Merge branch 'master' into annotation+newOptimizer
new a504d4a Use constant sets for output estimation.
new 83b0f57 Merge branch 'ringwald02' into annotation+newOptimizer
new e783189 Fixed wrong compiler hints in JSONGenerator
new aa2fabc Adapted JSONGenerator to new data model
new e68b903 Fixed union bug in self-match
new c5e1404 Improved robustness of buffer implementation
new 5cc68c6 Refactored code for recovery
new 8422d88 Decoupled task execution from network failures
new ccda744 Improved robustness and logging of byte-buffered channel manager
new a4a84ac Removed deprecated restartTask method
new 9f34e38 Introduced task manager RPC method to invalidate entries from the receiver lookup cache
new be48862 Added method to invalidate lookup cache entries to recovery logic
new 0e3521c Merge branch 'stage1_version02' into checkpointing
new 182fa7d Fix: Second input is now partitioned on the same fields as the first input if this one is already paritioned
new 0ca8e65 Fix: Wrong estimates for num records if avgRecordsEmittedPerStubCall is known, but not the number of stub calls
new 63bb42d Improved logging of errors at the task manager
new 6a39c85 Unified event delivery model across input and output channels
new c28df98 Added event type to report transfer envelopes with unexpected sequence numbers
new 6c1c231 Simplified hand-over of transfer envelopes from tasks to the byte-buffered channel manager
new d498b59 Introduced unknown receiver events to signalize delivery failures to the sender
new a41aa99 Fixed problems with cache invalidation in the recovery logic
new 4123d1a Merge branch 'streaming' into checkpointing
new 663bde8 Clean-up after merge
new 3e9d44b Continued to work on integration of streaming branch into checkpointing branch
new e6a0344 Merge branch 'ringwald02' into annotation+newOptimizer
new 03f3671 Merge remote-tracking branch 'warneke/checkpointing' into checkpointing
new b20a3aa Continued to work on integration of streaming branch into checkpointing branch
new 8ce6106 - reworked stub annotations - added read and write set computation to optimizer nodes - adapted example programs
new 248949e Refactored context class hierarchie used by the byte-buffered channel manager
new 4241b22 - added methods to compute output schema and write sets
new 3e35519 changed write set and output schema computation
new bba1e67 Merge branch 'master' of https://stratosphere.eu/git/hpi
new ee77191 - fixed reading of copy and projection stub annotations
new 5b832f7 cleaned MC manager
new 32344b6 - extended optimzer nodes with input schema check
new aa7c099 - fixed valid input schema check for optimizer nodes
new 5da5783 Cleaned up task manager operation protocol
new fb2c4a2 - added java docs and comments for stub annotation methods
new 57f579a Added testcases for ObjectSchema
new 556572f renamed mapping method
new 9a8342a - fixed PactRecord.union()
new b0d0955 Merge branch 'master' into annotation+newOptimizer
new 1cc8e19 more objectschema implementation, fixed tests
new 548a05b import fix
new 79b1601 package cleanup
new c283ed3 refactoring using interfaces for all Node Types
new f3ee1a6 Added schema to SopremoTestPlans
new 31b65cb - renamed compiler hints and added java docs
new 75c9c12 Worked on proper event dispatching in case a replay task runs concurrently with the original task
new 0cd638b - renamed write annotation to modification annotation\n- added java docs to stub annotations
new a69a3bd - renamed annotation another time
new 3adda89 - renamed compiler hints
new f82178b - removed output schema computation
new 7a9e71f - cleaned up pact-examples - ported triangle enumeration to new data model - removed some unused code - moved some pact-examples code to pact-tests
new 558aaed Merge branch 'examples02' into annotation+newOptimizer
new 9034a54 - fixed stub call estimation of MatchNode
new d018251 - fixed compiler hints in TPCH Query 3
new 245daf1 Fixed resource leaks during task clean-up
new 249358b Improved robustness of recovery phase
new dac6317 changed cpu usage intervall
new 0ddb44c merged with daniel
new 7d85f20 Worked on replay task implementation
new e6a1ccc Implemented ReplayOutputChannelContext
new ca0c7c6 Improved robustness of forwarding barrier
new 91a3530 Implemented execution state update for ReplayTask
new 1103ec2 Improved robustness of task manager profiling
new 805a014 Finished implementation of ReplayTask
new 86be814 Fixed bug related to detection of failed tasks
new 88face4 Merge remote-tracking branch 'warneke/checkpointing' into checkpointing
new eb999a5 Implemented visual feedback for execution state REPLAYING
new 31e6659 Modified ExecutionStateTransition to reflect new state changes during task replay
new 3912a96 Fixed possible resource leak during task recovery
new 09c443f implementation auf pigMix1
new f5cd647 Merge remote-tracking branch 'warneke/checkpointing' into checkpointing
new b84f04b Extended lookup protocol to reflect new state REPLAYING
new dc1cdb4 Changed verbosity of RuntimeOutputChannelBroker
new e1f8f60 Fixed bug in ReplayThread close logic
new 52adce0 Implemented logic to restart canceled tasks as part of recovery
new 3824e64 Introduced sequence numbers for input split requests to handle recovery of input tasks
new 6392ae6 Revised fuzzy matching of test records
new b3af7c5 Resolved issues with close logic of replay tasks
new 10ba382 Fixed problem with lookup cache invalidation during recovery
new 73bd45e Minor fix to debug message
new 1936afc Extended return code enumeration for IPC calls
new 3301426 Improved logging of state transitions
new 754881b Fixed misleading log messages in compareAndUpdateExecutionState method of ExecutionVertex
new ea12017 Improved logging in utility class ExecutionStateTransition
new 506f305 Introduced new return value for routing lookups to reflect finished tasks during recovery
new 1216d33 Unexpected envelope event is not sent outside of the queue synchronization block
new 5a805a8 Added convenience method to RuntimeEnvironment
new 0611b19 Temporarily disabled SpillingBarrier
new 2f16e49 Fixed bug in Task Manager
new 196fa56 Worked on locking during recovery
new 44e14f6 Fixed javadoc
new ef78fc4 Fixed bug in channel close logic when receiving task has already finished
new c6ece44 Implemented input split tracker to make replay of input tasks deterministic
new b0f17dd Fixed bug related to channel lookup service
new 2355f26 Merge branch 'stage1_version02' into version02
new 90949b3 Improved performance during job setup phase
new fd14cb3 First implementation of unique fields in optimizer
new 17b99e3 Merge branch 'version02' into checkpointing
new 7d02e5e Removed uniqueness property from Global and LocalProperties, as it is now tracked within the optimizer node itself
new 1c80782 Merge branch 'annotation+newOptimizer' of https://stratosphere.eu/fhueske into version02
new 48b66dd Minor performance improvement
new f0b7ee3 Fixed problem with memory leaks
new 0a6f773 Merge remote-tracking branch 'warneke/checkpointing' into checkpointing
new 50af9f7 Fixed bug in local buffer pool
new 2ec2480 Fixed minor bugs in OptimizerNode (handling of output estimates when unique key is available)
new 21b9d74 Fixed bug in uniqueness determination in optimizer node
new c0cc062 Improved robustness of channel close procedure in presence of execution failures
new 19f0891 Merge remote-tracking branch 'warneke/checkpointing' into checkpointing
new 2f67b4a Added missing implementation in ReplayTaskContext
new 4453543 Merge remote-tracking branch 'warneke/checkpointing' into checkpointing
new 7feff89 Added compiler hints for uniqueness
new 9c7664d Fix: Distinguish correctly between uniqueness properties in input and output
new 11285c1 continued implementation of LazyObjectNode
new b423a8c little fixed for LazyObjectNode, TODO inserted
new a4f21da Merge branch 'version02' of https://stratosphere.eu/stage1 into version02
new 204b7c8 - used FieldSet instead of int[] for field sets in optimizer
new cb51fd9 - optimizer nodes hold key fields in FieldList to preserve order
new c64131e Fix: Check for correct subset of key in partitioning
new 22e7291 Fixed unit tests
new e7c3e9b Merge branch 'ringwald02' into annotation+newOptimizer
new 3680e27 Improved logging of buffer utilization
new 83d2dfe Improved logging
new 4b8dfa7 Fixed incomplete cancellation of pact test plan
new 92ebdbd Fixing sopremo test plans
new f7ea8e6 Implemented envelope consumption tracker to guarantee replay of envelopes in the correct order
new a5267d5 Reduced verbosity of EnvelopeConsumptionLog
new 07aafd1 Fixed some bugs in the envelope consumption log
new 80098e1 Quick workaround for buffer deadlock problem
new 5ccb057 changes in pigmix and merge with daniel
new f0c64bf Clean up of code
new 0fe7418 Merge branch 'marrus_checkpointing' into checkpointing
new 2edd236 Merge branch 'version02' of https://stratosphere.eu/stage1 into version02
new 858666d Fixed problem with unnecessary buffer copy attempt during recovery
new 2d8ae9a Fixed bug in class ReplayOutputChannelContext
new 28551bf Fixed problem with ClosedByInterrupedException during finish
new 4a2abd4 Temporarily switched ephemeral checkpoints to use one file per channel
new 7a89de0 ReplayThread now reads back data to memory before emitting it
new dc05b6f Temporarily enabled receiver side spilling to prevent channel deadlocks
new 7576c86 minor changes in decision components
new 6e8a009 merge with daniel
new 60d3d3a Integrated Stephan's new file buffer manager
new c80ddc9 Merge branch 'filemanager_merge' into checkpointing
new 894ed5f changed some logging for parsing
new e94fd90 Temporarily added code to measure data input/output of PACT first-order function on byte level
new fc48a7e Merge branch 'checkpointing' of https://stratosphere.eu/git/warneke into checkpointing
new c2b45d7 Improved logging
new fb8b77d Fix to make checkpoint deserializer work with new file buffer manager
new 295ce85 Improved robustness of buffer implementation
new f9a6904 Small fix to avoid deadlocks after recovery
new d90d06e Fixed minor bug in JobManager
new 3641a09 Modified recovery logic to also handle node failures
new 88833e4 changes in DecisionCoordinator
new 705529b merged with daniel
new bc1256b Clean-up of code
new cf7ad57 changes in decision logic an locality
new b98b0d1 - fixed bug in TextInputFormat (input size estimation)
new 9f5a8a6 somewhat dirty fix for checkpoint annotation from pact layer
new 6a5056d made lower and upper bound configurable
new c8de5b9 removed some debugg syso
new 4cb0692 Merge branch 'marrus_checkpointing' into checkpointing
new 1135990 added some checkpoint configuration
new 2a2f210 Merge branch 'marrus_checkpointing' into checkpointing
new b7daec0 Fixed problem with data collection in PACT runtime
new 4342adc Marked temporary code properly
new 7956ed2 changed configuration of checkpoints
new 923baa1 Merge remote-tracking branch 'origin/checkpointing' into checkpointing
new f5417d7 added always checkpointing flag
new 23d6487 Merge branch 'stage1v02' into hpi
new 64ed7d5 introduced MissingNode
new 383a832 implemented arrayschema stub
new f35feb9 Refactored code for checkpoint decision logic
new 57c6638 bugfix in iterator more testcases
new bd41a87 Checkpoint decision is now made by the task thread itself
new 244cd5f merge with daniel
new ab80d8b - fixed nullpointer bug in GlobalProperites with Matthias Sax's patch
new 9c4b0cb fixed CPdecision
new 411ca70 Added some debug output
new c8bd062 Merge branch 'marrus_checkpointing' into checkpointing
new aa0379a memory optimization for upcoming reusage of pactrecords and objectnodes started arrayschema
new b7c2ca9 Resolved conflict after merge
new dffd3c9 Refined configuration of checkpoints
new 6eea6e4 Fixed two bugs related to checkpoint configuration
new 9cc2318 Fixed wrong return value of getChannelType method in AbstractGate on task managers
new 2d820e4 removed tail from ArraySchema
new 9335efd fixed bug/test, size of ObjectSchema was too small
new 401f2f5 continued Implementation of ArraySchema, ArrayNode returns now MissingNode instead of IndexOutOfBoundsException
new 6ede56c fixed code ownership and added some javadoc
new 8fb9db2 Fixed bug in collection of PACT data statistics
new 6e5da51 - fixed bug in order property propagation of Pact compiler
new 3c3a3c5 Merge branch 'version02' of https://stratosphere.eu/git/stage1
new 379acae Merge with stage 1
new 59a53fc Added sequential input and output format
new 1c53d5a Started to implemented distributed checkpoints
new 8dda087 Extended file system API to support renaming of files
new c7d4cfa Continued to work on implementation of distributed checkpoints
new e083ce8 Modified ReplayThread so it can handle distributed checkpoints
new 52a19f8 Fixed some bugs related to writing checkpoints to a distributed file system
new f0beced removed getPactRecord() from LazyObjectNode (reason: getJavaValue() serves the same purpose)
new 1d6f64d Finished implementation of recovery from distributed checkpoints
new a1b669f implemented base structure for testing arraynodes, interface tests for arraynodes implemented
new 382858c renamed ArrayNode>>subList() to subArray(); implemeted more tests for ArrayNode interface and implementation
new 31ee303 some more tests for interface and implementation of arraynode
new 032d5af Fixed bug in ReplayInputChannelContext
new 7612fc7 Disabled receiver-side spilling
new f0e92f1 changed return type of ArrayNode>>add(int,IJsonNode) from void to IArrayNode to be more consistent with ArrayNode>>add(IJsonNode); started to document all JsonNode-Interfaces
new 1cc94d23 Changed calculation of meta data file size to enable faster recovery
new c124175 Fixed problem with default block size in HDFS binding
new 7e029eb Improved strategy to read checkpoints as part of recovery
new ca08872 Increased size of envelope consumption log
new 078e87f Checkpoints are now written asynchronously
new 6e14c1f Fixed problem with shut down of checkpoint's asynchronous write thread
new b3114e2 Fixed problem with FQDN in instance connection info
new 280f16f - fixed PactProgram constructor (bug reported by Thomas Bodner)
new 8556577 Improved robustness of checkpoint utility class
new 440a46e added ArraySchemaTest started implementation of recordToJson found bug in ObjectSchema -> test written
new 64ba062 Merge branch 'tommy' into hpi
new a00eba6 Added tests for ArraySchema Fixed NullPointer Exceptions
new 17d536c Merge branch 'stage1_version02' into version02
new 0932f49 Merge branch 'stage1' into version02
new ea84ab2 Improved robustness of clean-up procedure when task is canceled
new fc045f3 Fixed bug in method to cancel/kill task
new fbe5d5b implemented LazyArrayNode, changed return type of IArrayNode>>toArray from Object[] to IJsonNode[], refactored LazyObjectNode>>getOtherField() so less type-casts are needed
new a1cb029 Introduced new checkpoint state undecided
new b592333 JsonNodeWrapper now implements IJsonNode, added additional testcases for IArrayNode, added LazyArrayNodeTest fixed bug in LazyArrayNode>>remove
new 16e7568 added testcases for LazyArrayNode and IArrayNode
new 640df79 Added method to trigger checkpoint decision asynchronously
new 50e4594 Added method call to make checkpoint decision as a response to an asynchronous event
new 3bee04c Merge branch 'version02' of https://stratosphere.eu/git/stage1
new 69ca2d0 Improved performance of BinaryOutputFormat and SequentialOutputFormat
new 7735018 Added getNumInputs to ContractUtil
new fbcd4a4 Revised and documented Iterator and Iterable classes
new bc4da60 Adding key expressions to operators for schema inference
new 9681b84 added some additional javadoc comments
new 5b4e8f7 Enabled lazy deployment by default
new 97040bc added some new javadoc comments
new 9fc032f Added binary and sequential input/output formats for efficient storage of PactRecords in a native format
new a06c917 Added test case for sequential input/output format
new 0bf3ccd Added setter for FileBasedStatistics
new e7a17b7 Moved sequential and binary formats from this branch to stage1/version02
new 7b5d0ad Merge branch 'version02' of https://stratosphere.eu/git/stage1
new 11f8f14 Merge with hpi
new 1756f35 Increased level of detail in BinaryInputFormat in case of exception during statistics gathering
new e5e7cdd Implemented basic version of open(path, bufferSize)
new 607255c Merge branch 'version02' of https://stratosphere.eu/git/stage1
new f9a42e7 File Input of TestPlan properly deserialized with configuration parameters
new b0040bc More details in Binary Input Format in case of error during statistic gathering
new 63f07f6 Fixed last remaining test cases for SOPREMO core port on version 02
new 4bac7a5 Removed temporary class
new 7745bdf Refactored envelope forwarding API
new 2aa9350 Added missing Stratosphere headers
new 6534ac6 Added missing Stratosphere headers
new 6854239 Fixed unit test
new 06d9299 Fixed various bugs related to file channels
new 83009e7 Fix several bugs related to recovery from file channels
new 6586bd2 documented interfaces of serialization package
new 8bb4928 started implementation for ArraySchema with tail
new 2c0132e implemented tail functionality in recordToJson
new 8427b44 Fixed bugs related to task recovery
new b449b60 started tail implementation in LazyArrayNode iterator should work already refactored Iterator
new 4a4dc31 Merge branch 'michael'
new dd15ef0 Extended user API to set the number of execution retries per vertex
new c965c9a splitted ArraySchema/LazyArrayNode up to head and tail types
new 82b4600 Finished java doc of all node types
new b8fdb35 Improved computation of initial checkpoint state
new c1ca650 Clean-up
new 3d6347a Made local checkpoints the default again
new 6781646 Fixed restart bug in class ReplayThread
new cbdf3d8 Merge branch 'michael'
new f5e5748 Merge branch 'version02' of https://stratosphere.eu/stage1 into version02
new 46c992b Fixed problem with wrong initial checkpoint state
new bdeab0f Fixed problem with missing thread interruption in class ReplayThread
new f1f22f2 Merge branch 'checkpointing' into version02
new e441729 Integrated stage1/version02 PACT layer
new 7a2eccc Merge branch 'casp_multicast' into version02
new 32edb00 Merge branch 'stage1_version02' into version02
new abb1f24 usage of broadcastrecordwriter implemented..
new 75f4c65 Fixed compilation problem
new aa7ba03 Fixed problem in replay thread
new b8f487b Multicast Test Case + MulticastManager readyness criteria
new 7a66df4 Fixed POM files and removed some unused imports
new 1aa43a3 Merge branch 'checkpointing' into version02
new e11ecb5 Code clean up
new cb70ce9 multicast auto deploy + test
new 8e39f65 Merge branch 'casp_version02' into version02
new 4a1af10 Minor fix in MulticastManager
new 5976885 BroadcastChannel Test fixed
new ad143f9 Fixed problem in replay thread in improved integration tests
new f6011a3 Merge branch 'checkpointing' into version02
new 8e11973 Fixed bug in multicast manager
new f738748 Merge branch 'casp_version02' into version02
new e2b32b4 First implementation of a general Schema. Extended the signature of Schema>>jsonToRecord with an EvaluationContext; added simple testcases for GeneralSchema
new 1b31895 GeneralSchema is now return by the NaiveSchemaFactory if no better Schema found
new ae392a4 documented GeneralSchema; added some testcases for GeneralSchema
new 3439d95 NaiveSchemaFactory now supports both ArraySchemas (HeadAS and TailAS)
new 6fc400e GeneralSchema.recordToJson now uses the provided target node correctly if the kind of this target is Array or Object
new 0e1ac6f added testcases for NaiveSchemaFactory; fixed "IndexOutOfBounds"-bug in NaiveSchemaFactory
new 25b43fa 2 new testcases for GeneralSchema
new 17bd3a9 more tests for GeneralSchema
new f6ee1d0 Added interfaces for new memory manager views. Removed defunct mem-manager service provider.
new 19f2f0b Merge branch 'version02' of https://stratosphere.eu/git/warneke into version02
new 3634e59 Added global event sequence number
new d03c4bf fixed minor style errors
new 49ff39a style in MulticastManager
new 8ed0bbb Removed unnecessary bit operation from MemorySegment Renamed MemorySegmentTest Removed redundant OutOfMemoryException
new 6fc1fab Added abstract paged input and output views
new fe81c0a Added methods for waiting for returned segments to the block readers and writers.
new 33e6f9d Added new paged channel views Adopted TypeAccessors Added memory segment source
new a593ae5 Adopted PactRecord and its accessors to new accessor api.
new 4d5575d Added strict binary logarithm computation to math utils
new 1e5a0ce Fix for memory views
new 9e1d287 Added basic memory views. O
new 9f10958 Adopted NormalizedKeySorter to paged memory layout.
new 9d5caf4 Added new PagedMemoryViews
new a9cf131 Added Hash Partition Class with new paged memory manager classes
new 907688c changed method signature of EvaluationExpression>>evaluate(), this method is now able to take a target node which will be reused if possible
new 615a1d1 Added test utility classes for plugable types.
new f40bd63 Added generic type comparators and adjusted type accessors.
new a568f26 Added test data generator.
new 6df5e99 Removed Obsolete BufferSortableGuaranteed
new 81858eb Removed warnings
new 59c6238 Minor test cleanup and renaming
new a7520d7 Added hash join adopted for paged memory model and plugable types.
new 98fdb5b Fixed bug in replay logic
new a415b10 Merge branch 'checkpointing' into version02
new 929857c Added exception check to combiner closing, to catch late exceptions.
new c468e5b Fixed bug in Channel Views
new e7b83fa Code clean-up
new ed806e7 Merge branch 'casp_version02' into version02
new 574bca0 Merge branch 'version02' of https://www.stratosphere.eu/git/warneke into version02
new 8b4bb97 Removed deprecated input/output gate listeners
new 0b96918 Reduced verbosity of logging output
new f813451 Fixed bug in restart logic of ReplayThread
new f7fc094 Merge branch 'checkpointing' into version02
new f7e59dd Fixed integration test for checkpoints
new fd1430c Fixed bug in FailingJobITCase
new 053b38f Improved clean-up of checkpoints after job has finished
new 1e4d2a5 Merge branch 'checkpointing' into version02
new 3cc7944 Fixed problem with undetected missing envelopes in RuntimeInputChannelContext
new b08898f Merge branch 'checkpointing' into version02
new fe76929 Removed deprecated code
new 7467145 Fixed problem in POM file for pact-examples
new bd2ec5b Fixed possible resource leak in EphemeralCheckpointForwarder
new c12df90 Reduced verbosity of ForwardingBarrier
new 1788f44 Properly closed RPC stub objects in the various shutdown procedures now
new dd8af64 Fixed signature of methods destroying RPC proxies
new c014ed6 Implemented missing close call to job client in IT cases of nephele-server module
new 7c10f5d Fixed possible resource leak in checkpoint's write thread
new a75f00d Adapted MockEnvironment to match new internal structure of RuntimeEnvironments
new 576ebdb Fixed possible deadlock in AbstractByteBufferedInputChannel
new 63621f0 Reduced debug output
new 0e33d78 Fixed bugs in ClusterManager and the corresponding unit test
new e96a418 implemeted reuse of target node in ArrayAccess; not working if result is a PrimitiveNode; implemented sometestcases for reusage
new ad73765 implemeted reusage of target node in ArrayCreation; added some testcases for ArrayCreation
new 4ac19c6 implemented reusage of target node in ArrayMerger; added some testcases for ArrayMerger; restructured target reusage in ArrayCreation
new d4371ea implemented reusage of target node in GroupingExpression; added testcases for GroupingExpression
new bb6c3f4 implemented reusage of target node in GenerateExpression; PrimitiveNode's (except BooleanNode) now have a setValue Method to allow reusage of that nodetype
new a40822d refactored desition of target reusage -> moved to SopremoUtil
new 8b7357a removed 'null' as target from evaluate-calls inside an evaluate-method
new b8c92e7 Merge branch 'version02' of https://stratosphere.eu/git/stage1 into version02
new 77877a9 Merge branch major changes from warneke into memmanager branch
new 18c7fad multicast is by default topology-aware now
new 02bfbfe JsonNodes now have a clear method: allows node reset before reusage all EvaluationExpressions now have an field 'expectedTarget' which stores the type of an JsonNode: used to determine if a target node can be reused or not
new ffced0a added some testcases for reusage of target nodes in BatchAggregationExpressionTest and ObjectCreationTest; exceptions while reuse target nodes are now handled in SopremoUtil.reuseTarget; PrimitiveNodes are now only cleared with .clear() if SopremoUtil.DEBUG is set to true;
new aec7799 removed senseless testcases from AndExpressionTest
new d39f580 started to comment expressions
new fb106e0 - removed verbose system.out.print statement
new d22d095 Merge branch 'version02' of https://stratosphere.eu/git/stage1
new 602312d Adjusted testing framework to checkpoint-aware nephele
new d6de389 - removed System.out.print statement from EnumTriangles example job
new 6e82eb4 cleaned up MulticastManager. topologyawareness is on by default.
new 178705b - added stacktrace output for failed pact tests
new d4d01b0 - removed union handling from compiler - replaced key arrays by fieldlists / fieldsets in most places - added several todo flags for release
new 1631c5b Fixed #247
new e3f5597 Moved Distribution Pattern out of User Code
new aeafb65 Merge branch 'casp_version02' into version02
new 6e56ba3 dist pattern fix
new 520af03 Merge branch 'casp_version02' into version02
new da181db Started to adapt PACT layer to new distribution pattern API
new 2cff723 Some minor fixes
new 8653389 Backported patches for ephemeral checkpoints from version02 branch
new 466be07 Fixed problems with removal of checkpoints
new 5bf545c Merge branch 'checkpointing' into version02
new cf17d4e added some additional class comments
new 580254f naive way to reuse primitives in GeneralSchema; further commenting
new 5ee18a8 further commenting
new 0c37ffe Included TestPlanTest cases
new 643ecc3 Merge branch 'version02' of https://www.stratosphere.eu/git/warneke into version02
new ad7e826 Added Nephele speed test to examples package
new ec5ff80 Added some new java-doc comments.
new ccd6119 initial commit
new ce0a4b0 Merge branch 'arvid'
new a994d46 Started work on clustering operator
new 777127b First test running for Annotator
new 205e633 Added GeneratorInputFormat (input from config values)
new 77ffc2f Added GeneratorInputFormat (input from config values)
new b1c4c7e implemented TailArraySchema
new 9f9bf2d fixed wrong Schema used in LazyHeadArrayNodeTest
new 5712177 Worked on non-file solution for adhoc sources.
new 239339b Changed PACT's JobGraphGenerator to use new Nephele channel API
new ed37570 implemented initial clustering, one test not working by now though
new d521e3c Removing old files.
new f15c9a0 implementation of LazyTailArrayNode and added Test
new 1450ac0 changed basis array test case and ignored failing test from LazyArrayNode
new b25b9ff implementing creation of cluster tree
new 2c4c3f5 Minor changes to logging in job manager
new 2d489ba Introduced enumeration for Nephele's possible execution modes
new ab40ee4 Started work on tree creation
new b20325a Code cleanup
new a86dea5 Merge branch 'michael'
new 1e50f32 Finished java doc commenting of all expressions
new 32569e3 removed nephele streming plugin from default configuration
new c6b9a69 Added HeaderlessChannelReaderView Fixed HashJoin for recursive spilling
new dbc307b Adopted I/O manager to multiple write threads for I/O spreading. Adopted interfaces for page read/write request combining.
new 317818c Generification of Sorting logic (part 1) (does not compile!)
new d4aed45 Fixed NPE for TestRecords sorting
new d20d0f8 Merge branch 'arvid'
new 40fa231 Created JUnit Test for Ticket #250
new 5e83b02 Merge branch 'sewen_version02' into version02
new 071eff2 Improved style of junit test
new c7b7934 Extended getClass signature to accept a user-defined class loader
new 6126c9b Fixed #250
new c64c807 marked all expressions which dont reuse the target node during evaluation with TODO Reuse target
new fe80cf6 Updated sopremo pacts
new f1b1ca9 Updated sopremo common to 02
new 1d4c6e7 Updated most base operators to 02
new 67e5b9f Updated simple replace to 02
new c52c0df Updated library version
new 4ca3e1d Json serialization for cluster trees, some Json serialization functionality
new 14d2171 Added parameters to composite operators, some clean-up
new f03e662 Merged arvid branch
new 172e63b refactored SopremoUtil.reusePrimitiv: the parameter <targetClass> was redundant
new a9b5c6a Merge branch 'version02' of https://stratosphere.eu/git/stage1
new d144cd6 Fixed junit test
new 376c9f5 Merge branch 'master' of https://stratosphere.eu/git/hpi
new 648cc0c Fixed problems with last hpi merge
new ee9531f Added byte array reusing to delimited input format.
new fb13f94 Merged branch arvid
new ebeb03c Adjusted some calls to some parameter adaptions
new 01b4353 Work on main clustering in progress
new 4c5c973 Fixed project path
new 32fc549 Fixed project path
new 1bbbc74 Added atomic enumerator, to enumerate through multiple temp directories in a thread safe way. Adjusted code for envelope consumption log to work with multiple temp directories.
new be7c418 Adjusted LocalInstanceManager to work with multiple temp directories.
new f680499 Merge branch 'version02' into memmanager
new 42955f6 Fixed bug in execution pipeline assignment
new 8365d12 Separated type accessors into statless serializers and context dependent hasher/comparators. Adopted Memory Manager signatures to page model. Adjusted HashTable and SortMerger (including internal in-mem sorters and stream mergers)
new 9d45467 Adopted Sorter IT Case
new 762665f Merge branch 'version02' of https://stratosphere.eu/git/warneke into version02
new 14bc1b9 Fixed in basic sorter Adopted partial sorters
new 363fffa impemented NormalizableKey interface for all JsonNodes, extended JsonNodeTest to automatically test the normalization of the tested node
new f387143 Merge branch 'hpi'
new 1288fac implemented NormaliableKey interface in JsonNodeWrapper, extended JsonNodeWrapperTest to test the new functionality
new 884f589 Created generic stubs and made pact record stubs special cases of them.
new 98708dc Fixed Asynchronous Partial Sorter Tests Renamed serializer
new b14ec40 refactored copyNormalizedKey & getMaxNormalizedKeyLen -> JsonNode implements a standard behavior which can be overriden if another behavior is necessary
new 336ef26 Adopted hash-match strategies Adopted key-grouped-iterators
new c5f0721 Adopted KeyGroupedIterator Test Adopted Combining Sorter First part of CoGroup Strategy refactoring
new 45c3c36 - fixed dependency of WordCount example on AsciiUtils
new 6fcc0f4 Adjusted CoGroupIterator
new 441087c Adjusted test programs to generic signatures.
new e35e342 Fixed CoGroupSortMergeIterator First part of SortMergeMatchIterator
new 4da3d06 Relocated some tests, working on cluster representations
new 6b9ab8d Further work on representation updates
new 299ee85 Putting some clustering operators together
new 08d4c21 Extended KeyGroupedIteratorTest Adopted BlockResettableIterator to paged memory model.
new 60cabcd Minimal HashPartition tuning
new 11139f8 Added spillable output view for record caching.
new 5cffebc Removed old obsolete classes.
new b3205af further work on clustering
new 76d2231 Adopted spilling resettable iterators to pages memory model and I/O views. Various minor one-line additions / cleanups.
new 8e65a80 Cleaned and consolidates I/O Manager code.
new ddc8c8d Adopted SortMerge strategy for match.
new b8892ca MemoryManager changes to page memory manager.
new ffbcf3f Removed old input view files. First step to adopting runtime task classes.
new 280db9e Moved serializer classes to pact-common
new 00c1980 First portion of task adoption to generic runtime.
new 427fae3 Data Source and Sink with INput / Output Format refactoring...
new 8af29ea initial commit
new 303ef94 Next part of task adoption
new 6b8e2ef Adopted remaining tasks (except Self-Match)
new b5c00a9 Merge branch 'memmanager' into iterations_master
new 319c8c0 initial clean up
new f07e0fb fixed wrong calculation of lazyArrayNode size
new 2a09d13 fixed lazyTailArrayNode iterator
new 68ef86a implemented set method of lazyTailArrayNode
new 6591263 Fixed bug that classloading fails in configuration with null class loader.
new 016fa59 Removed System.out.println statements Fixed RecordINput/Output Format tests
new d6965cc added parameterized test for lazyTailArrayNode and fixed bugs when tail is small
new dcde786 finished lazyTailArrayNode
new 376b8af SopremoUtil can now use a custom class loader for deserialization (currently used by SopremoMap to load debugging objects)
new f473a43 Fixed output size bug; added simple plan assembler; clean up
new a12b628 Applied new deserialization function to other sopremo operators
new a33b075 put some docs into lazyTailArrayNode
new 3b8ae64 a little more cleanup
new bbcab8a Extended data structures to handle multiple connections between a pair of TaskManagers
new df23a0c Added wrapper that turns mutable object iterator into a regular iterator with shared object.
new 47bfac0 Adopted Tasks and Tests (prefinal version)
new 564f26e more cleanups
new be9805f added stuff from Moritz' branch
new a5746a7 Fixed bug in DataSourceTask
new 768bfb8 Temporarily changed Enumeration of Triangles job to use Reduce for first self-join.
new ceaeb05 Temporarily made match with self-join predicate fall back to regular match instead of using specialized self-match operation. (Self Match currently not adopted)
new 59bf7b3 Merge branch 'version02' of https://stratosphere.eu/git/stage1 into version02
new ff28851 Merge branch 'version02' into memmanager
new 2e86aac Merge branch 'master' of https://github.com/dimalabs/stratosphere-iterations into github_merge
new d14a53b and more cleanup
new 20a7880 resolved conflict in SelfMatchTask
new ad8d530 fighting through the code
new a9f84e9 Removed accidentally added marker file.
new dbb28db more cleanup
new 8ee8846 more cleanup
new b735928 more cleanup
new 8861997 Adjusted nephele utils to new runtime code.
new 015aa00 Merge branch 'version02' into iterations_master
new 8ed38df First part of iteration contract.
new 5776fff conflicts
new ddaf77a Added class stubs for high level iteration constructs.
new a8d6c35 Merge branch 'master' of https://github.com/dimalabs/stratosphere-iterations into iterations
new 00fadaf more hacking and cleaning
new 8be41f7 Merge branch 'master' into ssc-iterations
new 54c8e2f fixed a typo in new iteration contracts
new e6c037d Replaced synchronized block in lookup structure by java concurrent data structure
new 8553cce removed algorithm implementations, will be restored later
new 548e1c6 Merge branch 'version02' of https://www.stratosphere.eu/git/warneke into version02
new 5357b24 implemented copyNormalizedKey() in DoubleNode, new testcases for JsonNodeWrapper, refactored method to fill the target with zero bytes in copyNormalizedKey()
new 7f06e42 refactored assertion in JsonNodeWrapperParameterizedTest >> shouldCreateDifferentNormalizedKeys() to be more readable
new eb35c2d crouching forward
new fac1086 crouching and crouching
new a85e7f2 Fixed clean-up problem in recovery code
new fbbd8c5 Merge branch 'checkpointing' into version02
new ab3d6aa Fixed bug in serialization method of RemoteReceiver
new e324a2d Implemented algorithm to compute connectionIDs
new f040561 Fixed problem in network stack to handle multiple TCP connections between a pair of TaskManagers
new caf1f7c Merge branch 'networkfix' into version02
new adee6a7 Resolved problems after merging
new 5d5da25 Fixed configuration problem with distributed checkpoints
new 76e58e6 Fixed #243
new 354968e Fixed problem with read event subscription
new eb889af it compiles...
new dc44b3f started to add javadoc comments to all classes in sopremo-common
new bfb497f Fixed bugs in testing framework (reported by Thomas Bodner)
new 69c1fc1 Fixed refitting of PactRecords for ObjectSchemas
new ef701d5 Added plan assembler
new 86fc7e3 Added some toString methods, fixed conf bug, added point generator
new 8466d50 Set up parameters for composite operators.
new 2a91f3f Ran a clean-up on sopremo-sdaa11.
new 7cd906c Refactored key expressions
new 7e034ec Merged in branch arvid.
new 9a1590a further documentation with java-doc
new bcedcc0 further documentation with java-doc
new 142cd80 Implemented post processing, need to merge before testing.
new 416fc71 Removed superfluent file.
new 546ad6c Fixed schema inference bugs in composite operators
new e8be883 Extended post-processing. Ran clean-up.
new f920633 Connected clustering parameters to suboperators.
new fb44978 Merge branch 'arvid'
new 11703ed Removed an unused test.
new e8345ea Added some missing operator annotations and constructors. Added two point test files.
new afd4269 Ran clean-up.
new 8639cf4 Added integration test to test scheduling overhead for jobs with large DoPs
new ec22cf9 Added missing Stratosphere header
new 040c694 Improved efficiency of AbstractID class
new 337804e Improved code style
new 3c43cbe Transition to new internal execution graph representation (not yet complete)
new c37caf7 Fixed Long.SIZE bug
new 70e9096 Working on SON algorithm.
new e95abd9 Counting all candidate occurrences in SON algorithm.
new 197be37 SON is now working.
new ec445b2 Merge branch 'compiler02' of https://dev.stratosphere.eu/git/fhueske into version02
new 45c65f5 Continued to work on transition to new internal execution graph representation (not yet complete)
new 07eb00f Compatibility to OpenJDK 1.7.0
new 1b9f6ee Finished transition to new internal execution graph structure
new 86c4f3c Fixed problem with uninitialized channel and compression settings
new 34b38bc Removed IOReadableWritable interface from channels
new 69ca0bb Refactored cardinalities and adhoc sources
new 41d3749 Completed test on scheduling graphs with larger DoPs
new e13446a Reduced DoP for graph scheduling test (previous version caused OutOfMemoryError)
new db263a1 Added signatures and factories for custom deserializers.
new 89191dc Improved robustness of RuntimeEnvironment
new d738c4b Merge branch 'stage1_version02' into version02
new fb47685 it compiles and starts
new 2eb4c9d Renamed Serialization Buffer
new 956b02f Merge branch 'version02' into iterations_merge
new 22d8dd5 Post-Merge fix of MockEnvironment
new cc3eca2 mutig
new 2ff2f38 Merge branch 'ssc-iterations' of https://github.com/dimalabs/stratosphere-iterations into ssc-iterations
new f5220d6 Post-Merge fix of ExecutionGraph
new 99b800f Reworked stub annotations to ConstantFields only
new 78292c0 Fixed problem in MockEnvironment
new b5bbbb4 Further java-doc commenting in SopremoTestPlan; deleted unnessesary file Schema.java.orig
new 042019d Fixed cancellation of pacts in testing framework
new 2524b07 Fixed bug when translating nested composite operators into elementary modules
new f85aa67 Merged with branch including custom deserializer for nephele.
new 3d75297 finished java-doc commenting in SopremoTestPlan
new 67606a5 Merge branch 'arvid'
new 6666a60 Merge branch 'arvid'
new 94d9d3f SopremoTestPlanTest -> trying to find bug in 2 testcases
new ae90376 Changed member variable visibility as in Ticket #228
new 83e142c Typo fix.
new 4bd97fb Fixed Tests for nephele record serialization/deserialization and added tests for serialization logic spanning buffers.
new ddad2de Adjusted signature of DelimitedInputFormat to deserialize from byte array subsequence.
new 630edd7 Changed DelimitedInputFormat to save byte copying to extra buffer and deserialize out of the read buffer directly.
new bf24a98 Refactored grouping
new 13b545a Added missing files
new abf881f Fixed Bug in adopted Test Input Formats
new 3289e47 Merged branch 'arvid'. Kept SONTest
new 41752c8 Added cardinality annotations to clustering operators.
new 4f0046f Fixed minor inconsistencies in log messages
new d1cb187 Merge branch 'arvid'
new 4008292 Added recursive expression rules
new 0b9be22 Refactored join, grouping, and other base operators
new c16c280 Fixed some bugs in clustering algorithm. Added PrintAndForward operator. Clustering still suffers from point duplication.
new 63b5253 Fixed point duplication defect.
new fe26436 Ran clean-up.
new f06a3f5 Changed envelope dispatcher interface so every InterruptedException and IOException is now propagated back to the task
new 93256b2 Reduced verbosity of RuntimeInputChannelContext log messages
new 5e3ed25 Refactored join
new 52543e6 First part of Job Canceling Tests
new 1ee2aef Merge branch 'sewen_version02' into version02
new 120edfa restarting from pact-runtime
new 5b312a2 cleanup debug code
new cc04f4b fixing...
new 70dffb6 fucked up
new cac6e60 x Revert "Post-Merge fix of ExecutionGraph"
new afca565 more comments
new 05fda3d Separating Pact Drivers and Control-Flow drivers, first part.
new 3c89437 Part refactoring of abstract task as generic non-iterative control flow task.
new fd6347d Finalized sparation of pact driver and control flow logic.
new 6b28d31 Removed obsolete iteration packages.
new 7f83d1d Merge branch 'ssc_new' into ssc_merge
new b4ce185 comments + headers
new fc483e2 Skeleton for the new job cancellation tests
new 89d6f4a Changed broker interface for new compression API
new 4ace762 Continued modifications of compression API
new 4cc2f82 Modified and extended system cancelling tests
new 78c392a Switched to cached thread pool in task manager to speed up cancelling of tasks
new 2431cef Continued to work on new compression API
new 7951115 Made Cancelling Tests IT Cases Re-enabled testing of task failures.
new 4957613 Extended notice that the project uses Apache Code, to be compliant with Apache Guidelines.
new f9c3125 - removed HDFS dependency in pact-tests - removed MiniDFSCluster from pact-tests
new 278efa7 Fixed bug in JSONGenerator, inputs have not been comma separated
new 915c07a Fixed bug where null parameter arrays are passed to the user code.
new f21ebf0 Changed logic of cancelling thread to join with executing thread.
new 86e61ed Pact Tests now run with disabled fault tolerance, for immediate visibility of failures.
new d118ae4 Improved cancelling for file output tasks to better handle HDFS write abortions.
new 7f6f1a9 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into fab_merge
new c1e5a0d Introduced ConstantFieldsExcept annotation
new ba247d8 Merge branch 'arvid'
new 979a58d Added output cardinanlity bounds to annotation
new 002aa74 Added outboundcards to TPCH Query 3
new 68d49ca Small bug fix for outboundcards
new 879597d Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new ff4b9e2 Re-enabled task failure it case.
new 0573d48 Merge branch 'r_v2' into version02
new aeddbd0 fixed 2 testcases for TernaryExpression, started to comment TransitiveClosure
new be57e7d Small fixes in optimizer
new e1e8965 Added uniqueness hints to k-means iteration example.
new 7dafea9 Temporarily disabled one cancelling test to allow version02 branch to build.
new 27cfb52 Refactored sopremo types
new 58c582d Added accessors to sources of Testplans
new 6a03114 Refactored sopremo common
new 58a3cda Finished revision of sopremo base
new 2f1dcce Fixed file input and output stream handling for more robust cleanup. Existing files are not attempted to be overwritten, but explicitly deleted first (does the same, but HDFS handles it better)
new 45fe071 Task driver thread handels all throwables and not only exceptions.
new 309f888 Fixed cancelling bug for chained tasks.
new c59a0d5 Removed System.out.println statements for checkpointing decisions.
new 887eec7 Correct handling of NullPointerException in I/O requests when memory has been asynchronously released by canceling or failing the task.
new e868dab Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new ec1e3a4 Merge branch 'arvid'
new c15b7d4 Reworked WebLogAnalysis to new RecordInputFormat
new 4f99baa Added singleton annotation for operators that shall run as a single instance. Added operator for finding frequent items.
new 8729883 Changed Singleton annotation to more flexible DegreeOfParallelism annotation. Avoiding test plan DOP synchronization for explicitly set DOPs.
new c5e9d39 adjusted test plans to stage1
new 302f7c0 adjusted sopremo to stage1
new 5807377 removed simple; will be recommited as meteor
new 0326922 Fixed bug NullPointerException on branching PACTs
new 48bb516 Merge branch 'r_v2' into version02
new 1dc0beb Added grouping operator of DAP algorithm.
new a3f9ad0 Added grouping operator of DAP algorithm.
new 3abad86 Ran clean-up.
new 1ca5d6a Fixed estimates for DataSource
new 46a7f55 Added basket shrinking operator for the DAP algorithm.
new ca31f52 Fixed memory leak in FileInputSplitAssigner
new 5744fc0 Fixed memory leaks in TestPlan
new 0082ea9 Removed sopremo cleansing and sdaa11 packages; they will later be added in a separate branch
new f8ef6f4 Added sopremo query package
new 0970212 Sopremo util -> sopremo query
new 081b928 WIP on Create Frequent Itemset Candidates Operator
new f4bcc18 Finished Create Frequent Itemset Candidate Operator.
new 6e165ad Added uniqueness properties to inputs of KMeans example
new 2353a37 Add PartitionProperty for unique fields
new c491d83 Temporarily added more outputs to find test plan deadlocks
new d30a13b Fixed sporaduous state transition from job graph FINISHED back to RUNNING and subsequent dead lock
new 5d08cf6 merged with stage1
new c9110b7 Increased timeout time for cancelling tasks.
new ef201b2 unified some expressions
new dcb44f0 Migrating Thomas's Range partitioner changes.
new b5f2a3f Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new fdf6edb Interface and compiler portion of range partitioning for data sinks.
new 415e201 Added Range Partitioning with istribution to the JobGraph Generator. Added basic test case for TeraSort with Distribution.
new ed54150 Added ascii terasort input and re-added runtime range partitioning code.
new 01b7fae Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 9d929d2 Finished global sorting. Implemented TeraSort Test Case.
new cac3da0 Merge branch 'version02' into range_partitioner_merge
new a44cc54 Fixed #255
new 397bf1d Merge branch 'version02' into stage1_version02
new eeed9c2 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new e1ae38f Simple first attempt to resolve the deploy/cancel race problem
new b2dd634 Merge branch 'version02' of https://dev.stratosphere.eu/git/warneke into version02
new fd95d97 Fixed NPE in pact testing
new aed6a90 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new acca0ef Continue to work on deploy/cancel race problem
new d6c6a6b Merge branch 'version02' of https://dev.stratosphere.eu/git/warneke into version02
new c2cc8e1 Package reorganization in pact runtime.
new 6e19a7b Made TempDir Separator the system's path separator (not hardcoded ':')
new 77e78a9 Fixed potential race condition in TaskManager failed task checking.
new 9d03568 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 78dc3b3 Fixed timing race in ExternalProcessInputFormats with waiting for process termination.
new 87aa0b8 Fixed compile bug with generic signatures in input format.
new 80d6c58 Improved compatibility with Windows
new fcfa895 Fixed test plan for tests without expected values
new 3d664ea Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new 1e5b1c7 Fixed overly restrictive range check in pact record user type deserialization.
new 60efa8e Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new c61d5b1 first halfworking version of bulk iterations
new 4d81c3a output
new 06555bf Refactored sopremo schema
new 4a4a228 added contextual projection
new 7e7b1d6 Added approximate double matching for sopremo test plans
new 392d8d5 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new c42db1c removed test-jar from sopremo pom
new 48aec24 added an intermediate job to the simple testing pipeline
new c2a1d97 updated gitignore
new cf6f054 Adjusted pom.xml for test dependencies to latest documentation
new 1dddc98 Added meteor
new a43529c Adjusted dist pom.xml
new 73c662c first shoot at channel reading for iterations
new c6b56e1 Adds secondary sort capability
new b06d663 Add example that shows off secondary sort
new ad57c21 Improved compatibility of JobManagerITCase test with Windows
new 673a2b0 Continued to improve robustness of cancelling logic
new 616a7ae Merge branch 'version02' of https://dev.stratosphere.eu/git/warneke into version02
new c946ad9 Merge branch 'stage1_version02' into version02
new b5c3ec1 added superstep barrier + synchronization
new 8f14b18 Fixed bug in charset decoding logic.
new c80ecc0 Fixed race in TackManager's checking for failed tasks.
new 936df09 Change user interface regarding SecondarySort stuff
new 7fa7eac1 Modify where secondary sort keys are stored
new f6d147d Fixed NPE in OperatorFactory
new 91bdc11 Merge branch 'master' of https://dev.stratosphere.eu/git/arvid
new 349dc88 Merge branch 'version02' into alj_v2
new 95fd235 Adjusted interfaces for secondary sort to Orderings.
new 2695916 Cleaned POM fiel for pact examples.
new df467c5 Fixed cancel bug and bug in unregisterExecutionListener method of ExecutionVertex
new 5244602 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into stage1_version02
new 04e1edf Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 80f0329 Added compiler testcase for branching plans
new 6c82a7e Create UnionNode in optimized plan when contract has more than one predecessor per input
new 0abfce7 Adapted JobGraphGenerator to explicit UnionNode in optimized plan
new 8d4c01a Fix: add information about input groups to correct task
new 1a881dc Temporary fix: Adapt dop for union from descendant
new 5db54d4 First draft of UnionNode
new 517270f Removed unnecessary method from Unionnode
new d5a00eb Added logging for a special error case in data sink tasks.
new 07c7e92 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 67bb1ed Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 227e5f4 Removed orphaned getConstantSet method from OptimizerNode
new 4fac2fa Implemented output estimation for UnionNode
new 1693319 Adjusted CostEstimator for Union handling
new d2556dd Implemented property handling for union node
new 0c05161 Adapted interesting properties generation for UnionNode
new 84da181 Implemented branch handling in UnionNode
new 181ebbb Fixed NPE when determining global properties in UnionNode
new 83b790b Refactored coercing
new d8b6a4b Fixed package importer for .jar
new 8d795e7 Refactored NULL expression
new 42c99fd Fix: Add instances per machine for UnionNode
new 976a2fb Fix: Do not chain tasks which have Union as input
new d8a8bd0 Fix: Branch handling for incoming connections in UnionNode
new 7972cb1 Add union to BranchingPlans testcase
new 6d367f4 Added ITCase for Union with in TPCH Q3
new b349f99 Added comments to UnionNode
new 82f1b9b Implemented log file rotation
new 3a38cec Fixed minor bug in ChannelDeploymentDescriptor and added unit test
new a2868dd Forwarded changes concerning separation of task and driver logic from the iterations branch.
new 8909a0b Added unit test for GateDeploymentDescriptor class
new 6a6f5af Added cancelling hook that was lost during merge.
new 8137fbc More robust startup behavior of nephele mini cluster for testing.
new 1c53791 Robustness of cancelling improved.
new 0c5620d Fixed flaw in unit test for GateDeploymentDescriptor class
new fa512fc Refactored expressions and functions
new e8dceba Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new a5270b4 Implemented a workaround for nonfunctional Pact union
new 6923185 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new c5dd1f1 Fix NPE in Ordering toString method: Keytypes may be null
new 806ba02 Do not display UnionNode in WebInterface
new 02a1726 Added unit test for the default transfer envelope deserializer
new 878dbbc Merge branch 'version02' of https://dev.stratosphere.eu/git/warneke into version02
new 772983a Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into stage1_version02
new bc43f27 Safety commit.
new 640f8ab Corrected exception message in PactInteger Removed unimplemented method from PactString
new 9f01e11 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 2970792 First draft of test case for partitioning property when dop changes
new d7bc25c Merging...
new a53f5f0 Merging Pt. II...
new 9e82d88 Change all pact contracts to use Builder pattern
new 4c8f7e4 Update ContextChecker and incorporate into plan compilation
new 4b9a39e Fix PACT Builders to only have one constructor
new 9cb3582 Finished changes to the compression interfaces
new 380af51 Merge branch 'version02' of https://dev.stratosphere.eu/git/warneke into version02
new 6caf711 Added guava dependency to nephele job and taskmanager startup scripts
new 7380a04 Fix: Wrong output of shipping strategy in JSONGenerator
new 7adb4b6 added event-handling for bulk synchronization task
new ae2c74d Fix: Filter GP and LP when DoP changes over a connection
new daa08cf Finished compiler test: different dop for pre-partitioned match inputs
new e980698 Added diagnostic code for deserialization error tracing.
new d1ee396 Adapted Arvid's mock classes to reflect changes if internal Nephele API
new d6a8775 Merge branch 'stage1_version02' into version02
new 5f149f7 Fix in OptimizerNode: remember which branches have already been closed
new 9431f82 Added test for property propagation through UnionNode
new d3cd2a7 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 26768ad Changed remaining compression libraries to the new compression interface
new 30867cf Merge branch 'version02' of https://dev.stratosphere.eu/git/warneke into version02
new ca4eeaf Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new a316ed2 fixed wiring, cleaned up logging
new 651768d Compression now also works in combination with recovery
new 021b828 Merge branch 'version02' into stage1_version02
new 490a466 iterative mapreduce is working
new 6c8bdc0 removed unnecessary config option
new 832c49c Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new a937895 Use max of the inputs for distinct value cardinality estimation in UnionNode
new 9bfab2b Removed .idea folder
new ea36291 Fixed bug in LZMA decompressor
new 0a83449 Manual Merge of version02 and iterations branch.
new 96d8dda polishing iterative mapreduce
new 33d900e Merge branch 'ssc-iterations' into iterations_merge
new 9b5d566 Removed accidenally checked in dep.txt Added ignore patterns for idea ide.
new 074b354 Added event subscription / publication methods to mutable reader interface and implementations.
new 57cdfd9 merged with 0.2 branch
new 56c6ea9 Removed unfinished checkpointing features for OS release
new b6df6df Reduced logging during task recovery
new 552aae5 fixed iterative mapreduce
new ecf79bc Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 5115711 Improved logging in case a vertex cannot be canceled
new 144794e Fixed bug in method checkCancelRequestFlag of class ExecutionVertex
new 1941ea5 Merge branch 'arvid'
new 8bc5535 Fixed resource leak in library cache manager
new 025fb99 added testcases for MissingNode, Object- and ArrayNode
new 6c51f01 Fixed minor bug in TaskDeploymentDescriptor and added unit test
new 753d199 Added ITCase for Join with merge only as local strategy
new c6cdfcb Added ITCase for Union (including empty inputs)
new 834f8eb Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new ea9dd3b Fixed bug in checkpoint removal method
new e152e68 added some testcases for NullNode and changed NullNode>>equals() method
new 17ff56c Fixed possible race in recovery logic
new 254d790 Minor improvements
new f441803 minor formatting of LazyTailArrayNode
new 95bb200 formatted LazyTailArrayNode to easier merge
new 301a25a Merge branch 'michael'
new 836cfa8 polishing iteration examples
new 7010243 multicast receiver: connection ID from executiongraph
new da27fed Merge branch 'hpi'
new f0cff6f EC2 AMI ID can also be set in global configuration now
new bdcbb5e Fixed #258
new 7e10e2b Fixed miscellaneous minor bugs in compiler.
new d04c89f Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 122bdd6 EC2 AWS ID and KEY can also be configured globally
new 9e6f4ee executed project cleanup fpr sopremo-common, added some new testcases for JsonNodeWrapper, further java doc commenting
new 833ead4 further javadoc commenting
new 09fcd64 Merge branch 'version02' into ring_v2
new feb669d next shot at pagerank
new 385905f futher java doc commenting, removed method getInputName() from Source -> duplicate to getInputPath()
new 82027ee further java doc commenting
new e267c8f Minor improvement of code style
new fc3a1584 Merge branch 'casp_version02' into version02
new 34b7493 Minor style changes
new 2a452d3 Fixes problem with ambiguity of Hadoop hostnames
new 1dd6996 Re-enabled generation of zip and tar.gz files in distribution pom file
new 3f79a88 first shot at iterations with intermediate dual input tasks
new 3e4e413 Refactored TestRecords
new b37e6e5 Refactored and Reorganized sopremo-common
new bfd753f Moved query related sopremo implementation to this package
new 7fe9348 Added meteor
new 0caf470 Refactored base
new 063ad52 Removed files that are superfluous after previous refactorings
new 1653867 Added base layout for sopremo packages
new 3d52529 Added tooltips for jobs and improved consistency of GUI
new bee443e Fixed #185
new 61ef8f8 Fixed unit test
new 30c52d0 drastically simplified event handling
new 227d430 Continued refactoring of sopremo-query
new f64e431 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 8f8644f Add ReduceContract.Builder ctor without key
new f155fce Add key-field-less ctor to Builder pattern
new 4c9ef2b Added required library to jobmanager and taskmanager start scripts
new f47ad55 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 0727ee7 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new e49ba52 Merge branch 'version02' into ssc-iterations
new 7e9e805 fighting with pagerank
new 31c7aa4 Merge branch 'ssc-iterations' of https://github.com/dimalabs/stratosphere-iterations into ssc-iterations
new 954a184 Added connectNetwork() method Adjusted PageRank Implementation to use network channel for broadcast.
new 9bee983 Fixed Bug in Broadcast In-Memory Channel Closing.
new 9b69763 first draft of sync as sink
new a413278 merged with nephele fix and changed sync to be an output
new 80a145f Fixed bug in var-len integer deserialization.
new 3e8a922 Modified Data Sources to reset PactRecord objects before handover to input format.
new fdcfa74 Fixed Bug in Random Access Input view for small data fractions.
new 07efc0f Merge branch 'version02' into ssc-iterations
new dd80acf Merge branch 'ssc-iterations' of https://github.com/dimalabs/stratosphere-iterations into ssc-iterations
new c4e6c5e pagerank works with caching
new 8ad1166 Merge branch 'ssc-iterations' of https://github.com/dimalabs/stratosphere-iterations into ssc-iterations
new c06897b Cleaned up pact-examples: 1) Removed PigMix package, removed Manifest files, removed CoGroupSecondarySort job, renamed ReduceSecondarySort job
new 5eb48c3 Renamed SecondarySort into GroupSort
new 13cfeb9 Improved pact-example jobs: 1) updated JavaDoc and inline comments, 2) added constant field and output cardinality annotations, 3) improved some implementations, 4) minor fixes
new 5e53a8b polishing and commenting of bulk iterations
new 9834088 - moved groupsort and terasort into an example.sort package
new 4c9eb3d Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new af8d81b - completed refactoring of SecondaryOrder to GroupOrder in pact-compiler
new 2d0fd67 Change Builder patter as per Fabians feedback
new 2c7c726 Merge branch 'arvid'
new 0e7b6df fixed import warnings + further commenting
new 615b8d3 further commenting, added classcomments to json node types
new d32a7a0 commented missing schemas
new 6f689de Fixed a bug in the scrambling field handling of the PactCompiler
new 78643cd Adapted the expected result of the WebLogAnalysis integration test
new abedf18 Fixed some bugs in the Pact compiler
new bcb3e3b Fixed the PairwiseSP example program and adapted the corresponding test case
new 4e52d6b Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new f8e96be Merge branch 'master' into version02
new f814a5f Fixed Pairwise Shortest Path example program and test case
new 8e5e07a added csv test resource
new d38710f Refactored registries and aggregation methods
new 71a9ea6 Merge branch 'arvid'
new e1bf6f6 fixed bug in ArrayNode.fillArray(result)
new bb1ec09 Changed ShipStrategy from Enum to Classes. Partitioning Strategies hold partition keys as member variables
new 9c7c468 Reactivated GlobalSortingITCase
new 9b2b8f0 Added or unified Apache license header in pact modules
new f0a952b Updated pom file of pact-examples, removed double import of guava in JM and TM start scripts
new 9d3c5a2 Remove empty source jars from distribution
new cdbc648 Fixed function registry test cases
new 0c9993e Fixed meteor tests
new 3e69756 Excluded meteor server/client for now
new e5407f1 partial refactoring to have sync check iteration termination
new 56ef8a9 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new 71a8a76 Fixed function call tests
new 86dafff Refactored meteor grammer; now without backtracking
new 57a3f90 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new dd41461 Merged branch arvid.
new ff46382 Added dop getter/setter to SopremoTestPlan.
new e0ff2ec Added build of pact-tests jar to pact-tests pom.xml
new e4d1ca2 removed expression tags; added explicit preserve property for join
new 25f3474 Fixed AbstractObjectNode's #copyValueFrom(...).
new e6d7fd6 Introduced hybrid event model
new 305b8ae Merge branch 'compilerExecStrategies' into version02
new f852b66 completed refactoring termination decisions into the sync
new 3b2a56a polishing AbstractIterativePactTask
new 2fef62f Merge branch 'stage1_version02' into version02
new 03aa952 Added sopremo server/client with IT tests
new c4660f9 fixed bug in broker key generation
new 7272531 polishing and commenting
new b27f6e6 Fixed outer joins
new 4c96c8c Fixed sopremo server/client test cases
new 340666b added meteor client
new 3a32f41 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new 48634b1 Added meteor/sopremo scripts; adjusted nephele scripts
new 896bb7a Removed java warnings
new abb3a93 Merge branch 'arvid'
new db32a66 Simple input format for N3 files (e.g. for DBpedia).
new 8c3a05d Removed superfluent import.
new 33e57b6 Fixed dop issue in SopremoTestPlan.
new 0d3ff64 Added sanity check to N3InputFormat.
new 1aef68e Added main to Sopremo server
new 6d3dbdb Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new 4189b70 convergence checking via sync is now working
new 1fa6eae Replaced slow implementation of ID-to-vertex lookup
new 807fbc1 Changed executor service in JobManager to support larger clusters
new cada27e Optimized Terasort Data Types as mutable objects.
new a7a5b7e Added normalized key direction inversion to normalized key sorter.
new 5bb24b8 Added direction for comparison on PactRecordComparator.
new 70fdcd0 Improved efficiency of mechanism to release instances
new 346a0fd Removed deprecated class
new ff13bd6 Added diagnostic trace for input split opener timeout.
new 1e8903a Fixed minor issues with sopremo server
new 2516597 Added minor robustness changes for input split opening.
new 581942c Merge branch 'arvid'
new 2c2d96a Removing N3InputFormat: It now can be found in sopremo-datamining.
new 7d66099 Made fs stream opening timeout configurable.
new ef934c0 Made timeout configurable per stub.
new a4142cc Merge remote-tracking branch 'remotes/sewen/version02'
new 65a9a67 Added sort directions for comparators to runtime and job compilation.
new f190992 Fixed NullPointer Bug in PactRecordComparator.
new 8b9db71 Merge branch 'av2' into builder_merge
new 7c5f373 Remove all public contructors from PACTS
new 161f46f Made RPC.getProxy a generic method
new f0117f7 Minor adjustment of builder pattern code.
new 20fcb49 FIxed bug in default deserializer.
new 2aa485c Fixed bug in DefaultDeserializer
new da3ab6e Fixed overrestrictive null-pointer check in Ordering.
new 644437a Fixed sort direction configuration writing/reading.
new 15d4cdc Fixed and extended tests for global ordering.
new 42f9f26 Added package transfer mechanism for sopremo
new 97f8384 Fixed pom.xml in sopremo server
new 654193e Fixed query error message
new 4e34954 Prototyped first version of input format configuration builder.
new 81e622e Temporarily made config keys public to make not adopted examples compile.
new 122bf3c Forward fitted changes to Sopremo Packages.
new a17486d Disabled activation of input channels
new f79b81e Implemented piggybacking of lookup information
new 772e2a7 Fixed compilation error on jenkins
new 15f6d3a Simplified thread model for updates to the execution graph
new aadf6ce Implemented optimization to speed up resource assignment in large-scale setups
new 54c09d1 Changed test layout of queue scheduler to get it working on slow machines
new 5515b02 Implemented resource check during task deployment
new fa233cc Fixed bug in JobManager shutdown method
new be71d3e Added missing methods to MockEnvironment
new e216243 Fixed IT of sopremo server
new 5433cb3 Fixed sopremo client IT
new e615d2d Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new c899efa removed deprecated compiler hint
new 10e9d9d Test plan releases vertices properly now
new 02cf55d Changes to input format configurator (builder) pattern. Added pattern for output formats.
new 8806498 Forward fitted changes to Sopremo Packages.
new 57dd84d Reworking of FieldSet/List and properties.
new c68c67b Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1
new 0f9b29a Merge remote-tracking branch 'hpi/master'
new 7cf162e First part of optimizer reworking.
new 7c27790 Merge branch 'version02' of https://dev.stratosphere.eu/git/stage1 into version02
new ad3e6f3 Poost-merge adjustments.
new 8b3c4f1 Cleaned up accidental HDFS dependencies. Added commons-codec as dependency to nephele-common
new c0ac81c Extended Configuration for binary data. Fixed de/encoding problem in TaskConfig.
new 1221ddb Fixed builder pattern port
new afd49e2 Forward fit new config API to all examples
new 635f6ba Forward fit new config API to plans in pact-tests
new adf0aa0 Prototyped first version of input format configuration builder.
new 7467afe Temporarily made config keys public to make not adopted examples compile.
new d6e87cb Changes to input format configurator (builder) pattern. Added pattern for output formats.
new a0f09c7 Forward fit new config API to all examples
new e8f30d4 Forward fit new config API to plans in pact-tests
new 2aae64d Post rebase cleanup.
new 5b3dab3 Merged version02 into optimizer reworking.
new 66319bc Merge branch 'acb' into v2cbm
new 5b7f786 Fixed and renamed delimited input format test.
new 9805f39 Next steps in optimizer reworking
new 24d1a29 first working version of incremental iterations
new 2414e7f Reworking of cost estimation. Reworking of data properties.
new 51b4a24 Merge branch 'stage1_master' into version02_master_merge
new 62bd67c Plans do not reuse provided collections.
new 78f4e73 finished configuration options for workset iterations, polished code
new aeb473b Removed Jackson dependency from taskmanager classpath.
new efe660d Merge branch 'stage1_master' into v2_iter_merge
new c0d3fbd polishing
new 904819e polished code
new 5602949 Merge branch 'v2_iter_merge' into ssc-iterations
new 2b48a47 reworked configuration after merge
new 2dfa118 brute force method to fix cp issue of missing commons classes
new 30cd031 made JSON plan output more detailed.
new 614f172 reactivated deadlock resolver in PactCompiler
new 176d774 Merge branch 'master' of https://dev.stratosphere.eu/git/stage1 into version02
new 554041b Fixed bug #269. Adapted RecordInputFormat to forward configuration to FieldParsers and extended test case.
new d23c350 fixed broken BrokerTest
new 6cfbc89 Merge branch 'master' of https://dev.stratosphere.eu/git/hpi into hpi
new 09be0a8 Improved code style
new d2c7625 Temporarily disabled debug message due to problems with log4j configuration in tests
new e36fcb2 Improved robustness of default configuration
new b024fdb Removed dead code
new 3752d6e Fixed unit test
new 47c1493 Optimizer Refactoring continued. WARNING: Broken
new 540c89d Next steps in optimizer refactoring.
new 19fad42 Fixed #202
new 2cf88a2 Merge branch 'stage1_master' into ssc-iterations
new 50d8575 Strategy Refactoring Pact Record Post Pass (1st part)
new a27d614 Started to integrate new RPC service
new 817cad1 Continued to work on integration of new RPC service
new 5315547 Continued to work on new RPC service integration
new 84821a7 Changed RPC object serialization to Kryo
new 0e7b18b Started to implement support for data fragmentation
new dca2be0 PactRecordPostPass
new 84249fa Fixed bug in multi packet output stream and added unit tests
new 48ff703 Fixed bugs in serialization methods of Path and JobGraph
new 39dcf1b Fixed several bugs in new kryo-based RPC service
new 55b4670 Fixed bugs related to new RPC service
new d681783 Added support for multi-threaded RPC handlers
new f76fda8 iterative examples run on cluster now
new 7043a35 Optimizer Property Handling straightened.
new b61cb5e Improved serialization efficiency for basic RPC messages.
new b8e8a60 specialized logging for execution visualization
new 38ac27d Made a series of performance improvements to the RPC service and started to add java doc
new d5c648c Fixed unit test
new 48f8643 Simplified serialization of job graph
new 59ef7d5 Fixed bug in RPC service and improved thread-safety of some data types
new 83eb6db Fixed unit test
new ee12593 PageRank reuses PactRecords
new c51b05a underflow due to int constant for MEGABYTE
new 419a31a - Ported UnionITCase to contract builder pattern
new 294cc84 - fixed minor typos in inline documentation
new 8bc461c - updated version and documentation wiki URL in README files
new 0b0f224 polishing
new 3cd0ed7 towards repeatable hashjoins on constant data path
new 45708d7 Modified Nephele start scripts to include dependencies of new RPC service
new 23e0a1b Added generic versions of contracts.
new e0d24e8 Updated AWS dependencies
new e081089 Fixed problem with unit tests
new ca869a3 Changed instantiation of the RPC service
new 7037bc2 Removed SenderHintEvent mechanism in favor of new faster RPC service
new 202cf24 Adapted other usages of RPC services to new interface
new 2cd6cef Added missing types to list of RPC types
new 1cd3849 Added more missing types to list of RPC types
new 3c5d1f6 Modified profiling to work with new RPC service
new 326ebec Modified visualization to work with new RPC service
new 5d5bb5a disabled BroadcastRecordWriter
new 1e5b9cd fixed PageRank implementation
new 6ec57e8 Fixed error in calculation of buffer size for RPC requests
new 7153e4e Fixed various bugs related to new RPC service
new 38f335d Intermediate result size optimized version of WordCount.
new 1fae50d Added pointer (truncated long) method to mem segments. Normalized Key sorter has config parameter to set norm key len.
new 540d57d9 both pagerank versions working
new e9fbd7f Fixed Window Size Bug in Partial Sorter.
new 358697a Fixed Window Size Bug in Partial Sorter.
new e22be89 Refactored Comments and Optimizer for Generic Versions of the Contracts
new d1fe433 Merge branch 'wc_tune'
new d2f2157 Fixed NullPointer in LocalProperties.
new 171b78a Generic Plan Entry point into Optimizer. First portion of adopting two input nodes.
new 2340eb3 third version of PageRank
new 1d94736 Fixed default jar path in sopremo package manager
new f16e37d Changed command line syntax
new 313541d Made the default location of jars configurable
new b81dc69 Fixed formatting
new ecb9f4a Enhanced ArrayNodes
new e932d05 Enhanced type coercion
new aa3e502 Composite operators now return SopremoModule instead of ElementarySopremoModule to help optimization and remove duplicate code
new b82f6ad Generalized signature of setInputs in GenericDataSink
new a5c02d8 Fixed boolean coercion; made boolean constants immutable
new 9d157c0 Fixed resource warning of eclipse 4.2
new c0af3cc Changed signatures of modules from arrays to lists
new 631cf83 Added predicates utility class
new 04d235f Refactored GlobalEnumeration
new bd5e2fc Added temp variable factory
new 247d73a Removed superflous open in Selection#Implementation
new 27bc017 Removed generic return value from CoreFunctions#filter
new 8862c78 Added CachingArrayNode for more efficient string tokenization
new 6cba057 Added input cardinality to global enum; improved difference
new 7b7088d Added additional setter and ctors for Sink and SopremoTestPlan
new 1629f74 Fixed meteor import
new c2a6372 Refactored toString in Sopremo types
new 61fd0d1 Added add methods for container expressions
new f1a48ab Speeded up some CoreFunctions
new f8e0c49 Added option to switch between one time arrays and materialized arrays in reduce and cogroups
new 08a81a9 Made ExecutionGraph executor spawn only daemon threads as there is no cleanup mechanism yet
new edb1022 Made PactStrings appendable
new 65db94f Renamed TestPlanTest#Join to TestJoin to remove it from content assistent when you want a Join
new 14238ca Fixed global enumeration
new de367bb Fixed memory leak through anonymous thread factory in ExecutionGraph
new 73a0c1e Fixed memory leak through anonymous thread factory in ExecutionGraph
new 47a7e83 Fixed PactString#append
new 63a8f46 Made ExecutionExceptionHandler in TestPlans static to make the code more robust against resource leakage
new 06f432c Added (I)StreamArrayNode for reduces and cogroups; removed MultipassValues annotations -> user must copy the values manually to ArrayNodes
new 26ad595 Added StreamArrayNodes
new 6b7ad2c Refit base operators to IStreamArrayNodes
new 306087e Mocked local channels acquire buffers in a blocked fashion now
new 94eeb83 Fixed #273
new 331e813 Fixed CsvInputFormat for multi-part input files
new 121308f Refactored exception handling in dynamic method invocations
new 31ddc61 Fixed CachingList#clear
new e69530d SopremoServer checks request for formal validity
new 9d6b0f3 Continued refactoring of exception handling in reflective invocations
new 0509303 Added naive sampling data source
new c7f9129 Fixed ctor of ArrayNode thus tracing of Reduce and CoGroups
new 8ecdba6 Fixed RegexTokenizer
new 7cf8a82 Added null check to Defaultclient#submit
new 54b954c Enhanced deserialization methods of SopremoUtil
new 3e578d7 Added guava to sopremo-server script
new 207a9cf Merge remote-tracking branch 'hpi/master'
new c93e7d7 Moved bytebuffered channels to nephele-server package
new e740df9 Changed RecordSerializer interface
new 74e2c4d Worked on new record serialization
new 1fb7854 Implemented methods to efficiently serialize strings in default record serializer
new 0894ca6 Fixed javadoc
new 08889df Started to refactor Nephele channels
new c08199f Continued to work on Nephele channel refactoring
new 8c7f192 Made support for spanning records configurable
new 4763e83 Continued to work on channel refactoring
new 99db488 Continued to work on channel refactoring
new f5c82e8 Continued to work on channel refactoring
new ffcf4f6 Worked on refactoring of Nephele channels
new ca4fdb1 Merge branch 'stage1'
new eb7ddb0 Merge branch 'newrpc' into version021
new 5759493 Merge branch 'serializer' into version021
new 63a9cb1 Changed generation of IDs to improve thread-safety and save calls to random number generation
new 762ba71 Continued to adapt code to new serialization scheme
new 2e2134e Continued to work on new serialization scheme
new 9c58414 Continued to work on new serialization scheme
new 728d61a Continued to work on new serialization scheme
new 4f56ede Moved serialization related unit tests to server package
new 7ce0010 Added method to construct job ID from byte array
new 082a0ab Fixed serialization bug in AbstractJobVertex.java
new c7d8721 Fixed bug in RuntimeEnvironment.java
new dee6724 Fixed bug in new ObjectSerializer
new fcdb05f Fixed DefaultSerializerTest unit test
new dec7586 Removed deprecated unit tests
new 5366dc8 Changed interface of AllocationID
new e37feb0 Changed interfaces of GateID and SpillingQueueID and modified unit tests accordingly
new 0693c8d Removed unnecessary System.out.println in unit test
new f77e2f7 Added missing type to ServerTypeUtils
new 769ae6c Adoption of MatchNode to new optimizer.
new e3d3b14 Fixed deserialization problem in AbstractDeserializer
new 92e7da3 Fixed serialization bug in JobGraph.java
new ba3d4dd Adapted AbstractJobResult and child classes to new kryo serialization
new ae8b055 Changed record serializer back to old version to maintain compatibility with old unit tests
new 3d0762e Adapted PACT code to compensate missing IOReadableWritable interface
new 6d6a225 Adapted Sopremo code to compensate the missing IOReadableWritable interface
new c577f24 Removed IntegerRecord from RPC protocols
new 0a11cde Formatted POM files and changed version to 0.2.1
new da046fc Fixed problems with POM files
new 272e44a Updated log4j dependency
new 6438617 Cleaned up nephele-profiling project
new 9b5bb8d Fixed problem with nephele-profiling POM file
new 040f74b Removed duplicate Apache license notice
new 35b2f5d Introduced group state to reduce computational complexity on execution state changes
new c771352 Implemented UTF8 string encoding/decoding
new a4875c2 reworked convergence detection
new 36a7fb3 Fixed bug in DefaultRecordDeserializer
new 35bfb66 Refactored record (de)serializer tests
new 87c43e5 Fixed shutdown problem in job client
new 4b7cb93 Removed superfluous imports
new 01b6f39 Updated references to documentation on website
new 7cadf9f Added missing Stratosphere headers in Nephele packages
new 55247b1 Fixed some minor problems discovered by FindBugs
new 42d79fa Declared setBytes and getBytes of Configuration deprecated
new 7de4fdd Removed outdated references to IOReadableWritable interface
new e29bc5c Fixed some minor style problems
new 99ab99e Removed superfluous imports
new 350e89c Improved robustness of object serializer/deserializer
new 3790c42 Changed mechanism for connection retries
new a174a3c Updated plugins in master POM file to work with Maven 3 and get rid of warnings
new 45faeed Fixed various small style problems and potential bugs
new 910885f Removed deprecated class IOUtils
new cd0e5b3 Fixed small style problems and potential bugs
new 835188a Fixed potential race condition and memory leak in EventCollector
new ae69f41 Improved code quality
new e6ece05 Simplified multicast manager
new b562163 Added missing kryo jars to pact start scripts
new d8adb41 Refactored class names
new 1bae223 efficient workset iteration convergence
new 69b1a2d Improved coverage of transfer envelope deserializer test
new 9592b61 Updated dates in file headers
new fd9cfb3 Started to integrate statistics module into new RPC service
new 53585f3 Fixed potential race condition in RPC service
new e79fbca Runtime adoption to new operator model.
new 6d8214f Extended RPCServiceTest to detect duplicate calls on the application level
new bd31268 Performance optimization of the RPC service
new 3f3bd9c Further adoption of pact runtime.
new dd6b85a Worked on statistics collection for RPC service
new 4ffbb30 Added additional sanity check to RPC calls
new 750387f Changed fractionID from short to int to avoid collisions
new fa8c892 Added missing utility class
new 9feceee Add LocalPlanExecutor for quickly executing plans locally
new 7e3de5f incremental iterations work now
new 9de90fc Fixed critical bug which has caused duplicate calls of RPC method
new 1f84ad4 Added explicit signature check of RPC protocol interfaces
new 0df3494 Worked on handling of new InterruptedException for RPC calls
new 909ad2f Continued to work on handling of InterruptedException from new RPC service
new 6c9721d More modifications to RPC protocols
new 0f9096e Continued to incorperate RPC interface changes
new db927db Changed ProfilerImplProtocol interface to throw an InterruptedException
new 244f6b6 big refactoring, removed custom caching, nicer repeatable hashjoins
new c8a64a1 Added PactString#setValue(CharSequence, offset, len)
new 70c44fe Changed error message for uri file schemes to make it clearer
new 29423cb Added CharSequenceUtil
new e8b016b Changed TextNode signatures to CharSequence
new cbf99f7 Major refactoring of composite expressions: each expression must provide an iterator over its structure
new dcf9205 Adjusted base operators to the expression refactoring
new e48779e Tokenizer now work on CharSequences
new 7ba07dc Adjusted unit tests to expression refactorings
new 72a865e Meteor parser now gives more detailed descriptions and solutions to some syntax/semantic errors
new 1e7c2a2 Finished PactTask rewriting for new task model.
new c6a7da5 convergence criterion finally working
new 412a8b4 convergence criterion finally working
new d750ff0 Minor code style improvement
new 20ce93d Added missing types to ManagementTypeUtils
new 2cf655d Refactored aggregations; enhanced expression transformations; Added rewrite of grouping expressions to batch aggregation
new f5e70f3 Small improvements to sopremo-common
new ac1cb44 Adjusted sopremo base to last changes in sopremo common
new c4494bf Improved error specification of meteor scripts
new 1429274 Fixed test cases and pom.xml
new 2e7c738 Increased timeout and reduced logging of RPC service
new 39aa032 Made SpanningRecordSerializer the default choice again until bug in non-spanning serializer is fixed
new c341a9a fixed bug in event deserialization
new 5b13fe7 Fixed SopremoUtil#assertPlanEquals
new bcc6c42 Fixed MeteorTest#assertPlanEquals
new a3915d0 Incorporated rico's patch for lazy array projections
new cef2300 Adopted Runtime tests to new runtime.
new 1ddfd69 Set nephele-server logging level to WARN
new 675c1b4 Merge branch 'master' of https://dev.stratosphere.eu/git/arvid
new c5e33e5 Implemented equals/hashCode for FileInputSplit, removed unnecessary locking in input split provider
new 04b4adf towards compensations
new 2997a76 Fixed deserialization bug of Join
new 0a253f7 Fixed channel inversion for TwoSourceJoin
new 9d49009 Added missing node check for batch aggregation
new 04e71a6 Fixed deserialization bug of Boolean Nodes
new 72b5748 first compensations possible
new e5d2438 cleanup
new 037c991 Fixed FileLineReadWriteTest unit test
new 7d7dcbd Fixed problem in management graph test utilities
new 2ef259c Fixed #290
new 4e7c55e Fixed bug in recovery logic
new c74c6c4 Fixed problem in state transition logic
new e26170d Changed configuration implementation to use java concurrency classes instead of synchronized statement
new 79101ff Fixed critical bug in RuntimeEnvironment
new a0fb875 Started to refactored routing layer
new b85709c Continued to work on refactoring of network layer
new a12eb71 Started to refactor routing layer
new 01146e4 Refactored TransferEnvelopeReceiverList
new 36cbd33 Continued to refactor routing layer
new 91f0792 Added file missing from last commit
new cd1fd0e Continued refactoring
new c4a44d2 fixed errors if no convergence criterion is used
new 8bd989c Implemented convenience method to detect last envelope transfered through a channel
new 587c116 Fixed bug in EC2CloudManager
new 8e6b19f TaskManager profiler now sends instance profiling data even if no task is currently running
new 4273631 Reduced visibility of methods in profiling component
new b7517b2 Fixes possible deadlock in recovery logic
new f91ba58 Fixed problem with code style
new cb556f1 Removed deprecated class JobSubmissionException
new 1ef82a7 Refactored execution graph listeners
new 8228595 Changed Nephele setup in test cases
new 02591cc Made NetworkLayer and DefaultRoutingLayer regular objects again to avoid problems during unit tests
new eaac55d Fixed QueueScheduler unit test
new 24142a3 Fixed minor javadoc problems
new 0e6d8e2 Fixed bug in EC2CloudManager
new 44c4730 Fixed problem with S3 file system test
new 2c96be3 Fixed minor problems with unit tests
new f092d02 Merge branch 'stage1' into version021
new f4ad676 Increased allowed cancelling time in PACT cancelling tests necessary due to slight changes in Nephele's event delivery order
new 7e706bc Fixed problems with integration of new RPC service in Sopremo
new 453e5cb Cleaned up source code
new bda10f8 Reactivated reference tracking in kryo to avoid problems when serializing exceptions
new a9e32af Renamed NetworkLayer and RoutingLayer to NetworkService and RoutingService, respectively
new b73b840 Changed API of of local buffer pool owner
new 481fcb0 changed nightly build profile
new 6409932 server settings for auto deployment
new b4aad89 Fixed problem exception serialization problems
new a3f771f Merge branch 'stage1_version021' into version021
new 75dd60b Minor code reformat
new a00414b Added missing methods to DelegatingConfig.
new b44083f Merge branch 'al_021' into stage1_021
new b46e7fd Merged with Aljoscha, added LocalExecutor
new ee270d3 Merge branch 'stage1_021'
new b8011f7 Fixed Runtime Tests Fixed Common Delimited Input Format tests
new 6211bc3 driver property handling
new fd4f836 version of pagerank that can handle dangling nodes
new 85be580 compensatable pagerank that handles dangling nodes
new f21a3ce compensatable pagerank
new 0380935 Added two input node candidate enumeration.
new 0b28a5b Fixed enumeration / pruning for two-input contracts.
new a3aa07e Implemented Plan Dump as JSON for optimizer plans and Candidate plans.
new 6ce0b81 Implemened array data model.
new 5f283d3 Fixed Bug with incorrect output directory preparation.
new 3156bf1 Fixed serialization for array data model.
new 4e85e88 Fixed Optimizer DOP changes. Added test cases for optimizer DOP changes. Fixed Optimizer Branch Handling. Added Test Cases for Branch Handling.
new 32c775c Added union operator. Added handling of multiple sinks. Fixed branch handling. Added pipeline breaker insertion to prevent deadlocks.
new 3663b92 Picked Nephele Fix from ssc-iterations branch.
new 2a7d225 Synced pact-common and pact-compiler between iterations optimizer reworking and iterations runtime reworking.
new 77bb87d Synced pact examples and pact clients.
new a4fb411 Synced pact-tests between optimizer reworking and runtime reworking.
new 74c5bd1 Synced array-datamodel project between optimizer and runtime reworkings.
new 5b80a52 Merge iterations runtime code with iterations compiler code (1st part)
new b816c72 Extended possible TEMP modes for channels.
new f2c8d82 Compiler Iteration Support (Plan Creation, Static/Dynamic Paths, Interesting Properties).
new e2f2aa0 Finished compiler phase for bulk iterations (modulo post pass for PactRecord and the array data model) Fixed Bug in SingleInputNode data-property handling.
new 2a55a75 Implemented Compiler Post Pass for Bulk Iterations With Pact Record.
new dd1fae9 First part of adjusting runtime to compiler.
new a1d72ad Merged with ssc runtime for bulk iterations.
new d1ecc77 Temporarily moved the iterative playing files to another project to make the setup compilable.
new f28c286 Fixed compiler error in maven for TaskConfig.java
new 237d8f4 Moved iterative examples to a separatre project.
new 9d64696 Temporarily disabled archive packaging.
new 94d4803 Added stub and contract for reducer with key.
new fe40b95 Bulk Iterations finished.
new 4d688fc Fixed error during closing of delimited input format.
new 8b59af4 Fixed Bug concerning incorrect filtering of GlobalProperties.
new 7576c77 Added / extended tests for clustering, including iterative variant.
new 54f4bd0 Enabled proper canceling of iterative tasks. Merged Iteration Head now supported.
new 527686b Add DeNormalizableKey interface and fixed-length sorter
new bf327eb Workset Iteration Compiler, part 1
new 73137c2 Included resettable driver strategies Adopted ssc variant of dangling pagerank
new faf1456 Fixed memory leak in temp barrier.
new 4303a36 Added types and serializers/comparators for dangling pagerank.
new 5f58ce7 Applied ssc patch to improve stubs and input formats.
new 3fe087d Implemented dangling pagerank with generic data types.
new 9ff86bb Merge branch 'al-iterations' into iterations-al-merge
new 948abc4 Included fix-length record in-place sorter.
new eb2c6df Warning to indicate that in-place-sorter is not spilling ready.
new 1b77e69 Enabled spilling for fix-length in-place sorter.
new 2c97f5e Enabled synchronous combiner. Added combiner to custom dangling page rank.
new 11629af Fixed inefficiency and congestion in input channels.
new 0a4ef24 Changed interrupted checking in output channels from per-record to per-buffer.
new 8a98a0b Changed PactProgram to not instantiate plan multiple times. Removed obsolete reflection visitor. Cleaned up context checker.
new e068e32 Combiner filled with global and local properties.
new ea85759 Fixed bugs in JSON dump generator. Added tests for JSON dump generator.
new fad6d50 Fixed plan web display.
new b4135dc Adjusted cost heuristics / comparisons.
new 8fdd403 Changed type serializers / comparators from interfaces to abstract classed (faster virtual method lookups)
new e5050f6 Reworked Input formats for correct handling of cached statistics.
new cf7296b Reworked commons IO testing and added sampling test for the delimited input format.
new 7943cdd Extended tests for delimited input format.
new 4c1a87c Added extensive optimizer tests.
new f0ff109 Temp.
new 15feaff Extended and reworked optimizer tests.
new bbb00dd Extended compiler tests for K-Means. Fixed Cost formulas to properly distinguish between sorted, hashed, and arbitrary materialization.
new 2fd68f1 Stripped down stratosphere for ease of internal feature prototyping. - Excluded Sopremo / Meteor for now. - Excluded build-tools and EC2 scripts - Excluded buggy checkpointing tests in Nephele.
new 027179c Cleaned up pom.xml Small fix for pact runtime tests.
new ebad4bd Dropped SelfMatchTasks (currently not working and of low priority to fix). Fixed ChainedTaskTests in pact runtime. Repaired root pom.xml
new 21db751 Refactored Job Manager Execution Modes. Reworked Nephele Mini Cluster. Added Local Executor.
new 37d4afe Reworked Nephele Mini Cluster to start more reliably. Fixed Local Executor. Fixed Bug in Delimited Input Formats. Reworked KMeans tests (both single step and iterative).
new 36452ce Extended JSON Dumps for iterations.
new c74349e Reworked UDF annotations. Enumeration of incremental iteration plans complete.
new 6e48634 Excluded nephele EC2 project. Cleaned up POM files.
new 4d82d61 Introduced RuntimeContext for UDFs.
new 2ebd88e Initial commit
new ff59018 Fixed Test for Delimited Input Format.
new 64ea667 Adjusted smoe examples and fixed some tests. Temporarily disabled tests for global sorting, which is disabled for the time being.
new 11f44c4 Added tuple data type (experimental).
new d39a0ec Fixed Union in Optimizer Plan Enumeration. Fixed Cancelling tests.
new 0c07b8e Minor consistency fix in the pom files.
new 8dee02d Merge branch 'iterations' into ozone_master
new 57e84f7 fixes #11 : nephele-ec2cloudmanager dependency still in stratosphere-dist pom.xml
new ce0d789 Implemented generic aggregators for iterations in the API and configuration.
new 5de45a3 Added PactBoolean type.
new d7e4f59 Fixed aggregator registration for iteration tasks.
new fd8e676 Reworked examples. Implemented custom aggregators (runtime misses iteration head task)
new bfe554f Finished customizable aggregator implementation. Added DanglingPageRank example. Reworked iterative tests. Reduced logging verbosity for iterations (temporarily commented out monitoring facility for time tracing)
new 15a4365 Fixed Union Plan Enumeration. Fixed Branching Plan tests.
new 3e1c771 Fixed problems with merge only joins in iterations.
new 7ef29f3 Merge branch 'master' into iterations
new e0d4ca4 Added json verification to json generator tests.
new 1798455 Implemented pact plan visualization for bulk iterations.
new 61884ee Made sure that correct hash join strategy is used for operators joining with the solution set.
new 7671b33 Implemented optimizer plan post pass for workset iterations.
new 9624875 Fixed erroneous cluster mode instantiation.
new 68de91d Dropped erroneous test for faulty multicast channels.
new 88827e2 Hided not wanted elements in visualizatin of iteration pact plans
new 550798c Temporarily accellerated external-sorter tests.
new eb23527 unified white space renamed variables for gateIndexes
new d9434f9 added CHANGELOG wrote first entry in CHANGELOG
new cf530d3 Merge pull request #16 from mhuelfen/master
new aa89229 Maven POM file cleanups. Added missing primitive type wrappers. Adjusted API for ozone-scala.
new d6b58e1 Fixed various tests.
new dd2f437 Merge branch 'master' into ozone_master
new 07aba3c Implemented runntime for workset iterations.
new fff0171 Fixed shutdown logic in task unit tests.
new 71d6f25 Fixed port conflicts between unit tests and running nephele instantces.
new 33f0629 Implemented JobGraph generation for Workset Iterations.
new efbdfc0 Reworked compiler post pass to be generic for all flat record models.
new c354c88 Update pom.xml
new 50b39a0 Merge pull request #29 from aalexandrov/patch-1
new e62e402 Implemented reopenable hash join.
new 06ef780 Fixed startup scripts to include extended hadoop dependencies in the classpath.
new abed9be Extended comments in nephele config file.
new 217286b Minor cleanup and corrections in API classes.
new 376156e Fixed webfrontend plan display for workset iterations.
new cf90104 Split pact-compiler project between compiler and its unit tests and the compiler end-to-end tests with example programs.
new 6c39b50 Merged pull request #35 (salting hashes for multi-column keys)
new d720592 Fixed hash join tests with after salting hashes.
new 57fdfaf Fixed dependencies of pact compiler tests.
new 8ac958e KMeans example point input format parses negative numbers.
new 75502d8 Disabled recovery by default.
new a576272 New kmeans data generator.
new 8a3eb95 Made sure user code class loaders are used for cloading user code classes.
new 7e3b912 Implemented CoGroup join with solution set.
new 38a35c4 Cleaned up connected components example and tests.
new 7631654 Fixed bug in pact-record-output-emitter partitioner.
new e8fd584 Fixed class loading during transmission of user-defined aggregators through the iteration events.
new 67ff06d Minor cleanup in examples.
new e6f8817 Fixed WorksetCoGroup Tests.
new b407f8b Cloudera distribution of hadoop added as default dependency. Separated classpaths for cluster and clients.
new 4cd5474 added travis yml
new 338e24f Merge pull request #52 from rmetzger/gith_ozone_travis_integration
new 5ee6266 Ensured proper setup of logging framework in system integration tests.
new 29eeb33 Fixed bug where test temp files were not cleaned up.
new b152872 Iteration head tasks are not merged with first operator in superstep, if there is a local strategy that needs to be executed directly prior to the first superstep.
new 35ff4dc Updated Maven artifacts version to 0.2-ozone. Allows deploying Ozone to a local repository next to a vanilla Stratosphere distribution.
new 0540148 fixed: ArrayIndexOutOfBoundsException when reading test input > 32KB
new 4542555 fixed: multiplexing deadlock
new 42cdca4 re-openable hashjoin integration test
new ea720e0 Changed memory segment to use "unsafe" (native) memory accesses.
new 82eda24 Mapped normalized key comparisons and record swapping in sorters to memory segment operations.
new 624cb64 Fixed erroneous normalized key generation in PactCharacter.
new 7efa33c Removed obsolete denormalizable key types.
new c310f4c Added bulk copy methods to memory segment.
new e892cbb Updated bulk get/put methods in memory segment in support of unified nephele/pact memory buffers.
new a452fd4 Fix config and start scripts to work on Windows/cygwin
new 63d30a0 Adjusted cygwin path conversion for path lists.
new f80ad30 Fixed bad assembly of dropin libs in the stratosphere-bin shell scripts.
new 9eafabd Revert "Adjusted cygwin path conversion for path lists."
new 8420997 Revert "Fix config and start scripts to work on Windows/cygwin"
new 5ad8c66 Fix config and start scripts to work on Windows/cygwin
new e4a2725 Merge pull request #60 from aljoscha/master
new 20164cc Merge pull request #59 from aalexandrov/fix_dropin_libs
new 5bf8efc added test case to verify input format bug
new 6de3f2a Fixed failing TextInputFormatTest
new 509a717 Backported ID Methods from 0.2.1
new 942a623 Generified binary and sequential i/o formats
new f0d6dfa Generalized methods in format utils
new 8a509ba Fixed incorrect handling of generic formats in data sink tasks
new fae50fc Fixed local instance manager live lock during shutdown
new f3be324 Generified generic data sink ctor
new b1a5c40 Fixed generics in FormatUtil
new b900a97 Decreased waiting times in IPC Client to speed up LocalExecutor
new 51974d5 Made PactString appendable
new 242c704 Added contract util for generic contract manipulation
new 0f28095 Fixed bug in PactString append.
new d5f86db Merge pull request #62 from rmetzger/gith_input_format_bug
new 88d7305 added test case (without fix) for a pact compiler bug with ALL_GROUP-reducer.
new b8d213d Implemented AllReduce.
new bc09753 Cleaned up warnings in pact-common.
new 261baf1 Created Debian Package for Ozone install (Pull request by Christian Richter)
new 83d6617 Changed to snapshot version; added maven repository for deployment
new 3e01501 Added automatic deployment to sonatype repo with travis
new 8f74840 Added HBase table formats (patch by Marcus, slightly adjusted).
new 59caef9 Updated Contributors list.
new b394c0b removed the FileBuffer from Nephele, and everything that uses it (Checkpointing, FileChannels)
new f09a609 Reduced test logging verbosity to only print warn messages.
new aca4323 Fixed classloader delegation of task conf
new 202e198 Added maven-profiles to enable switching between yarn and non-yarn hadoop
new 238f2ed Remove pact-examples dependency in pact-clients.
new c3d9b77 First part of fix to exclude pact-hbase when hadoop v1 is used
new b96d410 Added extra profile entries in the pom.xml files in order to fix the hadoop_v1 compilation problems.
new 3dcf89e Merge pull request #1 from aalexandrov/hadoop-maven-profiles
new f2a96a2 Made the hadoop_v1 profile active by default.
new b9504be Moved hadoop.version property to the profiles.
new 8f1f8e3 Update README.md
new 2b731f8 Update Readme.md with project overview and a little tutorial.
new 1734ec9 Merge pull request #85 from rmetzger/gith_readme
new a346a5f Update README.md
new 967a6e2 Update README.md
new 8a0a351 Rename SetId() to setId() Hopefully fixed a bug in the pact compiler for branching plans: - added a test case provided by Anja Kunkel from HU Berlin - my understanding of the bug is the following: During a check if additional pipeline breakers are necessary, the compiler checks for the LocalStrategy of a SinkJoinerPlan. The SinkJoinerPlan is a "fake" plan element to group multiple output sinks into one sink (the compiler assumes one root node, this is why a "fake" pla [...]
new 2320de6 Merge pull request #2 from aalexandrov/hadoop-maven-profiles
new d1b2979 Update README.md
new acb0416 Fix for a null pointer exception in new memory buffer
new 7c24622 Merge pull request #70 from carabolic/master
new 9964e80 Travis build matrix for different profiles
new c620943 Merge branch 'andrehacker-hadoop-maven-profiles'
new 44a21f8 1) Fixed problem where commons-io jar file was missing in the lib directory 2) Fixed wrong maven group definition of commons-io (changed from org.apache.commons to commons-io) and updated to a more recent version (same as hadoop)
new c1c94c7 Use wildcards to exclude all jetty artifacts
new 601b5ec Merge pull request #92 from andrehacker/ozone_lib_fix
new 16a23e1 Fixed nephele-config.sh substr command calls on OS X (closes #88)
new bf93703 Fixed bug. stub.open() was not called for COMBININGSORT local strategy.
new 5dc4dd2 Merge pull request #97 from fhueske/master
new 3405955 Links to documentation, typos in README
new 9ccf705 Merge pull request #96 from uce/fix/nephele_config_script_os_x
new fc4c4e6 Added ALL_GROUP strategy to PlanJSONDumpGenerator. Before this fix the pact web could not show the plan.
new 389bb0c Merge pull request #105 from andrehacker/fix_web_all_group
new a8f66c5 FileInputFormat.acceptFile() to filter out files and directories while creating input splits (like _log or _SUCCESS)
new 60026c8 1) Changed profile activation to properties (like hbase) 2) moved all properties to top of pom 3) moved module list to top of pom
new 0b9b66f Remove unused exclude-statements in assembly-descriptor (exclude elements can only define artifacts, not paths)
new f2d8958 Added hbase inspired script to generate poms for hadoop1 and hadoop2 (yarn)
new c2fcda6 Added relative path to all poms
new 7b40c87 Travis support for new profiles, readme, comments in script
new 82ef933 Removed TeraSort from example jars when packaging
new cd31327 Merge pull request #102 from uce/remove_terasort_from_build
new 831975d Merge pull request #111 from rmetzger/gith_andre_new_profiles
new e9a9dac Mailing list link in README
new 29e2fa3 Improved readme
new 63d45f4 Merge pull request #89 from rmetzger/gith_compiler_bug2
new 3b49607 Make PartialSolutionHolder non-final in BulkIteration
new 1b9fa7f Make the placeholders in WorksetIteration non-final
new bbc8288 Add support for passing objects to PACT contracts
new 14970c9 Merge pull request #73 from aljoscha/master
new bbfbc4b Merge branch 'master' of github.com:AHeise/ozone into AHeise-master
new fdd5bde travis fix
new 395f7b6 Add an example of using LocalExecutor in WordCount example
new a6a0a75 Merge pull request #121 from aljoscha/master
new e813c93 travis: add script to deploy both versions of ozone to sonatype
new c014688 typo in travis config
new eb79774 Merge pull request #108 from rmetzger/gith_input_format_filter
new bf8b2ac Generate source attachments for each subproject
new 8dca859 Add methods to get optimized plan from LocalExecutor
new 1dbf7ab Merge pull request #129 from uce/add_plan_dump_to_local_executor
new 717872b Merge pull request #126 from rmetzger/gith_maven_sources
new 09012c0 remove maven source plugin from 'nephele.pom'
new 380fa6e Add scala code to mainline
new 7fd44a8 Merge pull request #135 from aljoscha/add-scala-frontend
new b39814b Update path to stratosphere-dist folder in README.md
new 0e53fe5 Fixed translation bug where solution set was first input to the join.
new a33e1a3 Fixed concurrent modification in memory release.
new 921278e Removed Nephele plugins
new 0ddbd09 Fixed erroneous execution graph test.
new 5fa815a Updated maven surefire plugin version.
new 37c3b03 Added first version of Scala example jobs for triangle enumeration
new 95beea4 Fix bug with user-code wrappers
new e777ee6 Merge pull request #155 from aljoscha/user-code-loader-bugfix
new 431bfe7 Don't create empty splits in BinaryInputFormat#createInputSplits on one input file.
new d2dfc95 BinaryInputFormat#createInputSplits on one input file test added.
new 4950f1e Avoid invalid ranges in BinaryInputFormat#createInputSplits while creating empty splits. (HDFS doesn't like invalid ranges and returns an empty array in this case)
new 0f60183 Update README.md
new 1338fd6 Update project name in maven poms and readme
new 8231901 Fix bug in UDTAnalyzer
new 45e647a Fix bug in Scala serialization code generation
new 8508ed1 Added test cases for Java triangle enumeration example jobs
new d73e058 Scala triangle enumeration examples behave like their Java counterparts
new 526a869 Merge pull request #161 from aljoscha/serializer-fixes
new c583dc0 added tests for Scala triangle enumeration examples
new d045808 Merge branch 'master' into scalaTriangleEnum
new ef156bf Scala triangle enumeration examples follow the implementation of their Java counterparts.
new 221988c Merge branch 'master' into scalaTriangleEnum
new b471450 Changed triangle enumeration scala jobs to scala class instead of object
new f03fa9b Integration tests for triangle enumeration scala examples working
new 314d6cc Merge pull request #153 from fhueske/scalaTriangleEnum
new 38ad732 added getUserCodeClass to UserCodeWrapper
new 2bdf901 Merge pull request #167 from mleich/usercodewrapper
new 522da8a Put dependencies in pact-scala in the right places
new 0379fce Fixup the rest off the scala examples and add Integration Tests
new 8c46f5e Merge pull request #166 from aljoscha/fixup-scala-examples
new b6b335f Update README.md
new e51d6a3 Added local strategy SORT to DataSinkTask and extended DataSinkTaskTest correspondingly
new 95beeb3 Update commons-io artifact to same version as everywhere else.
new 7e0cebf Unified config and added YAML (syntax) support (#113)
new 02ff480 Improve pom-tooling scripts
new 56bce6e Added early checks against invalid null inputs to contracts.
new 21bcc0a Reqorked branch handling method in sink joiner to report when a disjoint data flow graph is found.
new 077dd43 Add filter on Join and Cross in scala frontend
new a572ff8 Merge pull request #174 from aljoscha/filter-on-match-and-cross
new a7035df Updated Readme to specify that Maven 3 is required.
new 3cf20cf Update README.md with required plugins for eclipse 3.7
new 2d44c7d Change name in base pom and version
new 0d82ed2 Changed branch handling logic to correctly recognize disjoint data flow graphs, rather then erroring out.
new 6dcf74f Fixed erroneous costs handling in sink joiner.
new b0ceb7e Fixed wrong URL of quickstart script in README file. [ci skip]
new a7d9660 Fix stratosphere-dist to include the scala jars
new 5bc7935 Remove ozone from readme [ci skip]
new 03c481a Merge pull request #179 from aljoscha/fix-scala-jars
new b117cbf Rename hadoopReduce -> groupReduce
new 680dfb4 Fixed problems with scripts and default config
new acb9c6b Added toString() methods to configuration and task classed to ease debugging.
new eec2840 prevent chained tasks in the iteration tail for now.
new 3746507 Fixed Stratosphere Website link (relative relative to absolute link)
new a41560f Change scala KMeans now that map as last op in interation works
new 1228a5e Reworked input channels with respect to returning events and buffers. Simplified logic and fixed bugs and reduced number of status polls. Reworked record readers to properly support unions and events.
new ebba4fd Fixed Nephele Visualization job selection not working on Mac OS X
new 83e209b Fixed and extended comments in WorksetConnectedComponents example. [ci skip]
new 08a9e76 fixed: PactRecord allocating too few memory when writing UTF encoded strings
new 9fef277 Upload builds as tgz and as directory to DOPA server
new 463d499 Fix stratosphere-dist: Some really outdated README's removed. The README and LICENCE were not copied to the build.
new 119a023 Fixed overly restrictive condition to identify disjoint plans.
new d5497cb Rename groupReduce -> reduceGroup, add reduce/reduceAll on DataStream
new 0ea6126 Moved pact-compiler-tests from individual project into pact-tests.
new fba6e15 Move plan checking from PactProgram to Client
new b03cef2 Change Client to accept new PlanWithJars instead of PactProgram
new 6dd6ec5 Change Client to return job runtime if called with wait=true
new fe50597 Add PlanExecutor interface and RemoteExecutor
new b53656b Merge pull request #195 from aljoscha/remote-executor-feature
new b8dc74d Remove comment from TransitiveClosureNaive scala example
new 4b89a25 updated CONTRIBUTORS file
new dddcac1 Merge pull request #200 from fhueske/updateContribFile
new 79e5463 Added weblog analysis Scala example and corresponding integration test.
new c60c7a2 Merge pull request #204 from fhueske/weblogScalaExample
new f941a6d Add union input test (issue #192)
new 8a15cae Add warning in nephele-config.sh that the values are only defaults
new 31dbfe6 Prevent operator chaining directly after iteration nodes.
new b08240d Fix NepheleJobGraphGenerator bug with iterations
new 9f227b2 Use JAVA_RUN in all start scripts [ci skip]
new d149850 Added test case to check compiler with plans branching directly after a loop.
new 633e3e6 Implemented ordering within groups in optimizer. Added tests. Cleaned up property matching/reasoning for dual input operators.
new 361e469 Remove IPv4 Stack Hint [ci skip]
new 3331a3e Maven requirements [ci skip]
new b2af1d9 Cleaned up wordcount examples.
new 2a00bc3 Re added accidentally lost WordCountArrayTuples example.
new 159088d Improved handling of probelm causes and better error messages when connecting to HDFS for hdfs resident files.
new a890498 Fix1: Combiner gets same DOP and SubtasksPerInstance as its input to be chainable Fix2: Local strategy of stand-alone (non-chained) combine driver Adapted CombineTask tests to new local strategy
new 80551cb Fixed instantiation of utility combine node to use the correct properties.
new bb5d770 Fix for Issue #93: slaves file requires blank line at end (otherwise last slave won't be started)
new 0f5440d change deploy tool to detect current stratosphere version and dynamically generate the yarn build
new 5313c67 Fixed typo in method name
new 253a735 Removed unnecessary import from RequestedLocalProperties.
new 24d97ca Small fix in PactRecordComparator
new 0407a74 Reenabled range partitioning with manually specified data distributions. - Added Generics to DataDistribution - Added range partitioning to output emitter - Adapted output emitter tests - Added PactRecordDataDistribution and corresponding test - Reactivated pact tests with range distribution. - Reincluded TeraSort Pact Java example into example jobs.
new 5278efc Merge pull request #223 from rmetzger/fix_deploy_tool
new 55bfa06 Hotfixing version detection Add renaming utility to master branch
new eed09f0 Simplified DataDistribution. For now, compatibility of DataDistribution and global sort order is not checked. The DataDistribution must be correctly specified on ALL keys of the sort order. Checks will be added later.
new 8b8ae7f Show version and git revision on JobManager startup (in log) Place .version.property file into root directory of the build.
new 1096d71 Dump pact plan as json, using the local executor
new 4285102e Added extra versions of the Cross contract that determine which side should be broadcastet and how to pisk the local strategies.
new 1eb4f7d Information Webfrontend for JobManager
new f3db2bc Eliminated redundant copies in log file streaming. Minor cleanups.
new 225dce0 Added constants for true and false to PactBoolean
new 34d20cc Runtime client prints original description without HTML preprocessing.
new a544e44 Removed defunct program description HTML preprocessing code.
new 99602f9 Used intrincis opertations for primitives construction in pact record.
new 79ad2cb Fixed web frontend startup script to properly redirect standard streams.
new d7cb6b7 Added redirection to job manager info frontend int the pact compiler web frontend.
new 62c70b6 Reworked text parser to propery work with quoted strings.
new a91802d Cleanup of test logging and some comments.
new c127194 Cleaned parsers and reworked double parser to go through Java's parsing logic (which is object heavy, but precise) until we have a precise parser.
new 343a158 Added small introductory text about stratosphere to the readme.
new 0c1dee0 move logVersionInformation() method to main() method
new c92f790 exclude jruby-complete from hbase.
new a8228ce Cleanup of main pom; generate javadocs
new 58e88f6 Merge branch 'version_information' of https://github.com/rmetzger/stratosphere into version
new eb3bb86 Added version properties file to be ignored by git
new 77e2087 Added default logging to job manager (when started from within IDE). Failure to start web info server does not terminate job manager.
new 36aabd4 Fixed initialization of runtime context in combiners.
new 6f9bcee Change how DataSourceFormat is handled internally
new e065c37 Add implicit generation of UDT[T]
new 3dd51fc Change DataSinkFormat to also allow easy implemention of custom formats
new a02f070 Change scala version to 2.10.3
new 9525793 disable uploading 'stratosphere-dist' to dopa server
new 24f6581 Maven and build changes - use "build" profile of maven, to avoid any download progress information - Reduce logging verbosity of javadoc-plugin - instruct maven-eclipse-plugin to download sources (so that users can debug through our code without actively downloading the code) - Remove warnings in eclipse from the new git-commit-id maven plugin
new 0aa2a21 hopefully fix bug with version detection using maven for yarn deployment to sonatype
new d9549cc Improve deployment on travis
new 710b12a CSV Parsers fail on inputs that cannot be parsed instead of silently ignoring the lines.
new dff76e1 Changed default testing log verbosity for TestBase.
new cfb20f9 Fixes #242. Excludes nephele-examples, pact-examples, and pact-scala-examples from distribution lib folder
new ce740b8 Fix and spell correct version change script.
new cbfc5c2 Add support for using arbitrary Pact Value classes in scala frontend
new fd48f0e Add link to starter jobs
new 9157b29 LocalDistributedExecutor: Execute Nephele in CLUSTER-mode mode, with multiple TaskManagers in one JVM. The datatransfer happens over the OS network stack, not through memory channels
new fd9520a Rename multiple Scala classes: - DataStream to DataSet - DataSourceFormat -> *InputFormat - DataSinkFormat -> *OutputFormat
new 1edf660 Manually configured JAVA_HOME is preferred over system configuration. No default JAVA_HOME is used. Instead an error message is shown. Adresses #207 Added use of default java command as third option (after stratosphere-conf.yaml and JAVA_HOME).
new 80660c6 PactProgram and PlanWithJar create proper user code class loaders.
new 385c0be Resolve issue with hardcoded "file://" URIs under windows Relocation of constructTestPath and constructTestURI methods to Path
new 4501f80 Fixed check for local file scheme in TestBase2.
new 7402996 Added stubs for count function and counting reducer Added word count example using the counting of group elements.
new eeae687 Added IT Case for count() agrgegation function.
new 91f7d16 Minor changes in RemoteExecutor.java and LocalExecutor.java. Removed obsolete null-value check in the finally clauses in LocalExecutor.java. Returning proper exit code in RemoteExecutor.java.
new 6cdc38b Rename Record*Format to Csv*Format in scala frontend
new feddc18 Adjusted test to new output format names.
new a8d6368 Name escaping for jobmanager webfrontend
new 3fff141 throw exception instead of return max dop of 1 one IOException (from file system/hdfs)
new 945a3c6 Extracted OS detection into separate class. Reworked hardware configuration factory.
new 5d60a30 Updated Readme.
new bed28cb Simplified Java quickstart skeleton.
new 7330dc7 Move TPCH3 IT case from TestBase to TestBase2
new 41a11f2 Fix global/local schema stuff and workset iterations
new 9dd4635 CsvFormat configurable via regular parameters. CsvFormat generic (independent of PactRecord) Additional parsers. Examples partially ported to configuration via parameters (rather than confog strings).
new 6820a1e New maven project "stratosphere-addons". It contains code maintained by the project. (Most of them have a lot of dependencies and are not required by most users) Move pact-array-datamodel to stratosphere-addons Move pact-hbase to stratosphere-addons
new 5a3fe6c Move hbase example to hbase-addon project
new 23dcf4f Moved array datamodel dependencies.
new 70eca7d Change assigning of fields in CsvInputFormat to correctly omit
new a1aae7a Fix GlobalSchemaGenerator
new effdbb0 Re-add combinable reduce in scala, consolidate implementations
new 817b4ec Rename all the custom DataStreamS to DataSet
new 175df97 Extends Java csv input format to accept field indices
new 2d7801d Add indices support in scala csv input format
new 14a6cb9 Fix some log/debugging output
new cad8b4e Refactor Scala data input/output formats
new b44349e fixed TableInputFormat returns no records when re-opened with a new split
new 38725c7 Added static utility serialization and deserialization methods to PactString for custom data types.
new c61bc99 Added unsplittable behavior to input formats via marker interface UnsplittableInput.
new cf9fad8 Proper open/close handling of combine stubs in combining sorter. Combine stubs are lazily initialized upon spilling. Adjusted combining sorter test cases.
new 404f656 Updated contributors.
new 39ddc96d Added cobertura Maven plugin for test coverage report generation
new 4d73ef0 Added JDBC Input Formant and tests.
new 25aa028 Fixed serialization warnings. Marked transient fields. Minor formattings.
new 84e2941 Adjusted JDBC example to use internal derby DB for better debugging support.
new 6ee987f Added DefaultInputSplitAssigner as default fallback for GenericInputSplit.
new 3e0d974 Fixed handling of unsplittable inputs and added sanity checks.
new c10ab7f Removed redundant split generation in JDBC format after fixing unsplittabel input behavior.
new 29e67ae Merge JobManager Webinterface
new 1626523 FileInputFormat builder accepts GenericDataSources.
new a7b305c Extended UniformPactRecordGenerator to produce keys and values starting at an offset
new 1a527af Extended DataSinkTask to support union input and added corresponding test case and integration test.
new 9a1ce54 Fix typo in serialization method name.
new f2657cc Add Pregelsphere
new 9306beb Executor services use daemon threads which prevents lingering threads at job end.
new aacb734 Make 'closed' status in hash join atomic to prevent multiple concurrent closing.
new 9188abb Added missing googleapi
new 7b0c53b Fix concurrent memory release in HashJoin cancel case. Minor formattings.
new 2dd2cb7 Add "stratosphere-yarn" sub-project
new 28780d4 generate debian package for dopa; new configuration parameter for yarn client to create default yaml
new 8114f64 move yarn to separate profile to disable it individually
new 53bb5bd Implement superstep abstraction on Nephele readers/writers. Cleanup Nephele readers/writers.
new 6a18692 Relieve 1. travis worker by deploying only one version to sonatype
new 696c8fe Rename Pregelsphere to Spargel
new c7febc1 Make all scala rich stubs have apply method instead of specific name
new 3ec7cae Add deferred updates to workset iterations (issue #21) and fix chaining of iteration state updates (issue #123)
new 3c6713a Formatting and minor cleanups in iteration code.
new a6cbd94 remove discoveryManager
new 1366203 Updated Nephele task names. - Names have prefix of Pact contract (Map, Red, Cmb, Mat, Crs, CGp, ...) - All chained tasks are added to name of chain parent
new 02f6328 yarn now also starts the web interface extended pact-client to nicely support remote execution.
new 0616800 unified 'run' and 'remote' in pact-client
new 5facf2f Fix issue of selecting wrong class loader in combiners.
new edd3da1 fix minor build issue: deploy uber-jar only if yarn version is build
new 9a36178 Allow empty paths in FileInputFormat to fix a problem with the job preview
new b7053ed Optimizer handles deferred solution set updates.
new dbd97b8 Clean hash join shutdown on cancel case.
new da46afa Reduced test logging verbosity.
new 962a8b5 Fixed accidentally committed log level change in local executor.
new f73c583 Job Graph Generator and Optimizer logic for generalized iterations.
new cfad3eb Adapted iteration tests to modified parameters.
new cfd0ac3 Fixed all JavaDoc warnings in pact-common. Added and updated some documentation on the way.
new 5efd241 Simple batch scripts to run stratosphere under windows
new 22e5179 Extended task names
new 25c6b89 Merge branch 'taskNames' of https://github.com/fhueske/stratosphere into fabian
new a4b1dbd Added integration test case for AllReducer and iterations
new 7922332 Adjusted DataDistribution for key[] based bucket boundaries.
new 039c082 Add ClosureCleaner
new aa5c8c5 Implemented accumulators
new 761c20a Merge accumulators and minor cleanups.
new 0ad1dcc Added stubs for reorganized projects.
new 33cb2ca Reorganized basic project structures. No renamings yet.
new ea879a8 Fix ASM library version conflict.
new 83aa557 Fix assembly to correctly package webserver docs.
new eb8c49e Removed old dependencies.
new fc6b516 Renamed packages in stratosphere-core.
new 1541ac3 Fix JobManager IPC class instantiation.
new f3d14f0 Fix clustermanager test.
new 4aa2499 Renaming on projects -clients, -compiler, -examples. Minor cleanups.
new f1cd620 Renamed scripts in stratosphere_home/bin
new 8cc2052 Added delta page rank example.
new a9b9ae1 Correctly extract the workset flag from the configuration.
new eecdb83 Minor cleanups related to delta pagerank example.
new 6b2f3dc Renamed programs & plans.
new d18e0bc Cleaned up test packages.
new f76231c Remove non-javadoc comments
new 82c79da Added and unified Apache License headers in all files.
new 54bb2de Adjust deb package to new names and scripts
new 1e2497b Cleaned up sysouts and apache headers in shell scripts
new b3b0fb6 Cleaned up configuration parameters.
new 7ec6f6b Update README.md
new ac472ce Job remains Plan for easier migration.
new c955839 Renamed functions and operators in the Scala API. Cleaned up some examples.
new cc5840f Fixed example jar assembly.
new e3aff46 Rename former PactRecord and Pact* core types to Record and *Value
new 4199a83 Cleaned up delta page rank example and added test case.
new eb00496 Change namespace for scala api.
new 51563c3 Rename Sequential In/Out Formats to Serialized*Format
new 79496c0 Name cleanups on core api.
new e632ef0 Unify java and record project. Removed api suffix from projects.
new 167bc93 Java pi and record api namespace unified. WorksetIteration changed to DeltaIteration.
new 6c39736 fix hdfs for hadoop 2.2 fix yarn copyright adopted hadoop configuration for hadoop 2.2.0
new 9743895 fixed stratosphere-client's classpath
new 781711d added debugging msgs to yarn, changed ajax requests to relative paths
new 6664c73 Change version to release candidate 1 (rc1)
new 9282465 Fix ScalaPostPass Fixed doc warnings for MemorySegment
new cf4fb95 Removed PACT from log messages.
new 2d2853c Remove obsolete broadcast job.
new 5e1853b Remove all '@author' tags (apache style)
new 727c9c0 prepare release to maven central: release profile fake javadocs for scala examples travis: deploy only SNAPSHOT to sonatype
new 0cc4b61 Fix warning in scala-examples pom Update NOTICE.txt
new 92272ed Replaced ozone by stratosphere in contributers file
new 0486867 Fixed name in contributors file
new ffcb8d5 #339: JDBC tests do not create derby.log file
new 5910863 Merge pull request #358 from fhueske/updateContribs
new 76f4b2b Merge pull request #357 from fhueske/avoidDerbyLog
new 00a8eb9 Remove term PACT from CLI messages
new 5d3e686 Config directory is read correctly in CLI client.
new 52de6c1 Update documentation reference in the README.md
new 9c781ec2 CLI Client prints progress messages.
new 5d7a87d Fixed distributed filesystem instantiation.
new 1d69354 Corrected error messages for PackagedProgram
new eebfac8 Improvements on hdfs initialization error messages.
new b0974ef Update README.md
new 4aa4d10 Excluded sources jar from the examples assembly.
new 7eab75c Fixed Connected Components Scala Example.
new 2b4c538 Deactivated closure cleaner due to class loading problems.
new 30fab79 #360: updated CLI client help text after renaming
new e067e95 Merge pull request #365 from fhueske/updateCliClientHelp
new e5d1fed Deploy snapshots and release binaries to amazon s3
new 092a868 Fixed typo in EventCollector to correctly remove failed jobs from recentJobs list
new f3c667f Merge pull request #375 from markus-h/webinterface_failed_jobs-pr
new 1344d34 Changed version to 0.4
new ff7fe0b Changed version to 0.5-SNAPSHOT
new 0572f4f Applied version changes to all pom files.
new c38c68e Renamed 'match' in functions to 'join'.
new 84d613f Fixed bug in web-client.
new ea64262 Rename FilterStub to FilterFunction
new 066e454 Clean up bytes to memory pages computations. Fix number overflow errors for very large memory sizes.
new 6fe6693 Clean up destriptions and log/web display names.
new 412bcc3 Polling for jobmanager webinterface
new 95882e2 Created 'avro' addons subproject Added 'AvroInputFormat' with test.
new d609ead Avro complex types (array, map, enum) implemented
new a96bf0d Undo eclipse formatting in avro if disable javadocs gen when java6 is being used.
new bdd378c Add shutdown method to LocalDistributedExecutor and remove failing CustomDataTypeTest => the removed test functionality will be included in an upcoming test by @aljoscha
new 418fb21 Fix bug in scala cogroup.flatMap
new 3b682a9 Set LocalExecutor logging to INFO; print runtime. reduce logging verbosity of IPC server
new 43ba3b7 implemented jdbcoutputformat
new d1b47f6 moved jdbc into new project, adjusted for 0.5
new cb30f7a renamed jdbc package properly to the new 0.4 naming conventions
new 18f9bd7 added batch interval to jdbc; fixed issue with jdbc test cases
new b084029 Polling for jobmanager webinterface
new 0596773 Paths in windows scripts enclosed in double quotes
new e8194b0 Merge branch 'webinterface_autoupdate_newrelease-pr' of https://github.com/markus-h/stratosphere into webfix
new 6c7c8b4 Fix bug that incorrectly marked iterative tasks.
new 04e5dcd Added standalone plan visualizer tool.
new 332a2fa Add LineRank as test case.
new e36b05e Add Scala Page Rank examples
new d7ed899 Fixed ExecutionGraphTest. Test output files are removed. Reduced log level to WARN.
new 6eb306a Add constructors with degree of parallelism argument to Plan (issue #426)
new 0d43d8f Improve error message when no match is found in solution set join (issue #429)
new eedfe1e Add check whether group is empty in scala reduce operator
new a7fbbc9 Reenable ClosureCleaner and add new Test case for everything
new bf76637 removeField method in Record class
new b7217d3 Adding comments to removeField and uncommenting its test method
new 080ed98 create basic project structure
new 1ff8d1c Initial Raw test impelementation of Hadoop Input Formats capability
new 187d833 Code restructure
new d8fb870 Some refinements on the hadoop input format
new 5a242f7 Added convenience constructor to RemoteExecutor
new 85020f8 Reorganized .gitignore.
new 24df201 quick fix for build error
new 930b064 Added code for reflective avro types.
new e6911e7 Introduced CREATE and OVERWRITE file output write modes. OVERWRITE is default (as before). Rewrote code for file output path preparation. Fixed distributed writing to local filesystem #286
new 849ddf8 Added test for write modes on local file system
new 601fdd2 Updated configuration keys to new naming
new 31bae02 Added optional parameter to always write into directories even in case of DOP = 1. Extended FileOutputFormatTest. Some code beautifications.
new e5eb3c8 Adapted KMeans example such that also points with assigned cluster IDs are written as result. Adapted KMeans TestCases.
new 9397082 extend and expose KMeansDataGenerator
new 0d00289 Fixed broken build
new 0212c00 User compiler hints take precedence over crossWithSmall or CrossWithLarge hints.
new 690ba56 Add generated avro classes to simplify build and plugins.
new 5e40545 Add upper bound for dynamic path cost weight to prevent cost overflow.
new f17ccfb Set default locale to US in offending Scala Test Cases
new 5f821d9 Fix avro serialization and add tests.
new d0672a3 Merge branch 'master' of ssh://github.com/stratosphere/stratosphere into ozone_master
new 4cdf70f Correctly handle cases where iteration operators do not consume all input data. Allow cases where in-iteration DOP is lowered.
new 4492a9d Fix erroneous test case for AllReduce in iterations.
new f4513d1 Merge pull request #461 from StephanEwen/iters
new cfd0641 stratosphere debian package fixes
new 9b717e4 deploy spargel with dist
new 9690abb MatchNode UnsupportedOperationException fix
new d74d4bf Add WordCount example with anonymous classes (for discussion)
new 2d56177 Provide Iterable instead of Iterator to updateVertex method of Spargel API (issue #425)
new d40c671 Remove non-sensical comment from SpargelConnectedComponents (issue #428)
new f6b353f Add SpargelConnectedComponentsITCase to Spargel module
new 9b1c4ff Extend ConnectedComponentsITCase instead of code duplication for SpargelConnectedComponentsITCase
new 71a721c provide MessageIterator instead of Iterable
new 8344bbc Changed CsvOutputFormat constructor to support additional arguments
new 97147a3 removed some empty lines
new bcb6459 create parallel collections and add java value to stratosphere value interface
new 8dd2470 add Unit-test to check format and change some code styles
new b4ed23e some minor cleanups
new db40aa1 fix CsvOutputFormatTest (and re-introduced a flag for constructor-based instantiation
new 91ab016 add classloader to thread-global variable; introduce compiletime-typesafety for Hadoop Wrapper Types
new 169e456 rename hadoop-compatibility, more generics
new 3c26607 Extended avro serialization test.
new 09722dd Clean up several scala examples
new 2cb7bb9 Fix bug in avro serialization for empty collections. Add additional test for avro.
new 5300f4b fix minor bug that prevents the webinterface from working correctly with YARN
new 4c93530 Added API for broadcast variables.
new f45357c Added KMeans Java examples using the broadcast variables API.
new 3992fc6 Added support for extra inputs to RegularPactTask and TaskConfig.
new 3c43e58 Added integrated test case for broadcast variables.
new 4353134 Adjusted kmeans examples.
new 90846d7 Merge broadcast variable runtime. Extend runtime for iterative algorithms. Add iterative kmeans test for runtime code.
new 8504c51 Fix bug in bc variables. Adjusted test that now use bc var programs. Miscellaneous test cleanups.
new 7bf47b3 Minor readme fix. System.exit() is no longer required after the LocalExecutor
new 5faa419 Add serial version UIDs to newly serializable function classes
new 9f1cac4 Added support for broadcast variables to the optimizer IR structures.
new 533bcc6 Integrated broadcast inputs into getAlternativePlans enumeration logic.
new 619430a Added broadcast variables to the PostPass and JobGraph generator.
new 196c2f1 Added integration test for the KMeansSingleStepBroadcast Java example.
new cf2d1de Added compiler test for kmeans single step. Various examples cleaned up.
new 41f3199 Add compiler test for iteration with broadcast variable. First parts of handling BC variables in iterations in compiler. Miscellaneous test cleanups.
new ad09c62 Support for BC Variables in Iterations.
new f2a019e Removed duplicate and broken test for BC variables
new 0c7fe86 Added demo KMeans example.
new bb276e5 Changed default stddev in kmeans sample data generator.
new d06b2c5 Fixed WordCountUnionReduceITCase to not break the hep with too large test strings.
new 00676c5 fix invalid nightly stratosphere build for hadoop1
new 82542d6 [travis] Fix some ruby dependencies for travis, see https://github.com/travis-ci/travis-artifacts/issues/23
new 18014e8 Replication properties are not pushed down.
new 70b35d9 [yarn] use unique appId in to store jar in hdfs
new ee6515c [dist] deploy yarn in a separate compressed file
new d92b111 [yarn] fixed yarn binary; implemented a simple but effective shutdown mechanism for the yarn-session
new 20fcb24 [yarn] deploy new yarn.tgz with travis, fix file permission in binary
new f1975b3 Log rotation for start-local.bat
new f050b70 add failed node list to web interface
new 77b88ac Correctly handle transient variables during serializability check
new 91b5a2b Correctly marked text input format members as transient
new 7b2cf3a Add avro input format for generic objects. Add end to end test for avro with external jar and external test data.
new 93ecfc6 Removed redundant object cloning in usercode wrapper to fix class loading issue.
new 0559e4a Fixed logging in avro tets case
new 7d8c5c0 Serialization tags in ScalaInputFormat
new 6d4ec0e Handle serialization / lazy initialization of UDF types in scala input formats
new 6cd4299 Fix bug in CsvInputFormat resulting from changing UserCodeWrapper
new aa3d14d Added example program test jar
new fe2a2ab Simplified and fixed estimate computation.
new eaaaeea Fix estimate computation and add (enable) additional tests.
new 908cba5 Minor renaming of compiler hint
new d0ef7c4 Adjusted file URIs in some tests for Windows compatibility
new 1c086ce Made TextInputFormatTest platform agnostic.
new 06f94cb Moved single-step kmeans program from examples to test project. Single step program is subsumed by iterative program.
new 68121fc Moved end-to-ent test from 'test' phase to 'verify' phase.
new 2a5b25d Updated some comments and minor example cleanup.
new 762d506 Operators use UDF class name as default name, when no other is specified.
new 4180994 Enabled plan visualization for broadcast variables (quick fix visualized broadcast inputs like regular inputs)
new 706dec1 fix examples in GitHub readme page to 0.5 version usage
new 9b2aeb3 Cleaned up global sorting test cases and fixed latent bug in testing logic.
new cd07ed6 Fixed execution graph state checking to accept canceling -> failing transitions
new 3256315 Add branching logic for broadcast variables.
new bf6061e Added KMeans with additional point tagging as test case for branching broadcast variables.
new dc825e3 Csv leniently accepts bad lines also when skipping fields
new 6344e57 File data source fails fast on null inputs. File paths used as default names.
new 6c261d3 CsvInputFormat can optionally skip an initial header line.
new 3a63443 Default mode for output formats is not to overwrite existing files. Globally configurable default modes for overwrite / output directory behavior. Configurable behavior for FileOutputFormat through regular parameters, rather than configuration.
new 8311ebc OutputFormat unit test discard existing temp files by default.
new 2afb494 Additional test case for broadcast variables in branching data flows.
new 410821e Added options to configure the default behavior of the LocalExecutor (ports, overwrite, hdfs config)
new d9c222d Cleaned up BroadcastBranchingITCase (added Apache header)
new 32b2185 Compiler deadlock detection
new 62c28d6 fix NullPointException in web interface when inspecting a job immediately after it finished
new 7aacbf3 delay the display of job history with 8 sec instead of using a high network overhead method
new badff63 Fixed file output configuration and logging for various test cases.
new 719d27b Added functionality to re-initialize file format defaults for use with local executor.
new 2006980 Issue #519 Add setValue methods to Value types
new 2f1050f Termination Criterion for Bulk Iterations
new 33e2c08 Fix bug in data source cost accounting.
new 2242e76 Cleanup of termination criterion for bulk iterations.
new f8a8173 fix s3 deployment for stratosphere YARN version
new ddc1dc9 [yarn] Major YARN-Client improvements - HDFS security token support - "ship/" directory to transfer files to all TaskManagers (user-files) - Log4j-based logging (YARN now respects the logging configuration) - the YARN-client deletes all "temp" files from HDFS. - The JVMs started by YARN now respect the configured JVM opts in the yaml-file - the JobManager webinterface shows the log file (e.g it is aware of the YARN-specific log-directory) - The YARN-client now creates a [...]
new 0038c9d Fix the external packaged program test after merge with the new java api Relax generic bound in tuple type infor to work around bug in Java 6 compiler type inference. Local file system is used by default when URI is missing Removed final declaration from Tuple classes to allow inheritance (Fabian Hueske) Fix in TupleType comparator generation (Fabian Hueske) Cogroup Implementation (Markus Holzemer) Added missing Apache license header (Fabian Hueske) Initial commit for jo [...]
new 3205c52 Add RAT plugin in the MAVEN build. Also add licenses where-ever needed.
new 0826225 Fixes a bug when using Double types as sorting key
new 898f6fc Fixes a NullPointerException in PlanUnwrappingReduceGroupOperator
new 7fe59e9 included double quotes around scalars to handle paths with spaces
new 7244d04 [yarn] set the same user for the services running in the YARN containers. Fix #584 Fix #568
new 6bf7d5a Adjustments for java8
new 9dc354b Local environment has console logging deactivated by default.
new 021ad2b LocalEnvironment used the number of processor cores as the default DOP.
new f51f1b4 Change MutableObjectIterator to allow immutable objects
new f73c566 Remove Reference<T> hack (plus some other clean-up)
new d15b7fe Reset AsciiUtils to original behavior (do not implement MutableOjectIterator any more) Minor cleanups.
new 4aab95d Renamed AsciiUtils to SimpleStringUtils, because they actually work on more than ascii strings (all strings without surrogate chars)
new 4bbc6a4 Removed array datamodel and Scala Grabbag
new 2c00032 Small step towards semi join. Added semi join functions. TODO: Special exec strategy (runtime + optimizer) based on hash join required. Either no duplicates of filtering side in HT or filtered tuples removed from HT after first match.
new e9f9abb Updated TypeExtractor and TupleTpyeInfo to work on subclasses of Tuple1, Tuple2, ...
new 18a95e6 Merge Fix
new 778be22 includeFields support for new Java API's CsvReader
new e29e46b Removed ReferenceWrappingReducer. Cleaned imports in PlanOperators. Fixes in ReduceFunction.
new ca41f6a Rework command line client and added support for new Java API interactive mode. - Mixing generic and specific options is supported - Help is action specific - No -a is necessary for program arguments - New Java API programs with main(String[]) method as entry point work - The 'Main-Class' manifest entry is also considered when looking for Program entry points (easier export).
new bc613c8 Add getArity() method to Tuple
new 707fe0c Fix TypeExtractor to work with plain Tuple and derived Tuple
new 22890ef Add CsvOutputFormat for new Java API
new a55185e Minor consistency cleanups in CsvOutputFormat
new 429a940 Add convenience method to set local environments to overwrite files by default.
new 39414ef Clean up LICENSE and NOTICE files
new 880d9c1 Updated NOTICE file
new ce56c94 Fixed compiler so that it reuses already generated OptimizerNodes within the recursive descent step of the GraphCreatingVisitor by passing down the current con2node state. This implies that one has to consider the root of the step function for computing the unclosed branch stack and for merging the branch plan maps. The method hasDamOnPathDownTo had also been adjusted for the step function, otherwise the "Tracing dams for deadlock detection is broken" compiler exception [...]
new f05d24a Added test case for bulk iteration with static input and delta iteration with static input
new 76ba303 Cleand up imports after merge.
new a60c8d5 TextOutputFormat adds newline.
new ea04de0 Added test base for new java api programs
new fa4a5c2 Added test for WordCount in new Java API.
new 90e0337 Implementation of the remaining BasicTypes for new Java API
new 9c86933 Fix dependencies for java test base
new 7ac7968 Added first set of built-in aggregation functions for the new Java API.
new 98ea0a0 Remove duplicate InvalidProgramException
new 4f22ebb Implement aggregation operator
new 42de41b Changed examples to use aggregators.
new 0abe9ea Change some generic signatures to work around Java 6 generic type inference
new 4d4dd50 Fix erroneous test job.
new a5fbb39 Add ignoreFirstLine to CsvReader (new Java API)
new bdafcd8 Add Bulk Iterations for new Java API
new 3d5ae61 Fix client and webclient for interactive mode of new java api.
new 4e5d452 Remove resources from swt visualization
new a4efe57 Added small test for packaged program
new 3acd755 Initial support for Group Sorting (only key positions and Reduce operators).
new cafaa22 Fixes in TupleComparator and BasicTypeComparator
new 096d289 Removed unneeded code from example
new b3087b4 Triangle enumeration examples
new c7c94f2 Added integration tests for TriangleEnumeration examples on new Java API
new 0d8cd31 Fix stratosphere pom.
new b6edba2 Changes in the TupleGenerator:
new a7d1039 Added integration test for Filter operator.
new a5dfecc Made internal methods protected to clean up user API
new 7a33284 Added ReduceITCase for Java API reduce operator
new a65ee8f Adjust names and messages for file write modes (NO_OVERWRITE and OVERWRITE)
new 525cb03 Fixed NullPointerException in BulkIterationNode.mergeLists, fixed faulty chaining of root of termination criterion and root of step function, added static dynamic path detection for the termination criterion, fixed bug where the BulkIterationNode tries to generate alternative plans for the termination criterion even though there aren't any left for the step function
new 54e5e99 Extended scala api by introducing termination criterion
new 6bcb691 Added scala example for termination criterion
new 1aa1d26 Added license header to example file
new 4b6af0b Fix issue #505 removing trailing \r from lines in Windows text files
new 879afd7 Add TypeConfigurable interface for output formats. Minor cleanups.
new adab877 Input formats can tell their types to the java data set (no need for double manual configuration) Collections on tuples need no manual type information Additional sanity checks
new 4b1ebf5 Renamed type configurable/queryable interfaces to more intuitive names
new 3679f19 Avro input format provides type for the produced data set. Additional fail fast checks for new java api.
new c08ea5d Adjusted Avro Input Format for new Java API. Adjusted test case for externally packaged avro program.
new 9fb786d added util tests
new 3b3260a included examples source code into assembly
new cc8e16e Integrated Bootstrap in the User Interface and made some improvements and code clean ups.
new 280a2ca Added kmeans as an example for the new java api.
new cc03f84 HadoopDataSink works both for hadoop 1.2.1 and 2.2.0
new 7479b65 add license headers
new d61d87f add ContextCheck to LocalExecutor; check in HadoopDataSink for output path
new 33525af automatically generate a javadocs page
new 7ff8301 ported CompactingHashTable + unit tests to current master
new 66704bb Add project operator to Java API
new 90ceb0d Added tests for project operator
new 5442bf6 Extended Projection.types() functions up to 22 type parameters.
new 3781427 Moved parameter checks from DataSet to Projection. Handing object instance instead of serializer to MapProjector.
new 2e775ff CsvOutputFormat checks that only tuple types are used. Add comments to CsvOutputFormat.
new fc36cf5 Added JavaDocs for transformation methods in DataSet. Commented out not supported transformation methods.
new a98b104 First version of Spargel for the new Java API. Equality/hashing for some type infos. Comments on iteration runtime context.
new 9595fad Renamed spargel iteration classes (more intuitive names) and added all java docs.
new d7ef670 Made edge iterators iterable.
new b8b9b03 Added page rank example to spargel
new 66d7907 First part of integrating delta iterations with new java api's optimizer post pass.
new 74ce8d3 Delta Iterations for new Java API; SimpleDeltaPageRank + testcase
new b01641b Fixed bug in splitting logic of number sequence iterator.
new 7345107 Fixed import lost during merge.
new ebe03bf Fixed erroneous propagation of messages for Spargel.
new 253b4cd SpargelConnectedComponentsITCase properly verifies results.
new 84c2bcb Changed members of Costs to double, cumulative cost is now the node cost plus the costs of the children divided by their out degree
new 3def816 Refactor and Add Comments to Broadcast Variable Example
new 20453d3 fix sonatype deploy
new b032ff3 Add LocalCollectionOutputFormat for local executor
new 6278a6c JDBC InputFormat and OutputFormat for new Java API
new d0aaaa8 Created TupleBuilder for every Tuple, via TupleGenerator
new a146eac integrated CompactingHashTable in iterations code
new 243b408 Added JavaDocs for DataSet and Grouping
new e140e97 cleanup + documentation
new 1c1be8c Allow .yml file extension for config files (fixes #645)
new 7ad677b Make delta iterations use Keys.FieldPositionKeys
new 0321e8e Speed up execution by having an early heartbeat
new 81f58a0 Add support for serializing null strings. Fix bug in binary copying of long strings.
new 557e2ad Add tests for string serialization.
new bf96cec Add base utility for serializer tests. Add string array serializer with test.
new 6ec6ee5 intermediate (new hashtable and broken joinwithsolutionset*driver)
new 96568a4 cogroup fixed
new 5e48706 match fixed but ConnectedComponentsWithDeferredUpdateITCase still fails
new cf0eff3 Added Grouping unit test, extended Reduce integration test, added JavaDocs to ReduceFunction
new 44fdc64 Preliminary support for String arrays in new Java API
new d90bf15 Improve error messages for instantiation errors on arrays and for programs without data sinks.
new 5cc81cd Add write mode to data set write function.
new 88e105e map operator test
new e11a040 flatMap operator test
new 8d2be33 Testcases for the CoGroup operator in the new Java API
new 2adafc6 Change return type of the CoGroup combine functions to a single value. Add default empty method stub for combiners in CoGroup functions. Add semantic property fields to single- and two-input udf operators. Lots of comments.
new 4bcbd13 Union implementation for new java api, with simple UnionIT testcase
new b3e405f Rewrite TypeExtractor to support more types and complex type structures. Possible Exceptions are now more user-friendly.
new 8f4b8e4 Fix of JVM 6 related bug and enhancement of 2 other corner cases.
new 1cb1e0f Adjusted TypeExtractorTest for updates CoGroup combiner signatures.
new f359042 Added comments and checks to the StringUtils
new 3618369 Added comments to the Tuple classes.
new 3eb7f5e Add specialized type serializer for long[], including test. Minor cleanups in Java API tests.
new 29ae10a Minor cleanups in type extractor for new Java API.
new 2fa5351 ConnectedComponentsWithDeferredUpdateITCase green
new f863fa3 added test case with multiple probers
new ed73da3 Java 6 compliance
new d4d427f Simplified Java API by removing unnecessary project methods
new e281809 Removed group sorting for pair-wise Reduce function
new f4153c4 added license headers
new eec5188 Added aggregators and convergence criterion to new Java API. Better generics support for Aggregators Lots of comments.
new 6ccb67f Added convenience convergence criterion classes.
new 7e4c8c7 Added comments to parsers and improved error handling.
new a1555ce Added static parse methods to parse utility classes.
new ef72b32 Added Java 8 to README.md
new 4fe7426 Moved SerializerTestBase to s-core and resolved Maven dependencies
new 9e5e73a GroupReduce testcases for the new java api
new 6bd0ef9 Minor improvements on GroupReduceITCase (tests for group sorting)
new c9aa4fd Testcases for cross operator in new java API
new 34e6f2d Minor improvements of CrossITCase + some clean-up
new b6c3a79 Mixed key types for cogroup
new 208f482 Fixed mixed keys for CoGroup, adapted test cases, code clean up
new c9fdac0 Implements the ascending flag for basic type comparators.
new 9f91480 Merge branch 'integration' of https://github.com/rwaury/stratosphere into hash_merge
new f42f3e3 Fix instantiation of remote executor.
new 50ccb73 Merge branch 'ozone_master' into hash_merge
new 96b62f0 Minor example cleanups.
new acb38da Add/rework utility iterators.
new a0bfe4d Minor cleanup in local collection output format, csv reader, program description.
new 45d9b36 Removed redundant WordCount examples.
new 5ab1b66 Fix various serialization warnings.
new 34996a1 Postprocess the compacting hash table merge
new 5dc850e Add new java api based delta iteration example. Reorganize ConectedComponents example based tests.
new e78ccef Updated jar for end-to-end testing of packaged programs.
new 64c6ddc Cleanup among HashTable tests.
new 8c9ca48 Added unit and integration tests for join
new 63b0d8c Testcase for filter with broadcast variable
new 09632ed Add test for StringSerializer for #589
new d056a43 Mixed key types for join
new e29efbb Minor error checks and message cleanups
new 492f004 Old Java Api now also uses the binary Union Operator and cleaned the common.api/optimizer level from input operator lists. Also added PropertyPropagationTest for new java api union
new aabb30e Comments and cleanup for (delta) iterations.
new 37a5eaf Clean up common api operators and marked var arg inputs as implicit unions as deprecated. Record API builder pattern suppoerts the model still. The common api uses an explicit union model.
new e29cba5 Post merge cleanup of Union operator.
new 5c85e45 Unify delta iteration methods on DataSet.
new e2bf9c5 Fix documentation errors.
new fdaadf4 Add support for multiple joins with the solution set.
new 80ab530 Add test to verify that distinct probers are used in the case of performing multiple concurrent hash joins with teh same hash table.
new a7493f7 Various minor fixes: - better exceptions for faulty temporary directories - better exception if client can not connect to JobManager
new 29c322d Add distributed cache to stratosphere
new 8676280 change codestyles and clean up
new b0fbce7 add test for delete process of tmp file and tested in cluster
new 1aab122 Cleanup and simplification in the taskmanager and the local instances and mini cluster.
new f1024ba Fixed log levels, code cleanups and restore the thread interruption states for JobManager and TaskManager
new 2cbb93a Fixed heartbeat thread and startup/shutdown races in TaskManager
new ee6c523 Fix concurrency bugs in cluster manager and cluster manager tests. Simplifications of instance loading at startup.
new dbde1dc Clean up comments and fix doc errors
new 49d97ff Adjust iteration low level tests for reduced memory footprint
new 385b42d Improve error logging on RPC server.
new c0e5d27 Adjust tests LocalDistributedExecutor for low memory settings on build servers.
new b49ce58 Post-merge fixes.
new c8dbe68 connected components test case with 2 joins with the solution set
new bcc9328 Migrated tests to TestBase2 (for stabilty)
new afe4d87 Added Int, Short, Float, Double, and Long Serializer Tests
new 799f7a9 (Re)add TransitiveClosureNaive, fix join, add ITCase
new 45bed7a Add tupleType() method to CsvReader that allows to read directly into subclasses of Tuple
new 44ada15 Fix CSV reader tests and added comments to CSV reader.
new a2650c5 Display Exceptions in the JobManager webinterface
new ea530c3 Removed faulty constructor
new dd6694e Remove obsolete Broadcast Variable Join example.
new 44ccde6 Simplified translation of new Java API
new e5a33c3 added support for setting the DOP of individual operators
new 968458b Minor deprecation cleanup and comments.
new a17ec90 Add semantic properties to spargel plan.
new 41a0069 fix issues #736 and #733
new 37273f5 Suggested fix for #739
new 68100e5 Allow both comma and double-colon as path separator (for MR compat.); better error messages; delete address file
new 101287a Adds join projection, comments for join classes, removes unsupported methods for join.
new 4f496b8 Added unit test for join projection
new 52b539e Extended Join integration test for join projection
new 382bf30 All sink methods in DataSet return the DataSink object to allow setting parameters.
new 5196362 Improved error message in PackagedProgram for preview plans. Fixed pre-packaged end-to-end test.
new d124e8b Add projection cross
new 2e01c80 Minor fixes in JavaDocs and parameter checks
new cd94629 Unit tests to check for valid parameters of cogroup
new 2e5e9fd Activated unit test for CoGroupOperator
new ae12bd7 Default cross operator
new 440e73f Combinable GroupReduce for new Java API
new 5579008 Changed key handling for key-selector combiners
new 35f3966 Added Boolean, Byte, Char Serializer Tests
new 7c24b0f Implements a parse() method to parse TypeInformation in string representation.
new 6f14ef9 Parser can now be tested with a JUnit test and supports Tuple arrays. Some minor bug fixes are also included.
new 6990ab8 Adapted test class for maven
new a13a44d Add annotation support for new java api
new ec4bcb3 Removed obsolete array record utilities
new 3f06f87 Introduced notion of immutable types and stateful/stateless serializers.
new 404f39f Switched runtime task code from TypeSerializer to TypeSerializerFactory to support non thread-safe type serializers.
new ee8585f Add dedicated factories for stateful and stateless serializers.
new bfa1a2e Fix serializer equality checks and add tests.
new cae5a7d add checkstyle to project
new 938a2af refactored given checkstyle.xml
new ba8f2d2 minor cleanups for checkstyle
new 244cb3d Fix maven problems with checkstyle in eclipse [ci skip]
new 2a3ced4 use Kryo for object copy in AvroSerializer. Enable more tests in CrossITCase and JoinITCase for JAPI
new 2071f78 Lazy initialization of the kryo and avro serializers.
new a84276e Add default entry (commeted) for program JVM options
new 229fb8a Add object copying code to AvroSerializer
new 9050111 Add KryoSerializer and simple test
new 0685ca1 Adjusted generic serializer tests
new b59e9b5 Add modifications to hadoop compatibility package as required for parquet testing.
new 72377b1 Move testing utils and data to package stratosphere-test-utils
new 61610f9 Remove bin/ directory from tests and test-utils
new b94487d Remove old TestBase, rename TestBase2 -> RecordAPITestBase
new dcda680 Remove deprecated testing stuff
new c6dc3a47 Increase visibility of temp file handling in test utils.
new c89cd0c Removed unnecessary and unstable shutdown hooks for JobManager and TaskManager
new ef7ac90 Fix checkstyle in the test data
new b132823 Changed Key to Key<T>
new 1c1f022 Adapt scala code to change in Key -> Key<T>
new 2684fa9 Clean up Key generics and checkstyle errors. Fix various warnings.
new 893880d Improved TPC-H 10 example.
new 799c9f2 Example is now runnable without any parameters by default.
new a947361 The maven pom.xml file has been adapted to build a separate jar file coontaining the TPC-H query. The jar also contains the testdata, so that it can be executed without any further parameters.
new 707e2f0 Removed TPC-H test data due to unclear license state
new a86eec1 TPCH Q10 example cleanup
new 78a4283 Removed obsolete and broken RelQuery example
new 18b654f Add WebLogAnalysis example
new 7aec7bc Add TPCH Query 3 example
new 578d613 Renaming and minor cleanup of TPCH Q3 example
new 4244e6d Termination Criterion and PageRank for the new Java API Optimization of SimplePagerank, setting of a correct serializer for the termination criterion, empty implementation of combiners for cogroup
new c3d3f94 Add utility result verification method for K/V pairs with double value and delta threshold.
new df31a01 Allow bulk iteration termination criterion with different data type than partial solution
new 40d1289 Cleaned up page rank example and adjusted tests
new f65c65b getAggregators() for SpargleIteration
new ff96f6c Tests for aggregate operator
new 8bc853a Cache: exists() called / rel. path support
new 10d2886 Fix aggregation tests Fix error message for unsupported averaging data type
new 55a19fb Generalised the name of the expected InputSplit class in HadoopDataSource.
new c8f6602 Add avro to stratosphere-dist, thus adding it to the lib/ folder
new 0dd6554 Better estimations for filter operator
new f4c02ad Corrected minor errors in the optimizer filter operator.
new 5b41d36 Add getSolutionSet() and .getWorkset() for delta iterations
new c798c19 Rename DeltaIterativeDataSet -> DeltaIteration, is no DataSet anymore
new 06baf89 added ExEnv.registerCachedFile()
new d2a5178 StringComparators uses static StringValue.readString()
new 7f32534 Fix generic compiler problem with Java 6
new 982e1e0 Test case for showing the still existing BulkIteration bug.
new f920713 Added comments to iterative data set.
new 0231841 Cleaned up and adjusted BulkIterationWithAllReducerITCase
new d56565c Fix bug where a non-iterative data set is not fully consumed.
new 34ab689 more detailed error messages for CompactingHashTable
new 808ae18 Comparators for Value types
new 0158343 Straightened out ValueSerializer and ValueComparator
new f857cff Remove obsolete ReflectKeyExtractorGenerator
new 6f00c2c Adjust ValueTypeInfo Generics for Java 6 compatibility.
new 4ab2d9a Extension of the TypeExtractor to validate input type information and recognizing input mismatches.
new 37a31cd More generated Tuples up to 25.
new 5b34bef Introduced a checkstyle exception to also support TupleGeneration of more than 25 Tuples.
new ef040d4 Support for reading from ".deflate" files Implement clear distinction between unsplittable and serial inputs Made Avro input formats unsplittable
new 8e72db9 Boolean compare ordering switched
new ae975e8 Added support for local distributed execution environments.
new 3244022 Fixed free memory calculation bug in case where multiple task manager run on the same jvm.
new 511dc8d Removed local distributed executor environment from user api. Now only used for testing
new 93c4b9a Added setter and getter for numTaskManager in NepheleMiniCluster. Updated WordCountITCase and PackagedProgramEndToEndITCase accordingly.
new aa289b7 WordCount examples are documented with many comments in order to be very user-friendly.
new de80196 divided reduce and group-reduce
new d555ff5 Add a dedicated reduce operator to be used with key extractors
new 8d92304 Add comments to initial solution and -workset of delta iteration
new f8798e2 Execution environment data source methods return a DataSource, to allow the setting of parameters.
new 269ed2f Add equals and hashCode to type information.
new de2070e Add test for reduce operator translation
new c96dcf4 Add test for runtime reduce drivers and fist set of fixes for stable mutable object behavior.
new 5dacdb3 Remove unsafe getFieldFast() method from Tuple, because it turned out to be not faster than the switch-based getField() method.
new e33e904 Fix GroupReduceDriver test.
new d4e94d13 Fix ReduceDriver for mutable objects and arbitrary return types.
new 3496bde Fix and test reduce and Group Reduce translation for new Java API
new 603753b Move PageRankITCase to proper package
new 7183f4d Fix null pointer in ValueComparator
new 2ffeccf Add ReduceCombineDriver. Rename CombineDriver to GroupReduceCombineDriver
new 510f9f3 Minor cleanup and fix warnings
new f3c06bd Reduce combiner deactivated when reduce uses a broadcast variable.
new 29eda60 Update external Avro Test Program for updated data set signatures.
new 0585362 Small fix to get test to run under windows
new 1c14248 additional csv input format test
new cbed2a1 Fix bug for tuple size greater than 22
new e2fb213 add test for deflate input
new 966b189 Test for exclusion of ignored files (with underscore prefix)
new 06c90d0 Print stratosphere version also in YARN-mode in the JM log file disable the MatchJoinCancelingITCase test to speed up travis builds
new 340ebde Add javadocs documentation to user-facing classes.
new c2f2a5b Add Writable interface to allow seamless support for Hadoop types
new 5b7ac5d Reduce minimum memory threshold for sorter
new bb76fda Added direct array serializers for all primitives
new e294130 Fix deep copy code in GenericArraySerializer
new 18f95d2 TupleComparator fixed
new 9e86b64 Add test for generic array serializer
new 00442b4 Avoid unnecessary exception wrapping in PackagedProgram invokation.
new efbdcea Add TupleSerializer tests.
new f2eac04 Improve TupleComparators. Add a compare method to teh comparators that works directly on objects.
new 95fd0fa Fix bug in tuple comparator (state) Rename UnilateralSortmerger -> ExternalSorter (part 1) Fix checkstyle warning.
new 36d5bf5 Add utility test to check string and tuple sorting (not active by default, time consuming and Linux OS dependent)
new 79af0ae Fix checkstyle warning for Writable
new da2c467 Adjusted TupleTypeInfo for updated comparator
new 97ef44d Tests for tuple and base type comparators
new c932da1 Add serializer for primitive char array
new cb9d679 Primitive type arrays have dedicated serializers now.
new 4f6aac4 Adjusted TupleComparatorTests
new 667be33 Fix javadocs in CsvReader
new 58a95ec Deactivated outdated canceling tests
new f468356 Fix hashing incompatibility between TupleLeadingFieldComparator and TupleComparator
new 999054c Fix instantiation of tuple comparators.
new 5c8641e Disable LocalExecutor when using Client
new 4b8c3e8 Set the disableLocalExecution() in ExecutionEnvironment to protected
new 6728ec5 Add comments to execution environments
new 8152214 Adjusted JVM garbage collection options to enable class unloading.
new f90f172 Disable also local environment in client submission settings.
new dc72904 TuplePairComparatorTests
new ad144f1 Add tests for TupleLeadingFieldComparator
new ff8bcee Fix for branching merging logic in BulkIterationPlanNode
new c41569e Moved record API example jobs to stratosphere-tests
new 98001d9 Remove some of the redundant Record examples - some KMeans Variants - some WordCount variants
new 1fff513 Add javaDoc comments to ExecutionEnvironment (final), DataSet (parts), InputTypeConfigurable, and ResultTypeQueryable.
new 5a81d9d Expose WriteMode in JAPI. #781 Pass Configuration parameters to runtime operators in JAPI (+test)
new 4d0f612 Refactored and unifid Java API example jobs
new 465a6a4 Updated JAR packaging of Java example programs
new 73c1383 small corrections in refactored examples
new 4cdc633 ValueComparator uses ascending flag, tests
new 1b6a3ac Add GenericTypeComparator
new 698bcc6 Created new SortedGrouping to move the group order from the Grouping
new c3a38ae Minor changes for SortedGrouping
new 38ce861 Updated JavaDocs of ReduceFunction
new cf18cde Minor improvements in comparator tests
new a07dba6 Introduction of a Writable type and tests
new 443c5d6 Improved exception message in WritableTypeInfo.
new fe9627c Fix combiner for group reduce.
new 5308efd implemented infrastructure for string style annotations
new 526a1ed added semanticpropertyutilities
new 885b5e7 implemented parsing of the strings in SemanticPropUtil
new 38f8449 implemented semanticPropUtils class, added compatibility to operators
new 1e11017 Added Support for Wildcards. The following is now possible "*" for all fields constant and "1->*" when the first field is forwarded to all output fields.
new 0860c40 Filter UDFs always considers all fields as constants
new ebbc3a9 Fix group reduce compilation test
new 9e1db40 Merged and adjusted semantic annotations
new a6d188c Removed combine methods from CoGroup function and some minor improvements.
new d3df8dc Improved Java examples
new 6c4afe1 Completed, updated, and improved JavaDocs of Java API
new 9877062 Added UnsortedGrouping to separate Grouping methods from SortedGrouping methods
new 7f7c972 various fixes
new b31ae3a Substract only 15% from TM heap for yarn, capped at 500MB
new 093f24b Fix NullPointer exceptions in SemanticPropsUtil
new 96eead0 Improved error messages and exceptions on non-serializable objects.
new 2bb3e98 Add workset iteration translation tests. Add check that solution set is joined with on correct keys.
new 468bcb0 Improved comments in Java example jobs
new 6560220 Fix binary distribution: add LICENSE and NOTICE source should now build without the presence of a .git directory included the quickstart-archetypes into the main project.
new f0d3926 Added links to programming guide / examples remove reading from files from WC
new d7312d8 Refactor type string parser into own class TypeInfoParser
new 651a8c5 Move TypeInformation to stratosphere-core
new 54a27da Introduce TypeInformation at lowest Operator level
new 4069dac Fix scala warnings
new af2a765 Add comments to function classes.
new d5ac345 Made Scala and Java examples more consistent
new d97c45c Added Java equivalent of Scala RelationalQuery example program
new 7e4888d Rework CLI client - Add degree of parallelism option (run and info) - Simplify options (-j and -a not needed any more) - Fix corner cases with YARN - Many tests
new f5e3a86 Remove wait flag from CLI client. Wait is now the default.
new 505119b added improved syntax for annotations. Lists now possible within one String
new b974e3a Add additional test for semantic properties and translation. Fix some bugs.
new 0300aa1 Fixes an issue with wrong ClassLoader when submitting JobJars.
new 9c06e8c Improve error handling for Job Submission.
new 8dc3ac4 Removed System.exit() from Java example programs
new 7fa8e25 removed System.exit() calls in Scala example programs
new 1c465a0 Consolidated and exteded Cli frontend - all actions evaluate the target JobManager option - all actions evaluate YARN files pointing to the job manager - tests cover more cases
new e5f617d Getting OptimizedPlans from the Client evaluates the parallelism defined on the environment.
new f834e7d Make aggregations combinable and remove AVG aggregation
new 8677ad9 Fix hash partitioning for new java api
new c9589b8 Fixed RecordOutputEmitter and extended OutputEmitterTest for hash corner cases
new 67ea3c1 fixes toString return value of min aggregation
new 9016c4a Merge pull request #874 from vasia/fix_min_aggr_tostring
new f90e261 Improved error handling when fetching optimized plan of programs.
new 1c6d604 Improve ConnectedComponentsExample with constantfields annotation
new 3c29997 Aggregate Operator sets its semantic properties.
new 39fd71a added murmurHash implementation
new 84bfba4 Minor cleanups for hash partitioner
new 01a17b7 Fixes an issue when generating a type erasure exception in TypeExtractor.
new d237804 Set version to 0.6-SNAPSHOT
new 73a9dcc Make sure progress bar label is visible by making the minimum width to 20%.
new 7ad6c8b Improve exception for nonexistent local files
new 60c1afc Simplified exception stack traces when file is not found.
new b0557d0 Exception added to open() and fixed \r\n The DelimitedInputFormat.open() method did not check if it has parsers registered. Added throwing an exception when no parser is registered when calling open. CsvInputFormat does now accept windows line endings with standards settings. The |\r\n" will be replaced by "\n_"( _ is a space)... To prevent from errors the returned length is set to the space. So that this byte is known as parsed and will not get interpreted anymore.
new e398498 Functions can now implement ResultTypeQueryable to supply TypeInformation manually.
new abe88b7 Extend Delta iteration parameters Rework Spargel Add Broadcast variabel support to spargel Add translation tests for delta iterations Add translation tests for spargel
new 6545fa2 Add spargel compiler test.
new 28a3dfd Fix restrictions with branches in broadcast variables and iteration closures
new 1ce11d3 Fix potential bug due to unnecessary cast from long to int in FSDataInputStreamWrapper
new 363ea24 Implement toString of CsvOutputFormat
new d80b929 Rework stratosphere-clients tests to not expect a binary blob in the test resources (build the jar file using maven) add a test for ensuring the presense of a custom classloader in the CliFrontend Add missing ClassLoader for the "info" command in the CliFrontend
new b746f45 Remove setUserCodeClassLoader() from PackagedProgram and use partial mock in respective test case
new 2b0baea Fixes bugs where the TypeExtractor throws an NPE instead of the operators
new 2a9ed09 Fix maven enforcer plugin warnings in Eclipse
new 0bb812e Fix dependency exclusion for examples in yarn-uberjar
new 2db78a8 Offer buffer-oriented API for I/O (#25)
new 4cd4a13 Replace custom Java NIO TCP/IP code with Netty 4 library
new 6d8fea9 Add debug log messages to Netty stack
new 3beca62 Check number of designated buffers before returning buffer to BufferAvailabilityListener
new 6a40d41 Rename BufferAvailabilityRegistration constants and add initial LocalBufferPoolTest
new b0f8ba0 Remove @Test from NettyConnectionManagerTest and run tests via main method
new 24d0059 Merge cleanups
new c0e76bc Fix for FLINK-708 (Hadoop 2.4 compatibility) and FLINK-887 (YARN Jobmanager heapspace calc)
new c561a51 Add to distributed cache executable flag, directory support
new f952638 Distributed Cache general purpose copy method, thread safety
new 81b032a Enable additional spargel compiler test
new a83683a added own instantiate method to CoGroupDescriptorWithSolutionSetFirst; added Test
new d784bf9 FS.get(): Add URI causing exception to message.
new 9ccc41f Allow multiple successive programs on the same execution environment.
new 95b0cad Renamed Network Speed test to exclude the long benachmark from regular test cycles
new e43c165 quick and dirty fix for FLINK-927 and added more diagnostics information
new 5a6e2e7 Fix DelegatingConfiguration + Test
new 09c4c05 Fix generic warning in Plan
new 856d556 Fixes a bug in the Java 6 JVM where primitive arrays have a wrong type.
new edf6c4c [FLINK-898] Clean up distribution default config
new 3bc9775 Pipeline breakers are placed correctly direct after iterations if needed.
new 6c6fc89 Fix number formatting in JSON plans
new 22949fc Add LinearRegression example (Java API)
new 8a55793 Minor fixes for LinearRegression example
new c81d7b0 [FLINK-917] Rename netty IO thread count parameters
new 79acf26 [FLINK-934] Remove default values for JobManager and TaskManager JVM heap sizes in startup scripts
new f391957 Implement AvroOutputFormat
new f82c61f Add method to pass a schema for AvroOutputFormat
new 08f189a Aggregators and convergence criteria as objects instead of classes
new 708426b [YARN] Improved the check for resource availability within the cluster
new 229754d Minor fix for displayed estimates.
new 31a3739 [FLINK-935] Fix compiler logic that pushed work out of the iteration loop.
new 202aa4a Made FieldSet and FieldList immutable collections to prevent bugs to to side effect mutations
new ed7c3f1 Made LocalProperties Immutable (avoid side effect mutation bugs) Change several Iterators to Iterables in the compiler (simpler code)
new ca2b287 [FLINK-935] (continued) Correct feedback property check for iterative algorithms.
new 6a54932 [FLINK-942] Fix bug in config.sh to correctly set user-specified JVM args
new a70de7e [FLINK-930] Netty Initialization is sometimes very slow
new b7cbf30 Artificial commit to close pull requests.
new 9a75e68 Do not limit the client's heap space (See FLINK-934)
new 3c15276 Added Zihong Cao to CONTRIBUTORS list
new 4b9c71d Added configuration subsection in webinterface
new e57b106 New Webclient
new a84f8a1 Fixed error messages in web client
new 5484d58 extended plan-dump test for KMeans
new b692b04 Fixed JSON Bug for some plans.
new 73a94ff Add log info message with memory usage after TaskManager startup finished.
new 1a1a13e Remove Parameterized test runner annotation from NettyConnectionManagerTest
new 7c4c4a9 [FLINK-940] Added additional test for cogroup with delta iteration solution set on second input.
new 3a452e5 [FLINk-941] Place pipeline breakers for SingleInput nodes with broadcast variables, if needed.
new 5c23b8f [FLINK-950] Fix spurious file deletion failures.
new 6ee874a Projection constructor adjusts to max tuple size
new b2bd469 [FLINK-943] Remove leading and ending double quotes from 'env.java.opts' config value in startup scripts
new f3930e3 Transitive closure example in Java API
new 5fa5e50 [FLINK-944] CollectionInputFormat now uses the TypeSerializer to serialize the collection entries. This allows to use objects not implementing the Serializable interface as collection elements.
new 9ecb6df [FLINK-944] Consolidated serialization logic between different classes. Fixes for warnings.
new f8ec28c Re-encrypt the credentials for various services with the new apache/incubator-flink travis keys
new 9d57045 Syntactic sugar for sum, min, and max aggregations
new cd665b9 [FLINK-957] Throw meaningful warnings and exceptions upon incorrect use of delta iterations.
new 191dd1d Added Version and Revision of Stratosphere in Webinterface
new a65b759 The Hadoop Compatibility has been refactored and extended to support the new Java API.
new ff69b1b Hadoop Compat pull request clean-up
new 7b6b5a2 Fixes a bug where Thread.currentThread().getContextClassLoader() does not return the user code class loader within object deserialization.
new 86d206c Rework the Taskmanager to a slot based model and remove legacy cloud code
new 429493d Cleanup of merge with slot-based scheduler branch.
new ea79186 Removed RuntimeEnvironment instantiation from execution graph construction. Removed legacy job vertex classes and input/output tasks.
new 93bc0b9 Added failing behavior to JobManager if it is still in scheduled or created state New test case: Exception during ExecutionGraph construction in the JobManager Removed checkConfiguration method from AbstractJobVertex because it is not needed anymore
new fba44a9 Replaced Tarjan's algorithm with a simpler depth-first traversal cycle detection algorithm. By doing so, one gets rid off a possible linear time check whether a node is contained in the stack.
new e52fcf9 Streamlined job graph algorithms to get rid off linear contains operations.
new 2692643 Standardized creation of input and output channels in InputGate and OutputGate. Removed linear contains check in InputGate for channels.
new 8c1d82a Merge fix to omit input/output registering on JobManager Rework Invokable Task Hierarchy
new b4b633e Add some options for slot-based scheduling and changed default parallelism to one.
new 40b94f7 [FLINK-962] Initial import of documentation from website into source code (closes #34)
new 9ff440f Add script to merge pull requests
new 7d0e89d Show version information including commit date in TaskMgr log
new 1357ea3 Add garbage collector stats to output of TaskManager memory usage debug thread
new f3c5428 Revert unintentional change in 1357ea3a40f747e4e51b5b52612323fe55747da7
new 2f0bd8f [FLINK-979] Fix NetworkThroughput test input and output task config
new f13ad5b [FLINK-980] Fix buffer leak in OutputChannel
new fe91d4b Changed default number of task slots per machine to one. Add logging for task slots.
new d55ba70 LocalExecutor automatically picks up the maximum DOP for plans as its number of slots.
new 28863ee [FLINK-973] [FLINK-969] Unify, clean up, and extend all environment logging at JobManager/TaskManager startup
new 96e76a5 [FLINK-926] Add shallow copy, deep equality, and hashCode to Tuple classes
new 3d6cc5f [FLINK-949] Properly report GlobalBufferPool OutOfMemoryError to TaskManager
new 515ad3c [FLINK-960] Fix CollectionDataSource bug
new f7f1ed2 Update Quickstarts Java API, Run Example, and Setup Quickstart
new 6c827fb [FLINK-971] Configure PooledByteBufAllocator in NettyConnectionManager instead of using the default allocator
new e2aabd9 [FLINK-760] Add distinct operator
new 8431395 Speed up "getOptimizedPlan" by not starting the local embedded runtime.
new ef623e9 Change string construction to work around a known JVM performance bug still present in some older JVM versions.
new 35438ec InputVertices do not require an input format.
new 49cd35a Fix generic type warnings in generated tuples
new 9c51834 Remove debug LOG message of TaskManager heartbeats
new 47239b2 [FLINK-985] Update the config.md to properly describe the configuration settings.
new 69589fa Fixed Bug Flink-978
new 20fdcfb Reeenable tryLocalExecution() test in ClientTest
new 5f0a3d4 Change TypeExtractor to have non-static methods that do the actual work
new 3f87fc9 Add support for POJO objects
new f4d522b Removed redundant config constants value.
new 9ce6293 Fix buggy computation of TaskManager free memory size
new 0d0803f Fix the managed memory planning after patch 9ce6293075d1a2326df8a2e99c032445a555b28b
new 3c5feae Fix checkstyle errors and various warnings.
new 05ff333 Add "How to contribute" and "coding guidelines" to the project.
new 5b390d5 Add first files for system internals documentation
new c3f8809 Add various figures for internals. Update text on internals overview.
new d76d1b0 Fix simple error in local execution memory estimation
new 8980a7a Add "how to add an operator" section to internals. Add stubs for other internals pages
new 0902829 Mention that Oracle JDK 6 library will fail to build
new 5042280 Minor changes in Java POJO WordCount example
new cebb1f6 add gh_link jekyll plugin to docs
new 7a4c209 Finished Flink-928
new 3c8bdee [FLINK-888] Add swap() to Tuple2
new 8a8060e [FLINK-893] Inconsistent Iteration Step Function gives nonesense error message
new 883474d [FLINK-932] Introduce automatic generation of semantic props for projections
new cf29798 Fix various error messages and invalid JavaDocs.
new 32a003d [FLINK-996] Fix for bug in union replacement
new b422fe2 [FLINK-990] Added constant fields and combinable annotations forwarding to Scala API
new b945916 [documentation] modified gh_link to support naming
new 88e4dac [documentation] fix internals linking
new 5928706 [documentation] fixed a lot of links, better gh_link plugin
new 3f51195 First cleanup attempt, mostly on Scala code, to follow guidelines from http://docs.scala-lang.org/style: 1. Remove return statement from Scala code where it is not necessary (end of method definition) 2. Remove extra ; from Scala and Java code 3. First drop to abide to 100 chars per line for Scala code. Will send another PR for other files as I have encountered. 4. Remove parentheses for empty argument methods that do not have side effect (see http://www.artima.com [...]
new 98e659e [FLINK-994] Replaced DataInput and DataOutput with DataInputView and DataOutputView
new 7b6295d [FLINK-994] Added test cases for AbstractPagedInputView, fixed problem with hbase.
new 48a703f [FLINK-836] Integration of the CachedBuildSideMatchDriver into the optimizer
new 99c888c [FLINK-795] Tests for the integration of the cached match driver into the optimizer
new 47a68ad [FLINK-836] Rework of the cached match driver
new 53c7a89 Fix various JavaDoc errors
new 8ea6536 Clean up exception logging in JobManagerITCase.
new 5cec8e8 [FLINK-701] Rework of TypeExtractor for SAM support
new ce65fb6 Add dedicated test for the type extraction on input formats.
new 03c6160 Fix cost formulas for cached hash joins Fix estimation bug in channels Add tests for isolated cost formulas Add tests for channel class in plan candidates
new a9b1daa Fix missing strategy constants in JSON dump generator
new 52f9cf6 No explicit caching when hash table is cached Add tests for explicit cache removal when hash table is cached
new 49ca3ed Clean up checkstyle and JavaDoc errors in core project
new 26bc321 Fix optimizer error in channel instantiation (wrong parameterization)
new 6d9a40d Renaming part 1 (scala sources only)
new 24eb47a Renaming part 2 (core and java api)
new e73296f Renaming part 3 (runtime)
new b14581c Refactoring part 4 (compiler and clients)
new 43b86ad Renaming part 5 (java examples and test utils)
new 45c3c44 Refactoring part 6 (finalize scala api and scala examples)
new 3c08d36 Renaming part 7 (tests)
new 76273ec Renaming part 8 (addons)
new e762152 Renaming part 9 (first part of distribution project)
new 5f01154 Renaming part 10 (fix error in clients pom file)
new 8563d51 Rename POMs, scripts, quickstarts and other minor renames
new 6c9aa29 Add compiler test for solution sets depending on the delta set.
new 0f498c8 Adjust LICENSE file to remove LGPL section (library not used any more) Adjust NOTICE file for years
new da9aa3d Minor fixes for POM files : Inherited versions where possible, suppress unnecessary warnings
new 7e62878 Set version to 0.6-incubating-SNAPSHOT and update Readme
new ebe6b90 Update license header for java, sh and xml files
new fbc9338 Rename documentation
new 4771efc prefix all projects in addons and quickstarts with flink-
new 2f3c0b9 Change cluster shutdown order to avoid heartbeat exceptions during shutdown on large clusters
new fa9daad Fix issue with git-commit-id-plugin on Travis
new ca4e7b4 [FLINK-1004] Add the maven repositories for all vendors + documentation
new a822486 Improve error messages for data sinks inside iterations.
new ec0b00d [FLINK-1018] Add tests to verify correct placement of pipeline breakers with broadcast variables
new 3002258 [FLINK-1018] Fix cross pipelining/daming info to resolve cross-related streaming deadlocks.
new 5d4590a [FLINK-828] Implement accumulator example
new f982d40 Reconfigure Apache Rat to enforce the correct ASF license header
new 688f1c1 Fix Quickstart example (by using the latest 0.5.2 Stratosphere release)
new 5b34c0b Fix scope for scalatest dependency
new 8ed2b76 Improve exception messages for file output format when target file cannot be created.
new c04c9bb [FLINK-955] ResizingHashTable: automatic resizing, IndexOutOfBoundsException fixed, pointers
new 152dcde [FLINK-1026] Fix PojoComparator
new 05677f3 [FLINK-1031] Fix POM files to support Eclipse
new 9fb620d Update LICENSE and NOTICE files
new bbff328 Consolidate some third-party license entries, update readme in binary distribution
new 3827f06 Add Netty to License files
new dc55cc3 [FLINK-1024] Enable automated snapshot deployment through Apache's Maven infrastructure
new c066190 Add ASM to LICENSE file
new 911f673 Add ScalaTest to LICENSE file
new 2e50eac Add notice to ClosureCleaner
new 25b4099 [Documentation] Move "How to contrib"; "coding guidelines" out of the code repo (part of FLINK-1012) Improve build instructions with respect to Hadoop 1 and Hadoop 2 dependencies. [ci skip]
new ac6fd75 Fix License and Notice entries and headers for all web frontend files (css, js, fonts)
new bef5e54 [FLINK-386] Fix and clean up dependencies
new 5251263 [FLINK-998] Close network connections when idle
new a45c14b Update Netty dependency to 4.0.21.Final
new ccd4950 Add type parameters in OutboundConnectionQueueTest
new 32d168f Remove unused import from OutboundEnvelopeEncoderTest
new 23289d6 [FLINK-1039] Fix pojo expression keys for group reduce
new bcf85c2 [Docs] Limit nesting of generated TOCs
new 9d1c49f [Docs] Adjust Java API documentation to be in sync with latest changes
new 22b24f2 [FLINK-701] Refactor Java API to use SAM interfaces. Introduce RichFunction stubs for all UDFs.
new bc89e91 [FLINK-701] Several cleanups after SAM refactoring. - Lambda detection compiles on earlier java versions - Add lambda detection test. - Fix JavaDocs
new 934e4e0 [FLINK-701] Change KeySelector to a SAM interface
new 72d7b86 [FLINK-1023] Switch group-at-a-time function to java.lang.Iterable (from java.util.Iterator) Iterables over transient data throw an TraversableOnceException when iterated over again.
new e4c3754 [doku] fix broken image urls
new ecb829e Create release scripts, add support for "cdh4" build.
new 71cccd6 Reflect recent changes to Java API documentation
new 76a48df [FLINK-909] Remove additional empty (and non empty for iterative broadcast variables) superstep. [FLINK-945] Fix early memory release in iterations
new b6ae1ef [FLINK-909] Adjust aggregators test case
new 1637cb1 Disable POJO types
new b63beba Remove expression key methods
new 3f1e220 Fix broken history due to misplaced google load js
new 3779d18 Extended release script, update nightly build script
new 9d8f492 Maven now tests if files generated by the archetypes do actually build
new eb51c88 [FLINK-1042] Changed ClassLoader field to be transient.
new 7e39696 Remove field0 from CoGroup and Join Operator
new 9d09200 Change python2.7 to python in KMeans Quickstart
new e905c34 [FLINK-966] java examples included in packaged example directory
new e45534c Fix problems with missing files/dependencies with cdh-4 distribution.
new e8056af Fix legacy names in static webclient contents
new 4ce973f Fixes on CDH4 build / Maven improvements: - remove usages of commons-lang (we use only commons-lang3, as defined in flink-runtime/pom.xml) - Upgrade maven failsafe to 2.17 so that tests also fail if the test errors (exceptions during execution) - added new build profile "docs-and-source" that creates javadocs and source attachments. These are usually only needed when releasing (--> speed up the build)
new c693f04 [FLINK-1046] Made sure that Client uses correct user-code class loaders.
new e696ff7 Add Sanity Checks for Join/CoGroup with SolutionSet in Record API
new c0007b0 [FLINK-1047] Fixes main class for start-local.bat
new 1b0bbc0 [FLINK-1048] Swallow output of SET statements in ./bin/flink.bat
new 2eea26b [FLINK-1051] ./bin/start-local.bat prints error message if java.exe cannot be found
new 7abe636 Another fix for CDH4 compliance
new a87559a Adjusted examples packaging to only create jars for fully self-contained examples.
new d4de977 [FLINK-1053] Add "mapPartition" operator.
new d0cead7 [FLINK-1053] Cleanup implementation of mapPartition function
new 653216b Small bug fixes for running hadoop output formats
new 8d7e33c [FLINK-1054] Fix job history view in web frontend
new bbde5fa [FLINK-1006] Added support for the MapR file system
new 094af83 make CI build faster
new b2af293 Run tests in parallel
new b77cdc4 [FLINK-977] Improve error reporting for failed TM connection.
new 9395e4b [streaming] Initial commit
new 2414891 [streaming] updated README
new 6bf3d1e [streaming] Initial source commit
new f6ff8a5 [streaming] JobGraphBuilder refactor
new a0d9ef5 [streaming] Begin implementing StreamSource object
new 27f35d4 [streaming] Source and Task interface updated
new 7d82dd1 [streaming] StringRecord to Record migrate
new 0e2b44f [streaming] Ordered imports, migrated StringValues to IntValues and LongValues
new c643e64 [streaming] My stream refactored, JobGraphbuilder update
new 19ac4c6 [streaming] UserTaskInvokable usage added to JobGraphBuilder
new 290ba9f [streaming] Added UserSinkInvokable
new 91d2747 [streaming] UserSinkInvokable fixed
new 5bb1cb1 [streaming] Automatically getting the number of input components in StreamTask
new d3d90dc [streaming] Refactored the NumberOfInputs setting in JobGraphBuilder
new 48d80bd [streaming] Refactor 2 of the NumberOfInputs setting in JobGraphBuilder
new 8c21933 [streaming] Jobgraphbuilder connect update with partitioning
new 937412c [streaming] Package naming refactor
new c1f7a09 [streaming] Added DefaultInvokable functionality
new 7855864 [streaming] StreamSource and Task updated to support connection level partitioning
new 39098a5 [streaming] Apache Licensing added
new 010c00c [streaming] Stream classes refactor
new 9dfd75f [streaming] StreamInvokable class added, updated UserInvokables
new fbe9ae7 [streaming] test case update
new 486d7e0 [streaming] ShufflePartitioner Concept added
new 93354e9 [streaming] Started implementing FlatStreamTask
new d38c573 [streaming] Partitioner classes added
new 3ccdaf0 [streaming] JobGraphBuilder api update with partitioning
new 2bbfa24 [streaming] JobGraphBuilder method name refactor
new 6d6d8a5 [streaming] FlatStreamRecored fixed
new 241f4db [streaming] StreamSource and Task updated to support new grouping api + refactored
new 4f1e529 [streaming] Basic WordCount added
new 1debcc2 [streaming] WordCount Refactor
new f4551a8 [streaming] WordCount object reuse
new 820b58d [streaming] WordCount updated
new c7806ac [streaming] Added StreamRecordProvider instead of FlatStreamRecord
new cf867f5 [streaming] Added UUID generation to StreamRecordProvider
new d5f2d7f [streaming] StreamRecord created
new 038f4f9 [streaming] Added AckEvent
new 87865c1 [streaming] UUID used to identify StreamRecord
new cc0b496 [streaming] Implemented basic record acknowledgment
new 63a2dfd [streaming] StreamTask getClass TODO resolved
new 5d40e87 [streaming] Record copying in StreamRecord removed
new e34bcd2 [streaming] Created StreamComponentFactory for the common methods of StreamSource and StreamTask
new 87c11cf [streaming] Making a copy of Record in StreamRecord
new 4116c4b [streaming] emit update
new 98063ff [streaming] solve issue #3
new 37c46f8 [streaming] FieldsPartitioner fix
new 28ba739 [streaming] StreamComponent additional refactor
new 26443e6 [streaming] UserFunction setter move to StreamComponent
new 41130d5 [streaming] FaultTolerancyBuffer class added
new 04a717e [streaming] ack update
new fecbe35 [streaming] updated streamrecord getrecord method
new 960cecc [streaming] Fail event added
new 02e7747 [streaming] emit update
new 68acdcb [streaming] FTBuffer fix
new e53d45e [streaming] remove duplicate maven plugins. Added travis config
new 1cb9016 [streaming] StreamComponentHelper refactor to Generics
new cd21bce [streaming] StreamComponentFactory rename to StreamComponentHelper
new d639608 [streaming] SerializableStreamRecord added
new b1071d8 [streaming] FaultTolerance update with timekeeping + concurrent publishing bugfix
new f660d05 [streaming] Implemented thread safe event publishing
new 3d19332 [streaming] initiate windowing
new fb0aaa9 [streaming] Started using Serializable StreamRecord
new 7d70f49 [streaming] StreamRecord toString quickfix
new 7bff50f [streaming] add timestamp field
new 2a6e93d [streaming] improved threadsafe publishing
new 258023d [streaming] uuid update
new a6fecec [streaming] methods added for fault tolerance testing
new e943753 [streaming] initialize tuple batch processing
new ba48c65 [streaming] tests written for FaultTolerancyBuffer
new 61531e9 [streaming] enable batch sending
new 00c6c1c [streaming] remove input files
new dcc0e2e [streaming] Fixed FaultTolerancyBufferTest error caused by batchable StreamRecord, cleaned some imports
new c147c35 [streaming] StreamComponentException added
new 6ec3603 [streaming] batch StreamRecord Refactored
new bca5dfd [streaming] Renamed batch simple test (StreamSink and StreamSource)
new e879d8c [streaming] StreamComponentException usage
new 5547fc6 [streaming] hamlet.txt added to testdata
new d1fc338 [streaming] new streamrecord constructor added
new 55f880b [streaming] javadoc added to fault tolerance buffer
new b933fcb [streaming] CellInfo refactor
new ff431e5 [streaming] BatchForward Refactor
new d8a1321 [streaming] FaultToleranceBuffer rename
new 7ca4718 [streaming] javadoc added to api elements
new 87fd433 [streaming] WordCount Refactor
new 9fc9154 [streaming] javadoc added to api
new f42bfb2 [streaming] wordcount moved out from testbase
new 3ae8663 [streaming] WindowedWordCount Refactor
new 34b9f7d [streaming] CellInfo Refactor
new 38d108a [streaming] Added FTBuffer
new cef2a4d [streaming] Added WordCountDummySource for simpler testing
new 306ef32 [streaming] WordCount Refactor
new ab00ad6 [streaming] Test Refactor
new 8fa43e8 [streaming] Added .gitignore
new 73c4e33 [streaming] Added StreamRecord setter
new fda3455 [streaming] Added logging for API
new b8b928f [streaming] Updated StreamRecord, removed AtomRecord
new c2ec3cb [streaming] Logging intermediate stage
new 700b38d [streaming] Added new getters and setters to StreamRecord
new bd81e2c [streaming] StreamRecord copy quickfix
new abf758d [streaming] fault tolerance update
new f350b9d [streaming] Logging & WordCount bug
new 517eea9 [streaming] wordcount bugfix
new 65831b7 [streaming] Added NoSuchRecordException and StreamRecord tests
new f9cbd54d [streaming] Added Apache Licenses to sourcefiles
new 4b03b9b [streaming] updated fault tolerance buffer and jobgraphbuilder to properly handle broadcast partitioning
new 9b34c8d [streaming] wordcount cluster test
new 3d6462b [streaming] Cluster trial & error
new 33e4803 [streaming] wordcount cluster testing
new 13e9f38 [streaming] Logging updated
new 981ea47 [streaming] StreamRecord package created
new 48ae7ca [streaming] StreamInvokableComponent rename
new cd47b2b [streaming] Added test package for Partitioners
new 98e087f [streaming] Added testing for Partitioners
new ef76b59 [streaming] wordcount cluster settings updated
new 966a141 [streaming] cellinfo and wordcount update for cluster testing
new 6f1136c [streaming] wodcount cluster settings update
new 01997bd [streaming] Logging update
new ffdbb03 [streaming] Sink results added
new 348e85b [streaming] cluster testing
new a3809ee [streaming] minor bug fix
new 6e3809f [streaming] Added Source & Sink parallelism
new bf51915 [streaming] Eliminated Testbase2
new 32c6701 [streaming] StreamRecord javadoc fixed
new 976bc57 [streaming] fault tolerance improvement and bugfix
new 77b7dcc [streaming] Logger updated, only streaming is logged
new 2fd380e [streaming] Encapsulated log setup
new 0eba9a8 [streaming] LogUtils updated
new 8951d92 [streaming] StreamComponentTest added
new e1c059d [streaming] Shorter log messages
new d47377f [streaming] Components and faulttolerance buffer updated to support exactly once processing
new b76232b [streaming] Repository change to dms.sztaki.hu/maven-public
new 6d25540 [streaming] Adjust pom.xml to match new repo
new fd5ebc7 [streaming] Refactor: added interfaces to abstract invokable classes
new 6fbe897 [streaming] Code cleanup, added licenses
new 9840f82 [streaming] faulttolerance update
new 6be31d5 [streaming] Rat plugin skeleton added
new d740d11 [streaming] streamrecord bugfix
new 9edb627 [streaming] taskinstance id update
new ea4b082 [streaming] FaultTolerance test updated
new fcaf6ab [streaming] Licensing added to LogUtils
new ae9dde4 [streaming] Added apache lang3 dependency, pom refactor
new 7c80ded [streaming] Refactored JobGraphBuilder and StreamComponents
new 581d0da [streaming] Pom warnings resolve
new f7adcbf [streaming] UserInvokable Licensing
new 5ebe516 [streaming] fault tolerance refactor
new 436554c [streaming] RandIS rename to DummyIS
new 393cf18 [streaming] fault tolerance tests
new 84f7a45 [streaming] ExactlyOnceBufferTest added
new 7f91c57 [streaming] ExactlOnceBuffer bugfix
new e267208 [streaming] fault tolerance refactor
new 38638c8 [streaming] enabled exactly once processing for fault tolerance
new 83a2911 [streaming] fault tolerance buffer updated to support directed emits
new 30ca8dd [streaming] Readme update
new 063dfec [streaming] Examples moved to example package
new 440f23b [streaming] Readme update
new f30581c [streaming] Strated implementing StreamRecord with Tuple
new 34d53c2 [streaming] TupleTest passing
new 05c5b48 [streaming] Tuple serialization added
new adeee2b [streaming] StreamRecord refactor
new 130e5f15 [streaming] tuple test
new ebb18f2 [streaming] StreamRecordTest fixed
new a5e1f0a [streaming] set/get methods written for some basic types
new 9885004 [streaming] wordcountlocal updatet for tuple
new 960d468 [streaming] pom refactor
new 3c07d68 [streaming] Partitioner tests updated with Tuple
new 7941e5c [streaming] BatchForwardLocal updated with Tuple
new 7bedeba [streaming] batchwordcount updated for tuple
new ad67279 [streaming] batch and window wordcount updated for tuple
new 63346f7 [streaming] CellInfo updated with Tuple
new 5030bec [streaming] TupleTest removed
new d4d8c40 [streaming] updated fields partitioning api
new e2a2a49 [streaming] copyTuple method added to streamrecord
new 3b5ec86 [streaming] StreamRecord documentation update1
new bb01ea0 [streaming] JobGraphBuilder documentation update
new aa63c82 [streaming] StreamRecord documentation update2
new 1525410 [streaming] StreamRecord getters refactor
new b22a9e9 [streaming] StreamRecord setters refactor
new cc7d7ef [streaming] StreamRecord copy updated
new a6d09db [streaming] getFieldSpeedTest
new bd87f04 [streaming] streamrecord add/set tuple updated
new 3ac9293 [streaming] removeTuple method added to streamrecord
new a59e2b6 [streaming] streamrecord add method and tests updated
new 0a260cb [streaming] speedtest for tuple20 added
new 9a5801c [streaming] StreamRecord basicTypes update
new 9b31a87 [streaming] minor refactor
new f8d671b [streaming] Removed record fail from invoke
new e3f0f4b [streaming] Started implementing basic type serialization with Long instead of String
new edd8968 [streaming] jobgraphbuilder setnumberoftasksperinstance update
new 7ed3179 [streaming] streamrecord tupleBasicTypesFromLong update
new eaf7feb [streaming] jobgraphbuilder update
new 54c6a0d [streaming] Updated type serialization
new 84e67e7 [streaming] Implemented AckEvent and FailEvent serialization
new 687ff80 [streaming] ack and fail event updated + WordCountRemote modified for debugging
new 22fa55b [streaming] Implemented getResult() for performance stats in WordCountRemote
new fe14263 [streaming] performance tracker class added
new e547f4f [streaming] Updated input checking for next record at invoke
new 6f8f384 [streaming] initiate internal state for stateful operators
new 98967ea [streaming] user-defined window operator
new a2caec7 [streaming] timer added to performance tracker
new fc14906 [streaming] performance util refactor
new 81fd2cf [streaming] add licence
new 9b46f38 [streaming] python script added for performance visualization
new fdb55b5 [streaming] performance tracker update and counter added to wordcount example
new e432195 [streaming] wordcount example modified for cluster testing
new 11d337f [streaming] Added performance test data copying script
new 299b2e9 [streaming] Changed String UID to byte array
new 42751b1 [streaming] WordCount updated for testing
new 266a7e3 [streaming] Started implementing Storm WordCount for performance test
new 0c771a4 [streaming] Performance test scripts added
new ce54860 [streaming] WordCount updated for cluster testing
new 76dd218 [streaming] performance test scripts updated
new 7f20110 [streaming] WordCount update for testing
new a10202f [streaming] Added test runner script
new ac58ccb [streaming] replaced synchronized methods with concurrent collections
new bdda531 [streaming] performance tracker update
new e841da5 [streaming] WordCount performance
new 413227c [streaming] perf util update
new 68ebfc4 [streaming] WordCount performance testing
new 4f5b68d [streaming] update internal state abstraction
new bf33535 [streaming] add license
new cf27df6 [streaming] update internal state abstraction, add index.
new cbabbe7 [streaming] refactor
new f7d2298 [streaming] jobgraphbuilder update
new 955ee99 [streaming] WordCount example refactor + performanceTracker update
new 3c4d5b1 [streaming] performance tracker fix
new 26f4fcb [streaming] Upgrade to 0.5-rc1
new 08d2ac6 [streaming] basic topology example added
new 900c8d8 [streaming] incremental machine learning skeleton added
new 16d90f0 [streaming] StreamRecord serialization updated to support basic array types
new a68d78f [streaming] Updated Tuple type serialization
new 53e54a6 [streaming] StreamRecord update with faster serialization and removed copy when adding/setting tuples
new 2d17a6c [streaming] StreamRecord serialization improvement
new 4085a27 [streaming] fix some conflicts
new ca1e41d [streaming] fix several bugs in in the examples. Window operator runnable
new ac08ec2 [streaming] IncrementalLearning skeleton updated
new 58407ef [streaming] Javadoc fix
new e005d75 [streaming] Minor pom fix
new c5ae0d7 [streaming] StreamRecord iterable and new constructor added
new d9d476e [streaming] IncrementalOLS implementation added, IncrementalLearning renamed to IncrementalLearningSkeleton
new d341b5e [streaming] Update to 0.5-rc2
new 45e3871 [streaming] IncrementalLearning skeleton updated
new 7d87160 [streaming] Javadoc fix
new 03e06e4 [streaming] Minor pom fix
new 8fd500e [streaming] StreamRecord iterable and new constructor added
new c9d95f1 [streaming] IncrementalOLS implementation added, IncrementalLearning renamed to IncrementalLearningSkeleton
new 98107e1 [streaming] Update to 0.5-rc2
new ee68f63 [streaming] perf util refactor and update
new 7b780ca [streaming] add window sum example
new d6c56ed [streaming] Incremental OLS fix
new 105b596 [streaming] finished windowing sum and windowing wordcount example
new 683277f [streaming] minor bug fixed
new d15a8f0 [streaming] basic RabbitMQ tolopolgy add to test future support for RabbitMQ
new 794e280 [streaming] FaultTolerance set via JobGraphBuilder config
new ce2d67f [streaming] Merged RMQTopology
new 03b0f8b [streaming] added support for udf objects in jobgraphbuilder
new c2aff83 [streaming] JavaDoc and api update
new e7e266f [streaming] Fixed double logging, added FieldTypeMismatchException
new db00b86 [streaming] api refactor
new 716aaa8 [streaming] add clear function for StreamRecord, add framework of checkpointer.
new 5c98abd [streaming] License fix
new 75431b7 [streaming] Version set to 0.5
new 3b787e2 [streaming] api cleanup
new f6c8a62 [streaming] add frameworks for iterative computation.
new ad1a95c [streaming] add stream join and stream window join example, refactor window state
new ac16877 [streaming] add license & implement iterative processing
new ee31494 [streaming] Version set to 0.5
new 26fcfeb [streaming] add kafka topology
new 680b486 [streaming] Replaced List<RecordReader> with UnionRecordReader
new 2a79bb2 [streaming] Refactored StreamComponentHelper and StreamComponentTest
new 46990c8 [streaming] Refactored logging to avoid expensive String concatenation
new 3e2337e [streaming] branch added for new api
new dd9ebec [streaming] StreamCollector added
new 3dc8b26 [streaming] streamrecord reworked
new a1116c3 [streaming] datastream added
new a3b1dfa [streaming] Project version set to 0.1
new 453109d [streaming] Project version set to 0.2-SNAPSHOT
new 942d6c0 [streaming] array based streamrecord added
new 4c9b89f [streaming] license added
new 11abb7a [streaming] Standard and Union StreamRecordReader added for improved serialization, not yet added to StreamTask and Sink
new 1704dfd7 [streaming] created abstract streamrecord class + added StreamRecordReader and UnionStreamRecordReader to streamcomponenthelper
new fb81958 [streaming] ListStreamRecord test added
new 0721d18 [streaming] StreamComponentHelper updated
new 51dbe6e [streaming] Fixed StreamComponentTest
new 5f6cdb6 [streaming] Stratosphere dependency upgraded to 0.5.1
new 9e6abe1 [streaming] Refactored API to use new StreamRecord
new c92727b [streaming] add CF job
new b5dfc94 [streaming] update iterative jobs
new 453acfb [streaming] Implemented dummy flatMap
new 1971b67 [streaming] Added JobGraphBuilder getter to StreamExecEnv
new b9d0d0b [streaming] TypeExtraction test works
new 7904f10 [streaming] Added FlatMapInvokable
new e196ee6 [streaming] new api test
new 6a45336 [streaming] new api refactor
new aede14f [streaming] MapFunction support added
new 25222de [streaming] new api refactor
new 0d46177 [streaming] Deleted StreamOperator
new ba25a0b [streaming] Deleted SingleStreamInputOperator
new ce56b14 [streaming] connectWith and partitioning added to newapi
new ce7a899 [streaming] addSink added to newapi
new 4f4e975 [streaming] Source skeleton added
new adfb62a [streaming] addSource fix + added missing licensing
new a39148a [streaming] connectWith fix for different connection types
new a9ffdfd [streaming] added todos
new 0975167 [streaming] Added BatchReduce deserialization at stream components
new ed42237 [streaming] WordCount Counter & Splitter update
new 8da89a7 [streaming] Added FileSourceFunction
new 4851238 [streaming] Tested BatchReduce
new f1d4b25 [streaming] TypeExtract test added
new 586edb6 [streaming] WordCount updated
new cde1d46 [streaming] package refactor
new f8425f1 [streaming] Added FilterInvokable, eliminated code repetition at adding a function to DataStream
new e614194 [streaming] Updated CellInfo and BasicTopology examples
new 926403e [streaming] Updated Kafka and RMQ sources to new api
new a7702c0 [streaming] Updated StreamComponentTest
new 44c378a [streaming] stream-join modified for new api
new 2548470 [streaming] minor update for partitioning setting with connectWith
new 2a31b8a [streaming] FaultTolerance test update
new 55df54d [streaming] deleted obsolete examples, renamed addFileSource -> readTextFile to match batch api
new eace47b [streaming] window join modified for new api
new 26a5266 [streaming] Added batch setting to components
new 269b099 [streaming] Added batch timeout
new 543a27d [streaming] .batch operator added to datastream
new 108eba3 [streaming] connectWith fix
new c145afe [streaming] iterative example deleted due to lack of relevant content
new 2cbc142 [streaming] Incremental OLS update
new d3ba0b3 [streaming] IML Skeleton update
new 839d46c [streaming] adapt to new APIs
new 28ba85b [streaming] Minor WordCount Refactor
new 2e3606c [streaming] adapt to new APIs and modify iterative algorithms
new 7e7051b [streaming] TestDataUtil added
new 84759da [streaming] added support for batch partitioning to jobgraphbuilder
new 6691674 [streaming] Added StreamCollector2
new e509ba9 [streaming] Checksum check added to TestDataUtil
new 3e337a0 [streaming] Added DataStream copying
new 3e93ea6 [streaming] TestDataUtil update with Logging
new 697eb77 [streaming] minor fixes
new 6c2a1b3 [streaming] refactor and jbuilder update for StreamRecord2
new cb205d3 [streaming] StreamCollector2 added to streamcomponenthelper with fix
new f244803 [streaming] Commenting out tunfinished iterative jobs
new 386a332 [streaming] Licensing added
new 916c3a8 [streaming] Iterative datafiles cleaned
new 8fb273a [streaming] Fixed AtLeastOnceBufferTest
new 082779c [streaming] Refactored BatchReduceTest
new 96434ab [streaming] in the wordcount example the download function is platform independent
new b39305f [streaming] parallelism parameter added to operators
new 6452ca0 [streaming] Fixed java 1.6 error
new c804ab5 [streaming] Map and FlatMapTest implemented
new a1d3d8f [streaming] Added MockRecordWriter for testing
new 4f94e2fc [streaming] Updated StreamCollector2Test
new 03aaf82 [streaming] Added MockRecordWriterFactory
new e31a981 [streaming] Moved tuple copying to StreamCollector2
new 3d05ef4 [streaming] new tests in MapTest
new 845b1dd [streaming] Test updates
new 9f4d7b6 [streaming] license add
new fa9fced [streaming] more test in MapTest
new 7322ac2 [streaming] test in MapTest, addSink with paralelism argument
new b9a48d3 [streaming] TestDataUtilTest added to test the download function of TestDataUtil
new 6b21f33 [streaming] test build fix
new 615dd87 [streaming] download function of TestDataUtil was rewitten without using package nio
new 0dea5d1 [streaming] comment remove
new f9d0323 [streaming] StreamExecutionEnvironment javadoc update
new 07586af [streaming] hamlet md5sum change
new 08f578c [streaming] remove java.nio from TestDataUtilTest
new bbd1ed6 [streaming] .print() added as a sink to datastream
new 63bd5c9 [streaming] example fix
new e518e0d [streaming] new tests, wordcount performance classes, commented examples
new 5875dac [streaming] conflict solved
new 8a2ad26 [streaming] license add
new 9a7b6d5 [streaming] examples update
new 07f53c3 [streaming] added some comment
new 8457ed2 [streaming] comments on examples
new f60f286 [streaming] javadoc for DataStream
new 7345bf6 [streaming] StreamExecutionEnvironment javadoc update
new 19de827 [streaming] examples refactor
new 54f06b1 [streaming] clustersize setting added to streamexecution environment
new ccc1f5f [streaming] streamcollector2 bugfix
new 7b7ac3d [streaming] Fixed BatchTest
new 54a66d7 [streaming] using Sets for testing parallelism
new c386ec7 [streaming] fromElements and fromCollection source added + refactor
new b6b3187 [streaming] generateSequence source added
new bc977eb [streaming] fromCollection, fromElements test
new 30af0de [streaming] jobgraphbuilder refactor and javadoc
new 169139a [streaming] generateSequence test
new 7251f31 [streaming] Stratosphere version set to 0.6-SNAPSHOT
new 37a85a6 [streaming] refactored dummysources
new c3fe735 [streaming] datastream and streamexecution environment javadoc update
new 8f77a93 [streaming] streamcollector refactor
new b6a17eb [streaming] connectwith function with multiple streams in the argumentum list
new f08d55d [streaming] Strato dependency to 0.5.1
new ebae500 [streaming] StreamComponentHelper refactor
new 46dab75 [streaming] Strato version to 0.6-SNAPSHOT
new 0ede939 [streaming] test for connect with
new 9028197 [streaming] Test refactor
new 04dbc25 [streaming] PreformacneSplitter update
new 6375105 [streaming] RMQSink and Test
new b0219bb [streaming] Decomposing project mv
new 9b49450 [streaming] Started moving to 0.6
new 7d9858a [streaming] refactor window operator and internal state management
new 50157f5 [streaming] update state manager
new f054ac0 [streaming] 0.6 build fix
new a31df65 [streaming] First succesful decomposed build
new a2cabbb [streaming] DataStream id update
new e416f39 [streaming] pom update
new b2f8f6e [streaming] Remove dms repo from pom
new 23788bc [streaming] RMQ test removed
new edf3a0f [streaming] javadoc update
new 0e2008b [streaming] default signature added to operators
new 4728eb9 [streaming] fix kafka producer bug
new 5d0efac [streaming] flatmaptest refactored
new 7efb84f [streaming] MapTest refactored
new a3ac7af [streaming] streamcomponent cleanup
new 75d9493 [streaming] BatchTest refactored
new e02b729 [streaming] test cleanup
new b53e58f [streaming] StreamExecutionEnvironment restructure to match main project
new 0fd098f [streaming] KafkaSink, added shutdown to KafkaSource
new 916b1eb [streaming] merge
new 086d1a7 [streaming] add disk dump sink, prepare to support multiple output stream
new b44650b [streaming] Removed unused StreamInvokableComponent
new a3164ab [streaming] Replaced StreamComponentHelper with AbstractStreamComponent
new 5db9601 [streaming] Added RemoteStreamEnvironment
new cdce868 [streaming] RMQ Sink for other types
new 4363991 [streaming] test update
new 1ef06ef [streaming] streamcollector test fix
new 5f8fa5e [streaming] javadoc fix
new 0a0ec77 [streaming] package restructure
new df9dac2 [streaming] Version set to 0.3-SNAPSHOT
new f0c5731 [streaming] RMQ source for multiple types
new 74ac9d4 [streaming] Rat fixes
new 6225f15 [streaming] Performance removed
new 2b83102 [streaming] rmq source refactored
new f5cda1b [streaming] javadoc update
new 90df953 [streaming] kafka sink and source for multiple types
new 47e2c82 [streaming] setParallelism added for datastream operators to match main project
new e6da708 [streaming] merge
new 3e83eb4 [streaming] jobgraphbuilder bugfix
new 33884df [streaming] Javadoc fix
new cff52b4 [streaming] addons rename to connectors
new 4111693 [streaming] remove legacy source folder
new 93f8ef6 [streaming] explicit output flushing removed from streamcollector
new 152e8bb [streaming] addon packages rename to connector
new e6652de [streaming] merge
new a9ed127 [streaming] explicit output flushing readded + need fix
new 65d0e32 [streaming] Package restructure
new 5b05ca6 [streaming] Updated RemoteStreamEnvironment
new b96db72 [streaming] IterativeDataStream Prototype
new d26c230 [streaming] Fixed JavaDoc of RemoteStreamEnvironment
new 298a7f7 [streaming] IterateTest refactor
new d571088 [streaming] simple iteration added with BlockingQueues
new 00a813f [streaming] iteration source/sink refactor
new d2607b1 [streaming] Licenses
new 0ea292e [streaming] Implemented and tested naming a component
new 5d401ff [streaming] Iterative prototype
new 7dc7b5c [streaming] Imports organized
new 8ad6400 [streaming] Test minor refactor
new 4e25b07 [streaming] Minor fixes
new 1171d02 [streaming] ZeroMQ package
new 23f649e [streaming] Multiple iteration 1
new 59edac8 [streaming] Added directed emit
new e77998c [streaming] test minor refactor
new cd9f960 [streaming] Updated OutputSelector
new 2b85c01 [streaming] Refactored collectors
new b89fa9a [streaming] jobgraphbuilder refactor
new 12e52f8 [streaming] Package and Java Dependency rename
new 1e434d1 [streaming] Module rename
new 3b94765 [streaming] Dependency update
new cf24143 [streaming] Data{In/Out}putView QuickFix
new dea3e77 [streaming] snapshot repo to pom
new c052172 [streaming] pom fix
new 361526b [streaming] Src licenses updated
new 771d9e3 [streaming] Readme trim
new df925b9 [streaming] Output-flush testing
new 1653ed5 [streaming] jobgraphbuilder remake to build graph at execution
new d573717 [streaming] OutputFlush moved to a separate branch
new 0cfb0b7 [streaming] jobgraphbuilder remake
new 717241a [streaming] Output-flushing
new 2bb9aa7 [streaming] iteration test fix
new 509de41 [streaming] iteration sink automatically named to 'iterate' for directed emits
new c298ef1 [streaming] streamrecord remake + cleanup
new 852f9e1 [streaming] cleanup
new ed40b29 [streaming] streamrecord cleanup
new f742963 [streaming] partitioner performance improvements
new 2166db7 [streaming] package refactor
new 6cfc9a9 [streaming] License fix
new 20f5dce [streaming] Flink version update
new 9d1806c [streaming] License update
new a5e882d [streaming] JobGraphBuilder minor refactor
new 82c9f7c [streaming] Enforced Flink coding style
new 5b33f5e [streaming] Removed legacy performace tester utils
new 9d5bd60 [streaming] Legal issues of dependencies addressed
new 7238010 [streaming] Fixed generics and added SuppressWarnings
new 646190d [streaming] Eliminated writing to standard output
new aff4455 [streaming] Test restructure + added tests for streamrecord and collectors
new b8d95bb [streaming] Fixes enabling build (mainly Licensing, Codestyle, Poms)
new c524951 [streaming] Merged conflicts
new d228164 [streaming] Build clean up & Removal of streaming.index package
new 1ff04d5 [streaming] Removed profiles from pom.xml and made partitioners generic
new 871abbb [streaming] Corrected POM changes
new 859983c [streaming] Forward connection type added to DataStream to support inmemory forwarding of tuples
new 5d72dd4 [streaming] Iteration update to use proper partitioning and forward connection + DataStream refactor and Javadoc update
new bb8a282 [streaming] Enforced the ASF2 license in POMs
new c79b48b [streaming] added writeAsText and Csv
new 60f632a [streaming] Package refactor & cleanup
new 4e07bb2 [streaming] Added support for same outputname for multiple tasks + proper iteration edge naming
new 251ee67 [streaming] Added exceptions
new 3228db5 [streaming] Javadoc update for some core classes
new f54d7b9 [streaming] Fixed filter
new 0c1ef6d [streaming] Serialization rework to reuse objects
new c21f0e3 [streaming] Added mutability switch for operators + cleanup
new 11f62c1e [streaming] Fixed StreamCollectorTest
new 5dbf815 [streaming] API javadoc + StreamRecordSerializer update
new 6e52195 [streaming] windowReduce added + BatchReduceInvokable reworked
new f436690 [streaming] Added CoFunctions for two type inputs
new b92ce01 [streaming] Fixed multiple input CoFunction
new 2c4e195 [streaming] Distributed partitioner added
new f186f3d [streaming] Automerge error + License fix
new 1edd031 [streaming] CoMapTest update
new 126a1cb [streaming] Updated operators for better mutability handling
new 1fccb10 [streaming] Replaced connection types with StreamPartitioner in DataStream
new be459ae [streaming] Operator invokable refactor
new a2c4137 [streaming] StreamRecordWriter added for automatic output flushing settings
new 330d8fd [streaming] Moved task configurations to StreamConfig
new d282eef [streaming] Refactored StreamComponents
new 7ca778b [streaming] Added twitter-hbc dependency to connectors and upgraded slf4j accordingly
new a06f9d1 [streaming] Added Flume connector and updated connectors
new 7c5bc3c [streaming] connectors logging and error handling fixed
new 2f704ae [streaming] Javadocs for connectors
new 799424d [streaming] Wrapped serializers to make component construction simpler
new ee7c4a8 [streaming] JSONParseFlatMap added to examples
new b3cd5fd [streaming] Twitter connector prototype
new 1162cac [streaming] Added support for simple types instead of Tuple1 in the API
new fed03a2 [streaming] Removed unnecessary files from streaming project root
new 776bd3f [streaming] Updated API to use RichFunctions
new 910f74d [streaming] Directed emit API updated to use split and select
new f932700 [streaming] DataStream type refactor
new 0465d30 [streaming] Added new DataStream types for operators
new e73ea29 [streaming] Updated Streaming function interfaces to match main project
new d56d48f [streaming] API update with more differentiated DataStream types and javadoc + several fixes
new 9be9814 [streaming] DataStream output naming reworked from vertex to edge based model
new 1b31f4d [streaming] Iterative DataStreams updated with buffer timout and max wait time
new 74d3742 [streaming] DataStream fix to return DataStreamSink on closing operators
new 309727e [streaming] GroupReduce operator added + StreamCollector bugfix
new e089959 [streaming] Implemented sliding window and batchReduce
new 696bce0 [streaming] Added groupBy operator to DataStream + name refactor
new fc46d4c [streaming] Updated operator test to avoid environment execution
new e6766fd [streaming] Several minor bugfixes
new 35cf874 [streaming] Exception handling update & minor refactor
new 0163cfa [streaming] Fix LICENSE file for streaming project. Minor merge fixes.
new 923b508 [streaming] Fixes for tests to support parallel builds
new 61bb30b Update LICENSE and add license headers to CSS and JS in flink clients
new 8bc7894 Split between source distribution license/notice and binary distribution license/notice. Add a DEPENDENCIES file to list all maven dependencies with licenses and notices.
new 8594905 Add new DEPENDENCIES file to apache-rat's exclude list [ci skip]
new ae32c18 [YARN] properly set diagnostics messages on failures
new e8f2e9d [FLINK-968] Add slot parameter to YARN client
new 91a52a1 [FLINK-1050] Windows local setup documentation: added note for java being in %PATH% variable, headers, and missing link label
new 6c48063 [Documentation] Add documentation on accessing Microsoft Azure Storage Tables [ci skip]
new 4717c0c [FLINK-1053] Add documentation for mapPartition() function
new aa8ad75 [FLINK-954] Improved WebClient
new 5eb636a [Documentation] Fix broken links
new 46f5c89 updated CONTRIBUTORS file
new 6eefedc [FLINK-834] Added DataSet.writeAsFormattedText()
new 0bb3af7 Update release script (its the exact setup for creating the 0.6-incubating release)
new d7609a9 Set version of poms to 0.7-incubating-SNAPSHOT ; 0.6-incubating release tasks: - update _config.yaml of integrated documentation - quick check on the quickstarts / build instructions to match the latest release - quickstart.sh scrips now point to the correct versions.
new 48e6b9f [FLINK-993] Release builds and nightly builds now have the same names
new bcc2af9 Forgot license header (which causes apache-rat to fail the build)
new ce3ed7e [FLINK-1067] Replaced Stratosphere by Flink in FAQ
new f96a7e0 [FLINK-1068] Remove cdh4 specific build profile.
new 0084059 [FLINK-1074] Fix for NULL input tuples in ProjectJoin
new 1e38a63 [FLINK-1071] Add Map Partition to Plan dump JSON generator
new 7596012 [streaming] CoFlatMap & CoGroupReduce functionality
new 75b9bc8 [streaming] Added database-backed state
new d5f8a69 [streaming] Memcached, MySQl and SQLite support for state management.
new 4d407ca [streaming] Refactored db state connectors and added their license
new 1b046f4 [streaming] Refactored stream components with InputHandler & OutputHandler
new 6cf15c2 [streaming] Minor bug and license header fixes
new ce55dc3 [streaming] Updated DBStates
new fa75af0 [streaming] DataStream merge fix + example clean-up
new c3ec1e1 [streaming] CoRecordReader and iterator added + ConnectedDataStream refactor
new 3583513 [streaming] Examples updated with CoFunctions
new f74cb0a [streaming] Added JSONParser and updated Twitter connector
new 0b72112 [streaming] WindowJoin Example refactored
new cad38ed [streaming] connectors logging and deploy update
new 90ad6b0 [streaming] reduce operator added to DataStream and ConnectedDataStream + grouped batch and windowReduce operators reworked
new a103950 [streaming] Moved dependencies to enforce correct policy
new 82aa005 [streaming] Mutable and Immutable invoke in CoInvokable
new 4207c5f [streaming] Added MockCoInvokable, replaced environments with it in CoFunction tests
new d5d9706 [streaming] Tests added for Reduce, GroupReduce and BatchGroupReduce invokables
new 17ce048 [streaming] Removed assembly execution on maven package for connectors
new 0731f77 [FLINK-1065] [streaming] Explicitly adding commons-math dependency
new 723cb27 [streaming] StreamInvokable refactor and javadoc update + StreamRecordSerializer update
new f149197 [streaming] GroupReduceInvokable update
new 1850211 [streaming] Added exceptions for wrong usage of StreamExecutionEnvironment
new 0e8bf02 [streaming] Added customizable timestamps to window operations
new eba8df0 [streaming] Add redis dependency notices to binary distribution NOTICE file and DEPENDENCIES file
new 0b10051 [FLINK-1070] Change return type of "getBroadcastVariable()" to List.
new cbbcf78 [FLINK-1075] Removed the AsynchronousPartialSorter.
new fbed013 [FLINK-1079] Fix inconsistent parameter naming
new 0a6e53d [FLINK-1078] PrintingOutputFormat uses same partition indexing as FileOutputFormat.
new c9dd603 [FLINK-1084] Fix broken links in "How to add an operator"
new 01ff302 Add Pi approximation Java example
new 4d4151d Some simplifications to the PiEstimation example
new d60a316 [FLINK-1020] Introduce minBy and maxBy
new 22203e7 [FLINK-610] Added KryoSerializer
new dac281f Default generic serializer is Avro. Minor improvements in KryoSerializer. Add mini benchmark for Avro/Kryo.
new 80af60b Disable merging of Iteration Aux Tasks
new 3aa5511 Fix DeltaIteration Bug with Immutable Types
new 0818850 [FLINK-1086] Replace JCL with SLF4J and Log4j with LOGBack
new 0535683 [FLINK-1017] Add documentation for execution parallelism
new 679bdc1 Updated documentation figure: FlinkOnYarn.svg
new 761952c [FLINK-629] getFieldNotNull added to Tuple and updated Aggregators and Comparators to use that where appropriate
new 66c1263 [FLINK-629] Updated getFieldNotNull usage and added it to TupleSerializers
new c0c2abd [FLINK-1063] Revert race introducing commit
new fb3bdea [FLINK-925] Support KeySelector function returning Tuple types
new 122c9b0 [FLINK-925] Extended for distinct operator and added test cases
new f8b6b79 Fix typo in package LICENSE
new df477e6 [Tools] Minor fixes in release script
new de0f346 Fix typo in CONTRIBUTORS
new 7123c78 Update CONTRIBUTORS file
new 244c539 [FLINK-1097] Fixed multiple slf4j bindings when using Hadoop2
new 2f6a955 Remove naive verification of tuple size
new 7adbf53 Remove space after comma for TupleXX.toString()
new 1c58eb8 Remove CONTRIBUTORS file to prefer dynamically generate it
new d97efde [streaming] Fixed SlidingWindowStateIterator
new 47dca69 [streaming] Reduce operator added to ConnectedDataStream + test
new fbfcc9e [streaming] Updated directed emit to not use output names when all outputs are selected
new 0c8f1da [FLINK-1080] [streaming] Streaming aggregation added
new 4d73f51 [streaming] Added TypeInfo to DataStream
new bcbebed [FLINK-1080] [streaming] Streaming aggregation update and refactor
new 13a9277 [FLINK-1058] [streaming] Streaming initial documentation
new 9cbd68a [streaming] DataStream type refactor for easier future extensions
new 47d02a0 [streaming] Invokables and tests added for fast batch/window reduce operations and aggregations
new 5f601cf [streaming] window and batch operator added to DataStream + Documentation updated accordingly
new d0dd513 [streaming] Updated logging to utilize SLF4J
new b6ffdba [streaming] Added CoBatchGroupReduceInvokable, CoWindowGroupReduceInvokable and grouped variants
new 03a28cb [streaming] Added counter aggregation
new 48d8ed7 [streaming] Added checked exception to execution
new 6b6951e [streaming] GroupedBatchReduce modified to batch by key, updated WindowReduce + Batch/Window reduce refactor
new 439ca7ff [streaming] Minor bug fixes in Connectors, StreamCollector & docs
new e2fe9ee [FLINK-989] Improve error message when not finding enough task slots.
new 028fcf5 [FLINK-1030] Refactor and clean up instance managers.
new c32569a [FLINK-1094] Reworked, improved, and testes split assigners
new 2d6199f Redesign Scheduler from pre-assignment to more flexible schedule-on-demand model
new aa7550a Adapt RPC to support primitive types as parameters and return values.
new e6aadfc Redesign Scheduler part 2
new cb7039e Unify all job vertices to one type (rather than dedicated input/output types)
new 9035b6d Make IDs immutable and serializable.
new c16f6d8 Stubs for intermediate data set and related classes
new b32e77a Refactor job graph construction to incremental attachment based
new 2ac08a6 Remove management graph and simplify historic job status
new 43e7d0f Introduce execution attempts at execution vertex. Add tests for job event classes
new ae139f5 Finalize ExecutionGraph state machine and calls
new 25acb6b Adjust ExecutionGraph state machine to TaskManager's failing model (direct transitions to canceled)
new 09d1c33 Adjusted job graph generator to new job graph classes
new 22d8bf8 Adjust test logging for new execution graph tests to logback framework
new b3c30ca Add proper locality of scheduling tracking to scheduler. Add local scheduling to slot sharing groups.
new 9187175 Add options strict co-location constraints to scheduler
new ae57c7c More graceful failing/errors/logging when canceling in early job stages
new 1fdd7e6 Fix buffer leak in TaskManager / test tasks
new d5d3a08 Fix logging in EventCollector Fix comparisons (null pointer safe) in JobManagerITCase
new 8998a30 Better error messages at TaskManager startup and registration
new ef7957f Fix race at TaskManager registration during startup
new e56d883 Fix serializability for SlotSharingGroup
new caa4ebe Adjust tests to new JobGraphModel
new 8231b62 Add co-location-constraints as a special case of slot-shared scheduling
new f229d5b Fix bug in topological sort
new 5d13ddb Port streaming package to new JobGraph API and adjust all runtime-level tests
new 2876455 Improved distribution of IDs. Previous implementation lost bits due to double-to-long multiplication and rounding.
new 8e7216a Fix failure exception message report back to client
new cdee875 Make Co-Location constraints resilient aginst out of order scheduling and depply integrate them with slot sharing Fix miscellaneous checkstyle errors/warnings
new 73ebd3e Fix Java6 errors in AbstractID, pull JobManager changes into YARN app master
new cd699c5 Fix test to be backwards compatible with Java 6
new a00ef7a Fix TaskDeploymentDescriptor serialization
new 9803657 Adjust the web frontend display of the jobs Tolerate concurrent scheduling attempts
new 3e64400 Update web frontend javascript to new states Small fix in integration test
new 8411195 Improve shutdown of JobManager (graceful exit of runing jobs and RPC service)
new 91cfbc5 JobManager checks for empty job graphs
new 7861849 [FLINK-953] Remove fake tail from iterations
new e17575b [FLINK-1077] Improved error message if test fails
new 9463e27 [FLINK-1096] Correction to histogram accumulator
new 7f946ce [FLINK-1038] added RemoteCollectorOutputFormat
new 57b8e66 Refactor TupleTypeInfo and add GenericPairComparator
new 6bbe2a0 Perform TypeExtraction outside of Java Operators
new dee54cb Move the Iteration "Operators" to the operators package
new 785f2c4 Make DistinctOperator and Keys use TupleComparatorBase
new 16dad15 Change ObjectArrayTypeInfo.getInfoFor to use componentInfo.isTupleType()
new a32890a Refactor Tuple wrapping/unwrapping in Join and CoGroup
new 568dff1 Move RichFunctions to api.common package
new b8131fa Rewrite the Scala API as (somewhat) thin Layer on Java API
new 84b04be Connected Components example Scala API rewrite
new a8dd958 WebLog Analysis example
new e0f2440 Transitive closure Scala example
new dd9e27e Added TriangleEnumeration examples for reworked Scala API.
new 81e81b9 Add logback-test.xml to java8-tests and logback.xml to java-examples
new 0dc7614 Adds PageRankBasic Scala example. Removes old Scala examples
new 299cef7 Pi estimation example job in Scala
new 83debdb [scala] Add Field Name Key Support for Scala Case Classes
new 1a4147f Add SemanticPropertiesTranslationTest for Scala API
new dbc680f Add Scala API completeness Test
new 7fe9273 Added LinearRegression scala example. Removed old BGD example.
new 4cce46e Renamed java examples package
new a41a29b Fix rename of java example package to examples
new 31ed0c4 [scala] Fix Formatting in Examples and add ITCases
new fd28098 [scala] Reactivate DeltaIterationSanityCheckTest
new 0385651 [scala] Add Scalastyle, use scalastyle-config.xml from Spark
new ca4fa3d Rename ScalaTupleTypeInfo to CaseClassTypeInfo
new 4ddc3f7 [doc] Switch parser to kramdown, normalize Headings
new feade05 Add ExecutionEnvironment to ScalaAPICompletessTest
new 97d630d Rewrite Java API Guide as Unified Programming Guide
new 7084fa2 [doc] Unify Examples Page
new 15060ef Bump doc version to 0.7-incubating
new b8a8780 Turn Documentation into standalone website, add Overview Page
new c778d28 [scala] Add and* methods to AggregateDateSet
new 69808fd [doc] Unify "DataSet Transformations" page
new 0c79538 [doc] Add automatic generation of Scaladoc
new ec562ce [scala] Add package documentation for package api.scala
new 63e30ff [doc] Fix typo in docs/index.md
new 582cd03 [doc] Re-add streaming guide that was lost in rebase
new 24a9b1e Wait for slots instead of TaskManagers in test environment
new e649d71 [FLINK-1111] Move Basic and Array Type Information into "flink-core" Project
new 1e137be Fixes for LICENSE and DEPENDENCIES files
new 8d83721 Add a FAQ entry about serializability errors
new 4b64a06 Improved robustness of ExecutionGraphDeploymentTest
new d4704e8 [FLINK-1111] Adjust Java-8-tests for type information refactoring
new f329fe2 Changed scala copyright header.
new b904b00 Updated license notices in in java files to be written in block comments instead of javadoc comments.
new cf80d86 [FLINK-1114] Move scala-style checks to scala projects, change paths to style conifg, to allow isolated building of individual projects.
new 1ddec93 [FLINK-1115] Local file streams retry file creation on FileNotFoundException to increase resilience against spurious failures in tests
new b87f2fa Improve error message when scheduler cannot find a slot for immediate scheduling.
new 6bd4d2c Improve robustness of task manager test
new ab0b3a3 Remove error message in execution graph for concurrent state changes that are fully acceptable.
new 4a91be2 Tasks are marked correctly as failed (not canceled), when the taskmanager kills then during shutdown or reset.
new d3ef531 Limit number of RPC worker threads in TaskManager to prevent OutOfMemory (thread space) errors
new bd4197e [FLINK-1077] Fix unstable test CliFrontendPackageProgramTest
new 68801f2 [FLINK-1119] Make sure test mini cluster has started properly before submitting the test job.
new f97f9ba [FLINK-1060] Added methods to DataSet to explicitly hash-partition or rebalance the input of Map-based operators.
new a775c32 Exclude DataSet.rebalance() and DataSet.partitionByHash() methods from ScalaAPICompletenessTest
new 583c527 Added documentation for rebalance() and partitionByHash()
new 4b6d2c5 [FLINK-1073] Added test case to reproduce error
new e5731e0 [FLINK-1073] Enables sorted group input for GroupReduce combiners. - GroupReduceCombineDriver uses separate comparators for sorting and grouping. - Adding support for multiple comparators for a single input driver required some refactoring.
new 6702a2e [FLINK-970] Adds first() operation on DataSet, UnsortedGrouping, and SortedGrouping
new 141946a Added parameter checks and tests for first-n operator. Excluded DataSet.first(), UnsortedGrouping.first(), and SortedGrouping.first() methods from ScalaAPICompletenessTest.
new a3b0284 Added documentation for first-n operator.
new 7cc2400 [FLINK-1104] [streaming] Eliminated Tuple1 from connectors
new 7337110 [streaming] Streaming jobgraph and vertex refactor to match recent runtime changes
new ad98337 [streaming] added batchReduceGroup, windowReduceGroup functionality to ConnectedDataStream and GroupedConnectedDataStream
new 4175dca [FLINK-1102] [streaming] Projection operator added to DataStream
new 1bca326 [streaming] Fixed InternalStateTest to avoid printouts + minor StreamVertexTest fix
new 2dc5437 [doc] [streaming] Added Twitter connector & Projection operator to docs
new 30ac9fe [FLINK-1103] [streaming] Updated WordCount example to become self-contained and removed old TestDataUtil
new 70464bb [FLINK-1121] [streaming] minBy and maxBy operators added to streaming api
new 076223c [FLINK-1122] [streaming] Job Execution with user specified name
new cb81319d [streaming] Streaming packages added to flink-dist lib
new 1c077c1 Add *.log files to .gitignore
new d2c2cc3 Set default log level to info in examples
new c3c7e2d [FLINK-1056] Use maven-assembly to build fat-jar in quickstarts
new 9cf2467 Fix Bug with forced repartitioning in DOP changes.
new 73b5b3d Fix error with invalid config values for degree of parallelism.
new 4a44899 Fix race condition leading to erroneous "NoResourceAvailableException".
new 849e398 [FLINK-1062] Type Extraction for Lambdas
new a0c6ac9 Disable Checkstyle in java8 package
new 3c25a97 Make Java 8 Doc fit into new doc scheme
new e601a0d [doc] Fix missing Scala Version in index.md
new ec2a646 Cleanup LOG.debug to make sure no extra toString and unnecessary String concatenation
new cb803b5 Remove leftover logback-test.xml in flink-java8.tests
new 78a9b60 Point quickstart scripts to 0.6.1-incubating
new 312d127 Change logging backend of SLF4j from Logback to Log4j for better compatibiltiy with YARN. We'll still ship the Logback configuration file and pass them their path to the JVM so that users can use Flink with Logback as well.
new 3e5ab89 Removed slf4j-simple dependency from streaming component.
new f0ed58c Fix Bug in ScalaAggregate Operator and add ITCase
new 01e74da Change Partition Operator to actual general-purpose Operator
new e2c0b9d [FLINK-1123] Add first-n to Scala API
new 66f236d [FLINK-1120] Add Explicit Partition/Rebalance Operator for Scala API
new 2b4d779 Update doc with Scala First-N and Partition/Rebalance
new ea4c882 Added TPCH query examples for Scala API Improved Java TPCH query examples Removed RelationalQuery Java API example
new 76d4a75 [FLINK-1005] Extend TypeSerializer interface to handle non-mutable object deserialization more efficiently.
new 1d00cff [FLINK-1005] Add non-object reusing variants of key-grouped iterator.
new e7c4c85 [FLINK-1005] Make GroupReduce configurable to use either mutable or immutable object mode
new 6af80fb RAT plugin not inhertited, to prevent redundant checks.
new 30e84ff [FLINK-1072] improved build matrix
new 7e43b1c add shading for guava
new 758de7d Major depedendency cleanups - add "flink-shading" for shaded libraries (currently guava only) - relocate guava in all projects and exclude it from the lib and exported dependencies - Exlude unnecessary transitive dependencies from hadoop 1
new 38e4755 Deactivate shade plugin for quickstart projects
new 626d6b7 [FLINK-1117] Clean up flink-avro project: remove deprecated AvroRecord format, migrate tests to new java api.
new 719e288 - Allow dependencies to retain guava - Clean dependencies in flink-streaming connectors
new 15e5990 [FLINK-1118] Exclude log (and crash) files from rat checks.
new 8573bf4 [scala] Simplify Operation Classes: No more Impl Classes
new 949699d Fix guava dependency in flink-streaming-core to allow IDE local testing.
new c8054a3 [FLINK-514] Fixed javadoc problems
new 39ac5ab [FLINK-514] Fix additional javadoc problems and add suppressions for certain compiler warnings.
new 618effa [streaming] Added CoBatchReduceInvokable, CoWindowReduceInvokable, CoGroupedBatchReduceInvokable, CoGroupedWindowReduceInvokable
new 6492af0 [streaming] Reduce and GroupReduce invokable refactor and performance tweak
new 127470b [streaming] ConnectedDataStream API and operator cleanup + modified windowReduceGroup functionality
new 9e722df [streaming] Improved tests for CoReduceInvokables
new 73c6fec Guava shading issue fix for Eclipse
new 425e8a4 [FLINK-1124] Remove redundant HTML close tag
new 1c2ce3a Repair guava dependencies
new d5fb423 Guava shading fixes for eclipse and IntelliJ
new 27e4020 [FLINK-1133] TypeExtractor resolves also variables inside Tuple-input
new 02c0845 [FLINK-1133] TypeExtractor now also supports nested Tuple-input derivation
new b689f3f Move DeltaIteration Sanity Check to Base Operators
new da3e507 Add an object-based variant of the solution set
new 02314ad [FLINK-12] Clean up configuration object - Remove class loader (was inconsistently used and set) - Objects are stored in their type, rather than as a string
new 8e21204 Add flag for unmanaged solution set to spargel
new d10d59e [FLINK-1110] Framework for collection-based execution
new bb71b23 [FLINK-1110] Fix MapOperator execution and added simple test
new 84bc21e [FLINK-1110] Implement collection-based Cross
new fdad5bf [FLINK-1110] Implement broadcast variables for collection-based execution
new 114af5a [FLINK-1110] Add execution on collections for flatMap
new fd3f5c2 [FLINK-1110] Add Collection-Based execution for Reduce Operators
new 3eac6f2 [FLINK-1110] Implement collection-based execution for mapPartition.
new 77ac6c0 [FLINK-1110] Implement collection-based execution for bulk iterations
new 471f340 [FLINK-1110] Started implementing the JoinOperatorBase.
new d9ed4ad [FLINK-1110] Add createCollectionEnvironment for Scala
new 217b03e [FLINK-1110] Implement collection-based execution for coGroup
new b61f63c [FLINK-1110] Adjusted test base to run programs both with local executor and collection executor
new 3fd3110 [FLINK-1110] Implement Collection-Based Execution for Delta Iterations
new ac69cb3 [FLINK-1110] By default, collection-based execution behaves mutable-object safe.
new aea6a6d [FLINK-1110] Adjust tests and fix various issues in the collection-based execution.
new cb19c74 [FLINK-1110] Fix IndexOutOfBoundsException in ListKeyGroupedIterator
new 54ede63 [FLINK-1110] Fix Reduce and GroupReduce Test Failures
new 3cc9a28 [FLINK-1110] Fix mutable object safe mode for data sources in collection-based execution
new 15f2544 [FLINK-1110] Add iteration aggregators to collection based execution
new ff5ddd5 [FLINK-1110] Fix HadoopInputFormat to work without prior serialization.
new 65bf092 [FLINK-1110] Adjust collection based runtime and tests for classloaders in runtime context
new a0057f9 [FLINK-1134] tried to fix issue with not terminating JVM when using RemoteCollectorOutputFormat
new 9caece6 [streaming] Excluded unused recursively pulled dependencies
new ca4380c Integration of new BLOB service.
new 6b6dae0 [FLINK-1106] Deprecate Record API
new 7af127e Updated run-example quickstart (commands, screenshots)
new 49812f3 [streaming] Several bugfixes and doc updates
new 97a7322 [FLINK-1103] [streaming] Added Twitter streaming example and default inputs for examples
new ec82d97 [streaming] CoWindow operator rework + stream iteration example added
new 926f835 [FLINK-1032] Rework support for POJO types in the Java API
new aca6fbc Added expression keys to distinct and partition operator and addressed some of the comments
new 6b493fb Add Pojo support to Scala API
new fd0be2f Various fixes - improved error messages - the composite vs atomic bug aljoscha found - Comparator test for Pojo Comparator enabled - TODO removed - string-based key expression for group sorting fields definition - support for specifying "select all" using * and now also _ (for scala fans) - Exception if user is having multiple fields with the same name in the class
new 598ae37 Documentation and fixes
new 6be8555 Really add POJO support and nested keys for Scala API
new 74dded1 Added wrappers for Hadoop functions
new 53d8f1f Revert "Added wrappers for Hadoop functions"
new 35415f2 [FLINK-1076] Extend Hadoop compatibility. Added wrappers for stand-alone Map, Reduce, and CombinableReduce functions.
new aa6d1cf [FLINK-1076] Return type determined via type extraction. Added test cases. Minor improvements and clean-ups.
new 3ebdebc [FLINK-1107] Hadoop Compatibility Layer documented
new e2fd615 [FLINK-1076] Extended Hadoop Compatibility documentation to cover Hadoop functions
new 758db36 [FLINK-1136] Replaced Flink logo in web submission client Added Flink logo to JobManager web interface. Updated Run Example Quickstart screenshots Removed old gradients and unused image files from submission client.
new 22c370d [FLINK-1145] Fix incorrect getter / setter detection
new 2de34f3 Fixed missing logo in offline plan visualizer
new 986f25f [FLINK-1149] DataSource sets DOP to 1 for NonParallelInputs.
new 3eebaa8 [FLINK-1150] Fix size estimate for FilterNode. Data size changes proportional to cardinality.
new f562d49 Simplify Pojo/Tuple/CaseClass comparator extractKeys() method
new d749c24 [scala] Add missing operator IT Cases
new f605127 [YARN] Fix issue with port-offsetting.
new da21ea3 [doc] Fix javadoc building.
new a868da8 [doc] Update programming guide for scala expression keys
new 17e9b5b Fix bug in Blob Manager, Cleanup Timer was not cancelled on Shutdown -
new ff21917 Remove Guava dependecy from streaming-connectors (void shading otherwise)
new 480f493 Enable forgotten JoinITCase (for POJOs) for Scala and Java API
new 578e406 Set the cleanup timer thread of the BlobLibraryCacheManager to be a daemon.
new 624fe95 Fix class loader when extracting lambdas
new 7a5e3e4 Fix various deprecation warnings in tests
new bf20591 [FLINK-1143] Allow delta iterations that do not join with the solution set
new 84663ad [FLINK-1148] Create a writeAsCsv(path, writemode) variant
new 4343e08 [FLINK-1152] More robust resource release when tasks are canceled during deployment
new 3f98994 Better test error messages when canceling tests fail
new 025589f JoinHints are passed to the optimizer
new 122d0ca Optimizer evaluates join hints from high level apis.
new 0af7b52 Fix incorrect scheduler test that sometimes produces a deadlock
new 69ae304 [scala] Change input of grouped ops from TraversableOnce to Iterator
new e29833d [streaming] CoGroupedWindowReduceInvokable refactor
new a813785 [streaming] Added a TypeWrapper which combines two TypeInformations into a Tuple2 TypeWrapper.
new b8e8bd7 [streaming] Added CoBatchedDataStream and CoWindowDataStream with reduce functionality + CoBatchReduce bugfix
new f5d3839 [FLINK-1160] Method added to RecordReaders to allow publishing events to specific inputs
new ba44459 Fix the Javadoc link in DataStream class
new b6f599f [FLINK-1170] Fix faulty input split localization Pass hostname to split assigner Avoid clashes by only using the first component of the fully qualified hostname
new 23e30f0 [FLINK-1170] address pull request review comments
new ed1827c Prevent RPC service from blocking on exceptions during task cleanup on canceling.
new a0ad903 [FLINK-1171] Move Scala API tests to flink-tests project
new 867e3a5 [FLINK-1164] Gracefully handle empty (identity) iterations
new 259f10c [FLINK-1167] Handle unions at the root of the iteration
new 90c8469 [scala] Change CaseClassSerializer/Comparator to not use For-Loop
new 5e34858 [build tools] update release sciprts
new 7680950 Set version to 0.8-incubating-SNAPSHOT
new 5e29f68 [FLINK-1189] [streaming] Added cross operator
new 8397253 [FLINK-1189] [streaming] Temporal cross refactor
new a221796 [FLINK-1175] [streaming] GroupBy updated to allow multiple field and keyselector groupings
new 7709a3a [FLINK-1188] [streaming] Updated aggregations to work also on arrays by default
new 3da9dd4 [streaming] Removed obsolete state objects from streaming-core
new d883c5f [FLINK-1185] [streaming] OperatorState and StateCheckpoint classes and implementations added for state checkpointing and rebalancing
new 3af57ea [FLINK-1187] [streaming] StreamingRuntimeContext added with API support for registering fault tolerant state objects for the operators
new f2b8650 [FLINK-1178] Changed type preference to ValueType, WritableType, CaseClassType
new 73ee385 Remove unnecessary final modifier in PlanExecutor.loadExecutorClass method
new 3f33278 [FLINK-1194] Fix Java quickstart archetype POM file
new eebe510 Add DeltaPageRank example
new b0c1af5 [FLINK-1182] Improve error messages for POJO type mismatches
new 0ee60d3 [FLINK-1181] Fix IOReadableWritable checks in RPC service
new 4bb0477 Fix version and download paths in docs config
new 36a8fda [docs] Various fixes in docs - corrected links to download page - corrected download urls - corrected wget shortcut for yarn setup - corrected links to faq in yarn setup - corrected guide for manual yarn build - FAQ layout
new f5898a0 Another round to remove final modifier to private methods because it is not needed
new f42dcc3 [FLINK-1203] Deactivate fork reuse in tests (workaround for potential surefire bug)
new a747b61 [FLINK-1202] Remove incomplete file outputs on failure
new 2557832 Remove obsolete collection execution example. Correct remote collector format example.
new dd687bc Implement coarse-grained fault tolerance
new f0fd882 Introduce a delay before restarts to make sure that taskmanager failures are detected before restart.
new 8b39ba9 Improve error messages in case of invalid file paths or URIs
new 5e48fc9 Make sure TaskManager does not accept task deployments when shutting down
new a6152c3 [FLINK-1205] Fix library cache manager to track references to tasks and revent accidental duplicate registration/deregistration
new bbd8209 [FLINK-1203] Use forked execution in all tests, except in the end-to-end integration tests in flink-tests
new cc76653 [FLINK-1198] Broadcast variables are shared between tasks in the same TaskManager
new d8052d4 [FLINK-1198] Make Broadcast variables shared per taskmanager, rather than a shared singleton per JVM (supports multiple TaskManagers in the same JVM)
new e1fd689 [FLINK-1198] Broadcast variables can share initialization via broadcast variable initializers
new 7d2db95 [FLINK-1198] Fix nullpointer exception in broadcast variable materialization
new ca9e6ab Make sure that operator names are properly escaped for display in the web client
new 9b25942 Temporarily disable fork reuse in flink-tests Unit tests (workaround for FLINK-1207)
new 9b6561d [doc] Fix programming guide link in iterations.md
new 233161b [FLINK-1210] Improve error message in delta iterations when the next workset does not depend on the workset
new 58f7d30 [FLINK-1174] [streaming] Added window join operator
new 5e9a454 [streaming] Enhanced BufferTimeout functionality for StreamRecordWriter
new 3510bf9 Change TypeExtractor to support interfaces within classes
new 1e1df6d [scala] Add macroparadise to enable Quasiquotes
new bd66a08 [FLINK-1191] Add support for Scala Collections and Special Types
new e21d78d [scala] Make getType public in Scala DataSet
new c3835cd [scala] Add union operation to Scala ExecutionEnvironment
new a586614 [FLINK-1005] By default, new objects are created for each element in group operations
new 6ecd0f8 [FLINK-1214] Prevent partitionings on subsets of fields from being pushed down
new 17e0186 Add test case for TaskManager connection loss, leading to task failure.
new a959dd5 [FLINK-1220] Promote various log statements to INFO level. Add log statements for assignment locations
new ef40691 [FLINK-1222] Tasks send close acknowledgements early.
new ef9a373 [runtime] In local mode, make sure taskmanagers have completed registration before starting a job.
new e580497 [FLINK-1215] Fix spurious failures when creating output directories due to I/O races
new c9f3846 [streaming] Updated streaming groupBy operators to allow grouping on field expressions
new 7ae5804 [streaming] Aggregation rework to support field expression based aggregations for Pojo data streams
new 97d465b [streaming] Pojo wordcount example added to streaming
new 34c13e9 [FLINK-1224] [streaming] getExecutionEnvironment method fixed to work properly for StreamExecutionEnvironment
new 1e979e9 [Flink-1113] clean up JQuery dependencies
new 90730fe [FLINK-1212] Fixed shell script interpreter directive
new 4b75d83 [FLINK-1213] Added .gitattributes to normalize EOL [FLINK-1211] Fixed EOL character of Windows Batch files
new 81c5b2a [FLINK-1215] Increase robustness to spurious failures when creating output directories
new 65d0359 Make sure S3 directory paths are suffixed with '/' on creation
new 8e4c772 [FLINK-1186] Fix wrong flat key position when using expression key for nested tuples
new c9cfe3b [FLINK-1323] Refactor I/O Manager Readers and Writers to interfaces, add implementation that uses callbacks on completed write requests.
new 2f1176a [FLINK-983] Fix WebClient truncated function names
new e855ef4 [FLINK-1223] Allow value escaping in CSV files
new 57ecbcc [FLINK-1233] Improve error message when not enough slots are available to schedule a task. Add additional test case for concurrency on the scheduler.
new 3772d30 Improved input type inference, bug fixing, code simplification
new 21b1b97 [FLINK-1235] Compiler accepts iterations referenced from the static path of other iterations - Fix NepheleJobGraphGenerator to support iterations referenced on the static path of another iteration - Catch nested iterations on dynamic path properly in optimizer (and give a good error message)
new b3c290f [FLINK-1226] Add API support for passing Configurations to InputFormats
new b253cb2 [FLINK-1230] Add documentation and an example for collection-based execution
new 818ebda [FLINK-1221] Use the source line as the default operator name
new 537d6f6 [streaming] Removed obsolete Join example
new c6dd9b1 [FLINK-1204] [streaming] Individual, self-contained packaging for streaming examples
new 6867f9b [streaming] StreamExecutionEnvironment rework + user class loader fix for cluster deployment
new e7ce956 [streaming] Example cleanup + windowJoin fix
new d332d6c [streaming] Examples refactor and packaging update
new 8f9d8ea Fix caching of receivers
new 9ff2e5b [scala] Self-contained build for scala examples
new c339c26 [FLINK-1218] Replace new Integer with Integer.valueOf in tests
new d7d7238 [FLINK-1239] [streaming] IterateExample fix and parallelism setting in StreamExecutionEnvironment made public
new 8a955e5 [FLINK-1233] Fix flaky AggregateITCase
new 922f478 [docs] Add description of Quasiquotes compiler plugin in Eclipse to FAQ
new e23874c [FLINK-1242] Fix streaming-examples and scala-examples POMs to work properly with Eclipse
new 42828f2 [FLINK-1008] Fix createProgramPlan() throws exception
new 7f8296e [FLINK-890] [docs] Adjust examples to show reader methods and correct class-vs.-interface errors.
new a296f40 [FLINK-1244] setCombinable() returns operator
new 9c1585e [FLINK-1172] [docs] Fix broken links in documentation
new 2d1532f Fix flaky test SumMinMaxITCase
new f76eb15 [FLINK-1246] Add additional debug output to flaky recovery test
new 06c259f [tests] Various stability fixes to tests
new ae07abe [build] Manage version of joda-time to prevent conflicts between dependencies.
new 83d0256 [FLINK-1207] Context environments are realized through factories - local execution blocking is reset after each run
new 2000b45 [FLINK-1237] Add support for custom partitioners - Functions: GroupReduce, Reduce, Aggregate on UnsortedGrouping, SortedGrouping, Join (Java API & Scala API) - Manual partition on DataSet (Java API & Scala API) - Distinct operations provide semantic properties for preservation of distinctified fields - Tests for pushown (or not pushdown) of custom partitionings and forced rebalancing - Tests for GlobalProperties matching of partitionings - Cach [...]
new 6989cec [bin] Remove MaxPermSize parameter for JVM 1.8
new b264221 [FLINK-1209] [compiler] Improve error messages when forgetting to close an iteration
new 9f6a0b8 [FLINK-1250] [config] [docs] Correct and document config keys for heartbeat intervals and timeouts
new 1ecacf0 [FLINK-1247] [docs] Fix broken links in documentation
new f84e4ec Minor code clean up to get rid of IntelliJ IDEA warnings
new da60630 Add byte array serialization to InstantiationUtil
new 54aa41b Added getExecutionEnvironment to the DataSet of the Scala API.
new ce822bf [FLINK-1254] [compiler] Fix compiler bug for pipeline breaker placement
new ae505ad [FLINK-1253] [tests] Make sure tests do not die with garbage collection overhead exceeded
new d640b6c [FLINK-933] Add primitive input format to read a sequence of primitives
new 3ac4df8 [FLINK-993] Primitive input format fails for invalid input. Adapted documentation.
new d92a24a [streaming] Source parallelism API update
new a036378 [streaming] Fixed async buffer sending at end of AbstractInvokable
new 5c3dceb [FLINK-1142] Log information about I/O manager temp dirs
new 4203bf9 Minor code clean up
new 591f16d [FLINK-1252] Add support for serializing Date and Enums in the Java API
new 8081ddc [FLINK-1251] Enums are now handled properly by the collection input format
new 8af0473 [FLINK-1252] address pull request comments
new a77d752 Added binary input and output format which uses the objects' TypeSerializer to serialize them.
new 4a74f32 [FLINK-1265] Fix user classloader bug for registerInputOutput() method
new b3e5ed0 [Flink-1262] inconsistency between CsvReader.java and TupleGenerator.java
new d0f2db0 [FLINK-1264] [compiler] Properly forward custom partitioners to the runtime
new 98ff76b [FLINK-820] [compiler] Support for disconnected data flows
new a69d60a Removed object reusage in GenericArraySerializer's deserialize method.
new 02e2857 Log memory usage stats at INFO level instead of DEBUG
new d7853fd [APIs] Enhance test coverage for CollectionInputFormat and add tests for failed serializations of user code objects
new cf54a1c [FLINK-1263] [optimizer] Implement compatibility checks for binary operators and custom partitioning
new 42fe874 Minor code cleanups - left from previous patches
new 80416ac [FLINK-1173] [streaming] Add socket text stream as a data source for the streaming API
new 6dfb3fa [FLINK-1173] [streaming] SocketTextStream minor fixes + documentation
new 4838efe Fixes FLINK-1276
new bcdd167 [FLINK-1249] [APIs] [compiler] Add custom partitioner for CoGroup
new c03237a [FLINK-1221] Use only method name and location as default operator names
new 65d85f1 [FLINK-1221] Use StackTraceElement methods instead of String parsing
new 8724bf7 Small changes and tests for the newly introduced EnumType
new 606a6d4 [Java API] Fix various warnings
new 392683f [FLINK-658] [APIs] Add group sorting to CoGroup
new 87497b7 [runtime] Quick fix for error with unsupported ship strategy
new 82f5154 [FLINK-1282] [docs] Update layout of docs
new d858930 [FLINK-1286] [APIs] [runtime] Fix serialization in CollectionInputFormat and generate meaningful error messages
new 48b6d01 [FLINK-1278] [runtime] (part 1) Remove special code paths for the Record data type in the input readers and the source task.
new 112b3a9 [Scala API] Case Class serializer can work with classes that cannot be instantiated empty
new 8a8155e [FLINK-1282] [docs] Added {{ site.baseurl }} to css and image paths
new 74bc7dd [FLINK-1282] [docs] Make Flink logo link back to frontpage
new 9656e83 [FLINK-1234] Activate hadoop2 profile by default
new e8e7abb [scala] Add ClosureCleaner for Scala Lambdas
new 2ae366b [docs] Fix paths to work with local builds
new f66892d [runtime] CaseClassSerializer correctly treated as stateful
new 1a91132 [scala] Fix slow building of adjacency list in Scala PageRank
new 1dd8b8d Rewrite TPC-H Q3 to use Long instead of Integer
new 1a7a50f [scala] Add equals() to TraversableTypeInfo
new 3d242fd Removed TypeSerializerFactory from ScalaCsvInputFormat. The TypeSerializer is now serialized directly.
new bbe54ac [FLINK-1270] [APIs] FS.get() supports relative paths
new 17bc479 [FLINK-1095] [clients] Remove '-d' option in info from CliFrontend
new d554faa [FLINK-1273] [runtime] Add Void type to basic types
new a1100af Upgraded HBase addon to HBase 0.98.x and new Tuple APIs
new 45fb6d8 [FLINK-1290] Fix Optimizer to create plans when encountering incompatible partitionings.
new a9b7cbe [scala] [runtime] Add extra tests for sorting of case classes
new 4e9c32f [Docs] Just a typo in docs/index.md
new 84d6da8 [FLINK-1291] Remove default GC options from the shell scripts
new e46d14b [FLINK-1154] Quickfix to kill TaskManagers in YARN mode.
new e3eaac2 [FLINK-984] Compiler tests for distinct(). Adopted the old code from @markus-h
new 33724f0 [Docs] Fix rendering issue and typo
new bc41197 [FLINK-1292] Allow for longer normalized keys when using composite keys
new 858d1bc [Java API] [docs] Rephrase Javadoc of minBy/maxBy and link from min/max
new a677c77 [FLINK-1157] Document TaskManager slots and minor fixes.
new 36f1ee8 [streaming] Introduced a new invokable to allow flexible windowing based on trigger and eviction policies. Additionally created all required policy interfaces.
new 93178ae [streaming] Added interface for policy helpers. Such helpers will allow to use policy based windowing through a simpler API.
new d731b3b [streaming] Created trigger and eviction policies based on element counters. Included respective policy helper and test cases.
new 40c3ae4 [streaming] Introduced extractor interface to enable flexible handling of arbitrary input data types.
new 6f3bf57 [streaming] Created active trigger and eviction policies based on time. Included respective policy helper and test cases.
new 05c1519 [streaming] Added extractor implementations for various extractions and conversions. (incl. test cases)
new a6cc8af [streaming] Created trigger and eviction policies based on data punctuation. (incl. test cases)
new fb4a839 [streaming] Created tumbling eviction policy. This policy evicts always all tuples after a trigger occurred. It can be used to prevent doubled computation between trigger and eviction policies whenever tumbling windows are used. (includes test case)
new 997d3e1 [streaming] Created trigger and eviction policies which calculate a delta between two data points using a given delta function. The policies evict/trigger in case the delta is higher than a specified threshold. (incl. test case and the interface for delta functions)
new b263624 [streaming] Added abstract class ExtractionAwareDeltaFunction to enable easy extraction of data in pre-defined delta functions.
new 4d586e7 [streaming] Added cosine distance and Euclidean distance as examples for possible delta function implementations. Test cases are included as well.
new 542c66f [streaming] Integrated the policy based windowing into DataStream and introduced WindowedDataStream to handle windowing helper.
new 3f50683 [streaming] Added test cases for the policy based windowing invokable.
new 3d11d5b [streaming] Created several examples for the usage of policy based windowing.
new cd7bfd3 [streaming] Introduced grouped windowing invokable, added required cloneable policy interfaces, and adjusted existing windowing invokable to make it usable together with the new grouped windowing invokable.
new 70079c1 [streaming] Make all predefined policies cloneable and introduce an activating wrapper for cloneable eviction policies
new 751f101 [streaming] Adding unit tests for the grouped windowing invokable.
new f96ba06 [streaming] New windowing API merge and cleanup + several minor fixes
new 55ee64f [streaming] Extractor requirement removed for custom timestamp windowing
new 2d73c3f [streaming] Windowing API update + package refactor
new 0ef399c [streaming] Window join api rework to support functional style
new 996f02c [streaming] Changed time based windowing policies to make lower boundary excluded and upper boundary included in the windows and adjusted policy test cases respectively.
new d6dc434 [streaming] Windowing helper API cleanup
new 64baa00 [streaming] Window cross API rework
new f0cc5d6 [FLINK-1279] [streaming] Forward partitioning changed to use round-robin method
new 240e5f1 [streaming] Renamed test cases for window and grouped window invokable to be consistent with the invokable names
new b082af0 [streaming] Introduced central eviction policies in the grouped window invokable
new 3f74e05 [streaming] Central trigger/eviction API integration + invokable refactor
new 4e046a9 [streaming] Updated javadocs for new windowing semantics
new 783aa4a [streaming] Changed GroupedWindowInvokable to always delete groups in case they have an empty element buffer
new f844088 [docs] [streaming] Windowing rework documentation update
new 3470b37 [scala] Fix non-reuse copy in CaseClassSerializer
new 979837a [scala] Fix TupleSerializerTest for corrected CaseClassSerializer
new 770ce23 [FLINK-1301] Added Apache license headers to Markdown, HTML, SVG, Python files. Made exceptions for license check plugin more fine-granular.
new 63eeafc [FLINK-1139] Added FinalizeOnMaster hook to run code after the last task of an OutputFormat completed
new 15f58bb [FLINK-1139] Fixed HadoopOutputFormat to run with DOP > 1
new f945e2c [FLINK-1139] Updated Hadoop Compatibility documentation
new 94c8e3f [FLINK-1311] [optimizer] Correctly tag static/dynamic path for auxiliary nodes in iterations.
new 51c1f67 [FLINK-1161] [streaming] Streaming API type handling rework to support java 8 lambdas
new 4a7ba2d [FLINK-1312] [streaming] OutputSelector changed to SAM-type to allow java 8 lambdas for splitting
new d8066c5 [streaming] Java 8 WordCount example added for streaming
new 26820ea Updated java 8 package to match flink-examples standards
new 9d02f2a [FLINK-1315] [optimizer] Extra test reproducing the IllegalStateException bug in bulk iterations.
new ac80458 [FLINK-1315] [optimizer] Fix bug in branch tracking logic.
new a79ea78 [FLINK-1316] [web client] Fix plan display for nodes referenced from multiple closures.
new 6d69f69 [java8] Fix pom.xml to properly work with Eclipse m2e
new a9ecaba [FLINK-1040] Make types() call in projections optional
new 799ff8a [FLINK-1040] Updated JavaDocs and removed deprecated types() calls from examples and tests
new 1a2bbeb Fixed java quickstart example
new 099b9fd [scala] Add withParameters() support for sinks/sources
new 880801c [FLINK-1310] Change ClosureCleaner Logging to DEBUG
new 1b69749 Enable flink-hbase module for hadoop1 build as well.
new 6691599 [FLINK-1302] Make JDBCInputFormat implement the NonParallelInput interface
new 454e2bc [FLINK-998] Close TCP connections after destroying logical channels
new 3799560 Exclude docs/_site/** from License Check
new e0a4ee0 [FLINK-1287] LocalizableSplitAssigner prefers splits with less degrees of freedom
new e47365b [FLINK-1208] Enable CsvInputFormats to ignore invalid lines and lines starting with comments
new 4cc6bb1 [FLINK-1324] [runtime] Trailing data is cached before the local input strategies are closed.
new 0028238 [FLINK-1322] Make Scala API respect WriteMode set in Config
new 9e40366 [scala] Change ScalaAggregateOperator to use TypeSerializer
new de7f478 [misc] Fix/suppress various compiler warnings.
new 13968cd [FLINK-1305] [FLINK-1304] Test for HadoopInputWrapper and NullWritable support
new c56be66 [FLINK-1307] Allow file input from nested directory structure
new 8fc04e4 [FLINK-1307] Excluded directories that match the file-filter from recursive descent.
new c8fa1cd Fixes broken code highlighting in documentation
new 283c398 [FLINK-1327] [core] Fix wrapping of MemorySegments in ByteBuffers
new 510a811 [streaming] Basic support reading from local and distributed file systems in readTextFile methods
new 1a6b404 [streaming] ReadTextFile re-implemented as RichFunction and cleanup
new 0297d60 [Runtime] [Tests] Remove flaky check in LocalInstanceManagerTest
new 4820eba [Distributed runtime] Fail task if execution state update is unsuccessful
new fb96f12 [Java API] Fix equality checks on PojoTypeInfo
new 026311a [APIs] Add ExecutionConfig
new 486cc90 [FLINK-1325] [Java API] Add Java ClosureCleaner
new cb607df [FLINK-1325] [Java API] Minor cleanups on the ClosureCleaner
new 61b023f Bump version to 0.9-incubating-SNAPSHOT
new b5ac6ec [streaming] DataStream print functionality update
new 88b8b9d [streaming] [examples] Refactor and packaging for windowing examples
new fbd0060 [streaming] Updated deprecated iterative functionality and docs
new 5f78007 [FLINK-1325] [streaming] Added clousure cleaning to streaming
new 1c1c83b Fix invalid type hierarchy creation by Pojo logic
new a70aa67 [FLINK-610] Replace Avro by Kryo as the GenericType serializer
new 63ef8e8 [FLINK-1333] Fixed getter/setter recognition for POJOs
new 94cfe14 Fixes race condition in ExecutionGraph which allowed a job to go into the finished state without all job vertices having properly processed the finalizeOnMaster method.
new 6e9b284 [FLINK-1336] [core] Fix bug in StringValue binary copy method
new 7006fead Added configuration constants for akka's actor system.
new 1e74b4c Reworked the NepheleMiniCluster logic
new 4f841fc Reworked the EventCollector and the ArchiveListener as actors.
new 4a8a6e5 Reworked the TaskManager.
new 24da11b Implemented JobManagerProfiler and TaskManagerProfiler as actors.
new 3539087 Removed proxis from JobClient and CliFrontend.
new b313eeb Removed old RPC service.
new 04f8ef7 Ported the JobManagerITCase to actor implementation.
new a9cc0a8 Updated all JobManager and TaskManager relevant test cases to work with actors.
new f15ff9b Removed legacy protocol classes.
new b1cb66f Updated license headers of scala files to conform to scala-checkstyle.
new ac94253 Removed execution service from execution graph and replaced by akka's futures.
new 241c1ca Replaced the JobClient by an actor.
new 85f061f Removed old java implementations of the JobManager, TaskManager, JobClient, EventCollector, TaskOperationResult and MemoryArchivist.
new de88a10 Adapted Webserver to work with actors.
new ec35d1c Added the webserver to the job manager.
new fda5366 Removed old events. Adapted webserver communication so that it can now talk to the actor implementations.
new f96bca0 Added AKKA_LOG_LEVEL config constant.
new 031f988 Added scala docs to actor messages.
new d460933 Removed listen parameter from SubmitJobDetached message.
new 5a192bd Reworked Yarn client: Actor based communication.
new 76d603c Moved WebInfoServer and WebInterfaceServer resources into resource folders of respective projects. Jetty uses the jar as base directory.
new 0ae7204 Implemented proper shutdown of yarn containers if the system is shutdown via the yarn client.
new 8cfc2ad Resolved scala checkstyle issues.
new 2551dc4 Updated DEPENDENCIES, NOTICE and LICENSE files.
new 0924120 Adding timefactor to make up for slow travis tests.
new e85b82f Removed blocking call in Execution.deploySlot
new 26c7794 Removed submitTask and cancelTask from Instance. Replaced unnecessary blocking calls.
new b8d0a0a Reworked local cluster start. TaskManager watches JobManager and tries reregistration in case of disconnect. Introduced akka.ask.timeout config parameter to configure akka timeouts.
new bd4ee47 Adapted test cases to actor model after rebasing.
new c175ebe Fixed JobManagerITCase to properly wait for task managers to deregister their tasks. Replaced the scheduler's execution service with akka's futures. Introduced TestStreamEnvironment to use ForkableFlinkMiniCluster for test execution.
new 8eadd3e Removed JobStatusListener and ExecutionListener. Fixed LocalExecutor output for maven verify.
new 8d414d7 Removed dead instance cleanup from InstanceManager so that Akka's watch mechanism is the current mean to detect dead instances.
new f726e55 Made ExecutionGraph, Execution, ExecutionJobVertex, ExecutionVertex, AllocatedSlot, Instance, CoLocationConstraint, SharedSlot and SlotSharingGroupAssignment serializable. Integrated Kryo to be used to serialize Akka messages.
new dd9a1ba Add debug guardians to suppress string generation which caused a significant performance loss.
new 1cd44e0 Add startup timeout config parameter. Increase akka ask timeouts for integration tests. Increase akka logger startup timeout.
new f10d357 Use container based builds in travis. Enable caching for travis. Set travis fork count to 2.
new a0f7785 Change integration tests to reuse cluster in order to save startup and shutdown time.
new c93d9ea Add option to use single actor system for local execution. Use local connection manager if a single task manager is used for local execution. Remove synchronized blcok in getReceiverList of ChannelManager which effectively serialized the connection lookup calls of a single task manager.
new 0516d26 Execute lookupConnectionInformation and UpdateTaskExecutionState concurrently within futures
new f32c475 Exclude netty and protobuf dependency from hadoop-commons-2.0.0-alpha
new f5618fa Use Akka version 2.2.1 for hadoop version 2.0.0-alpha to resolve dependency conflicts. Adjust code to comply to respective Akka API. Remove obsolete TODO.
new b962243 Exclude netty dependency from hadoop-mapreduce-client-core to resolve dependency conflict
new ae8fb94 Remove experimental KryoSerialization for Akka
new 04b97c9 Fix race condition in ExecutionGraph which made the job finish before all vertices have called the finalizeOnMaster method.
new 64b2602 Add proper task resource removal in case that a task submission fails
new 88e64fc Let the submitJobAndWait method check continuously whether the job manager is still alive. Terminate waiting for a response in case of a job manager outage.
new c5e9a51 [streaming] StreamInvokable rework for simpler logic and easier use
new ff05df9 [dist] Updated the assembly of the examples subdirectory
new 6884a0f [streaming] Added immutability for window and filter operators
new 227e40f [streaming] Make windowed data stream aware of time based trigger/eviction in tumbling window situations.
new 3396400 [streaming] Streaming local execution fix to create proper jobclient for minicluster
new 561eaf0 [FLINK-1338] Updates necessary due to Apache graduation
new 87d699d [streaming] Time trigger preNotify fix
new 34353f6 [scala] [streaming] Base functionality added for streaming scala api
new c123e11 [scala] [streaming] Extended scala data stream functionality to include simple operators
new de06d95 [scala] [streaming] Finished scala StreamExecutionEnvrionment functionality + DataStream sinks + docs
new 80393c4 [scala] [streaming] Windowing functionality added to scala api
new 7aa6829 [scala] [streaming] Added SplitDataStream functionality
new f165c35 [scala] [streaming] Added support for iterative streams for scala api
new 1c87d8b [streaming] Temporal join and cross rework for consistence and extended features
new 555837c [scala] [streaming] Temporal join operator added
new e37ec79 [scala] [streaming] Temporal cross operator added
new 75dd021 [scala] [streaming] Modified aggregations to work on scala tuples
new 6f215b5 [scala] [streaming] Fixed scala formatting
new a751988 [scala] [streaming] Added groupBy support for case class fields
new 1d019b9 [scala] [streaming] WindowJoin scala example added
new 8bf9416 [streaming] Streaming API grouping rework to use batch api Keys
new fac7734 [scala] [streaming] Added scala window helpers + timestamp rework for lambda support
new d4ec009 [scala] [streaming] Added implicit conversions from java to scala streams
new a761cdc [scala] [streaming] added group windowing example with different policy types
new 55ef795 [scala] [streaming] added initial ConnectedDataStream support (no windowing,batching) for the scala api
new b9d0241 [scala] [streaming] Added connect op to DataStream and implicit conversion for ConnectedDataStreams
new 2425885 [streaming] Source parallelism + connector rework
new 3f1af0e [streaming] Updated connector type handling to suport generic classes by GenericSourceFunction interface
new 8183c8c [streaming] [scala] Restructured streaming scala project and examples
new f71b0c4 [docs] Trivial typo in example code: o -> out.
new f330f1c [FLINK-1338] [docs] Remove incubator footer from docs
new 6167fcc [docs] Remove files from obolete and unused figures
new d2691d2 [FLINK-1346] [docs] Add stubs for Akka documentation
new 4895131 [FLINK-1335] [docs] Update internals with brief description about JobManager data structures and scheduling.
new 24c4736 Remove full package name for FlatMapOperatorBase
new 972a7b0 [FLINK-1349] [runtime] Various fixes concerning Akka - Remove obsolete code from old IPC net utils - Smaller Writable/IOReadableWritable serialzation buffer start size (most messages are rather small) - For message logging, make system calls (timestamps) only in debug mode - Clean up warnings / code simplifications
new cec30ff [FLINK-1349] [runtime] Various cleanups to make scala runtime code interact smoother with java
new 2b86e95 [FLINK-1335] [docs] Add guide how to set up Eclipse, and bring README.md up to speed.
new d2f0c40 [FLINK-1335] [docs] Minor fix to README file
new 0190dd2 [FLINK-1357] [compiler] Add union between static and dynamic path
new 93eadca [FLINK-1027] [cli] Added support for '--' and '-' prefixed tokens in CLI program arguments.
new 92ceacd [FLINK-1236] [hadoop compatibility] Add local split assignment support for HadoopInputFormats
new b0a2e4a [streaming] Temporal operator windowing syntax update
new 11518b5 [streaming] Deleted obsolete parts of the connected stream api
new 8500ad0 [streaming] Updated streaming guide for recent connector and data source changes
new 5daa45c [scala] [streaming] Added package file for streaming scala api typeinfo implicits and conversions
new baf81c6 [scala] [streaming] added scala streams as sources in streaming-api scala examples
new 875c6aa [FLINK-1300] [core] Remove unused and redundant files DataInputViewStream and DataOutputViewStream.
new e71ee0b [FLINK-1259] [apis] Added comments to interface and docs that filters must not mutate date elements.
new c52f4ca [FLINK-1169] [apis] Add documentation for join hints.
new 47ec09e [FLINK-1363] [runtime tests] Fix race condition in ExecutionVertexCancelTest.testSendCancelAndReceiveFail
new 5997036 [FLINK-1365] Fix ValueTypeInfo
new 383ae26 [FLINK-1366] Enable FastPath in TextValueInputFormat again
new e1f8581 [FLINK-1361] change jobManager log file name back to old value
new 2499294 [FLINK-1354] Made test graph for TransitiveClosureITCase smaller
new 3832d7b [FLINK-1137] Enhance MutableObjectIterator with non-reuse next()
new b7b32a0 [FLINK-1285] Make execution mode configurable
new d529749 [FLINK-1285] Make Merge-Join aware of object-reuse setting
new 26c9819 [FLINK-1285] Various cleanup of object reusing and non-reusing code.
new d9cb5b7 [runtime] Release additional broadcast variable references early
new 19066b5 [FLINK-1371] [runtime] Fix KryoSerializer to not swallow EOFExceptions
new b22406a [streaming] [scala] scala SocketTextStream added and minor fixes
new 10a8186 [streaming] Replaced partitionBy with groupBy + re-added global partitioning
new 06503c8 [FLINK-1367] [scala] [streaming] Field aggregations added to streaming scala api
new d8dbaee [FLINK-1245] [Java API] Introduce TypeHints for Java API operators
new f290929 [FLINK-1266] Generalize DistributedFileSystem implementation to HadoopFileSystem wrapper, which supports all subclasses of org.apache.hadoop.fs.FileSystem. This allows us to let users use all file systems with support for HDFS. The change has been tested with Tachyon, Google Cloud Storage Hadoop Adapter and HDFS.
new 0af4d3a [FLINK-1266] Update mongodb link and address pull request comments
new c024d81 [FLINK-1266] Properly pass the fs.defaulFS setting when initializing filesystems
new 39fb7c9 [FLINK-1266] More dependency exclusions & fixed image in web client
new 0954c4e [FLINK-333] [apis] Forward crossWithSmall and crossWithLarge hints to optimizer.
new 7f659f6 [docs] Update README and internals (scheduling) for graduation and fix broken links
new 7e08fa1 Fix typo in README.md
new 6b36fd2 [FLINK-1197] [docs] Add information about types and type extraction
new 86f8753 [FLINK-1225] Fix for quickstart packaging
new ecb5595 [FLINK-1358] [streaming] Streaming added to the quickstarts
new 3a39352 [FLINK-1386] [quickstart] Fix pom in java quickstart archetype
new 935e316 [FLINK-1378] [scala] Fix type extraction for nested type parameters
new 8af6ef4 [FLINK-1378] Add support for Throwables in KryoSerializer
new c8c50be [FLINK-1378] [scala] Add support for Try[A] (Success/Failure)
new d908ca1 [FLINK-986] [FLINK-25] [Distributed runtime] Add initial support for intermediate results
new 9f07373 [FLINK-1380] [streaming] Updated SplitDataStream to extend DataStream to get rid of selectAll method for splits
new aba7617 Undo erroneous commit 86f87537
new cfa04aa [scala] Disable Warning Message in TypeAnalyzer
new be03598 [FLINK-1397] Fix logfile access from JobManager web interface
new 9fea951 Remove dup code fromRemoteExecutor#executePlan method
new 5634ee2 [FLINK-1405] [windows] Fix Windows scripts (flink.bat and start-local.bat) - Fix for paths with blank characters - Fix for single entry wildcard classpaths (http://bugs.java.com, bugID: 7146578)
new d62ab47 [hotfix] Also use java closure cleaner on grouped operations
new ba7a19c [FLINK-1271] [hadoop] Remove Writable limitation from Hadoop format and function wrappers
new f83db14 [FLINK-1112] Add KeySelector group sorting on KeySelector grouping
new 2b16c60 [FLINK-1112] Additional checks for KeySelector group sorting and minor fixes
new c236df0 [FLINK-1183] Generate gentle notification message when Flink is started with Java 6
new 3897b47 [runtime tests] Fixes TaskManagerTest.testRunJobWithForwardChannel which caused spurious errors. Doubles the timeout for tests.
new ce5ce6a [FLINK-1375] [assembly] Remove incubator DISCLAIMER file from binary distribution
new e7daefd [docs] Clean up documentation figures - Remove old unused figure image files - Add a file clarifying that figures are licensed under ASL 2.0
new c954c4d [docs] Add FAQ entry about scala implicits error when missing imports
new f38e203 [FLINK-1384] [webfrontend] Remove unused JS libraries
new 543453d Minor dependencies cleanup: - Move sling JSON dependency to streaming connectors (prev streaming core) - Exclude YARN API from transitive mapreduce-core dependencies we use the dependency only for .mapred and .mapreduce interfaces - Remove some unnecessary dependencies (junit in java8) - Manage Kryo dependency - Cleanup minor POM warnings.
new cd6da11 [tachyon] Minor fix in codestyle and warnings
new 0b2edf1 [LICENSE] Update LICENSE and NOTICE files - Add missing entries for dependencies - Remove entries for removed dependencies - Change DEPENDENCIES file to point to src and bin LICENSE and NOTICE file - Add comments in some files to clarify whether the are Flink original, or from which third party file they are adapted - Change some links from incubator to TLP
new 839fd03 [docs] Prepare documentation for 0.8 release
new 6f765db [dist] Updated mailing list info in binary distribution
new 3836c96 Fix for quickstart versions
new d14f383 [build tools] Release script update
new e818729 Commit for year 2015
new a22f994 [maven] Fix project name and inception year
new 9cd96df [FLINK-1382][java] Adds the new basic types Void and Date to the TypeInfoParser
new d3072ba [FLINK-1229][FLINK-1206] [web frontend] Synchronize webclient arguments with command line and add default parallelism.
new 2d4ed15 [FLINK-1399] Add support for registering Serializers with Kryo
new a0b6af2 [FLINK-1399] Fix kryo registration of types and make sure that tags are assigned for registered types.
new 3b58509 [tests] Make dates in test data agnostic to time zones
new 29c54a2 [FLINK-1416] Fix dependency versions in quickstart archetypes
new 020b282 [FLINK-1395] Add tests for custom serializers with JodaTime.
new 6cc3583 [tests] Minor cleanup of compiler warnings.
new fb9f562 [Distributed runtime] Refactor data availability listener of UnionBufferReader to increase readability
new d1cc30d [Distributed runtime] Allow recursive union of buffer readers
new c9709a8 [Distributed runtime] Rename read method of BufferReader to indicate blocking behaviour
new 95fece8 [FLINK-1409] Let CoRecordReader subscribe to buffer reader notifications
new bd7819a Update incubator-flink name in the merge pull tools to flink.
new 58e1e44 FLINK-1420 Small cleanup on code after branch for 0.8 release
new 4e197d5 [FLINK-1372] [runtime] Fixes logging settings. The logging is now exclusively controlled by the logging properties provided to the system. Removes akka.loglevel config parameter.
new d2dd78f Adopts the logger level for the akka log level
new 8d73d45 [FLINK-1372] Re-add logging of temp directories at task manager startup
new ce8acc4 [FLINK-1372] Log memory usage at start up and fix log level mismatch for scheduled memory log message
new d60197b Fix missing IOException import in JobManager
new 7610588 [Docs] Fix typo in programming guide
new 996d404 [FLINK-1296] [runtime] Add better paged disk I/O readers / writers
new 4825656 [FLINK-1296] [runtime] Add sorter support for very large records
new bc69b0b [FLINK-1326] [runtime] Make sure that serializers release their very large intermediate buffers early
new be8e1f1 [runtime] Add spillable input deserializer
new 28a62d8 [FLINK-1296] [runtime] Limit memory consumption on merged by spilling larger records into a single special merge stream
new 76eaef0 [FLINK-1296] [runtime] Fix bug that first record in buffer is not correctly recognized as large record
new 5970e21 [FLINK-1296] [runtime] Fix bug when large record handling results in empty spill files
new 7df6a3d Fix conflicts after rebase of PR #249
new dc0d81b [FLINK-1403] [streaming] Distributed filesystem support for streaming filesinks
new d9b942b [streaming] Streaming runtime collector rework for increased flexibility with directed outputs and operator chains
new 26535c4 [FLINK-1345] [streaming] Basic operator chaining added
new 3e30c6f [FLINK-1345] [streaming] Chaining refactor + ChainingStrategy exposed through the API for operators
new 7dbb55e [FLINK-1345] [streaming] Advanced task chaining added
new e3b608c [streaming] JobGraphbuilder separated to StreamGraph and StreamingJobGraphGenerator
new 92947f0 [FLINK-1345] [streaming] Added support for chaining operators with directed outputs
new 631b6eb [FLINK-1372] [runtime] Adds EnvironmentInformation.logEnvironmentInfo method calls to JobManager's and TaskManager's main methods.
new 9cdd2b3 [Runtime] Fix unnecessary object creation for large record sorter
new 49a8680 Cleanup missing space =)
new 5c7243c Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/flink into asf_master
new 00a978b Rename coGroupDataSet.scala to CoGroupDataSet.scala, and crossDataSet.scala to CrossDataSet.scala
new 7deeda7 Move the UnfinishedCoGroupOperation class into its own Scala file.
new a5702b6 [FLINK-1353] [runtime] Loops through the JobManager's timeout to the Execution objects.
new fd67328 [tests] Fix missing task parallelism in JobManagerITCase bipartite job support test
new 5fc77d6 [quickstart] Set quickstart.sh version to latest release (0.8.0)
new 2af6586 [FLINK-1295][FLINK-883] Allow to deploy 'job only' YARN cluster. Add tests to YARN
new 2c1c91e [FLINK-1295] Address pull request review comments
new 8f8efe2 [FLINK-1385] Make resource avilability checks optional (warn instead of fail)
new 96585f1 [FLINK-1406] [documentation] update compatibility notice with link to further documentation
new 095dc4a [FLINK-1440] [docs] Fix missing plan visualizer image.
new 7ce9a8f [FLINK-1381] Allow multiple output splitters for single stream operator
new 7aa9a50 [FLINK-1081] Add getPos() method into FSDataInputStream class
new bf5e39a [FLINK-1081] Add HDFS file-stream source for streaming
new 9b63f26 [FLINK-1081] FileMonitoringFunction fix for proper handling of modification times
new e01057e [streaming] Fix bug with operators inheriting lower parallelism
new 5bc93e8 [docs] Address comment from outdated github pull request This is the comment: https://github.com/apache/flink/pull/295#discussion_r22783345 The pull request has been merged through a different commit.
new ad31f61 [FLINK-1425] [streaming] Add scheduling of all tasks at once
new 268ff7a [FLINK-1389] Allow changing the filenames of the files created when writing to a directory
new 06b2acf [FLINK-1428] [docs] Fix typos in Java code example for RichGroupReduceFunction [ci skip]
new 0548a93 [FLINK-1168] Add support for multi-char field delimiters in CSVInputFormats. This commit includes parts of Cbro's pull request and subsumes PR #247
new 3bdeab1 [FLINK-1453] Fix failing flink-yarn-tests on OS X
new 6bb0235 [FLINK-1446] Fix Kryo createInstance() method
new 6067833 [FLINK-1147][Java API] TypeInference on POJOs
new a5150a9 [FLINK-1433] Add HADOOP_CLASSPATH to start scripts This closes #337
new 730e056 [FLINK-1352] [runtime] Fix buggy registration of TaskManager to JobManager by introducing dedicated RefusedRegistration messages
new 517289d [runtime tests] Fix buggy recover a task manager failure integration test case
new b263932 [streaming] Refactor iterative datastream for clear self-contained functionality
new 82c4200 [FLINK-1434] [FLINK-1401] Streaming support added for webclient
new 78f41e9 [FLINK-1328] Integrated forwarded Fields into the optimizer (incomplete)
new de8e066 [FLINK-1328] [api-breaking][java-api][scala-api][optimizer] Reworked semantic annotations for functions. - Renamed constantField annotations to forwardedFields annotation - Forwarded fields can be defined for (nested) tuples, Pojos, case classes - Added semantic function information to example programs
new 4c2c426 [FLINK-1328] [docs] Updated documentation of semantic properties. Improved documentation of key specification and data type.
new 805ea69 [FLINK-1328] Added previously failing semantic annotations to examples and fixed them by enabling partitioning on AtomicTypes.
new 9671c2f [Typo] Delete DiscardingOuputFormat
new 06c2c35 [FLINK-1457] [build] Exclude avro test file from RAT check
new ad45bf1 [FLINK-1344] [streaming] [scala] Added implicits from scala seq to datastream and static StreamExecutionEnvironment initialization
new c28d96c [FLINK-1344] [streaming] Quickfix for the recent webclient support
new 9849990 Remove semicolon in Scala files. Fix java doc alignment in AggregatorsITCase.java
new f7e84c1 [FLINK-1460] fix typos
new 3896831 [FLINK-1425] [streaming] Non-lazy scheduling set for streaming programs
new 31641a6 [Typo] Typo fixes in code comments.
new 563e546 [FLINK-1419] [runtime] Fix: distributed cache properly synchronized
new f94112f [FLINK-1452] Rename 'flink-addons' to 'flink-staging'
new 3d9267e [FLINK-1452] Add 'flink-contrib' module
new 5f47559 [FLINK-1105] [api-extending] Add support for local sorting on data sinks.
new 94c3e9c [FLINK-1105] [docs] Added documentation for locally sorted output
new fb7ce0e [FLINK-1437][Java API] Fixes copy() methods in PojoSerializer for null values
new 215cf0c [misc] Code cleanups and fixes for various compiler warnings
new 2a7e40b Improved exception for missing type of InputFormat
new 57b3e9f [FLINK-1193][java-api][scala-api] Complete support for multidimensional arrays
new 9906cba [FLINK-1193][java-api][scala-api] Fix copy method for ObjectArraySerializer
new e3f6c9b [FLINK-1464] [java-api] Added ResultTypeQueryable interface implementation to TypeSerializerInputFormat.
new 36039b6 [FLINK-1165] [java-api] Add createCollectionsEnvironment to Java API
new aeec128 [FLINK-1165] [java-api] Rename "createCollectionEnvironment" to not break existing APIs.
new 80646b5 [java api] Fix various compiler warnings through code cleanups
new 0c726f8 [FLINK-1330] [build] Build creates a link in the root directory to the build target directory
new 3ec6430 [scripts] Fix job manager heap size configuration key
new 2bea793 [FLINK-1468] [scripts] Add integer check for job/task manager heap size config values
new 10cb2fa [FLINK-1468] [scripts] Cancel job/task manager startup when misconfigured heap sizes
new d539301 [streaming] Task chaining bugfix for partitioner settings
new 7ac6447 [FLINK-1473] Simplify SplittableIterator interface
new 17ac128c [FLINK-592] Add support for Kerberos secured YARN setups to Flink.
new 48d8dd5 [FLINK-592] Address pull request comments: fail early on missing auth, load log4j-cli.properties and do not set 'default' as default queue
new 5e1cc9e [FLINK-1477] Respect HADOOP_HOME when starting Flink
new 2665cf4 [FLINK-1318] [api-breaking] Simplified quoted string parsing, made it optional, and use a configurable quote character
new 27a479f [FLINK-1318] [docs] Added documentation for CSV parsing options.
new 7452802 [FLINK-1443 [api-breaking] Extended split assigner interface by parallel task id.
new a19b4a0 [FLINK-1443] Added support for replicated data sources. Introduced new PartitioningProperty for any distribution (random partitioning or full replication).
new 9fedfeb Ensure blob manager storage directory creation is successful
new 7c64000 Log blob cache and server storage directories at startup
new 71d05d7 Fix typo in task manager startup temp directory check log message
new 91f9bfc [FLINK-1458] Allow Interfaces and abstract types in TypeExtractor
new 9d181a8 [FLINK-1442] [runtime] Reduce memory consumption of archived execution graph
new db1b8b9 [FLINK-1376] [runtime] Add proper shared slot release in case of a fatal TaskManager failure.
new 8ae0dc2 [FLINK-1415] [runtime] Clean up archiving of ExecutionGraphs
new 56b7f85 [FLINK-1442] [runtime] Minor code cleanups in MemoryArchivist
new 0ab9d46 [scala api] Minor code cleanup for compiler warnings
new f361e7d [docs] add documentation for FLink GCE setup using bdutil
new 6372063 [FLINK-1479] [runtime] Spawned threads in sorter get the same context class loader as the parent thread
new 4046819 [FLINK-1415] [runtime] Akka cleanups
new d033fa8 [FLINK-1471][java-api] Fixes wrong input validation if function has no generics
new 140faa9 [FLINK-1480] Set Hadoop version to 2.6.0 for travis tests
new dacff90 [runtime] Enables remote communication for local standalone cluster mode which is required by the JobClient.
new 0ccd1fd [FLINK-1481] Fixes flakey JobManagerITCase which relied on non-deterministic behaviour.
new e766dba [FLINK-1482] Add shutdown hooks to delete blob storage directories
new 8803304 [FLINK-1482] Log error instead of rethrowing it during shutdown hook
new 7ffecac [runtime] Remove obsolete line reader test classes
new 7afcf00 [runtime] Increase timeout in pipeline queue tests, to increase test robustness on CI servers
new a9ac7aa [FLINK-1478] [jobmanager] Stubs to support eager input split assignment on task creation
new 970b2b7 [FLINK-1478] [jobmanager] Scheduler support for external location constraints
new e9c91e1 [streaming] Critical bugfix for streaming keyselectors
new a0e71b8 [FLINK-1488][yarn] Fix broken log file access
new 6187292 [FLINK-1490][fix][java-api] Fix incorrect local output sorting of nested types with field position keys.
new 76dd725 [FLINK-1485][documentation] Fix typo in Java join function example.
new 6ce241e [docs] Updated legacy references containing 'incubator' substring
new b483230 Remove 'incubator-' prefix from README.md.
new f6c85bc [FLINK-1166] Add qa-check.sh tool
new a07d59d [FLINK-1438] [jobmanager] Fix class loading issue for messages with custom input splits
new 6d49d1d [streaming] Proper hash join added for window joins
new 2f16ca2 [FLINK-1475] Decrease log level for yarn tests
new 7bc78cb [FLINK-1463] Fix stateful/stateless Serializers and Comparators
new 8b3805b [FLINK-1396][FLINK-1303] Hadoop Input/Output directly in API
new 6fcef7d [FLINK-1478] [jobmanager] Add deterministic strictly local split assignment (part 1)
new 4386620 [FLINK-1478] [jobmanager] Add deterministic strictly local split assignment (part 2)
new c1e1aca [FLINK-1478] [jobmanager] (addendum) Add eager check for null as input split host name
new 6ddfcb4 [hotfix] Fix missing guava dependency of flink-tests
new 30a52a0 [FLINK-1498] [tests] Set a minimal JVM size to prevent NIO memory problems
new 52d9806 [FLINK-1498] [tests] Better error messages in external sort tests
new 46e0526 [FLINK-1495][yarn] Make Akka timeout configurable in YARN client.
new bfb611f Remove unused enum values from Aggregations enum.
new 2afc9ec [streaming] Stock streaming example added
new b5752a7 [streaming] Java Stock streaming example added
new 6b402f4 [streaming] Windowing examples cleanup
new 7407076 [FLINK-1369] [types] Add support for Subclasses, Interfaces, Abstract Classes.
new b88f909 [FLINK-1492] Fix exceptions on blob store shutdown
new 0a4c769 [FLINK-1496] [distributed runtime] Fix loss of events at uninitialized input channels
new 9b2afb6 [FLINK-1201] [gelly] First mockup of initial API functions
new 4a106b3 [FLINK-1201] [gelly] Initial package
new 98b9d3c [FLINK-1201] [gelly] Stubs for basic classes
new 13e9fbe [FLINK-1201] [gelly] fix project setup
new 5846bac [FLINK-1201] [gelly] get undirected graph
new dea7a8c [FLINK-1201] [gelly] edge and value extend tuple types
new 294b7cc [FLINK-1201] [gelly] reverse and graph input methods
new 3788a1a [FLINK-1201] [gelly] Added Push-Gather-Apply, mapVertices, subgraph, outDegrees
new b1e95be [FLINK-1201] [gelly] Reverted to using Tuples, added tests.
new ebe235c [FLINK-1201] [gelly] Added Kostas' functions from the hackathon; added ExecutionEnvironment member to Graph
new edcb55a [FLINK-1201] [gelly] type information in Graph and in getUndirected method
new bc19f4e [FLINK-1201] [gelly] typeinfo in reverse and getOutdegrees
new 537f2a9 [FLINK-1201] [gelly] test for undirected, reverse and outDegrees
new ceb4fed [FLINK-1201] [gelly] made functions for getUndirected, outDegrees and reverse static inner
new f28aeff [FLINK-1201] [gelly] test mapVertices
new 35d88bc [FLINK-1201] [gelly] remove unecessary type from mapVertices
new 830a47f [FLINK-1201] [gelly] fixed subGraph() and added test
new 9562a1c [FLINK-1201] [gelly] mapVertices allows changing the value type
new c018c9f [FLINK-1201] [gelly] remove old hackathon test file
new 65d54c1 [FLINK-1201] [gelly] added execution environment to create calls in test
new f02262d [FLINK-1201] [gelly] separate test for mapVertices
new 034854d [FLINK-1201] [gelly] Added mapEdges
new 37a7b9e [FLINK-1201] [gelly] Added mapEdges tests
new 405be09 [FLINK-1201] [gelly] Removed unnecessary edgeKeyType field
new e1bbc95 [FLINK-1201] [gelly] empty test todos for implemented operations
new 9b000da [FLINK-1201] [gelly] fix count to work with Datasets of tuples, added test for numberOfVertices, numberOfEdges
new eaa0cd7 [FLINK-1201] [gelly] static inner classes for getVertexIds, getEdgeIds, isWeaklyConnected, tests for former 2
new 62ad471 [FLINK-1201] [gelly] isWeakly connected corrections and test
new b703e8f [FLINK-1201] [gelly] Updated the Graph constructor
new 633aed3 [FLINK-1201] [gelly] Added tests for addVertex, removeVertex, addEdge and union
new 3e48cb4 [FLINK-1201] [gelly] fromCollection(vertices, edges) implemented and tested
new bb5699b [FLINK-1201] [gelly] added create methods from set of edges
new 16703c5 [FLINK-1201] [gelly] Added removeEdge, added more tests
new eabf2bb [FLINK-1201] [gelly] Fixed/added tests, based on Vasia's feedback
new 7965755 [FLINK-1201] [gelly] fromCollection(edges) implemented abd tested
new fd7fead [FLINK-1201] [gelly] Fixed distinct vertex issues, changed removal filters
new 95a7c5e [FLINK-1201] [gelly] added descriptions for add/remove methods
new 024d744 [FLINK-1201] [gelly] reorganized tests and readme
new 1ed0e8e [FLINK-1201] [gelly] added vertex-centric iteration, removed pga
new 6182442 [FLINK-1201] [gelly] inDegrees and getDegrees implemented and tested
new 1ff9265 [FLINK-1201] [gelly] subgraph(vertexFilter) and subgraph(edgeFilter) implemented and tested
new ecb425d [FLINK-1201] [gelly] outDegrees with coGroup
new f4d2dda [FLINK-1201] [gelly] filterOnVertices and filterOnEdges implemented and tested
new 423e78d [FLINK-1201] [gelly] inDegree, outDegree, getDegrees implemented and tested
new c0ae386 [FLINK-1201] [gelly] cleared VertexKeyWith one class definintion
new 071c468 [FLINK-1201] [gelly] replace fromCollection with fromElements; remove unused import
new b11f283 [FLINK-1201] [gelly] replaces tuples with vertex and edge classes
new f87d3b2 [FLINK-1201] [gelly] count to use Graph's execution environment
new e6cff87 [FLINK-1201] [gelly] simple graph metrics example
new 9e70bad [FLINK-1201] [gelly] validate vertex ids implemented and tested
new 1717ca6 [FLINK-1201] [gelly] integrated inline suggestions
new 88c654b [FLINK-1201] [gelly] Added PageRank example
new 5e6f40b [FLINK-1201] [gelly] Added PageRank as a library method and example
new 1d90b52 [FLINK-1201] [gelly] PageRank example implementing GraphAlgorithm
new 16bdfab [FLINK-1201] [gelly] first take on neighborhood methods: OutEdges
new cac0e1d [FLINK-1201] [gelly] fixed type info for the outEdgesFunction
new 6036372 [FLINK-1201] [gelly] use vertex/edge instead of tuples in the test
new 2d26e27 [FLINK-1201] [gelly] some refactoring and cleanup
new 69426eb [FLINK-1201] [gelly] reduceOnEdges method for in-/out- and all edges
new a116fca [FLINK-1201] [gelly] added simplified reduceOnEdges without the vertex value
new 1c2a8ba [FLINK-1201] [gelly] SingleSourceShortestPaths example
new 2815df3 [FLINK-1201] [gelly] SSSP with runVertexCentricIteration
new f41b9ef [FLINK-1201] [gelly] changed mapVertices to return a Graph and simplified SSSP
new b5b63d7 [FLINK-1201] [gelly] changed mapEdges to also return a Graph
new 4b2c96d [FLINK-1201] [gelly] reduceOnNeighbors with vertex value
new 9a9dfc7 [FLINK-1201] [gelly] return arbitrary type instead of Tuple2 for the neighbor methods
new d9b46c6 [FLINK-1201] [gelly] reduceOnNeighbors without vertex value
new 99544bd [FLINK-1201] [gelly] correct graph execution environment in InvalidVertexIdsValidator
new 3f60009 [FLINK-1201] [gelly] joinWithVertices implemented and tested
new d57a9d7 [FLINK-1201] [gelly] [sssp example] only update the vertex value if new distance is smaller
new b0e17e3 [FLINK-1201] [gelly] set joins to sort-merge joins in isWeaklyConnected
new 935ad5a [FLINK-1201] [gelly] get rid of Vertex to Tuple2 and Edge to Tuple3 conversions in runVertexCentricIteration
new 3cf734f [FLINK-1201] [gelly] key and value types shouldn't be static fields; fixed #42
new b751df2 [FLINK-1201] [gelly] fix ClassCastException and Type errors in mapVertices; fixes #41 and #46
new b2c89cc [FLINK-1201] [gelly] Fix bug in TestReduceOnNeighborMethods caused by object reuse
new e0c10ec [FLINK-1201] [gelly] joinWithEdges implemented and tested
new 753c71a [FLINK-1201] [gelly] changed pageRank example to use joinWithEdgesOnSource
new d883c3a [FLINK-1201] [gelly] added description in GraphMetrics example
new 40457c2 [FLINK-1201] [gelly] Expose the full Vertex and Edge object in filter functions
new 1d6a200 [FLINK-1201] [gelly] use type hints for mapVertices, mapEdges and create
new b511932 [FLINK-1201] [gelly] Updated JavaDoc for Graph class
new b0b1295 [FLINK-1201] [gelly] cloned spargel classes
new d45c049 [FLINK-1201] [gelly] changed spargel classes to work with Vertex and Edge types
new 0bb7b7f [FLINK-1201] [gelly] removed 2-arg Edge constructor
new 0498abc [FLINK-1201] [gelly] refactored methods for Graph creation
new 878118a [FLINK-1201] [gelly] created fromTupleDataSet() methods
new 2b98beb [FLINK-1201] [gelly] remove isUndirected flag; methods will always consider the graph as directed
new 3cef210 [FLINK-1201] [gelly] filtering bad records and top track per user
new 8ff94da [FLINK-1201] [gelly] create similar users graph
new de2aa57 [FLINK-1201] [gelly] added label propagation in library
new 0393bc1 [FLINK-1201] [gelly] label propagation example
new 32d9d2b [FLINK-1201] [gelly] added label propagation step in MusicProfiles
new ccf1b80 [FLINK-1201] [gelly] LP example update: nodes get their id as initial label; if 2 labels have the same freq, select the one with the highest value
new ac477e8 [FLINK-1201] [gelly] updated music profiles example
new f99691c [FLINK-1201] [gelly] replaced create with fromDataSet
new 09d39ce [FLINK-1201] [gelly] use fromTupleDataset method instead of Tuple3ToEdgeMap
new 081de39 [FLINK-1201] [gelly] added licence headers; added gelly to addons pom file; fixed checkstyle errors
new 902df07 [FLINK-1201] [gelly] added missing javadocs
new e6b9cec [FLINK-1201] [gelly] use MultipleProgramsTestBase for the tests
new 6296c39 [FLINK-1201] [gelly] Renamed tests from TestXyz to XyzITCase
new c699557 [FLINK-1201] [gelly] changed ConstantFields to ForwardedFields
new 1e9b681 [FLINK-1473] Make abstract methods public in SplittableIterator
new bec9c4da [runtime] Corrects messages sent to the JobManager by the JobManagerInfoServlet
new f577c9e [FLINK-1455] [runtime] Improve robustness of external sorting test errors
new aedbacf [FLINK-1489] Replaces blocking scheduleOrUpdateConsumers message calls with asynchronous futures. Buffers PartitionInfos at the JobManager in case that the respective consumer has not been scheduled.
new 82cda12 [FLINK-1504] support for secure HDFS access using kerberos
new 90834ca [FLINK-1491] [runtime] Fixes logging output by setting Akka's stdout logger to log level WARNING.
new 18c9082 [tests fix] Fix runtime exceptions for large record sorter by properly mocking the environment.
new 69b7945 [FLINK-1530] Cache deserialized ExecutionConfig in the AbstractInvokable
new 6151d70 [FLINK-1492] [FLINK-1513] Fix BLOB service shutdown message and avoid global configuration
new f1b0fb0 [webclient] Remove obsolete arrow images
new 004c115 [FLINK-1411] Fix standalone plan visualizer
new 081a7dd [FLINK-1504] Fix YARN tests
new fab1bd9 [FLINK-1432] [runtime] Make memory segment release robust against concurrent modifications of the collection
new 46a675c [runtime] Fixes re-submission of a job by JobClient
new 3241214 [FLINK-1510] Make AvroInputFormat splittable
new 6a6c066 [FLINK-1436] usability improvements to the CliFrontend
new df0d62a [FLINK-1436] adapt all CliFrontend test cases
new 21f47d9 [FLINK-1531] [runtime] Adds proper EOFException forwarding to KryoSerializer.
new bc1432a [FLINK-1533] [runtime] Fixes NPE in the scheduler where the allocated shared slots are not properly checked.
new 988602b [build tools] Improve release scripts
new 2121185 [FLINK-1436] fix missing checks in CliFrontendInfoTest
new cba7866 [FLINK-1517] [streaming] Added indexed input iterator for streaming
new 6bec228 [streaming] Added ITCase for streaming classloading
new 1dafd81 [FLINK-1529] [jobmanager] Improve error handling on JobManager startup
new 0a22b71 [FLINK-1532] [tests] Fix spurious failure in AggregatorsITCase (plus minor cleanups)
new 12d4802 Small cleanups to add space between if-else keyword and parentheses to be consistent as I found them.
new 69cba1f Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/flink into asf_master
new 1583dcf [FLINK-1508] [runtime] Removes AkkaUtil.ask and replaces respective calls with explicit future handling.
new 589b539 [FLINK-1543] [runtime] Adds try and catch blocks around all method calls from an actor's receive method which can throw an exception. Sets the StoppingSupervisorStrategy as default for all guardians.
new da8c02b [FLINK-1179] [jobmanager] Add button to JobManager web interface to request stack trace of a TaskManager
new 81a7837 [FLINK-1545] [runtime][tests] Fixes AsynchronousFileIOChannelsTest.testExceptionForwardsToClose by introducing additional error check in AsynchronousFileIOChannel.close method
new 1b40386 [FLINK-1487] [runtime][tests] Fixes SchedulerIsolatedTasksTest.testScheduleQueueing by waiting for the released resources to registered at the Scheduler again.
new 055f6dc [FLINK-1551] [runtime] Fix wrong class cast in JobManagerInfoServlet
new 26ae979 [FLINK-1231] [streaming] More sophisticated streaming classloader ITCase
new 667f819 [streaming] StreamWindow abstraction added with typeinfo and tests
new 1146f64 [FLINK-1176] [streaming] Added invokables for modular windowing tranformations
new c560d76 [FLINK-1176] [streaming] WindowedDataStream rework for new windowing runtime
new 412779f [streaming] StreamDiscretizer rework to support only 1 eviction and trigger for robustness + test cleanup
new f32990f [streaming] Integration test added for windowed operations
new aef52e8 [streaming] Streaming scala api fix for window changes + example cleanup
new 8708688 [streaming] GroupedTimeDiscretizer added for lighter time policy thread management
new ef7b7cd [streaming] WindowBuffer interface added for preaggregator logic + simple tumbling prereducer
new cff6552 [streaming] Reimplemented StreamWindow.split to avoid dependency issues
new 3885823 [streaming] TumblingGroupedPreReducer added + new tests for windowing
new bb5dc7e [streaming] WindowMapFunction added + Streaming package structure cleanup
new 4470207 [FLINK-1539] [streaming] Remove calls to uninitalized runtimecontexts
new f571ece [streaming] Documentations updated to match the reworked windowing semantics
new 3d10a23 [streaming] Test cases added for all new windowing invokables
new e30a2ea [docs] [streaming] Documentation updates for stream windowing
new b941cf2 [FLINK-1454] [job client] Improve error handling for failed connections between JobClient and JobManager
new 2dcff4c [FLINK-1559] [akka] Normalize all akka URLs to use IP addresses rather than hostnames
new 6ba5fcd [core] [java api] Various code cleanup and fixed for warnings.
new 5ab1f1f [FLINK-1542] Test case at BlobUtilsTest should not assume user could not create new item in root directory
new 743399a [tests] Fix hostname escaping for older akka versions.
new c1e3267 [FLINK-1557] Move JobManager web frontend server out of JobManager actor
new 447ce0a [FLINK-1549] [yarn] Adds proper exception handling to YarnJobManager
new 649f158 [FLINK-1554] [runtime] Allows the LocalFlinkMiniCluster to start multiple TaskManager in the same ActorSystem.
new ac7bf42 [FLINK-1556] [runtime] Corrects faulty JobClient behaviour in case of a submission failure
new a1c9244 [FLINK-1566] [streaming] Made WindowIntegrationTests thread-safe
new 30e3893 [FLINK-1574] Fix null RuntimeContext when opening combiner UDF in CombiningUnilateralSortMerger. Move RuntimeContext initialization to begin of RegularPactTask.invoke().
new 47fed3d [FLINK-1561] [build system] Use a fresh fork for each integration test run
new cfce493 [FLINK-1578] [BLOB manager] Improve failure handling and add more failure tests.
new 7e39bc6 [FLINK-1391] Add support for using Avro-POJOs and Avro types with Kryo
new 77c4548 [FLINK-1392] Add Kryo serializer for Protobuf
new 5015ab4 [FLINK-1395] Add support for JodaTime in KryoSerializer
new 354efec [FLINK-1417] Automatically register types with Kryo
new e6754a6 [FLINK-1567] Add option to switch between Avro and Kryo serialization
new 42578b6 [blob manager] Fix flakey test.
new 681ea06 Remove extra space after open parenthesis in InstanceConnectionInfo#toString.
new c1a334e [FLINK-1483] IOManager puts temp files in dedicated directory and removes that on shutdown
new 6049398 [FLINK-1560] [streaming] StreamExecutionEnvironment enhancement for ITCases
new a673e7b [FLINK-1560][streaming] streaming WordCount ITCases
new 341c859 [builds] Print Java process stack traces of stalled builds
new 6b082b55 [builds] Add logger layout to prefix log output with Maven fork number
new 6c01598 [builds] Allow to upload build artifacts to S3
new e5528a2 [streaming] WindowBuffer separated from Discretizer for operator sharing + equality checks added for windowing objects
new ca7f36e [streaming] Discretizer sharing added with further window optimzations for better chaining
new 64f7bf7 [streaming] Add MultiTriggerPolicy: It wraps around multiple triggers and allows to use them at the same time. It supports both, active and not active policies at the same time.
new 09490c4 [streaming] Add MultiEvictionPolicy: It wraps around multiple eviction policies and allows to use them at the same time. It supports both, active and not active policies at the same time. Additionally it introduces different eviction strategies the user can choose from.
new 962db92 [streaming] Added cloneable versions of MultiEvictionPolicy and MultiTriggerPolicy
new 8111177 [streaming] Moved WindowingOptimizer to its own class + several minor fixes
new a110449 [FLINK-1585] [tests] Fix mini clusters to respect memory and buffer configurations and improve relative memory computation.
new 7d80711 [tests] Add integration test for restart recovery
new 5424be4 [web frontend] Small UI css class fix
new 52b40de [FLINK-1584] [runtime][tests] Fixes TaskManagerFailsITCase by replacing the TestingCluster with a ForkableFlinkMiniCluster
new dbf589a [FLINK-1584] [tests] Move logic for failure detection test cluster into test classes
new 4ff91cd [FLINK-1556] [runtime] Fails jobs properly in case of a job submission exception
new 5ac1911 [Flink-1484] [runtime] JobManager sends an explicit disconnect message to the registered TaskManagers in case of a graceful shutdown.
new 665e601 [FLINK-1499] [runtime] TaskManager sends explicit disconnect message to JobManager in case of shutdown
new a51c02f [tests] Cleanup style and timeouts in recovery restart tests
new c46bdff Update references in master to 0.8.1 release
new 1f49926 [tests] Flix flakey SimpleRecoveryITCase
new c56e3f1 [FLINK-1451] [streaming] Parallel file source fix + minor windowing fix
new f0a28bf [FLINK-1444][api-extending] Add support for attaching data properties to data sources
new 3d84970 [FLINK-1461][api-extending] Add SortPartition operator to Java and Scala APIs.
new a6acd2e [FLINK-1466] Adds HCatInputFormats to read from HCatalog tables.
new bed3da4 [FLINK-1466] Add support for complex types in Flink tuples for HCatInputFormats.
new a911559 [FLINK-1592] [streaming] StreamGraph refactor to store vertex IDs as Integers
new 5232c56 [FLINK-1505] [distributed runtime] Separate reader API from result consumption
new 86ca692 Change translateToDataflow to return Operator
new 98da559 Add methods to CompositeType for querying field types and names
new e868d59 [FLINK-947] Add a declarative Expression API
new 2bdfd88 [FLINK-1255] Add FAQ entry about Scala API TypeInformation
new ab202c8 Add link to Type Extraction Doc in FAQ entry about Scala Extraction
new 40ea8a4 [tests] Disables JobManagerFailsITCase and SimpleRecoveryITCase until they are fixed
new 1189790 [FLINK-1515] [gelly] Splitted runVertexCentricIteration into createVertexIteration and runVertexIteration to make VertexCentricIteration object accessible to developers.
new c111444 [FLINK-1515] [gelly] Changed PageRank to use broadcast set provided by numberOfVertices() to read the number of vertices instead of passing it to the constructor.
new 98bc7b9 [FLINK-1596] [runtime] Remove space in temp filename
new 9528a52 [FLINK-1598] [runtime] Better error message when network serialization of records exceeds java heap space.
new 9ddb565 [runtime] Improve error handling when submitting a job to the JobManager
new 5725c72 [jobmanager] Add a process reaper to kill the JobManager process when the main actor dies.
new 70df028 [tests] Speed up DataSinkTaskTest
new 1230bca [tests] Add process reaping test for TaskManager, improves process reaping test for JobManager.
new 4883af6 Small cleanup to truncate some lines that are too long for easy read of the code.
new ed8b26b [FLINK-1580] [FLINK-1590] [runtime] Various cleanups and improvements in the TaskManager initialization
new bfbbbf9 fixed package statement
new 64c302f Fix typo in exception message from assiged to assigned in ExecutionJobVertex.
new d18401c [FLINK-1606] [tests] Fixes JobManagerFailsITCase for Akka 2.2.1 by setting gate-invalid-address-for = 5s and quarantine-systems-for = off
new 80c2a0c [FLINK-1607] [tests] Fixes SimpleRecoveryITCase by rebalancing the data sources so that all mappers receive at least one element
new 859a839 [FLINK-1604] [runtime] Fixes livelock in PartitionRequestClientFactory.createPartitionRequestClient
new 2f1987a [FLINK-1604] [FLINK-1568] Add initial connect failure test
new 607bf12 [FLINK-1607] [runtime] Moves PartialPartitionInfo from ExecutionVertex to Execution to automatically clear them in case of restart
new 639cd1c Remove unnecessary log level checks
new 649334a [FLINK-1609] FileSystem.getHomeDirectory()
new 2fe3deb [FLINK-1519] Added canceling state to web interface.
new fd65a24 [FLINK-1582][streaming]Allow SocketStream to reconnect when socket closes.
new d182d04 [FLINK-1582][streaming] SocketStream minor enhancements
new c0c4c9f [tests] Remove timeout in PipelinedPartitionQueueTest
new 9ca4219 [web client] Fix webclient config forwarding
new c032725 [tests] Improve debuggability of ProcessReapingTests
new 9de47e7 [docs] Fixes jekyll's config to bind to localhost
new 62405ac [streaming] Streaming examples dependency fix
new f992b75 [FLINK-1462][gelly][docs] added gelly guide
new 557edff [FLINK-1462][gelly][docs] improvements and fixed typos
new facf54e [core] move AbstractID from runtime to core
new 3dc2fe1 [java-api][scala-api] convenience methods count/collect to transfer a DataSet to the client
new e91c1da [FLINK-1586] [streaming] Add support for iterative streaming graphs on JSON generation Closes #432
new 9ee8f42 [FLINK-1553] [streaming] Reworked Kafka connectors Closes #433
new b7b547d [streaming] Add a clean in WindowedDataStream
new ce0c290 [streaming] Several minor cleanups
new a201b30 [FLINK-1591] [streaming] Removed unnecessary merge before flatten as optimisation
new 84c11e6 [scala api] Moves TraversableType behind the CaseClassType in the TypeAnalyzer priority
new 9ff9410 [hotfix] Fix Scala type analysis for classes that extend Collections
new bbe6e8a [FLINK-1569] Disable object-reuse for collection execution
new 086209c Fix typos in iterations.md file
new 933609f [FLINK-1608] [taskmanager] Hostname/address for TaskManager can be specified in the configuration
new 861ebe7 [FLINK-1608] [taskmanager] Network address selection makes multiple attempts before switching to heuristics.
new caa2941 [runtime] Extend environment logging on startup
new e038629 [FLINK-1626] [tests] Fix spurious failure in MatchTaskTest
new 2a52871 [streaming] Proper exception propagation for udf exception + collector bugfix
new 256b2ee [distributed runtime] [tests] Add helper setters for NettyConfig
new 6da093a [distributed runtime] Notify about error when handing in channel
new 9407041 [distributed runtime] Throw interrupted exception during partition request client creation
new 6b79aca [docs] adjust GCE setup instructions to point to the latest bdutil git version
new dec5e33 [hotfix] Fix issue with nested Avro types
new 9255594 [FLINK-1577] Remove misleading error log when failing task externally
new 226e905 [FLINK-1555] Add serializer hierarchy debug util
new d50e8bf [hotfix] Fix loading of wrong TaskManager class
new a1162b7 [config] Remove unused config constants
new 94a66d5 [FLINK-1631] [jobmanager] Deactivate web frontend in parallel tests (prevent port collisions)
new 7abed95 [flink-yarn-tests] Add check for exceptions in the flink logs.
new 0ae0cba [scala-api] Corrects type cast in Scala API's DataSet.collect method and adds test cases for that
new 0333109 [FLINK-1627] [runtime] Fix race between remote receive and task release
new 5385e48 [FLINK-1631] [client] Overhaul of the client.
new 9c64137 [jobmanager] Improve error message in case task deployment times out.
new 9c0d634 [FLINK-1646] [runtime] Improve 'insufficient number of network buffers' error msg
new 55f1508 [tests] Simple code format in CountCollectITCase and suppresses sysout output for test.
new d8d642f [FLINK-1648] Add auto-parallelism to select all available task slots
new f329e4e [FLINK-1522][gelly] Added test for SSSP Example
new 8961bd1 [FLINK-1522][gelly] Fixed faulty split into create/runVertexCentricIteration
new e306c62 [FLINK-1522][FLINK-1576] Updated LabelPropagationExample and test
new b529b62 [FLINK-1522][FLINK-1576][gelly] Added more test cases for Label Propagation
new e1e0306 [gelly] refactored tests; removed duplicate data from TestGraphUtils
new 3abd6c8 [FLINK-1625] [streaming] Refactored StreamVertex and subclasses to clean up after invoke and properly log and propagate exceptions
new 8436e9c [FLINK-1625] [streaming] [api-breaking] Added proper cancellation to StreamInvokables + Sink- and SourceFunction interfaces extended with cancel method
new 08ef02e [FLINK-1625] [streaming] Streaming cancellation minor fix and documentation
new bcb3daf [docs] reintroduce link from documentation to Flink website
new 482766e [FLINK-1649] [runtime] Give a good error message when a user emits an unsupported null value
new eae2166 [FLINK-1650] [logging] Suppress wrong netty warnings on akka shutdown
new 8f321c7 [FLINK-1640] Remove tailing slash from paths. Add tests for Path and FileOutputFormat.
new 27d1e7f Some simple cleanups and doc updates while looking at (mostly) runtime package
new 92b1eb7 Simple fix to respect return value return by File APIs.
new fb62f6b [FLINK-1587][gelly] Added additional check for edge src/trg id validity
new 8c9ab85 [FLINK-1429] [streaming] Scala documentation and minor Scala API features
new bd1b916 Fixed simple typos
new 7582390 [FLINK-1429] [streaming] Scala programming guide update: intro & operators, minor fixes
new 5242e96 [FLINK-1637] Reduce number of files in uberjar for java 6
new f582449 [FLINK-1651] Fix test case at JobManagerStartupTest to avoid hang on certain users
new 0b15bc3 Fix checking null for ternary operator check on Exception#getMessage calls
new 9edc804 [tests] Add comments and to recovery tests
new 500ddff [FLINK-1667] [runtime] Add test for recovery after TaskManager process failure
new abbb0a9 [FLINK-1668] [core] Add a config option to specify delays between restarts
new 0df5601 [hotfix] Fix erroneous testing log4j configuration for flink-runtime
new b0a57c3 [FLINK-1628] [optimizer] Fix partitioning properties for Joins and CoGroups.
new b4e8350 [docs] fix anchor positions of headlines, reduce size of nav bar
new 5061edb [FLINK-1638] [streaming] Vertex level fault tolerance and state monitor
new a34869c [FLINK-1638] [streaming] Fault tolerance logic in JM and TM
new 452c39a [FLINK-1638] [streaming] Operator state checkpointing and injection prototype
new 0ccb87c [FLINK-1638] [streaming] Added connector for low level Kafka Consumer API
new e7485c2 [FLINK-1638] [streaming] Added Kafka topic creator and custom offset consumer
new 09aa841 [FLINK-1638] [streaming] Added persistent Kafka source
new cf49ebb [FLINK-1638] [streaming] State interface cleanup
new c9a3992 [FLINK-1638] [streaming] Seperated AbstractRecordReader for streaming and batch
new 5327d56 [FLINK-1638] [streaming] Barrier sync added to CoRecordReader, barrier tests
new ed5ba95 [FLINK-1638] [streaming] Kafka low level API example, documentation and fixes
new 37390d6 [FLINK-1638] [streaming] At-Least once monitoring semantics added and bug fixes
new 490fa70 [FLINK-1638] [streaming] RegisterState removed from datastream + CoRecordReader barrier test added
new f2b5c21 [FLINK-1638] [streaming] Add StateHandle and include javadoc
new 2bba2b3 [FLINK-1638] [jobmanager] Cleanups in the ExecutionGraph for streaming fault tolerance
new f09c0af [FLINK-1660] [streaming] Increased timeout for MultiTriggerPolicyTest and introduced a constant representing it.
new 2be00ac [FLINK-1657] [streaming] Count window parallel discretization
new 70abc16 [FLINK-1619] [FLINK-1620] Basic sliding prereducers added for Time and Count
new aacd4f2 [FLINK-1643] [streaming] Auto detection of tumbling policies added + WindowedDataStream refactor
new 2522f02 [FLINK-1619] [FLINK-1620] Grouped sliding prereducers added for Time and Count
new 84e76f4 [FLINK-1605] Bundle all hadoop dependencies and shade guava away
new fd9ca4d [FLINK-1654] [docs] Fix scala example in programming guide
new 13bb21b [FLINK-1629][FLINK-1630][FLINK-1547] Add option to start Flink on YARN in a detached mode. YARN container reallocation.
new 92e809d [docs] Adds documentation on setup of intelliJ
new 378b487 Remove unused imports from RichMapPartitionFunction. Wrap way too long statements in NetworkBufferPool.
new 81ebe98 [tests] Increase timeout for ProcessFailureBatchRecoveryITCase to compensate for slow Travis runs
new 07a9a56 [FLINK-1683] [jobmanager]Â Fix scheduling preference choice for non-unary execution tasks.
new 1c269e2 [maven] Remove flink-streaming-examples from flink-dist
new 6c99cb6 [FLINK-1450] Added fold operator for the Streaming API
new f785c73 [FLINK-1450] Added GroupFoldFunction and GroupedFoldInvokable with a test. Integrated them into DataStream
new 5f8ba8e [FLINK-1450] Integrated fold into WindowedDataStream and added a WindowFolder test
new aaa231b [FLINK-1450] Several minor stream fold fixes
new b891ff5 [FLINK-1677][gelly] Suppresed Sysout Printing for the Degrees with exception test suite
new 2db73aa [FLINK-1677] [gelly] Simple improvements to DegreesWithExceptionITCase.
new 2eea012 [project] Added additional IntelliJ file ignores
new 5308ac8 [FLINK-1705] [taskmanager] Fix hostname lookup.
new 5c8b0ba [FLINK-1691] [tests] Fix and cleanup CountCollectITCase
new 36b762e [gelly-tests] Fixes DegreesWithExceptionITCase to check expected exceptions
new 1950d05 [yarn-tests] Fix potential NullPointerException
new 3b579ad [optimizer] Remove obsolete and unused fields from OptimizerNode
new 361c90a [FLINK-1671] [jobmanager] Rename JobManager's ExecutionMode to JobManagerMode
new 4782770 [FLINK-1671] [tests] Rename "ExecutionMode" in MultiProgramTestBase to "TestExecutionMode"
new 7f8e156 [FLINK-1671] [core] Add execution mode to execution config
new 1c50d87 [FLINK-1671] [optimizer] Add data exchange mode to optimizer classes
new e795c43 [FLINK-1576] [gelly] improvements to the gelly examples. Updated GraphMetrics, MusicProfiles and PageRank to run with and without parameters. Added input descriptions to LabelPropagation and SSSP. Fixed some minor issues in the SSSP example. Fixed a bug in MusicProfiles that wasn't generating the user-user graph properly. Changed the PageRank library method to initialize the vertex ranks.
new 9077a53 [FLINK-1652] fixes superstep increment in CollectionExecutor
new 9db170f [FLINK-1632][gelly] Deleted GraphUtils and made Gelly methods use DS.count()
new a1daadc [FLINK-1632][gelly] Removed bcast var in GraphMetrics and PageRank
new b093469 Link to IntelliJ setup guide from README [ci skip]
new 05e0699 [FLINK-1714] Fix logger of the class SecurityUtils
new 9b4f483 [FLINK-1414] Move quickstarts to website
new 04a7388 [FLINK-1342] Use maven-shade-plugin in quickstarts to build fat-jar
new 72ca014 [docs] Remove -j and -a parameters which seemed no longer valid in the doc example for submit job to Flink run in YARN.
new cf492be [FLINK-1695] [ml] Initial commit to establish module structure. Adds simple Vector and Matrix types.
new 0c24262 [FLINK-1696] [ml] Adds batch gradient descent linear regression with l2 norm
new 458c524 [FLINK-1697] [ml] Adds alternating least squares (ALS) implementation with test case
new 8648543 [ml] Introduces FlinkTools containing persist methods.
new effea93 [FLINK-1698] [ml] Adds polynomial base feature mapper and test cases
new ff83c8c [FLINK-1696] [ml] Adds web documentation for multiple linear regression. Changes website links from relative to absolute.
new 21e2d96 [FLINK-1697] [ml] Adds web documentation for alternating least squares. Adds web documentation for polynomial base feature mapper.
new ac4e4a7 [docs] Fixes typo in cluster_setup.md and links in sidenav.html and navbar.html
new 3a50f24 [docs] make the nav bar scroll instead of fixing it at the top
new ef856a9 [docs] Fixes broken "Build Flink" link in sidenav.html
new 1930678 [FLINK-1641] Make projection operator chainable.
new 9d7acf3 [FLINK-1350] [runtime] Add blocking result partition variant
new 9c77f07 [FLINK-1350] [runtime] Set result type to BLOCKING if data exchange mode is BATCH
new cf6c63c [runtime] [tests] Run ProcessFailureBatchRecoveryITCase in BATCH and PIPELINED execution mode
new 4a49a73 [FLINK-1671] [optimizer] Fix comment typos
new e93e0cb [FLINK-1622][java-api][scala-api] add a GroupCombine operator
new 7167218 Quick fix to fix compile error due to change class name of MultipleProgramsTestBase.TextExecutionMode in GroupCombineITCase.
new 02459d2 Fix indentation for JobManager ScheduleOrUpdateConsumers and space for if-else.
new 798e595 [docs] [streaming] Quick fix for batch lexers in streaming guide
new dafcd4e [ml] [tests] Force pipelined execution of ALSITCase
new 6e38eb8 [FLINK-1436] [docs] update command line documentation
new 0a3ef15 [FLINK-1739] [runtime] Fix the bug of the jobManager and TaskManager IPC Port Check.
new 6071fb8 [yarn] Add final modifier to PollingThread#lock object to make sure immutability.
new ce39c19 [FLINK-1720] Integrate ScalaDoc into JavaDoc
new 5c743d8 [FLINK-1724] [tests] Respect number of task managers in TestingCluster
new 5c6603e [FLINK-1709] Add initial SlotCountExceedingParallelismTest
new b18c66b [FLINK-1752][streaming] Rework and improve Kafka connectors
new c0917f2 [FLINK-1752][streaming] Add KafkaITCase and various bugfixes
new 650c528 [FLINK-1706] Spilling BarrierBuffer added + basic tests
new f625b8d [FLINK-1706] Resource cleanup added streaming readers with BarrierBuffers
new ceea93d [FLINK-1706] IOTest added for BarrierBuffers
new 1b69032 [FLINK-1721] [yarn] Temporarily disable search for exceptions in the YARN log due to akka bug
new 258cede [FLINK-441] [optimizer] Rename "o.a.flink.compiler" to "o.a.flink.optimizer"
new c91fb7c [FLINK-441] [optimizer] Removed obsolete plan validator
new 9d222ca [FLINK-441] [optimizer] Remove obsolete and unused utility classes
new a9150b3 [FLINK-441] [optimizer] Rename Pact* and Nephele* classes
new c2db181 [optimizer] Migrate first set of tests (branching plans) to new API
new 5757850 [optimizer] Moved optimizer graph traversals to dedicated classes to simplify Optimizer class.
new 633b0d6 [optimizer] Rename optimizer project to "flink-optimizer" (previously flink-compiler)
new 6b4ee2a [streaming] Added thread-safe list to tests
new 29a6615 [FLINK-1594] [streaming] Added StreamGraphEdges
new a8ba72b [FLINK-1594] [streaming] Embedded StreamEdges
new 3158d1d [FLINK-1594] [streaming] Fixed co-tasks input handling
new d832400 [FLINK-1594] [streaming] Added OutputSelector wrapping
new adcdfda [streaming] Added Reader and Writer factories & minor cleanup
new 221e5e6 [FLINK-1594] [streaming] Self connect tests and fixes
new 1377ca9 [FLINK-1618] [streaming] Parallel time reduce
new ac888b2 [FLINK-1715] [streaming] Removed unnecessary print messages
new b6f183a test refactoring fix
new a6da9f2 [streaming] [FLINK-1740] Pass config param for numberOfExecutionRetries to the JobGraph for streaming jobs
new 22e0065 [FLINK-1757] [streaming] Fixed type cast bug in SumFunction
new 684ec7e [runtime] Fix scheduleOrUpdateConsumers logic for blocking results
new 2cd5e93d [FLINK-1760] [maven] Added Scala version profiles to support building with Scala 2.11
new 7988235 [FLINK-1760] Add travis profiles for scala-2.11 builds.
new 55db268 [runtime] Slight improvements and tests in the Buffer class
new 79000c8 [streaming] StreamExecutionEnvironment methods for streaming fault tolerance
new 3838dd1 Small changes to make code more consistent.
new 0619c05 [FLINK-1765] [streaming] GroupedReduceInvokable chaining fix + minor FilterInvokable fix
new ff60ecf [streaming] ChainableInvokable refactor
new 380ef87 [FLINK-1761] Fix IndexOutOfBoundsException when receiving empty buffer
new 925481f [FLINK-1761] [runtime] Fix sequence number mismatch on empty buffer drop.
new f372358 [streaming] Improve comments for source functions. Minor cleanups.
new 244e5d5 [streaming] Add test that runs streaming with fault tolerance
new a3bc785 [FLINK-1688] [streaming] Socket client sink added
new 1179649 [FLINK-1688] [streaming] [api-extending] Socket Client Sink added to the DataStream API
new 2842e2f [FLINK-1756] [streaming] Rename Stream Monitoring to Stream Checkpointing
new 35f3416 [FLINK-1763] [streaming] Remove cancel from SinkFunction
new d994d2e [FLINK-1679] deprecate API methods to set the parallelism
new cf84bca [FLINK-1679] use a consistent name for parallelism
new 013ed82 [FLINK-1679] deprecate old parallelism config entry
new 126f9f7 [FLINK-1679] extend faq and programming guide to clarify parallelism
new 00d22c3 [Travis] Set checkout depth to 100 to avoid failed builds due to long build queues at travis
new e83d1ec [FLINK-1767] [streaming] Make StreamExecutionEnvironment return JobExecutionResult instead of void.
new 80dd859 [docs] Fixes Java broadcast variable example
new 4c71e90 [logging] use correct class name for logging BlobServerConnection
new 8b3cbb5 [runtime] Return null at input gate after all end-of-partition events
new de45c06 [docs] Adds akka configuration description
new ed1b30f Update Javadoc from Nephele task manager to Task Manager; add missing Javadoc params in RegularPactTask#getOutputCollector.
new b566e48 [FLINK-1770]Rename the variable 'contentAdressable' to 'contentAddressable'
new 597d8b8 [FLINK-1544] [streaming] POJO types added to AggregationFunctionTest
new ae04025 [FLINK-1756] [streaming] Rename Stream Monitoring to Checkpointing in JobGraph.
new 033c69f [Flink-1780] Rename FlatCombineFunction to GroupCombineFunction
new 7b1c19c [FLINK-1512] [java api] Add CsvReader for reading into POJOs
new 7a6f296 [FLINK-1512] [scala api] Add CsvReader for reading into POJOs
new 43ac967 [FLINK-1512] [tests] Add integration tests for CsvReader
new 1b42b62 [FLINK-1512] [documentation] Added CSV to POJO feature to documenation.
new b13c9a7 [hotfix] [doc] Fix DataSet type in readCsvFile example
new 95bdaad [runtime] Refactor partition consumable notification
new d72a3f7 [runtime] Fix possible resource leak in RemoteInputChannel
new 0b86903 [FLINK-1755] Fix possible NullPointerException in LocalInputChannel
new 271ac0f [streaming] Kafka documentation update
new 7ed95d9 [FLINK-1773] [streaming] Introduced CentralActiveTrigger with GroupedActiveDiscretizer
new 83db1db [FLINK-1775] BarrierBuffer fix to avoid end of stream deadlock
new 2d373d8 [FLINK-1769] Fix deploy bug caused by ScalaDoc aggregation
new 61a3a64 [FLINK-1785] [test] Master tests in flink-tachyon fail with java.lang.NoSuchFieldError: IBM_JAVA.
new 0b48e52 [FLINK-1686] [streaming] Use different slot identifier per iteration
new 1f726e4 [FLINK-1686] [streaming] add parallel iteration test
new 4e3ba40 [FLINK-1726][gelly] Added Community Detection Library and Example
new 9eef3c8 [gelly] corrected community detection usage description and moved it from the library method to the example; removed unnecessary @SuppressWarnings(serial) from SSSP
new 6b9cee3 [Flink-contrib] Flink dev cluster on Docker with Docker Compose deployment
new 2d1f8b0 [FLINK-1501] Add metrics library for monitoring TaskManagers
new 973d778 [FLINK-1650] Set akka version to 2.3.9
new c9d29f2 [FLINK-1650] Let Netty(Akka) use Slf4j
new 9c0a453 [FLINK-1790]Remove the redundant import code
new 1aba942 [FLINK-1781] [quickstarts] Fix exclusions for different Scala versions.
new b6319ea [quickstarts] Remove redundant old fat jar assembly file.
new d11e091 [FLINK-1783] [quickstarts] Quickstarts create no dependency-reduced POM.
new 659ddc0 Add missing import.
new d7d9b63 [FLINK-947] Add parser to Expression API for exposing it to Java
new c9519c8 [FLINK-1623] Rename Expression API to Table API
new 1c1562a [maven] Fix maven snapshot deployment for Hadoop2 profile.
new 923a2ae [FLINK-1795] [runtime] Add test for duplicate elimination in the solution set.
new d6ea1f2 [tests] Remove incomplete and unused LineRankITCase.
new 8c32142 [FLINK-1796] [jobmanager] In local mode, the embedded TaskManager is watched by a process reaper as well.
new d03dd63 [tests] Add template log4j.properties files for tests
new 56afefc [FLINK-1669] [streaming] Test for streaming recovery from process failure
new c284745 [FLINK-1669] [streaming] Clean up and fix test for streaming fault tolerance with proess failures
new 2f66ab3 [FLINK-1633] [gelly] Added getTriplets() method and test
new 01adab5 [FLINK-1633] [gelly] some cosmetic changes to getTriplets and EuclideanGraphExample
new 2667f0e [runtime] Improve error messages and add tests for failed library downloads on TaskManagers
new f99d797 [tests] Improvements in timeouts for test stability on quirky Travis VMs
new fb3f3ee [FLINK-1779] [runtime] Rename the function name from getCurrentyActiveConnections to getCurrentActiveConnections in org.apache.flink.runtime.blob
new c89c657 [FLINK-1774] Remove the redundant code in try{} block.
new ee273db [FLINK-1801] [FLINK-1465] Network environment can start prior to TaskManager in "disassociated" mode.
new 121a5a0 Small clenaup to wrap very long lines in flink-runtime package.
new 6b0d407 [FLINK-1771] Add support for submitting single jobs to a detached YARN session
new c0b2975 [FLINK-1806] Improve error message when no S3 access/secret key configured
new b8aa49c [FLINK-1794] [test-utils] Adds test base for scala tests and adapts existing flink-ml tests
new 224fa94 [FLINK-1805]The class IOManagerAsync should use its own Log instance
new d8c74d2 [FLINK-1766]Fix the bug of equals function of FSKey
new 1a3ae03 [FLINK-1662] [streaming] Triggering on fake element bugfix
new c635802 [FLINK-1797] Add jumping pre-reducer for Count and Time windows
new 9219af7 [FLINK-1718] [ml] Adds sparse matrix and sparse vector types
new 5ddb2dd [ml] Adds convenience functions for Breeze matrix/vector conversion
new d2e2d79 [FLINK-1718] [ml] Unifies existing test cases
new 50ffff0 [travis] Fix YARN container log upload to s3 on Travis
new 5691f26 [streaming] Streaming program cancellation bugfix
new cbc8423 [tools] Add --abbrev-ref to get the right branch name of HEAD
new 015af17 [FLINK-1717] [ml] Adds support to directly read libSVM and SVMLight files
new 79a92a6 [FLINK-1811] Allow passing custom buffer sizes and timeouts to PersistentKafkaSource
new 7cf9586 [FLINK-1589] Add option to pass configuration to LocalExecutor
new 359b39c [FLINK-1753] [streaming] Added test for Kafka connector with tuple type
new 57e9ae0 [FLINK-1777][Documentation] Improved documentation for Java 8 Lambdas in Eclipse
new 0075925 [FLINK-1716] [ml] Adds CoCoA algorithm
new 10d20bf [FLINK-1816] [gelly tests] Fixes wrongly introduced exception checks in DegreesWithExceptionITCase
new 2ffefdf [yarn][streaming] Add support for streaming fire and forget yarn job submissions.
new 2cbbd32 Added support for Apache Tez as an execution environment
new 2d55cf0 [FLINK-1788] [table] Make logical plans transformable
new 189001d [FLINK-1803] [streaming] returns(..) method added to Stream operators
new b8bb762 [release scripts] Update scripts for 0.9.0-milestone1
new dda8565 [FLINK-1656] Filter ForwardedField properties for group-at-a-time operators in Optimizer.
new f39aec8 [FLINK-1776] Add offsets to field indexes of semantic properties for operators with key selectors
new f36eb54 [FLINK-1664] Adds check if a selected sort key is sortable
new 909cee2 Fix the constructor comments with correct parameter in DefaultMemoryManager
new 1cf49e9 [FLINK-1824] [streaming] Support added for missing types in DataStream api
new 1da4b64 [FLINK-1808] [streaming] Send barrier requests only when the execution graph is running
new e74521c [FLINK-1580] [taskmanager] Improve TaskManager startup robustness
new 43c080a [runtime] Simplify TaskExecutionState by removing obsolete manual serialization code.
new adc8530 [runtime] Fix bug that deploys to wrong target TaskManager slot
new 12c555f [runtime] Remove old redundant classes - StringRecord -> StringValue - IntegerRecord -> IntValue - FileRecord -> obsolete
new 4f4c6b9 [streaming] WindowWordCount example added
new 0ca1f0c [runtime] Add docs to BufferPool classes
new 4ed009e [TaskManager] Add test for failure behavior on TaskManager startup
new 5cd9e9d [runtime] Improve robustness of test TaskManagerRegistrationTest.
new 2f683af Fix issue where Windows paths were not recognized as absolute Added Windows test cases to Path tests
new 23fe006 Additional tests for Path.isAbsolute()
new d33b445 [FLINK-1817] Fix ClassLoaderObjectInputStream to support primitive type classes
new ed7d165 [FLINK-1560] [streaming] Streaming examples rework
new 464e782 [FLINK-1560] [streaming] Added ITCases to streaming examples
new 954beca [FLINK-1560] [streaming] Streaming example ITCases cleanup
new 52ebb29 [FLINK-1837] [streaming] Throw Exception for checkpointed iterative programs
new 4363f98 [maven] [quickfix] Don't exclude Zookeeper in flink-streaming-connectors
new 09bd1f8 [runtime] Remove old unused classes
new 4b89855 [runtime] Fix TaskManager's BLOB service host lookup when connecting to the JobManager
new 4692564 Remove 'executable' permission from various non-executable source files
new 71ca958 [contrib] Remove redundant LICENSE file in 'flink-contrib/docker-flink'
new 07aff92 [licences] Updated LICENSE and NOTICE file of the binary distribution to contain dependencies of 'flink-dist'.
new ae6ff29 [FLINK-1832] [scripts] fix conversion to Windows path with spaces
new cc7eda1 [FLINK-1832] [scripts] fix start scripts for Cygwin and paths with spaces.
new 0afed4d [FLINK-1840] Fix BLOB manager on Windows
new 5dd42c1 [FLINK-1839] Reworked TwitterStreamITCase for testability
new 4343e44 [dist] Excludes the empty *-tests.jar from being copied to the flink-dist/../examples directory
new b566884 [FLINK-1841] [streaming] More permissive WindowJoinITCase
new 41ab436 [doc] Fix typos and formatting in Flink on Tez doc
new e8faff7 [FLINK-1813] Avoid illegalstate exception when trying to broadcast on finished operators
new f07aa01 [quickstart] Error msg in streaming quickstarts when run with wrong number of arguments
new 365cd40 [runtime] Fix erroneous import of shaded dependency
new e48e76f [hotfix] Fix scaladoc in Table.scala Examples
new ae2537e [hotfix] Fix scaladoc in Table.scala Examples (second try)
new 62c465c [FLINK-1793] [streaming] Fix file source isRunning check for proper cancelling
new 80b570b [FLINK-1823] Remove linq from Table API documentation
new 9110269 [FLINK-1800] [docs] Add beta tag to components in flink-staging
new 1cff478 [tests] SumMinMaxITCase to use collect() rather than flakey temp files
new 8740d1e [FLINK-1845] [runtime] Fixup ReusingKeyGroupedIterator value iterators in NonReusingSortMergeCoGroupIterator.
new e45f13f [FLINK-1847] [Scala API] Changes the return type of Scala API's collect method to Seq[T] and adds parentheses to collect and count methods.
new e98bd85 [FLINK-1694] [gelly] added IterationConfiguration as a way to configure a VertexCentricIteration
new 48713a8 [FLINK-1694] [gelly] fixed typo and a small code simplification
new e281e4d [FLINK-1741] [gelly] Adds Jaccard Similarity Metric Example
new c518df9 [gelly] minor javadoc correction: the Graph is always directed.
new 0e3e6a3 [quickstarts] Set different default groupid for quickstarts to avoid exclusion by the assembly plugin
new a479463 [docs] Add custom search
new 9ffcdf3 [docs] Add clickable stack figure on overview page
new 201bea3 [runtime] Accumulators are reported through the RuntimeEnvironment, not directly sent as an actor message
new 6774054 [FLINK-1535] [core] Rework accumulators
new 922db79 [FLINK-1535] [tests] Add custom acumulators and custom type collect() to classloading tests
new 499790c [tests] Revert accidentally committed log level change for tests
new 9cd38f0 [FLINK-1850] Fix version on startpage
new 830dab2 [runtime] [tests] Remove RemoteInputChannelTest timeout
new 3246255 [FLINK-1835] Stabilize YARN tests
new 211d0bd [FLINK-1862] [apis] Add support for non-serializable types for collect() by switching from Java serialization to Flink serialization
new 36fcdae [tests] Increase robustness of SimpleRecoveryITCase
new 71b2d66 [streaming] ITCase for WindowWordCount
new e01894c [FLINK-1838] [doc] Streaming programming guide update
new 46573a6 [streaming] Removed unnecessary BatchIterator class
new 2d13c21 [streaming] Cancellation update in connectors
new f89e136 [flink-yarn-tests] Make error messages verbose for debugging
new 92e0c77 [docs] Remove skeleton page from navigation, add links to ML pages
new f81d9f0 [FLINK-1710] [table] Switch compile backend to Janino
new ad63707 [FLINK-1879] [client] Simplify JobClient. Hide actorRefs behind method calls where possible.
new 0e6c9d4 [FLINK-1868] [tests] Fix corner case of EnvironmentInformationTest
new e79813b [FLINK-1878] [APIs] Environments accept a flag that controls sysout logging during execution.
new 69a400f [tests] Cleanup sysout logging in tests
new 322782c [docs][yarn] Use SNAPSHOT flink version in SNAPSHOT documentation
new c910300 [runtime] Avoid IllegalStateException when TaskManager is killed during startup
new f50d754 [build system] Exclude log4j.properties files from uberjar and module jars
new 54d5662 [FLINK-1866] [streaming] StreamConfig key bugfix
new e5a3b95 [FLINK-1660] [streaming] [tests] Fix MultiTriggerPolicyTest race
new cb34e97 [FLINK-1753] [streaming] Added Kafka broker failure test
new 51a583a [scripts] Update error message for missing commands of the jobmanager.sh script
new 56e9f1a [hotfix] Fix invalid timeout in JobClient
new f1b445b [FLINK-1876] [streaming] StreamGraph refactor
new 4754a97 [streaming] Major internal renaming and restructure
new 354922b [FLINK-1753] Extend KafkaITCase with large messages test + rework PersistentKafkaSource.
new 8c5cd97 [FLINK-1900] Fix Scala Table API Example in doc
new c2faa6f [FLINK-1856][doc] Add notice about implicit TypeInformation
new ea71020 [streaming][connectors] Add more configuration options to PersistentKafkaSource
new 32a04e4 [docs] Corrects combineGroup documentation example
new 10fc1d8 [FLINK-1902] Show jobmanager address/port in configuration
new 26ce47f [FLINK-1900] add missing '
new f7ec859 Fix the message in runtime exception
new e2a0018 [docs] fixed a few typos in internal_general_arch.md
new a0900e7 [streaming] Parallel time reduce logic refactor to force prereducers
new 6a1edc8 [FLINK-1906] [docs] Add tip to work around plain Tuple return type of project operator
new 62c3d50 [FLINK-1809] Add Preprocessing package and Standardizer to ML-library
new 877043f [streaming] Fixes kafka test logging
new af9248c [FLINK-377] Generic Interface
new d182daa [FLINK-671] Python API
new 1d669da Added examples of TPCH Query 3 and Query 10, WebLogAnalysis
new e1618e2 [Flink-671] Python API additions
new 30a74c7 [FLINK-703] [java api] Use complete element as join key
new 45e680c [FLINK-703] [scala api] Use complete element as join key
new a0147c4 [FLINK-1891] Add check for empty storageDirectory path
new df7c61e [FLINK-1486] add additional print method for prefixing a user-defined string
new b704312 [FLINK-1878] [streaming] Stream environments accept a flag that controls sysout logging during execution.
new 2b8db40 [FLINK-1918] [client] Fix misleading NullPointerException in case of unresolvable host names
new 8fc847e [client] Work around limitations of JDK 1.6 in InetSocketAddress
new acd9235 [docs][typo] Replace reduceGroup() with reduce() in the GroupReduceFunction interface
new db60833 [FLINK-1875] Add figure explaining slots and parallelism
new bad77a3 [build system][travis] avoid hanging builds when downloading cache archives
new 6df1dd2 [FLINK-1909] [streaming] Type handling refactor for sources + scala api
new f1ee90c [docs] Change doc layout
new 4e61775 [FLINK-1422] [docs] Add function parametrization docs
new 579f991 [streaming] Small fixes for StreamConfig
new 56cb793 [streaming] FullStream window helper added + partitioner bugfix
new 4672e95 [FLINK-1799][scala] Fix handling of generic arrays
new 4dbf030 [FLINK-1930] [runtime] Improve exception when bufferpools have been shut down.
new 2347363 [hotfix] Bump asm version to 5.0.3
new 3f3830d [streaming] StreamConfig now uses InstantiationUtils for serialization
new 046f39e [streaming] Stream operators robustness improved for serilization
new b2aafe5 [FLINK-1867/1880] Raise test timeouts in hope of fixing Travis fails
new 722719f [FLINK-1514] [gelly] Add a Gather-Sum-Apply iteration method
new e1f56e9 [FLINK-1514] [gelly] Removed GGC example, added Connected Components instead
new 740d437 [FLINK-1514] [gelly] Unified create and run for GSA iterations
new 837508d [FLINK-1514] [gelly] Fixed inconsistencies after merge
new 921414d [FLINK-1514] [gelly] improvements to the GSA SSSP example; improvements to the GSA Connected Components example
new 4e3165e [FLINK-1514] [gelly] suppressed warnings in several places; adjusted tests
new 66d72ac [FLINK-1514] [gelly] renamed fields in Neighbor class; added forwarded fields hint in GSAIteration
new 40f5f3a [FLINK-1514] [gelly] Simplified GatherUdf; added forwarded fields annotations
new 6e24879 [FLINK-1514] [gelly] Removed edge value type from ApplyFunction; Reuse the output vertex
new 9de640a [FLINK-1758] [gelly] Neighborhood Methods Extensions
new d015bb0 [FLINK-1758] [gelly] Replaced groupReduce with reduce
new ea9d9a0 [FLINK-1758][gelly] Made reduce methods operate on values
new af35ecc [FLINK-1758] [gelly] made reduceOnEdges and reduceOnNeighbors only have accees to edge/vertex values, not IDs
new 9689ca8 [FLINK-1758] [gelly] [docs] reworked neighborhood methods docs
new b950d5b [streaming] Serializable no longer needed for examples
new 8791d4f [streaming] Timestamp comparison bugfix
new 88638de [FLINK-1930] Separate output buffer pool and result partition life cycle
new a2c9cbb [hotfix] Raise Akka test timeouts some more
new fceb90a [runtime] Bump Netty version to 4.27.Final and add javassist
new 247cad1 [FLINK-1924] minor refactoring of the Python API
new 11f1dd6 FLINK-1693 Add DEPRECATED annotations in Spargel APIs and update the doc to refer to Gelly for Flink graph processing.
new de573cf [FLINK-1828] [hadoop] Fixed missing call to configure() for Configurable HadoopOutputFormats.
new c527a2b [FLINK-924] Add automatic dependency retrieval for JarFileCreator
new 6460743 [FLINK-924] Add JarFileCreator tests for anonymous classes and Java 8 lambdas
new b0df4f4 [docs] [ml] Fixes wrong ALS example code
new f2daa10 [FLINK-1950] Change safety margin computation for YARN containers
new 844d5e2 [docs] Moves slots_parallelism.svg to correct directory
new 9a18e57 [yarn] [python] Adds -Xms start option for yarn, fixes python test case to overwrite files, fixes python docs
new ccd574a [FLINK-1922] [runtime] Fixes NPE when TM receives a null input split
new 5a2ca81 [FLINK-1923] [runtime] Replaces asynchronous logging with synchronous logging using grizzled-slf4j wrapper for Scala.
new 4cb5b72 [FLINK-1925] [runtime] Splits the processing of the SubmitTask message into two phases: 1. TDD reception with eager acknowledgement and 2. TDD instantiation with a subsequent state update message.
new 0fceb11 [runtime] Remove redundant JobType property from JobGraph.
new 421e4a1 [streaming] Change 'getParallelism()' signature to return a primitive to avoid failed equality checks.
new 8f55abe [runtime] Process reaper gives log time to reach disk before killing the process
new b1af2df [runtime] Miscellaneous style cleanups
new 7f0ce14 [FLINK-1953] [runtime] Implement robust and flexible checkpoint coordinator with tests.
new ca82b0c [FLINK-1948] [streaming] Manual task slot sharing settings added for stream operators
new 8c46155 [FLINK-1911] [streaming] Projection without specifying types
new 40be172 [streaming] Cleanup for projection update
new 8e429ce [FLINK-1615] [java api] SimpleTweetInputFormat
new 84790ef [FLINK-1843][jobmanager] remove SoftReferences on archived ExecutionGraphs
new 58de10a [hotfix] Remove asm dependency from root pom
new 42acf5d [docs] fix search form on subpages
new f2e6fd3 [FLINK-1883] [gelly] Connected Components example
new 1722e83 [streaming] Duplicate userfunction eliminated from StreamMap
new c9c9450 [FLINK-1670] [streaming] Collect function for DataStream
new 6b6675b [FLINK-1670] [streaming] Cleanup for DataStream collect
new ae867ef [FLINK-1855] [streaming] Add WordCount class into WindowWordCount and SocketTextStreamWordCount example jars
new 912edbc [FLINK-1956] [streaming] Proper opening of rich windowfunctions
new bdd8429 [ml] Adds proper log properties file setting for scalatest plugin
new 7d2e5aa [FLINK-1944] [gelly] Added GSA-PageRank example
new 51aa666 [gelly] [docs] Change the return type of groupReduceOnNeighbors example
new 0163e50 [FLINK-1871] [gelly] Added Spargel to Gelly migration guide
new 60ec683 [FLINK-1871] [gelly] [docs] added a link to the migration guide in the Spargel guide; moved the migration guide section to the end of Gelly guide; made a few corrections in the migration guide text
new adb321d [FLINK-1951] Fix NullPointerException in delta iteration due to missing temp
new bd96ba8 [FLINK-1682] Ported optimizer unit tests from Record API to Java API
new b3cb5e7 [streaming] Added naming for streaming operators
new 8ea840e Removed legally questionable tweet data
new faac203 [runtime] Fix Netty watermark configuration
new 0078c44 [FLINK-1978] Fix POJO deserialization for reuse objects with NULL fields
new 6892403 [streaming] [api-breaking] Changed returntype of WindowedDataStream's mapWindow
new 2f08d9d [FLINK-1937] [ml] Fixes sparse vector/matrix creation fromCOO with a single element
new ddb2b34 [FLINK-1933] [ml] Adds distance metrics and documentation to machine learning library
new ce2163e [gelly] removes generic type constraints
new 778cda7 [ml] [docs] Adds distance formulas to documentation. Automatically include latex_commands.html with mathjax markdown files.
new f0b45c4 [scala] Introduces trait type to TypeAnalyzer which avoids compiler warnings due to misclassification as a pojo type
new 2939fba [FLINK-1807] [ml] Adds optimization framework and SGD solver.
new 3b8f60e [FLINK-1997][table] Add <> and != for un-equal in expressions
new 84dcb7c [FLINK-1998][table] Fix equals expression
new bc8f197 [FLINK-1792] Add processCPULoad in metricsRegistry, add button to show/hide graphs, add summary for metrics
new 170366c [streaming] Made constructor of GroupedDataStream public
new 7e5a970 [FLINK-1974] Fix getNetRuntime() of JobExecutionResult and add documentation
new d259e69 [docs] Fix broken links in documentation
new acca10e [streaming] New Source and state checkpointing interfaces that allow operations to interact with the state checkpointing in a more precise manner.
new 1c8d866 [FLINK-1968] [runtime] Clean up and improve the distributed cache.
new 1d368a4 [runtime] Fix TaskExecutionState against non-serializable exceptions.
new 8e61301 [FLINK-1672] [runtime] Unify Task and RuntimeEnvironment into one class.
new 59faf46 Update build target path in README.md
new fbea2da [FLINK-1969] [runtime] Remove deprecated profiler code
new c1dba08 [readme] Update links to IDE setup guide
new 4cc971d [FLINK-1676] Rework ExecutionConfig.enableForceKryo()
new 318a14d [QA] store messages in file instead of in the environment
new 4068371 [FLINK-2001] [ml] Fix DistanceMetric serialization error
new cafb876 [FLINK-1987][docs] Fixed broken links
new 3be621c [FLINK-1928] [hbase] Added HBase write example
new a771cfb [FLINK-1928] [hbase] Fix license header for HBase tests
new b4152d7 [runtime] Improve error messages on Task deployment
new a3a7350 [FLINK-785] ChainedAllReduce
new 57615aa [FLINK-785] Fixed ObjectReuseITCase
new 4b53e66 [QA] display max 100 lines of compiler warnings
new ff750e6 [streaming] Discretizer reuse bugfixes
new 9b7f8aa [FLINK-1953] [runtime] Integrate new snapshot checkpoint coordinator with jobgraph and execution graph
new ededb6b [FLINK-1973] [jobmanager] Task execution state messages are logged on INFO level, rather than on DEBUG level
new 3b2ee23 [streaming] Integrate new checkpointed interface with StreamTask, StreamOperator, and PersistentKafkaSource
new 54e9576 [FLINK-1935] Reimplement PersistentKafkaSource using high level Kafka API
new c8de656 [streaming] StreamTask updated to handle chained states
new 959d227 [tests] Fix ProcessFailureRecovery tests by aligning restart delay parameter with heartbeat pause.
new 4bd3525 [tests] Add test that checkes canceling against a failed TaskManager process
new e79ff4e [tests] Adapted CoGroupITCase to use "collect()" rather than writing temp files (increases robustness)
new cf4f22e [tests] Consolidate miscellaneous tests into one IntegrationTestCase to reuse minicluster and speed up tests
new 7349333 [FLINK-1959] [runtime] Support accumulators in chained functions after a non-UDF operation
new 4786b56 [FLINK-1595] [streaming] Added complex streaming integration test
new 48e21a1 [streaming] Added proper StreamingMultipleProgramsBase
new 9da2f1f [FLINK-2006] [runtime] Fix testing TaskManager task status request to stabilize tests.
new 113b20b [FLINK-2011] [runtime] Improve error message when user-defined serialization logic is erroneous
new bd7d867 [FLINK-1949] Fix issue detecting stopped detached YARN session
new 705ee8a [FLINK-2008] Fix broker failure test case
new a35c720 [FLINK-1976][gelly] Added ForwardedFields annotations for Gelly functions.
new b335f58 [FLINK-1525] Implement a tool for parsing input parameters and provide facilities to use them in the system.
new f950def [FLINK-1711] Converted all usages of commons validate to guava checks(for Java classes), scala predef require(for scala classes)
new 8f28f41 [hotfix] Add missing import
new beb7f31 [FLINK-1975][gelly] Graph getUndirected improvement
new 1698f7e [FLINK-2019] Use a properly instantiated Kryo in the GenericTypeComparator
new 6dd241d [FLINK-1990] Support upper case of `as` for expression
new 562f8a3 [FLINK-1942] [gelly] GSA Iteration Configuration
new 7378054 [hotfix] Fix link to coding guidelines
new a6f6a67 [FLINK-2006] [tests] Fix "TaskManagerTest.testRunJobWithForwardChannel()" by properly deploying receiver only after sender is running.
new 31d19df Wrap very long line in FlatMapOperator class
new 390021e [FLINK-2022] Put default log4j.properties into quickstart projects
new ebc8d20 [core] Miscellaneous cleanups in the FileInputFormat
new c12403e [FLINK-2041] [optimizer] Remove pipeline breakers where they are subsumed by batch data exchanges.
new 6403dbd [streaming] Deleted obsolete database connectors
new 39d526e [FLINK-1820] Consistent behavior of numeric value parsers.
new ea23f28 [FLINK-1820] Consistent behavior of numeric value parsers.
new 8aad7af [FLINK-2040] [runtime] Tolerate out-of-order CANCELING and CANCELED messages.
new 8e6bb9a [FLINK-1952] [tests] Add a test that runs an iterative job after a failure in another iterative job.
new 3cd36a5 [runtime] Fix for task canceling the order of (1) resource deregistration (2) completeness notification
new 58865ff [FLINK-1977] Rework Stream Operators to always be push based
new a04f091 [FLINK-2009] Force chaining for System Operators
new f59d6a1 Disable Test in ComplexIntegrationTest
new 48a2720 [streaming] ByteStream and File state handle added
new 59bee4a [streaming] Discard method added to state handle
new 197cd6c [streaming] StateHandleProvider added for configurable state backend
new 6edf31a [streaming] Added HDFS test for FileStateHandle
new 2d3e69a [FLINK-1986] [streaming] Iterative stream creation bugfix
new 1479973 [streaming] State backend configurable from flink-conf.yaml
new 8f4039d [gelly] [refactoring] Removed Example end string from all gelly examples
new 585d27d [FLINK-1523] [gelly] Vertex centric iteration extensions
new 1dfbcba [FLINK-1523] [gelly] Added Vertex Centric Configuration Tests
new e172067 [FLINK-1523] [gelly] Added VertexWithDegrees as a subclass of Vertex
new e2f28d4 [FLINK-1523] [gelly] added getIn/Out degrees methods in update and messaging functions; deleted VertexWithValue type; deleted InaccessibleMethodException; if the options are not set, -1 is returned; added missing javadocs; added tests; renamed type parameters VertexKey -> K, VertexValue -> VV, EdgeValue -> EV.
new a067d59 [FLINK-1523] [gelly] [docs] updated vertex-centric docs accordingly
new 912f8d9 [gelly] renamed IncrementalSSSPExample -> IncrementalSSSP to match the new examples naming scheme
new f253655 [FLINK-2025] add support for booleans in csv parser
new 825cea2 [FLINK-2026][api] add a flag to indicate previous executions
new 89209a4 [runtime] Improve error message for failed network connections due to limited number of file handles
new 68e29d2 [FLINK-2059] Changed flink-compiler to flink-optimizer in the pom.xml
new 7bd8068 [FLINK-1980] [api] Allow users to decorate input streams
new f27025b [FLINK-2057] [FLINK-2058] [core] Fix hadoop input split class loading and remove IOReadableWritable from InputSplits
new 68f41a0 [streaming] Fixed error logging in streaming tasks.
new 85453b6 [FLINK-2063] [streaming] Configure checkpoint coordinator to treat all vertices as stateful.
new 7bd7b05 [FLINK-2063] [streaming] Add a streaming exactly once processing test with stateful operators.
new 939e3fc [FLINK-2062] [core] Fix names of memory size config parameter
new e9c1562 [FLINK-1418] [apis] Change print() to print on the client and to eagerly execute the program.
new 78d954b [FLINK-1418] [apis] Fix eager print() and adjust all tests and examples to not fail due to "eager" print method
new 6220f34 [FLINK-1418] [apis] Minor cleanups for eager on-client print() statement.
new ad1d936 [FLINK-2071] [java api] Fix serializability issue with projectsion function.
new b92ff12 [examples] Fix remaining examples to properly handle eager print() execution.
new f8a381f [FLINK-2023] [scala] Improve type analysis - Exclude static fields in Scala Pojo analysis - Recognize Java Tuples - Clean up legacy code
new 495a5c3 [FLINK-1985] [streaming] Add ExecutionConfig serialization for streaming jobs
new 8b904ae [FLINK-2052] Fix Serialization warnings in Stream Operators
new 35ea650 [runtime] Extend memory and GC monitor logging.
new b3b6a9d [FLINK-1992] [ml] Adds convergence criterion to Flink's SGD algorithm
new b602b2e [FLINK-2034] [ml] [docs] Adds FlinkML web documentation (introduction, vision, roadmap)
new fde0341 [FLINK-2050] [ml] Introduces new pipelining mechanism using implicit classes to wrap the algorithm logic
new 1e57475 [FLINK-2050] [ml] Ports existing ML algorithms to new pipeline mechanism
new 1aad5b7 [FLINK-1954] [FLINK-1636] [runtime] Improve partition not found error handling
new 36c2026 [streaming] Minor bugfix in the BarrierBuffer input finishing logic
new 24c4f83 [hotfix][table] Fix not-equals code generation
new 7e4c562 [FLINK-2007] [streaming] Proper Delta policy serialization
new 0cfa43d [FLINK-2082] [streaming] Create own context for chained streaming operators
new fdac963 [streaming] Fix bug with iteration sink/source syncing
new 2a65b62 [FLINK-1954] [FLINK-1957] [runtime] Improve error handling of transport failures
new 4de2353 [streaming] Fix iteration colocation + enable chaining for iterative jobs
new 6bc6dbe [FLINK-2074] Fix erroneous emission of Sliding Time PreReducer
new 4dcfc43 Fix moved comment in StreamTask
new 44c247b [runtime] Fix possible IndexOutOfBoundsException when scheduling or updating consumers
new 48e2cb5 [FLINK-2056] [ml] [docs] Addes docs for ML pipelines
new a1d2df6 [FLINK-1957] Fix NPE during cancelling of partition request
new ae44638 [FLINK-2053] [ml] Adds automatic type registration of flink-ml types. Adds de-duplication of registered types at ExecutionConfig. Fixes bug in Breeze SparseVector to Flink SparseVector conversion.
new e0d1fd5 [runtime] [tests] Fix possible NPE and add Netty serialization test
new 3ef4e68 [FLINK-1920] Properly pass command line arguments with spaces to Flink
new 924830f [runtime] Fix possible NPE during cancelling
new ea60678 [FLINK-2085] [runtime] Add an option to let the MemoryManager allocate and release memory as needed.
new efec229 [FLINK-2084] [core] Add an option to start Flink in streaming mode
new 0437722 [tests] Adjust tests for dedicated streaming mode and clean up test bases.
new eba6f9a [tez] Fix Flink-on-Tez use of pre-allocating MemoryManager
new baeedba [quickfix] Made recursive enumeration parameter flag public in FileInputFormat
new f2891ab [bugfix] fix FileInputFormat for exclusively two level deep nested files
new 7d6df2e [scripts] Check if execution/streaming mode is set
new f78339f Change FlinkMiniCluster#HOSTNAME to FlinkMiniCluster#hostname to match naming convention.
new b015a32 [FLINK-2083] [ml] [docs] Improves FlinkML documentation
new 49631dc1 [docs] Fix broken images in quickstarts
new b68049b [tez] Fix initialization of MemoryManager.
new edcfd8b [FLINK-2012] [gelly] Added methods to remove/add multiple edges/vertices
new bc19aa3 [FLINK-2012] [gelly] Changed addVertices to operate on vertices only
new 21207fd [FLINK-1941] [gelly] [docs] added documentation for the Gather-Sum-Apply iterations in Gelly
new 7164b2b [FLINK-1848] Fix for file paths with Windows drive letters
new 3586ced [FLINK-2043] Change the KMeansDataGenerator to allow passing a custom path
new b2b0fe7 [jobmanager] Fix potential null pointer exception in jobmanager webfrontend
new 11b021b [FLINK-2079] Add TaskManager deathwatch thread for YARN case
new 3c037be [yarn] Adjust default values for YARN heap memory cutoff
new 7ff675a [scripts] Start JM in batch mode in start-cluster.sh
new d1d7044 [core] cleanup & tests for FileInputFormat
new 63edeca [examples] Add toString() method to accumulator
new c77947e [FLINK-2073] [ml] [docs] Adds contribution guide. Adds links to FlinkML main site.
new 8e35feb [stream] Remove unused StreamSource.java
new 017b4f0 [FLINK-1952] [jobmanager] Rework and fix slot sharing scheduler
new bf94a34 [tests] Fix AvroExternalJarProgramITCase logging
new e96f279 [tests] Add a "not-so-mini-cluster" test to validate scheduler for iterative jobs on many TaskManagers
new 3061eb1 [tests] Consolidate manually triggered tests into a dedicated package
new 96bbdbd [tests] Minor warning cleanups
new c81256b [ml] [docs] Fixes broken back links
new f5f1a03 [streaming] Fix streamrecordwriter behaviour with buffer timeout set to 0
new 0ef2159 [runtime] [tests] Add TaskCancelTest
new ceb890f [FLINK-1636] [runtime] Add partition request backoff logic to LocalInputChannel
new 28eb274 [FLINK-2089] Fix possible duplicate buffer release
new 087571b [runtime] [logging] Fix log message
new 7ec95c9 [FLINK-2096] Remove implicit conversion from Window Stream to Stream
new 72828b5 [streaming] [hotfix] Flatten called explicitly on windowing examples
new 665bcec [FLINK-1874] [streaming] Connectors separated into individual projects
new a302817 [docs] [streaming] Flume connector temporarily removed from docs
new 7f5edeb [FLINK-2088] [streaming] [scala] DataStream.name() returns a typed DataStream
new 717f881 [FLINK-1907] Add Flink Scala Shell
new 6bb6de2 Some code cleanups on Scala Shell
new 4118160 Properly include Scala Shell in Documentation
new 995f8f9 [FLINK-2047] [ml] Renaming CoCoA to SVM
new d951f11 [ml] [docs] Replaces remaining CoCoA names by SVM
new 3e860e7 [FLINK-2104] [ml] Fixes problem with type inference for fallback implicits where Nothing is not correctly treated (see SI-1570)
new d1d2ccc [2104] [ml] Hotfix for wrong class name after renaming
new 4c9f161 [docs] let the squirrel logo point to the homepage
new d594d02 [FLINK-2109] [runtime] Fix CancelTaskException handling
new 5a7ceda [runtime] Clear serializer state when clearing RecordWriter
new 84fce54 [hotfix][scala-shell] fix location of classes according to package name
new 1c3b67e [FLINK-1687] [streaming] [api-extending] Synchronizing streaming source API to batch source API
new 120bd0f [FLINK-1687] [streaming] [api-breaking] fromCollection and generateSequence rework
new 2315c7c [docs] Removed unnecessary Serializable from ExecutionEnvironment JavaDocs
new 145b2ba [streaming] [scala] [api-breaking] StreamExecutionEnvironment API update
new 0fd6023 [FLINK-2112] [streaming] Proper package for kafka tests
new 0930179 [streaming] Build warnings eliminated from streaming-core
new 7cb35ea [FLINK-2113][gelly] removed env.execute() after print()
new 12cd156 [FLINK-2061] [java api] Fix GenericCsvInputFormat skipping fields error with quoted string
new 5b79957 [FLINK-2114] [streaming] Fix null check in PunctuationPolicy.toString()
new dce1be1 [FLINK-1954] [FLINK-1958] [runtime] Cancel transfers of failed receiver tasks
new f75c16b [FLINK-1954] [FLINK-1955] [runtime] Set task failure cause for produced result partitions
new 6182180 [runtime] Fix uncaught exception in Netty server pipeline
new 93e960d [runtime] Rename internal field of Netty error message
new 2f347a0 [FLINK-2037] Provide flink-python.jar in lib/
new ac43a69 [streaming] Test added for iteration sink-source CoLocation + non-chained windowing
new 7d29473 [FLINK-2004] Fix memory leak in presence of failed checkpoints in Kafka source
new 0334091 [FLINK-2121] Fix the recursive summation in FileInputFormat.addFilesInDir
new 572a45b [docs][hotfix] fix <p> tag issue by removing <br> tag
new d22e9f8 [FLINK-2132] [scripts] Fix java version extraction
new 7571959 [FLINK-1430] [streaming] Scala API completeness for streaming
new d163a81 [FLINK-2102] [ml] Add predict function for labeled data for SVM and MLR.
new 44dae0c [ml] Adds syntactic sugar for map with single broadcast element. Rewrites the optimization framework to to consolidate the loss function.
new 950b79c [ml] Replaces RichMapFunctions with mapWithBcVariable in FlinkML
new 90c0142 [ml] Fixes implicit issue with BreezeVectorConverter
new bc7f6d9 [streaming] Fixing some javadoc typos
new bf9cc81 Implemented TwitterSourceFilter and adapted TwitterSource
new a43e0d5 [FLINK-2103] [streaming] [api-extending] Expose partitionBy to user
new 6b28bdf [FLINK-2103] [streaming] [api-extending] PartitionBy for connected streams, scala & docs
new 3527f40 [streaming] [api-breaking] Consolidate DataStream method names
new 39ec54f [FLINK-2130] [streaming] RMQ Source properly propagates exceptions
new a750415 [FLINK-2069] Fix Scala CSV Output Format
new fad9795 [hotfix] Remove execute() after print() in Table API examples
new 11643c0 [FLINK-2070] [core] Deprecate "print(prefix)" methods and add "printOnTaskManager(prefix)" method.
new 0dea359 [FLINK-2134] Close Netty channel via CloseRequest msg
new 0081fb2 [FLINK-2135] Fix faulty cast to GroupReduceFunction
new 5e09e9b [FLINK-2126] [scala shell] All tests now dont check for "Job execution switched to status FINISHED.", which sometimes did not show up. Fixed typo in add numbers test
new 8e793f9 [core] Remove extra li HTML tags in TypeInformation JavaDoc class header.
new 7411343 [docs/javadoc][hotfix] Corrected Join hint and misleadling pointer to Spargel
new 1559701 [FLINK-2076] [runtime] Fix memory leakage in MutableHashTable
new 463300e [FLINK-1993] [ml] Replaces custom SGD logic with optimization framework's SGD in MultipleLinearRegression
new 86692e5 [scala-shell] [docs] Fixes wrong scala shell command in online documentation
new b5e5591 [hbase] Add a stream data sink for HBase
new 8e49e7b [streaming] Minor cleanups on data stream.
new 23a3646 [streaming] [scala] ITCases for streaming scala examples
new 39010dc [streaming] Removed StockPrices example
new 6685b0b [FLINK-2098] Ensure checkpoints and element emission are in order
new f4195ac [FLINK-2098] Improvements on checkpoint-aligned sources
new da8aa10 [FLINK-1229][docs] Updated web client documentation - WebClient assembler class flag is '-c' (not 'assembler') - doc-building script is named 'build_docs.sh' (not '_build_docs.sh')
new 92d3251 [FLINK-2123] Fix log4j warnings on CliFrontend startup
new 0d00836 [javadoc] fix link not found errors on jdk8
new 17cb647 [FLINK-1892] [tez] Bump Tez dependency to 0.6.1 from 0.6.0 to include tez bugfixes
new 4b9e340 [tests] Increase timeouts for process failure tests in order to compensate for volatile CI environments (Travis)
new 235b02c [FLINK-2160] Change Streaming Source Interface to run(Context)/cancel()
new 9b88184 [FLINK-2165] [TableAPI] Renamed table conversion functions in TableEnvironment
new 3e6b6be [FLINK-2002] [streaming] Test for iterations being gracefully shut down
new 86e8425 [FLINK-1126][docs] Best practice: named TupleX types
new 8a52076 [FLINK-1565][FLINK-2078] Document ExecutionConfig and object reuse behavior
new 2298cfe [FLINK-2133] [jobmanager] Fix possible deadlock when vertices transition to final state.
new f72e5c8 [FLINK-2139] [streaming] Streaming outputformat tests
new e3402c0 [streaming] Socket Client Sink propagates exceptions
new 8958603 [FLINK-2136] [streaming] Added test for scala DataStream
new 03ae80d [FLINK-2136] [streaming] Added parallelism tests to DataStream
new 59a2297 [streaming] Added throwing exceptions to streaming functions
new a363308 [FLINK-2136] [streaming] Added operator tests to DataStream
new 1ac0fb4 [hotfix][doc] Fix typo in Scala Shell doc
new b0d3107 [docs] fix rendering glitch by separating html from markdown text
new 4fa3c0b [FLINK-2164] Document streaming and batch mode
new 868b62b [flink-core] Added the member currentSplit to FileInputFormat. This member contains the split that this parallel instance must consume.
new defba67 [FLINK-1061] Document how to run an example
new 85c55dc [FLINK-2092] Adjust documentation for print()/collect() semantics update
new 58b9a37 [FLINK-2087] Add streaming mode switch to YARN
new d433ba9 [FLINK-2177] [runtime] Fix possible NPE when closing Netty channel, before it is active
new c854d52 [FLINK-1319] [core] Add static code analysis for user code
new 16ab1fd [FLINK-1981] add support for GZIP files
new 1484e00 [FLINK-2153] Exclude Hbase annotations
new 80b1d56 Add CONTRIBUTING.md file with pointers to our guides
new 3e9af82 [FLINK-2080] Document how to use Flink with sbt
new 804430b [FLINK-1635] remove Apache Thrift and Google Protobuf dependencies
new 7805db8 [FLINK-2000][table] Add SQL-style Aggregation Support
new 26304c2 [FLINK-2054] Add object-reuse switch for streaming
new ce3dd36 [hotfix] correct Maven dependency for streaming examples
new fcca75c [docs] Fix some typos and grammar in the Streaming Programming Guide.
new ee7c417 [docs] [streaming] Added states and fold to the streaming docs
new e0d60dd [FLINK-2174] allow comments in 'slaves' file
new 73f9911 [FLINK-1844] [ml] Add MinMaxScaler implementation in the proprocessing package, test for the for the corresponding functionality and documentation.
new 97611c2 [ml] Makes StandardScalers state package private and reduce redundant code. Adjusts flink-ml readme.
new 2eb5cfe [hotfix] Fix YARNSessionFIFOITCase
new 31d3eaa [FLINK-2182] Add stateful Streaming Sequence Source
new 1481647 [streaming] Optional iteration feedback partitioning added
new d81f4cf [FLINK-2194] [type extractor] Excludes Writable type from WritableTypeInformation to be treated as an interface
new c04a575 Fixed a few trivial issues:
new b5b71e1 [hotfix] Bring KMeansDataGenerator and KMeans quickstart in sync
new a8e0850 [FLINK-2196] [javaAPI] Moved misplaced SortPartitionOperator class
new 4fe2e18 [streaming] Allow force-enabling checkpoints for iterative jobs
new e2304c4 [FLINK-2191] Fix inconsistent use of closure cleaner in Scala Streaming
new 7f3108d [streaming] Fixed streaming example jars packaging and termination
new 63b8c36 [FLINK-2072] [ml] Adds quickstart guide
new 2ea1e7d [FLINK-2199] Escape UTF characters in Scala Shell welcome squirrel.
new 2d302ab [scripts] remove quickstart scripts
new e966a0d [FLINK-2183][runtime] fix deadlock for concurrent slot release
new 078e6ef [streaming] Logging update for checkpointed streaming topologies
new 9d6290e [build] [streaming] Streaming parents dependencies pushed to children
new 32ddc9e [streaming] [api-breaking] Minor DataStream cleanups
new 1e7d0bb [FLINK-2195] Configure Configurable Hadoop InputFormats
new 42d1917 [FLINK-2206] Fix incorrect counts of finished, canceled, and failed jobs in webinterface
new e45c5dc [docs] remove obsolete YARN link and cleanup download links
new e4b5695 [FLINK-2207] Fix TableAPI conversion documenation and further renamings for consistency.
new f8e12b2 [FLINK-2203] handling null values for RowSerializer
new 118469d [storm-compat] Introduced Storm wrappers to Flink
new 2bf76be [strom-compat] Added Storm API compatibility classes
new 0a8b63a [storm-compat] Added tests for Storm compatibility API
new 45dbfdd [storm-compat] Added tests for Storm compatibility wrappers
new 56e013f [storm-compat] Added abstract base to Storm compatibility examples
new 000b5d5 [storm-compat] Added Storm compatibility word count examples
new fa13e49 [storm-compat] Added ITCases to Storm compatibility examples
new 9ff3cf0 [storm-compat] Added README files to Storm compatibility modules
new e497a83 [storm-compat] Storm compatibility code cleanup
new 09e5be4 [storm-compat] Simple examples added
new e39699f [storm-compat] adapted layer to new streaming API
new 12b13f9 [storm-compat] Moved Storm-compatibility to flink-contrib and split flink-contrib into small sub-projects
new 3fe6d19 [contrib] Added log properties files to contrib & minor clean ups
new 37ceb8d [readme] Synchronize tagline with intro, fix typos
new 5317a1e [FLINK-2216] Exclude javadoc jar from examples
new b14ec17 [FLINK-2224] Log error cause in JobStatusChange
new f916819 [FLINK-2219] [webfrontend] Fix IllegalArgumentException and decrease log level
new af4481c [hotfix] Some small fixups in README.md
new 21605d6 [FLINK-2221] [docs] Docs for not using local filesystem on the cluster as state backup
new be50795 [FLINK-2209] [docs] Document linking with jars not in the binary dist
new 20d7e5a [docs] Update obsolate cluster execution guide
new 1bd0af7 [FLINK-2120][runtime] rename AbstractJobVertex to JobVertex
new 46ad405 [FLINK-2226][YARN] fail application on failed single-job cluster job
new b59c81b [FLINK-2210] Table API support for aggregation on columns with null values
new d381541 [hotfix] Removed execute() that followed print() in quickstart wordcount jobs
new 5374ba9 [FLINK-2225] [scheduler] Excludes static code paths from co-location constraint to avoid scheduling problems
new 7240c7a [legal] Updates LICENSE/NOTICE file of source and binary distribution
new 5c1aa34 [build] merge transitive notice files to shaded notices
new b7945bf [streaming] Fix out-of-sync class-level docs of SourceFunction
new 20a464f [core] Fix typo in DataSinkTask error message
new e9cad4d [FLINK-2232] [storm-compat] Increased sleeping time for IT-Cases
new 9ee4fa5 Version bumped to 0.10-SNAPSHOT
new b2be80d [FLINK-2149][gelly] Simplified Jaccard Example
new 05bff22 [streaming] Refactor the accessing of the user specified field by sum, min, etc.
new 57459e9 [FLINK-2140][gelly] Allowed access to the number of vertices in the GSA functions
new cdde553 [FLINK-2178][gelly] Fixed groupReduceOnNeighbors bug
new 3406d96 [core] Use consistent equality check in Value types
new c0d3fed [FLINK-2229] Add equals() and hashCode() to ObjectArrayTypeInfo
new ab40e5d [FLINK-2155] Enforce import restriction on usage of Flink shaded package and Commons Validate
new a42c641 [core] Use instanceof for equality check in Value types
new 36b9284 [scripts] cleanup release script and make it more robust
new 391f966 [scala-shell] [tests] Remove unnecessary output check
new bacf447 [FLINK-1877] [FLINK-2204] Ignore frequently failing Flink-On-Tez tests
new 4fff43a [FLINK-2262][utils] rename method for default integer value in ParameterTool
new 636a129 [docs] correct yarn command-line example
new ba2796a [docs] update version to 0.10
new 658a078 [FLINK-2257] [streaming] Properly forward rich window function calls to wrapped functions
new af05b94 [FLINK-2255] [streaming] Fixed a bug in TopSpeedWindowing examples
new d42c732 [docs] fix broken links in FAQ
new a7e2458 [streaming] Initial rework of the operator state interfaces
new ef11e63 [streaming] Allow multiple operator states + stateful function test rework
new f27c3f1 [streaming] Add stateHandle to checkpointed message
new e2e73ad [streaming] Return null for empty state instead of empty hashmap
new 0ecab82 [streaming] fix for null state in ConfirmCheckpoint messages
new 5ddd232 [streaming] KafkaSource checkpointing rework for new interfaces
new 56ae08e [streaming] Fix shallow discard + proper checkpoint commit
new 0a4144e [streaming] [docs] Updated streaming guide for new state interfaces
new 474ff4d [streaming] Allow using both partitioned and non-partitioned state in an operator + refactor
new 0ae1758 [streaming] Re-enable Checkpointed interface for drawing snapshots
new cad8510 [streaming] Add KeyedDataStream abstraction and integrate it with the rest of the refactoring
new fe5bbdb [FLINK-2271] [FLINK-1522] [gelly] changed PageRank example to expect an unweighted edge list added PageRank and MusicProfiles tests got rid of unused suppress warning annotations in Graph and JaccardSimilarityMeasure changed GSAPageRank example to expect an unweighted edge list
new 872c3fc [FLINK-2264] [gelly] changed the tests to use collect instead of temp files
new 3e80868 [FLINK-2264] [gelly] moved utility comparison methods to TestBaseUtils
new 6ab0627 [FLINK-2093] [gelly] Added difference Method
new 38ee125 [FLINK-2214] [ml] Fixes prediction join operation and empirical risk join operation of ALS by giving join hint
new 7a7a294 [FLINK-2116] [ml] Adds evaluate method to Predictor. Adds PredictOperation which can be reused by evaluate if the input data is of the format (TestingType, LabelType) where the second tuple field represents the true label.
new bc3684e [FLINK-2278] [ml] Fixes wrong Breeze sparse vector to Flink sparse vector conversion
new 128d3bc [FLINK-2279] [streaming] Add Connected Iteration
new 3f3b17e [FLINK-2261] [streaming] Remove reduce/fold/aggregations from DataStream
new b35aa20 [streaming] Created scala GroupedDataStream
new df42160 [FLINK-2152] [java api] [scala api] Add zipWithIndex
new fef9f11 [FLINK-2294] [streaming] Fix partitioned state next-input setting for copying chained collectors
new e19ed78 [runtime] Properly set cause of ProducerFailedException
new abaf4af [docs] move FAQ to the website's repository
new 7e75c7b [FLINK-2175] added UI support for multiple "assembler class" entries in jar files - program-class can contain multiple comma seperated entry classes - Main-Class can contain multiple comma seperated entry classes - WebClient shows checkbox for each entry class and can display plan for it
new bd3c8d5 [FLINK-2175] extending WebClient and CLI to show ProgramDescription added WordCountMeta example (used ProgramDescription interface to display meta data by clients) extended WebClient documenation
new a9dc430 [FLINK-2298] Add option to pass a custom name for Flink on YARN
new 1b97505 [tests] Remove subsumes low-level API tests for broadcast variabes
new f5c1768 [FLINK-2308] [runtime] Give proper error messages in case user-defined serialization is broken and detected in the network stack.
new 4e9e0d6 [FLINK-2158] Add support for null to the DateSerializer
new a137321 [FLINK-2275] [tests] Aigrated test from execute() to collect()
new 4cc7cf3 [FLINK-2272] [ml] Removed roadmap and vision from docs, added link to them in the wiki.
new eb23f80 [FLINK-2297] [ml] Adds threshold setting for SVM binary predictions.
new 7c2bbb6 [FLINK-2150] Added zipWithUniqueIds
new 6c21862 [FLINK-2285] [streaming] Removed duplicate call in close from GroupedActiveDiscretizer
new 9d8a348 [streaming] Minor streaming code cleanups
new f428aa7 [docs] improve setup guide for google compute engine
new 728a526 [docs] Add description and illustration of checkpointing mechanism.
new 0cb9eb5 [docs] Fix formatting error in description of stream checkpointing
new 0e21941 [docs] small fix to the description of the checkpointing mechanism
new 0d2c490 [FLINK-2323] [api-breaking] Rename OperatorState interface methods to value() and update(..)
new 627f3cb [FLINK-2293] [runtime] Fix estimation for the number of hash buckets on recursive builds
new 474f9c6 [FLINK-2242] [api] Deprecate RemoteCollector interface and implementation
new 9ea4be8 [FLINK-2000] [table api] Add sql style aggregation support
new 8acc0d2 [tools] Make release script a bit more flexible
new 60cfa0b [FLINK-2208] [runtime] Fix reflective access to CPU load to support IBM Java
new 8c72b50 [FLINK-2288] [FLINK-2302] Setup ZooKeeper for distributed coordination
new 9c0dd97 [FLINK-2288] [docs] Add docs for HA/ZooKeeper setup
new 535475c [FLINK-2288] [runtime] Cleanups and comments for ZooKeeper based initialization
new 706c391 [FLINK-2327] [runtime] Log the limit of open file handles at TaskManager startup
new 0c49891 [FLINK-2331] Whitelist the 'akka.remote.RemoteTransportExceptionNoStackTrace' to be acceptable in YARN logs
new e4a030c [FLINK-2124] [streaming] Fix behavior of FromElementsFunction when T isn't Serializable
new 28713a2 [FLINK-2124] [streaming] Handle 'fromElements()' for non-serializable elements. Cleanup code, and add proper tests.
new e451a4a [FLINK-2330] [streaming] Make FromElementsFunction checkpointable
new d948f1d [FLINK-2327] [hotfix] Properly print file handle limit on TaskManager startup
new 590c6d0 [FLINK-2280] GenericTypeComparator.compare() respects ascending flag
new 7ce05ad [hotfix] Fix wrong unit (secs vs msecs) in TaskManager logging statement.
new c98191c [hotfix] [tests] Increase registration timeout for TaskManagers in ProcessFailureCancelingITCase to compensate for sloggy CI environments
new c7ec74e [hotfix] [taskmanager] Fix line wrapping to please scala checkstyle
new cbde2c2 [FLINK-2339] Prevent asynchronous checkpoint calls from overtaking each other
new 490076a [docs] Fix wordcount example in YARN setup
new 97d1007 [FLINK-2138] [streaming] Added custom partitioning to DataStream
new bc8d7c4 [FLINK-2138] [streaming] Added custom partitioning to scala DataStream
new 3f3aeb7 [FLINK-2138] [streaming] Added docs and tests for partitioning
new ea4f339 [FLINK-2305] Add documenation about Storm compatibility layer additional improvements - added RawOutputFormatter - bug fix in SimpleOutputFormatter - enable default output formatter for StormBoltFileSink
new 3b69b24 [FLINK-2335] [streaming] Lazy iteration construction in StreamGraph
new 9350264 [FLINK-2141][gelly] Allow GSA's Gather to perform this operation in IN, OUT or ALL directions
new d0ecb91 [FLINK-2348] [taskmanager] Make async call dispatching robust against concurrent finishing.
new 61b1c0a [docs] fix loading of style sheet with protocol relative base URL
new 3d5d63f [core] Removed redundant common.io.FormatUtil
new efa62df [core] Minor cleanups in FileInputFormat and DelimitedInputFormat
new d94dfde [core] Add tests for DelimitedInputFormat's handling of records across split boundaries
new 7761ddb [hotfix] Add sshd line in Cluster Setup Documentation
new 7271881 [FLINK-1085] [runtime] Combiner forwards oversized records, rather than failing on them.
new 01c7433 [FLINK-1085] [tests] Make the combiner tests generic. Add more coverage for oversized records.
new 8d1efa0 [FLINK-2337] [storm compat] Excluded 'logback' from Storm dependencies
new aa5e5b3 [FLINK-2008] [FLINK-2296] Fix checkpoint committing & KafkaITCase
new 2ccb5fd [FLINK-2329] [runtime] Introduces InstanceGateway as an abstraction to communicate with the TaskManager.
new 910e8c4 [FLINK-2235] fix calculation of free memory for local execution
new b0b0cb5 [FLINK-2235] Fix tests to allow exception in 'EnvironmentInformationTest.getSizeOfFreeHeapMemory()' if Xmx is not set.
new 84b39dc [hotfix] Fix error messages in EnvironmentInformation when accessing user information
new 9167529 [FLINK-2353] Respect JobConfigurable interface in Hadoop mapred wrappers
new d368a9b [FLINK-2343] [scripts] Make CMS the default GC for streaming setups
new cd934e8 [hotfix] Commit to close lingering pull requests
new 6571a83 [docs] Add new figure of architecture/process model to docs overview page
new cbe3d96 [docs] Move stream checkpointing docs to scalable vector graphics.
new d592ee6 [taskmanager] do not process message if not connected to job manager
new 8261ed5 [FLINK-2292][FLINK-1573] add live per-task accumulators
new 9be1de3 [tests] relax timing assumptions in live accumulator test
new c062137 [docs] Fix Javadocs of RuntimeContext parallel subtask index
new 08ca9ffa [FLINK-1963] Improve distinct() transformation
new 2d191ab [FLINK-2359] [java api] Add factory methods to the Java TupleX types
new a2eb6cc [FLINK-1967] Introduce (Event)time in Streaming
new 0f45f2b [tests] add flag for synchronous execution of futures in TestingCluster
new 0f589aa [FLINK-2371] improve AccumulatorLiveITCase
new 1d373a7 [FLINK-2382] fix Flink live accumulators for TwoInputStreamTask
new 75d1639 [core] Remove obsolete OperatorUtil
new 44ee1c1 [FLINK-2358] [dashboard] First part dashboard server backend
new e86f451 [FLINK-2358] [dashboard] Add server for static dashboard files (HTML, JS, CSS, ...)
new d59cebd [FLINK-2358] [dashboard] Add first stub of angular.js based dashboard.
new ea2b1b1 [FLINK-2358] [dashboard] Adding comments to web dashboard files, add LICENSE file entries
new 29454de [FLINK-2377] [tests] Add reader.close() to readAllResultLines in TestBaseUtils
new 1404db6 [FLINK-2377] [tests] Make buffer closing logic robust to I/O failures.
new 0818bec [FLINK-2362] [docs] Add Scala and Java documentation for the 'distinct()' transformation
new bbbfd22 [FLINK-2376] Raise the time limit in testFindConnectableAddress under Windows
new 11b4863 [FLINK-1943] [gelly] Added GSA compiler and translation tests
new f798df8 [docs] Document some missing configuration parameters
new efafaee [docs] Clean up completeness checker for configuration docs.
new 50344d7 [FLINK-2198] [tests] Under Windows, skip tests that use setWritable
new 148395b [FLINK-2018] [core] Add ParameterUtil.fromGenericOptionsParser()
new 0332050 [FLINK-2304] Add named attribute access to Storm compatibility layer - extended FlinkTuple to enable named attribute access - extended BoltWrapper for user defined input schema - extended FlinkTopologyBuilder to handle declared output schemas - adapted JUnit tests - added new examples and ITCases - updated READMEs - updated documentation
new 1376214 [FLINK-1658] Rename AbstractEvent to AbstractTaskEvent and AbstractJobEvent
new 72b5dc9 [FLINK-2218] Web client cannot distinguesh between Flink options and program arguments
new aa6a7f0 [FLINK-2388] forward message to archivist in case accumulators can't be found
new 0c53891 [FLINK-1818] add cancel method to Client
new 4473db6 [docs] Fixes broken links on the setup_quickstart.html site
new c52e753 [FLINK-2357] [web dashboard] New dashboard backend server supports requests from old web server as well.
new fa78be6 [FLINK-2400] [tests] Improve error message on unexpected TaskTest message
new 2222454 [FLINK-2332] [runtime] Adds leader session IDs and registration session IDs to JobManager and TaskManager messages.
new 5d475f8 [FLINK-2385] [scala api] Add parenthesis to 'distinct' transformation.
new acb6a93 [streaming] Copy default state values for partitioned states
new 9b1343d [FLINK-2381] Stringify cause of ProducerFailedExceptions
new efca79c [FLINK-2384] [runtime] Move blocking I/O call outside of synchronized block
new 31c0c29 [hotfix] Fix warnings introduced by recent Watermark Commit
new 042b2e8 [FLINK-2405] [streaming] Added stateful functions to Scala DataStreams
new 4b44e02 [FLINK-2405] [streaming] Simplifies the way the partitioned field is set in StatefulFunction
new 78fd214 [FLINK-2419] [hotfix] addSink now uses transform + remove double checkpoint commit at head operator
new 5710841 [FLINK-2404] add support for primitives to simple accumulator counters
new a0556ef [FLINK-2418] [streaming] Add an end-to-end exactly-once test for Checkpointed functions.
new 8ba3213 [FLINK-2420] [streaming] StreamRecordWriter properly reports exceptions on flush.
new acae9ff [hotfix] Fix generics for stream record and watermark multiplexing.
new 2d237e1 [FLINK-2421] [streaming] Add tests for basic utility behavior of StreamRecordSerializer (fixed in previous commit).
new ed30ff4 [tests] Add a manual test to evaluate impact of checkpointing on latency
new 0579f90 [FLINK-2406] [streaming] Abstract and improve stream alignment via the BarrierBuffer
new 8f87b71 [FLINK-2402] [streaming] Add a stream checkpoint barrier tracker.
new ada9037 Fix [FLINK-2391] Storm-compatibility:method FlinkTopologyBuilder.createTopology() throws java.lang.NullPointerException bug
new 3e49daf [docs] Updated method documentation. Changed .isEqualTo(..) to .equalsTo(..)
new a34c941 [FLINK-2231] Create Serializer and Comparator for Scala Enumerations.
new 7bd57d7 [FLINK-2424] [core] Close output stream in serialization utility
new 833862a [hotfix] Code cleanups in the StreamConfig
new b211a62 [FLINK-2407] [streaming] Add an API switch to choose between "exactly once" and "at least once".
new 73af891 [FLINK-2419] Add test for sinks after keyBy and groupBy
new 466f9bf [cascading] add getJobConf() to HadoopInputSplit
new ca6dd42 [cascading] load user classloader when configuring InputFormat
new 1b3bdce [client] send cancel message via the job manager's ActorGateway
new 0558644 [FLINK-2324] [streaming] Partitioned state checkpointing rework + test update
new 58cd4ea [FLINK-2324] [streaming] ITCase added for partitioned states
new 83e14cb [FLINK-2324] [streaming] Added test for different StateHandle wrappers
new 1919ae7 [cleanup] move updateAccumulators method to a more sensible location
new 68b1559 [FLINK-1927][FLINK-2173][py] Operator distribution rework, fix file paths
new 3c236b2c [FLINK-2238][api] Generalized fromCollection(Seq) to fromCollection(Iterable)
new a56aad7 [FLINK-2412] [runtime] Check if parent released before querying in-memory buffer in SpillableSubpartitionView
new ce622aa [FLINK-2248] add flag to disable sysout logging from cli
new b0f2379 [FLINK-2446] [streaming] Fix SocketTextStreamFunction memory leak on reconnect
new c58ba3d [hotfix] Fix SourceStreamTaskTest to switch source to running before checkpointing
new 645d7cd [FLINK-2461] [tests] Guard tests that rely on unresolvable host names with the appropriate assumption.
new 9311b9a [FLINK-2427] [streaming] Make the BarrierBuffer more robust against lost/missing checkpoint barriers.
new aa0105a [runtime] Cleanup channel events. Add comments and move some classes to test scope.
new af88aa0 [FLINK-2438] [runtime] Improve channel event serialization performance.
new 40eef52 [hotfix] [streaming] Fix race in stream tasks when canceling tasks early.
new 81f9b21 [FLINK-2459] [cli] Cli API and doc fixes.
new b3dc3f0 [FLINK-2463] [web dashboard] Shows job configuration in new dashboard
new d73cb73 [FLINK-2434] [pom] Fix pattern for exclusion of org.apache.hadoop:hadoop-yarn-common:jersey-test-framework-grizzly2
new 83102f0 [FLINK-2436] [streaming] Make ByteStreamStateHandles more robust
new 7ee0275 [FLINK-2464][tests] Add logging to BufferSpillerTest to help debug spurious failures.
new 416ff58 [FLINK-2433] [docs] Add script to build local documentation on windows
new fab61a1 [FLINK-2409] [webserver] Replaces ActorRefs with ActorGateways in the web server to automatically decorate messages with a leader session ID.
new 0693c92 [FLINK-2322] [streaming] Close file streams to release resources early.
new b08e30a [FLINK-2465] [streaming] SocketClientSink closes connection early
new 24dee42 [hotfix] Remove unused (and broken) TraversableOnceIterable.
new 8eb9cbf [FLINK-2425] [FLINK-2426] [runtime] Add an unmodifiable config and provide access to task manager configuration and hostname inside RuntimeEnvironment
new 5bf2197 [FLINK-2426] [core] Cleanup/improve unmodifiable configuration.
new c3ef61d [FLINK-2425] [runtime] Cleanup code for forwarding config and hostname into TaskManager's RuntimeEnvironment
new 2cff89e [FLINK-2473] [core] Add a timeout to akka actorsystem shutdown.
new d0cd1c7 [FLINK-2464] [tests] Change log level of BufferSpillerTest to "info" to let statements occur in CI logs.
new 949ff8d [FLINK-2456] [hbase] Add a repository ID for hadoop2 in flink-hbase module
new 2859f59 [FLINK-2095][docs] Added missing screenshots to webclient documentation
new bb5e61d [FLINK-2422] [web client] Added explicit link in case browser is not redirecting properly
new 77b7471 [docs] Fixes broken link in FlinkML docs
new d570d07 Remove unwanted check null of input1 in ConnectedDataStream
new 06b37bf [FLINK-2005] Remove Record API from jdbc module
new b2d8c40 [FLINK-2205] Fix confusing entries in JobManager WebUI JobConfig section.
new 3076157 [FLINK-2442] [fix] FieldPositionKeys support Pojo fields
new 0dc6849 [FLINK-2105] Extract abstract superclass, interface from MergeMatchIterators, KeyGroupedIterators
new db0b008 [FLINK-2105] Add support for sorted but sparse test data generation
new df9f481 [FLINK-2105] [tests] Move duplicate utility classes to testutil package
new 941ac6d [FLINK-2105] Implement Sort-Merge Outer Join algorithm
new 5546a1e [FLINK-2447] [java api] TypeExtractor returns wrong type info when a Tuple has two fields of the same POJO type
new 100e8c5 [FLINK-1882] Removed RemotedCollector classes
new 0aa6f0c [FLINK-2467] Example WordCountStorm.jar is not packaged correctly - fixed assembly xml file
new fb7e634 [FLINK-1680] Remove Tachyon test and rename Maven module to "flink-fs-tests"
new d738430 [FLINK-2484] [streaming] BarrierBuffer releases temp files properly.
new 3e73496 [FLINK-2464] [tests] Make buffer spilling test robust to Java 6.
new 5226f0b [hotfix] Remove unused and outdated HashFunctionCollisionBenchmark
new 925ac1f [FLINK-1916] [FLINK-2361] [runtime] Fix EOFException and entry loss in CompactingHashTable
new 249fa2b [FLINK-2454] [buikd] Update Travis to drop JDK6 for tests
new 5a788ec [FLINK-2453] [pom] Move Java source and target version to 1.7
new a5b84b2 [hotfix] Increase timeout for YARN tests to 180 seconds to prevent occasional CI failures.
new 685086a [FLINK-2492] [runtime] Rename former 'match' classes to 'join' to reflect consistent naming scheme.
new 61dcae3 [FLINK-2240] Add bloom filter to filter probe records during hash join.
new 0b73b43 [FLINK-2240] [runtime] Pass flag to configure use of bloom filters through runtime configuration.
new 441ebf1 [hotfix] Fix TEZ task contect to reflect updated interface.
new f1dd914 [FLINK-2452] [Gelly] adds a playcount threshold to the MusicProfiles example
new 6d9eeb5 [FLINK-2243] [storm-compat] Added finite spout functionality to Storm compatibility layer
new dba2946 [FLINK-2243] [storm-compat] Demonstrating finite Storm spout functionality on exclamation example -minor renaming -improving JavaDocs
new fdebcb8 [FLINK-2387] add streaming test case for live accumulators
new 368d7ae [FLINK-705] [license] Add license reference for TPC-H sample data in tests.
new e503ebc [FLINK-2453] [docs] Update README and setup docs to reflect requirement for Java 7+
new 27044b4 [FLINK-1177] [docs] Mark HDFS setup instructions as option in cluster setup docs
new 0ce757f [hotfix] Fix repository language statistics by adjusting .gitattributes
new ceb5c5e [FLINK-2498] [tests] Clean up GroupReduceITCase and make it more robust by avoiding temp files
new b19e5e3 [FLINK-2483] [runtime] Add default branch of switch(scheduleMode) in scheduleForExecution function
new 4ce9475 [travis tools] Adds $HOME/bin/artifacts to $PATH of watchdog script
new d09fc76 [FLINK-2357] [web dashboard] Update Node.js installation instructions
new 5bb855b [FLINK-2502] [storm compatibility] Fix FiniteStormSpout documenation rendering - added missing empty lines - additional minor improvements
new b42fbf7 [FLINK-2500] [streaming] Code cleanup in DataStream
new f50ae26 [FLINK-2277] [scala api] Add flag to set delta iteration solution set to unmanaged
new 4ca7df5 [streaming] [tests] Checkpointing tests refactor & cleanup
new 10ce2e2 [FLINK-2423] [streaming] ITCase for checkpoint notifications
new d8d0748 [FLINK-2511] [runtime] Make sure to close FileInputStream in FlinkZooKeeperQuorumPeer
new eeec191 [FLINK-2509] [runtime] Add class loader info into the exception message when user code classes are not found.
new 54311aa [FLINK-2507] [storm-compat] Rename the function tansformAndEmit
new a41bc8c [FLINK-2437] handle the case of a non-public default ctor in TypeExtractor.analyzePojo
new 7349ef8 [hotfix] read from old and new parallelism config key
new 7cc85c7 [CLEANUP] Add space between quotes and plus sign in String concat for readability in flink-yarn module
new 26c6447 [FLINK-1819][core] allow access to RuntimeContext from Input and OutputFormats
new 4cc8d66 [FLINK-2509] [hotfix] Address pull request comments for ClassLoaderUtils
new 06e2da3 [FLINK-2515] [job manager] Checkpoint coordinator triggers checkpoints only when tasks are running.
new e1d1bd0 [FLINK-2519] [streaming] Make checkpoint alignment aware of finished partitions.
new 51872d7 [FLINK-2517] [docs] Minor fix to streaming guide
new 21a0c94 [FLINK-2393] [docs] Updates docs to describe switch between exactly-once and at-least-once
new 852d19c [FLINK-2523] [taskmanager] Increase interrupt timeout in TaskManager task.
new fab9ce5 [FLINK-2457] [core] Integrate Tuple0 - extended TupleType helper classes to handle Tuple0 - extended TupleSerializer to handle Tuple0 - included Tuple0 into JUnit tests - simplified Receiver.createTuple(int)
new c34af20 [FLINK-2457] [core] Slight adjustedments to Tuple0 singleton names to match naming scheme.
new f350e45 [FLINK-2431] [python] Refactor PlanBinder/OperationInfo
new c2b1eb7 [FLINK-2512] [storm compatibility] Make sure client is properly closed in FlinkSubmitter
new 3c1b5f0 [docs] Fix some errors in programming_guide.md
new 0a7cc02 [FLINK-2487] [ml] In cosine distance, check that datapoints are of same cardinality
new 358259d [FLINK-2458] [FLINK-2449] [runtime] Access distributed cache entries from Iteration contexts & use of distributed cache from Collection Environments
new e4e44be [tests] Make timeout discarding checks in CheckpointCoordinatorTest more robust.
new 0ea0bc1 [FLINK-2527] [gelly] Ensure that VertexUpdateFunction.setNewVertexValue is called at most once per updateVertex
new 0ecc563 [docs] Minor addition to the cluster execution docs.
new 63ee34c [FLINK-2534] [runtime] Some improvements in CompactingHashTable
new 92b1e47 [FLINK-2462] [streaming] Major cleanup of operator structure for exception handling and code simplication
new 3fcc04a [tests] Reinforce StateCheckpoinedITCase to make sure actual checkpointing has happened before a failure.
new 2f0412f [FLINK-2521] [tests] Adds TestLogger class which automatically logs the currently executed test names and the reasons for a failure.
new 143ec4f [FLINK-2286] [streaming] Wrapped ParallelMerge into stream operator
new 67087de [FLINK-2286] [streaming] ITCase for ParallelMerge behavior
new a9d55d3 [flink-2532] [streaming] fix variable name in StreamWindow
new 6eae11f [tests] Hardens TaskManagerRegistrationTest.testTaskManagerResumesConnectAfterJobManagerFailure test case by checking testing actor's complete mailbox for a Terminated message
new 09fdfda [tests] Rename 'compiler' tests to 'optimizer' tests for consistent naming
new d2e88ff [FLINK-2477] [streaming] Add tests for SocketClientSink
new 240e889 [FLINK-1962] Add Gelly Scala API
new 8a59f87 [FLINK-2529] [runtime] Remove some unused code in Execution
new 8602b7a [tests] Minor cleanup removing duplicate mock invokables in various tests.
new baaa3da [tests] Replaces Scala mixins for the Job/TaskManager with classes which extend the respective classes. Adds proper logger registration for sub-classes of FlinkUntypedActor.
new bac21bf [FLINK-2398][api-breaking] Introduce StreamGraphGenerator
new d05d386 [hotfix] Some Java 7 cleanups in InstantiationUtil
new 58421b8 [FLINK-2540] [optimizer] [runtime] Propagate union batch exchanges to union inputs
new c9cfb17 [FLINK-1901] [core] Create sample operator for Dataset.
new a82bd43 [tests] Move UnionClosedBranchingTest to optimizer tests
new 3a83029 [FLINK-2306] Add support for named streams in Storm compatibility layer - enabled .declareStream() and connect via stream name - enabled multiplt output streams - added .split() / .select() / strip pattern - added helpers in new package utils - adapted and extended JUnit tests - adapted examples some minor improvements (FlinkClient, integration of Tuple0)
new 970ab35 [FLINK-2451] [gelly] removed redundant examples; added comments describing which gelly method each example illustrates.
new d2d061c [FLINK-2451] [gelly] library methods cleanup
new 8f35988 [FLINK-2451] [gelly] re-organized tests; compare with collect() instead of temp files where possible
new 5ae8427 [gelly] made the number of vertices an optional parameter of PageRank; added the edge weight initialization to the library methods
new 9c7f769 [FLINK-2560] Flink-Avro Plugin cannot be handled by Eclipse - disabled avro-maven-plugin within Eclipse via <pluginManagement> ... <lifecyleMappingMetaData>
new 5aa70f7 [FLINK-2468] [tests] Make sure StateCheckpoinedITCase tolerates errors before first checkpoint
new c6391db [FLINK-2558] Add Streaming Connector for Elasticsearch
new cf88407 [FLINK-2563] [gelly] extended the run() method of GraphAlgorithm interface to return an arbitrary type
new 5156a1b [FLINK-2564] [core] Improve stability of RandomSamplerTest
new 6f07c5f [FLINK-2528] [tests] Increase robustness and error reporting of MatchTaskTest
new b2f8e30 [FLINK-2089] [runtime] Fix illegal state in RecordWriter after partition write failure
new 5322e87 [FLINK-2538] Close created JarFile in ClassLoaderUtil
new 5a9daca [FLINK-2270] [docs] Fix typo in docs (enableMonitoring => enableCheckpointing)
new a17d4e8 [FLINK-2460] [runtime] Check parent state in isReleased() check of partition view
new 0cca527 [hotfix] Fixes auto type registration settings in ExecutionConfig
new 659f9b5 [hotfix] Allow setting FLINK_CONF_DIR by hand
new bc62787 [hotfix] Add notice about using FLINK_CONF_DIR in Yarn Setup
new 6e1de98 [FLINK-2394] HadoopOutputFormats use correct OutputCommitters.
new b264b01 [FLINK-2555] Properly pass security credentials in the Hadoop Input/Output format wrappers
new e02c301 [scripts] resolve base path of symlinked executable
new ced6a19 [FLINK-2575] [runtime] Deactivate join bloom filters by default
new 4a5fe4e [FLINK-2189] [runtime] Fix various issues in hash table - check for memory availability before probing - correctly compute memory required for recursive build fast path - remove all temp files properly
new 366d937 [FLINK-2356] Add shutdown hook to CheckpointCoordinator to prevent resource leaks
new d08733d [FLINK-2480][test] add test for PrintSinkFunction
new 8ab89e8 [FLINK-2578] [tests] Fix stability of TaskAsyncCallTest
new 2c40ea8 [FLINK-2276] [tests] Fix stability of TaskTest
new 62cf96e [FLINK-2386] [kafka connector] Add new Kafka Consumer for Flink
new fb5aac2 [streaming] Cleanup de-/serialization schema, add TypeInformationSerializationSchema prominent, add tests.
new 33f4c81 [FLINK-2386] [kafka connector] Add comments to all backported kafka sources and move them to 'org.apache.flink.kafka_backport'
new b9892a0 [FLINK-2386] [kafka connector] Refactor, cleanup, and fix kafka consumers
new 76fcaca [FLINK-2386] [kafka connector] Remove copied Kafka code again. Implemented our own topic metadata retrieval.
new 844e0b2 [FLINK-2386] [kafka connector] Move Kafka connector classes to 'org.apache.flink.streaming.connectors.kafka'
new 08500f2 [hotfix] Determing native byte order via ByteOrder.nativeOrder()
new 541a06c [FLINK-2569] [core] Add CsvReader support for Value types
new 824785e [FLINK-2553] Example Jars not build correctly - reworked package structure of utils and wordcount.stormoperators package - reword class hierarchy of *FileSpout and *InMemorySpout - fixed pom.xml to assembly jars correctly - simplified example jar file names - replace maven-assembly-plugin with maven-shade-plugin (removed assembly.xml file) - extended README and documenation to building and using correct jars
new 38098cf [tests] Move manual test 'RecordsAndWidthsCombinationCheck' to proper tests scope
new f501643 [FLINK-2584] [java api] Downgrade version of javakaffee kryo serializers, for compatibility with kryo 2.4
new 74ed714 [FLINK-2587] [streaming] Make sure that close() is not called while checkpoint methods are in progress.
new 8cf8736 [FLINK-2326] [yarn] Write yarn properties file to temp directory
new bc63ef2 [FLINK-2582] [docs] Add documentation how to build Flink against different Scala versions
new 1e38d6f [FLINK-2556] [core] Refactor/fix pre-flight key validation
new 0807eec [FLINK-2565] Support primitive arrays as keys
new 91069d1 [FLINK-2499] [scripts] Warning message for hosts starting multiple daemons
new 9947b90 [hotfix] fix missing decorations for accumulator messages
new cf225f0 [hotfix] disable object reuse in merging of accumulators
new 9e20147 [scripts] Fixes path for taskmanager.sh in the start-cluster.sh script
new a18994a [FLINK-2594][client] implement a method to retrieve the accumulators of a job
new 554b77b [hotfix] Include Hadoop version into EnvironmentInformation
new bf8c8e5 [FLINK-2543] [core] Fix user object deserialization for file-based state handles.
new 0ba5355 [FLINK-2543] [core] Make exception communication and result/failure notifications consistent with respect to serialization of exceptions
new a7a57eb [FLINK-1681] [tests] Remove outdated 'nephele' iteration tests.
new 0858d9f [tests] Improve and combine iteration tests with aggregators (less static sharing, collect(), parallel execution)
new b9de4ed [FLINK-2291] [runtime] Add ZooKeeper support to elect a leader from a set of JobManager. The leader will then be retrieved from ZooKeeper by the TaskManagers.
new d5a9027 [jobmanager] fix warning about non-exhaustive case matching
new ac9a911 [FLINK-2599] [test-stability] Fix possible NPE in SlotCountExceedingParallelismTest
new 6b0c0e4 [core][runtime] move SerializedValueTest from runtime to core
new 8aa8e4f [scripts] Fixes correct Flink bin path usage in scripts
new 7364ce1 [scripts] Adds example settings for zookeeper ha to default flink-conf.yaml
new f4a48c2 [FLINK-2596] Remove non-transitive comparator in random sampler test.
new 8c852c2 [FLINK-2584] Check for unshaded classes in fat jar and shade curator
new ab14f901 [FLINK-2590] fixing DataSetUtils.zipWithUniqueId() and DataSetUtils.zipWithIndex()
new 6a58aad [FLINK-2590] Fixes Scala's DataSetUtilsITCase
new 31aeded [FLINK-2604] [runtime] Adds synchronization to stop method of ZooKeeperLeaderElectionService
new dd9979f [FLINK-2601] [runtime] Install shutdown hook at the end of I/O manager initialization
new 2e6e4de [FLINK-2545] add bucket member verification while build bloom filter.
new 166b370 [FLINK-2448] [tests] Create new Test Environments on every call to getExecutionEnvironment and allow sharing of job execution results
new 5d98e77 [hotfix] [gelly] Remove unintended calls to getExecutionEnvironment in VertexCentricIteration and GatherSumApplyIteration
new d09f002 [hotfix][docs] Update Kafka section in streaming guide to match the renamed class names
new 5375216 [FLINK-2607][quickstart] ignore signature files when creating fat jar
new 14ba66b [FLINK-2614][scala-shell] scala shell's default execution mode is broken
new 9f96b32 [FLINK-2475] Rename Flink Client log file
new 3d52844 [FLINK-2161] [scala shell] Modify start script to take additional argument (-a <path/to/class> or --addclasspath <path/to/class>) for external libraries
new 4911462 [FLINK-2605] [runtime] Unclosed RandomAccessFile may leak resource in StaticFileServerHandler
new 8a84937 [FLINK-2625] Pass configuration properly to JobGraphGenerator
new c8c0ec2 [FLINK-2628] [tests] CoStreamCheckpointingITCase prints a warning when test is inconclusive
new 9910510 [hotfix] [tests] Increase zookeeper session timeouts in tests them more robust
new 2f8bcf5 [FLINK-2626] [core] Add an average accumulator
new 9292e5c [FLINK-2626] [core] Minor cleanups in AverageAccumulator and AverageAccumulatorTest
new 97ad55f [FLINK-2372] Add new FlinkKafkaProducer bases on the new producer API
new 948b6e0 [FLINK-2567] [core] Allow quoted strings in CSV fields to contain quotation character inside of the field, as long as its escaped Ex: 'Hi my name is \'Flink\''
new 97fb9a4 [FLINK-2570] [gelly] Added a Triangle Count Library Method
new 24f7fa9 [FLINK-2480][test] add a prefix test for PrintSinkFunction
new f3dee23 [FLINK-2106] [runtime] Add Outer Join drivers and Outer Merge strategies to Runtime
new 2da82f9 [FLINK-2106] [runtime] Rename DriverStrategy.MERGE to DriverStrategy.INNER_MERGE
new e96e5c0 [FLINK-2616] [tests] Increases timeout of ZooKeeperLeaderElectionTest to 60s
new 1800434 [FLINK-2490][streaming] fix retryForever check in SocketStreamFunction
new 655a891 [FLINK-1320] [core] Add an off-heap variant of the managed memory
new c09d14a [FLINK-2636] [streaming] Create common type StreamElement for StreamRecord and Watermark
new b18e410 [FLINK-2635] [streaming] Make input processors independent of batch reader interface.
new 304139d [FLINK-2580] [runtime] Expose more methods form Hadoop output streams and exposes wrapped input and output streams.
new e45fdf7 [FLINK-2392] Improve YARN test stability
new 1b318c9 [FLINK-2321] [ml] Set seed for SVM to be random
new a9c29a7 [FLINK-2600] Enable test rerun for Elasticsearch Tests
new 0a00570 [FLINK-1674] Modified test cases for nested avro type
new bbddda7 [FLINK-2493] Simplify names of example program JARs
new 063b109 [FLINK-1297] add accumulator called OperatorStatsAccumulator
new c9edd9a [FLINK-2619] [tests] Fix for some unexecuted Scala tests
new 95d035a [FLINK-2619] [tests] Fix failing ExecutionGraphRestartTest and JobManagerRegistrationTest
new d0502e4 [FLINK-2638] [core] Add @SafeVarargs to the ExecutionEnvironment's "fromElements(...)" method.
new 4b6eae5 [FLINK-2003] [docs] Added instructions for encrypted filesystems
new 361947d [FLINK-2648] [tests] Fix flaky CombineTaskTest and improve cancelling in GroupReduceCombineDriver
new c94fdcd [FLINK-2650] Fix broken Links in Table API doc
new 9c2791b [FLINK-2631] [streaming] Fixes the StreamFold operator and adds OutputTypeConfigurable interface to support type injection at StreamGraph creation.
new 16fb4e9 [FLINK-2645] [jobmanager] Fail job execution if final accumulators cannot be merged and forward exceptions.
new 8754352 [FLINK-2617] [hadoop-compat] Added static mutexes for configure, open, close HadoopFormats
new 79a7bb2 [FLINK-2408] Define all maven properties outside build profiles
new 9c2eaa8 [FLINK-2632] [client] Fix web client to respect the class loader of submitted jobs
new c438cff [FLINK-2577] [streaming] Fix Stalling Watermarks when Sources Close
new aec4b15 [FLINK-2639] Add repository for hdp specific jetty to 'vendor-repos'
new 407d74f [FLINK-2647] [streaming core] Distinguish between "close" (flushing buffered data) and "dispose" (cleanup resources) in streaming operators.
new a492ed9 [hotfix] [tests] Fix warnings and casts in AbstractGenericArraySerializerTest
new 6354568 [FLINK-2656] Fix behavior of FlinkKafkaConsumer for out of range offsets
new b73fef2 [FLINK-2654] Add JavaDoc to ParameterTool class
new 8acd15d [streaming] Appropriate Exception message in WriteSinkFunction
new ce68cbd [FLINK-2658] fieldsGrouping for multiple output streams fails - added SplitStreamTypeKeySelector and JUnit tests
new 8a75025 [FLINK-2664] [streaming] Allow partitioned state removal
new e78b80c [FLINK-2373] Add configuration parameter to createRemoteEnvironment method
new a75dd62 [FLINK-2655] Minimize intermediate merging of external merge sort.
new c923fb3 [FLINK-2533] [java-api] Gap based random sample optimization.
new 2cc5d98 [FLINK-2665] [api] [runtime] Makes ExecutionConfig serializable by forcing Kryo serializers to be Serializable
new 31f6317 [FLINK-2670] [tests] Add tests that validate memory release under concurrent modification exceptions
new 7bea901 [FLINK-1851] [tableAPI] Add support for casting in Table Expression Parser - Also fix code generation for casting between primitives. - Extends documentation for TableAPI expressions
new a3150a3 [TableAPI] [tests] Disambiguate result of test programs to DataSet
new 76a40d5 [FLINK-2641] integrate off-heap memory configuration - add offheap configuration parameter taskmanager.memory.off-heap - remove offheap ratio parameter and reuse memory fraction parameter - set JVM -XX:MaxDirectMemorySize parameter correctly
new 2c9e2c8 [FLINK-2595] [tests] Fixed unclosed JarFile in ClassLoaderUtilsTest
new 8ca853e [FLINK-2637] [api-breaking] [types] Adds equals and hashCode method to TypeInformations and TypeSerializers - Fixes ObjectArrayTypeInfo - Makes CompositeTypes serializable - Adds test for equality relation's symmetric property - Adds test for PojoTypeInfo serializability
new 93c95b6 [FLINK-2640] [yarn] integrate off-heap configuration
new 988a04e [FLINK-2689] [runtime] Fix reuse of null object for solution set Joins and CoGroups.
new c269158 [FLINK-2659] [runtime] Fix object reuse in UnionWithTempOperator
new 77989d3 [FLINK-2691] [documentation] Fix broken links to Python script on QuickStart docs
new d15fd33 [hotfix] [tests] Increase resilience of ProcessFailureRecoveryTests
new 7825490 [hotfix] [kafka] Make tests robust against broker port conflicts.
new b6f52df [FLINK-2547] [web dashboard] Improved timeline view
new ff28981 [FLINK-2415] [optimizer] Create and attach proper JobGraph describing JSON plans to JobGraph for batch jobs.
new 562573d [FLINK-2547] [web dashboard] Updated web dashboard after request/response changes
new 01b0fc8 [FLINK-2547] [web dashboard] Add handlers for cluster status and web dashboard configuration
new f9d177b [FLINK-2357] [web dashboard] Added the 'Scheduled' mark to timeline
new 4825c8c [FLINK-2357] [web dashboard] Added tooltips to timeline
new 628e5f7 [FLINK-2415] [web dashboard] Provide more data in the job overview responses
new b29a5d4 [FLINK-2357] [web dashboard] Changed overview and timeline
new 1984a3f [FLINK-2554] [web dashboard] Add request hander that lists exceptions encountered during execution
new b26ce5a [FLINK-2415] [monitoring api] Add vertex details request handler, unify IDs between vertices and plan
new 907f773 [FLINK-2357] [web dashboard] Auto-update overview page
new ba31f83 [FLINK-2357] [web dashboard] Add view for exceptions
new 99a351e [FLINK-2687] [monitoring API] Extend vertex requests with subtask data and accumulators
new 749c0df [FLINK-2357] [web dashboard] Extend exceptions view
new 7138cd5 [FLINK-2357] [web dashboard] Added status counts for a job
new 6d873e6 [FLINK-2357] [web dashboard] Timeline for running tasks
new 46d8217 [FLINK-2357] [web dashboard] New node organization
new 6a3b095 [FLINK-2357] [web dashboard] Show plan (and optimizer properties) as a dedicated view
new c36b3d7 [FLINK-2357] [web dashboard] Adjust view for details of a job
new 616b7d5 [FLINK-2357] [web dashboard] Add auto-refresh to dashboard
new b3f7917 [FLINK-2687] [monitoring api] Add handlers for subtask details and accumulators
new 93a4d31 [FLINK-2357] [web dashboard] Add subtasks to vertex display
new 8db523c [FLINK-2688] [monitoring api] Add docs for monitoring REST API.
new 506ce61 [FLINK-2688] [monitoring api] Integrate monitoring request handler with HA leader handling
new 482d437 Revert "[FLINK-2605] [runtime] Unclosed RandomAccessFile may leak resource in StaticFileServerHandler"
new db49a3f [FLINK-2698] Add trailing newline to flink-conf.yaml
new 6dcc38d [FLINK-2701] [streaming] Add getter for wrapped Java environment to Scala ExecutionEnvironment
new 3fe9145 [FLINK-2557] [core] TypeExtractor properly returns MissingTypeInfo
new 0c5ebc8 [FLINK-2627] [scala api] Makes scala data set utils easier to access.
new b9148b6 [FLINK-2702] [examples] Add a distributed copy utility example
new a74fa8c [FLINK-2702] [examples] Add JAR packaging for DistCp example, plus minor cleanups.
new 0571094 [FLINK-2704] [streaming] Clean up naming of State/Checkpoint Interfaces
new 35dcceb [FLINK-2583] [hdfs connector] Add Stream Sink For Rolling HDFS Files
new e31a4d8 [hotfix] [build] Fix curator deps, Exclude Curator deps in Tests
new b234b0b [FLINK-2643] [build] Change Travis Build Matrix to Include Recent Hadoop Versions
new 3e233a3 [FLINK-2707] [streaming] Set StateCheckpointer before default state value
new 031aa4d [tempfix] [streaming] Disable fork reuse in streaming tests
new 127cd02 [test-stability] Hardens TaskManagerRegistrationTest by increasing the timeouts
new 5ca00c8 [tests] [runtime] Disable for reuse for runtime unit tests
new 930c08e [hotfix] [tests] Remove sysout logging in LargeRecordHandlerITCase
new 116cec0 [hotfix] [taskmanager] Add chain failure cause to exception when updating task execution state on JobManager
new a338ad08 [FLINK-2711] [tests] Increase timeout for TaskManager tests upon partition lookups
new 1ff8d04 [FLINK-2357] [web dashboard] Fixed broken plan on second entry
new f5476f2 [FLINK2392] Increase memory for TaskManager
new 4abdbbb [build system] Update secret keys for travis log delivery
new fd354ba [FLINK-2536] [streaming] Add a re-connect attempty to socket sink
new b9663c4 [FLINK-2536] [streaming] Cleanups and improvements on SocketClientSink
new 63d9800 [FLINK-2713] [streaming] Set state restore to lazy to avoid StateCheckpointer issues and reduce checkpoint overhead
new bd74bae [FLINK-2710] [streaming] Fix and improve SocketTextStreamFunction and SocketTextStreamFunctionTest
new 435ee4e [FLINK-2648] [FLINK-2717] [runtime] Harden memory release in sorters against asynchronous canceling
new f3809d8 [FLINK-2724] [runtime] Fix object reuse in GroupReduceCombineDriver and ReduceCombineDriver
new 5e6175d [FLINK-2649] [scala shell] Fix unclosed stream in case of an error in JarHelper#unjar()
new 6d1656a [FLINK-2392][yarn tests] Use log event which is guaranteed to show up to test whether the job was successful
new 0fea61a [test-stability] Sets the number of ZooKeeper servers of TestingCluster in ForkableFlinkMiniCluster to 1 in order to avoid test failures when two servers try to bind to the same port.
new 64e1dc6 [FLINK-2392][yarn tests] Produce more log output on travis for the flink-yarn-tests to avoid running into the 300s limit
new 7ad2103 [FLINK-2675] [streaming] Add utilities for scheduled triggers.
new b8f58fa [FLINK-2683] [FLINK-2682] [runtime] Add dedicated operator for aligned processing time windows.
new c24b8e6 [FLINK-2643] [build] Update Travis build matrix and change snapshot deploy profiles
new a3df109 [FLINK-2722] Use InetAddress.getLocalHost() as first approach when detecting the TMs own ip/hostname
new 47afdfb [FLINK-2392][yarn tests] Address concurrent modification exception
new 7984acc [Maven] fix order of parent module information
new 71bf2f5 [FLINK-2097][core] implement a job session management
new d58caa8 [FLINK-2097] temporarily disable session management API
new b5a3f55 [test-stability] Replaces Curator's TestingCluster with TestingServer in ZooKeeperElection/RetrievalTests. Increased the timeout to 200s in ZooKeeperLeaderElectionTest.
new 7825461 [FLINK-2729] [web-dashboard] Add TaskManager overview
new 7d78f36 [tests] Add RetryOnFailure annotation
new 0ec65f9 [FLINK-2696] [test-stability] Hardens ZookeeperOffsetHandlerTest by letting Curator's TestingServer select the port to bind to instead of using NetUtils.getAvailablePort.
new 54d8f49 [FLINK-2694] [test-stability] Hardens the JobManagerProcessReapingTest.testReapProcessOnFailure test case by letting the JobManager choose its port instead of predetermining it via the NetUtils.getAvailablePort.
new ca54205 [FLINK-2705] [yarn] Excludes commons-codec:1.3 from aws-java-jdk dependency to resolve dependency ambiguity
new 1f17ff5 [FLINK-2746] [tests] Add RetryOnException annotation for tests
new 44fe370 [FLINK-2744] [kafka connector] Reduce number of concurrent test forks to improce test stability on CI environment.
new ea3b5ef [tests] Improve Kafka concurrent produce/consumer test by allowing retries when connecting to non-leader broker.
new 8b40bb7 [FLINK-2734] [streaming] Fix ArrayKeySelector
new 5b46cbe [hotfix] [streaming] Improve error message for key operations on non-composite types
new 672979b [tests] Harden SocketClientSinkTest
new 1e5b74a [FLINK-2651] Add Netty to dependency management
new 7212042 Bump Netty version to 4.0.31.Final
new 717d54c [FLINK-2675] [streaming] Integrate Timer Service with StreamTask
new 3c08eec [jobmanager] Fix indentation
new bc21de2 Adjust Netty version in flink-dist/LICENSE
new 702277f [FLINK-1520] [gelly] Read edges and vertices from CSV files
new d01d369 [FLINK-1520] [gelly] add types methods and make formatting changes to the graph csv reader
new 0b23b5e [FLINK-2751] [docs] Add quickstart menu to the navigation bar of documentation
new 0d19e94 [FLINK-2616] [test-stability] Fixes ZooKeeperLeaderElectionTest.testMultipleLeaders by introducing a second retrieval service to retrieve the leader address after the faulty address has been written.
new 7f07cf8 [FLINK-2200] [build system] Add scala version suffix to artifact id for Scala 2.11
new 4cadc3d [FLINK-2200] [build system] Deploy Flink 2.11 with every build (nightly)
new 135db3a [docs] fix typo of the RabbitMQ Java example (added braces)
new 6b26e23 [utils] Missing getters for ParameterTool
new 0b3ca57 [scripts] Exclude .git in source release
new 501a9b0 [FLINK-2690] [api-breaking] [scala api] [java api] Adds functionality to the CsvInputFormat to find fields defined in a super class of a Pojo. Refactors CsvInputFormat to share code between this format and ScalaCsvInputFormat.
new 7e20299 [FLINK-2753] [streaming] [api breaking] Add first parts of new window API for key grouped windows
new a606c4a Fix some typos and naming inconsistencies in new Windowing Code
new 05d2138 Move window operators and tests to windowing package
new 86c45bf Harmonize generic parameter names in Stream API classes
new bfaad37 Add Count and Delta WindowPolicy
new 6610cae Add Window parameter to KeyedWindowFunction, move to package windowing
new 3be2dc1 Move delta window functions to package functions.windowing.delta
new dd51c97 [FLINK-2677] Add a general-purpose keyed-window operator
new 0f17755 [hotfix][streaming] correct return type of execute(..) method
new 0b4dc06 [FLINK-2561] [gelly] add missing methods to Graph: add-remove edges/vertices, difference, graph creation methods, validate, getTriplets. Add missing utility mappers.
new 9e0284e [FLINK-2561] [gelly] convert existing tests to use collect instead of files; add tests for newly added operations.
new 233dab4 [FLINK-2561] [gelly] add GraphMetrics Scala example
new 8d2289e [FLINK-2768] [docs] Fix wrong java version requirement in quickstart (1.6 -> 1.7 and 6.x -> 7.x)
new 3b8b4f0 [FLINK-2769] [dashboard] Remove hard coded job server URL
new 40cbf7e [FLINK-2756] [scripts] Fix start/stop scripts for paths with spaces
new e727355 [FLINK-2723] [core] CopyableValue method to copy into new instance
new 6891212 [FLINK-2754] Fixed FixedLengthRecordSorter write to multi memory pages issue and add more unit tests.
new 0a8df6d [FLINK-2653] [runtime] Enable object reuse in MergeIterator
new 16afb8e [FLINK-2761] [scala-shell] Prevent creation of new environment in Scala Shell
new af47756 [FLINK-2763] [runtime] Fix hash table spilling partition selection.
new bb899f7 [FLINK-2777] [docs] Fix Scala API description in programming_guide.html
new 2598709 [FLINK-2754] Add a new module for micro benchmark.
new 136347d [FLINK-2775] [CLEANUP] Cleanup code as part of theme to be more consistent on Utils classes
new 622c1be [FLINK-2764] [WebClient] WebClient cannot display multiple Jobs
new 1243d7b [FLINK-2703] Prepare Flink for being used with Logback.
new 011cbbf [FLINK-2773] remove strict upper direct memory limit
new 28d36cc [FLINK-2097] fix finalize() method of ExecutorReaper
new a3c0b44 [FLINK-2781] [core] Cleanup NetUtils.
new bfde1b7 [FLINK-2766] [core] Add proper handling of IPv6 address literals in URLs
new c04a770 [hotfix] [build] Add joda-convert as a non-optional dependency, to fix Scala interoperability
new 891db5e [FLINK-2787] [core] Prevent instantiation of RemoteEnvironment when running a program through the command line.
new 82d6236 [streaming] [storm] Clean up instantiation of mini clusters and test environments.
new f2ea4e4 [FLINK-2783] Remove "degreeOfParallelism" API calls
new 937793e [FLINK-2561] [gelly] add Scala Gelly docs
new 5623c15 [hotfix] Simplify new windowing API
new 41717d1 [FLINK-2778] Add API for non-parallel non-keyed Windows
new 846ad70 [hotfix] [tests] Run IPv6HostnamesITCase with parallel data exchange and less verbose output
new bbd9735 [doc] fixed typos in "Internals -> Fault Tolerance for Data Streaming"
new 9f71107 [FLINK-2663] [gelly] Updated Gelly library methods to use generic key types
new 9fe285a [FLINK-2525] Add configuration support in Storm-compatibility
new 19fd5bd [FLINK-2748][jobmanager] accumulator fetch failure leads to duplicate job result response
new fc7369e [FLINK-2776][cli] print job id when submitting a job
new 142a844 [FLINK-2762][cli] print execution result only if available
new df871b3 [FLINK-1599][docs] TypeComperator with no keys and comparators matches some elements
new d486cde [FLINK-2796][cli] fix -q flag to suppress log output
new daeab84 [FLINK-2727] [streaming] Add a base class for Message Queue Sources that acknowledge messages by ID.
new 7390201 [hotfix] [streaming] Apply closure cleaner to KeyedWindowFunction
new 6e0e67d [hotfix] [streaming] Handle rich functions properly in aligned time windows
new 88a9776 [FLINK-2802] [streaming] Remove cyclic watermark dependencies for iterations
new 5466824 [FLINK-2666] Add timestamp extraction operator
new 92fb06a1 [FLINK-2740] Adding flink-connector-nifi module with NiFiSource and NiFiSink
new 68c1afc [hotfix] Execute YARN integration tests only upon request (by activating the 'include-yarn-tests' profile)
new 9e6e0ae [FLINK-2550] Simplify Stream Java API Class Names
new 23d8e26 [FLINK-2550] Rename ConnectedDataStream to ConnectedStreams, Remove some operations
new 9baadfe [FLINK-2550] Remove groupBy and GroupedDataStream
new d0c9e78 Add Scala API for new Windowing
new 833b347 Disable tests because operators are not implemented yet
new 8c2c769 [FLINK-2550] Change Window API constructs to use Time instead of long
new 62df0a0 [FLINK-2807] Add Javadocs for new windowing semantics/internals
new 0de9d2e [hotfix] Use closure cleaner for reduce window
new 7b6e762 [FLINK-2550] Rename IterativeDataStream to IterativeStream
new 9513f0e [FLINK-2550] Rename SplitDataStream to SplitStream
new 352b041 [FLINK-1610] fix building of java doc for Java 8
new f8fa337 [FLINK-2813] document parameter for off-heap memory
new 19076b2 [FLINK-2810] Warn user if bc not installed
new de14a80 [FLINK-2811] [web-dashboard] Add job manager configuration overview
new 2b81b17 [FLINK-2741] Use single log statement in TestLogger
new 39115ab [FLINK-2786] Remove Spargel code and docs; Port Spargel tests to Gelly; Remove Beta badge from Gelly
new 7a67a60 [FLINK-2566] FlinkTopologyContext not populated completely - extended FlinkTopologyContext to be populted with all supportable attributes - added JUnit test - updated README.md additionally: module restructuring to get cleaner package structure
new 4cb9670 [Storm Compatibility] Maven module restucturing and cleanup - removed storm-parent; renamed storm-core and storm-examples - updated internal Java package structure * renamed package "stormcompatibility" to "storm" * unified *SpoutWrapper* to single SpoutWrapper.java class * moved classes to appropriate packages * shortened class names by stripping "Storm" - some more minor fixes, cleanups, and test improvements - updated READMEs and web documentat [...]
new 4c5d43b [FLINK-2822] [streaming] Remove scala.Serializable imports
new 4938ff0 [FLINK-2642] [table] Scala Table API crashes when executing word count example
new 906bd6d [streaming] Removed unused StreamReduce
new 225704b [FLINK-2283] [streaming] grouped reduce and fold operators checkpoint state
new a76d963 [FLINK-2283] [streaming] Test for checkpointing in internal operators
new c414ea9 [FLINK-2283] [streaming] Proper serialization of state in StreamGroupedFold and Reduce
new e494c27 [FLINK-2812] [streaming] KeySelectorUtil interacts well with type extraction
new b08669a [FLINK-2815] [REFACTOR] Remove Pact from class and file names since it is no longer valid reference
new ff0a1a0 Revert "[FLINK-2210] Table API support for aggregation on columns with null values"
new 48791c3 Revert "[FLINK-2203] handling null values for RowSerializer"
new af1e03e Create a deep-copy of the record when changing timestamps.
new b489c36 [FLINK-2825] FlinkClient.killTopology fails due to missing leader session ID
new a437a2b [FLINK-2066][core] Add configuration of delay between execution retries at job level
new 8d62033 [FLINK-2767] [scala shell] Add Scala 2.11 support to Scala shell. Update Scala 2.11 version and jline dependency.
new 6e42f9f [FLINK-2806] [scala-api] Add a TypeInformation[Nothing]
new 47b5cb7 [FLINK-2785] [gelly] implement fromCsvReader for gelly-scala; add tests and docs
new 8634dbb [FLINK-2819] Add Windowed Join/CoGroup Operator Based on Tagged Union
new 0bac272 [FLINK-2550] Rename reduceWindow to reduce on *WindowedStream, add Lambda Reduce
new 28a38bb [FLINK-2550] Add Window Aggregations to new Windowing API
new ff367d6 [FLINK-2550] Rework interplay of Window Assigners and TimeCharacteristic
new ce792b1 Move CoGroupJoinITCase to windowing package
new f9eea5e [FLINK-2674] Add Fold Window Operation for new Windowing API
new f2186a6 [FLINK-2561] [gelly] add gelly-scala examples: vertex-centric SSSP, GSA SSSP and how to use a library method (connected components).
new 5c2c112 [hotfix] Add ResultTypeQueryable to Keys in Stream CoGroup/Join
new f332fa5 [FLINK-2381] [Storm Compatibility] Failing Test: WrapperSetupHelperTest
new fa2bb8f [FLINK-2790] [yarn] [ha] Add high availability support for Yarn
new 0ee0c1f [FLINK-1789][core][runtime] Allow adding of URLs to the usercode class loader
new b2b2781 [hotfix] Change result of WindowedStream ops to SingleOutputStreamOperator
new 0c1141a [FLINK-2780] Remove Old Windowing Logic and API
new 9a21ab1 [FLINK-2550] Rename extractTimestmp() to assignTimestamps()
new c9088a4 [FLINK-2779] Update documentation to reflect new Stream/Window API
new 998be1b [FLINK-2831] [Storm Compatibility] Failing Test: WrapperSetupHelperTest
new 0455857 [hotfix] Fix wrong reference to WindowedDataStream in Doc
new 6b22227 [FLINK-2576] Add outer join base operator.
new b00c1d7 [FLINK-2576] [javaAPI] [scalaAPI] [optimizer] Add outerJoin to DataSet API (Java, Scala) and optimizer.
new 1272cd5 [FLINK-2576] [javaAPI] [scalaAPI] Restored binary compatibility for DataSet (inner) join.
new 48f614c [FLINK-2818] [docs] Correct javadocs of *ReduceDriver classes and some methods in the API.
new 7750a1f [FLINK-2613] [scala shell] Print usage information for Scala Shell
new 71d5a39 [FLINK-2156] [tests] Fix bug that some tests of Scala module cannot create log file
new 91ffbc1 [FLINK-2833] [gelly] create a flink-libraries module and move gelly there
new 3b77faa [FLINK-2784] Remove deprecated configuration keys and updated documentation
new 58ab14b [FLINK-2730][webfrontend] Add cpu and memory usage graphs
new d38aeac Small update to Javadoc in IterativeDataset.closeWith to add missing param.
new 86080bb [hotfix] Add countWindow and countWindowAll shortcut
new 2475c82 [docs] fix typo in Scala functions type descriptors
new 5dfc897 [FLINK-2817] [streaming] FileMonitoring function logs on empty location
new a7a1cbc [hotfix] Add default Trigger for GlobalWindows
new f7ab4f3 Change "it's" contraction to possession "its"
new d9e32da [FLINK-2843] Add documentation for DataSet outer joins.
new fbc18b9 [FLINK-2479] Refactor runtime.operators.* tests
new c82ebbf [FLINK-2774] [scala shell] Extended default imports for ScalaShell
new 6cb0fb5 [FLINK-2856] Introduce flink.version property into quickstart archetype
new eec2d15 [hotfix] Correct name of HDFS tests from 'org.apache.flink.tachyon' to 'org.apache.flink.hdfstests'
new 5ac2872 [hotfix] Remove remaning classes for old window triggers
new 479bec0 [FLINK-2808] [streaming] Refactor and extend state backend abstraction
new c24dca5 [FLINK-2550] [streaming] Make fast-path processing time windows fault tolerant
new 69dfc40 [FLINK-2550] [streaming] Rework JoinStreams and CoGroupStreams to properly implement operator builder syntax
new f2d5038 [hotfix] [streaming] Initialize StreamingRuntimeContext to rich functions early
new d5a016c [hotfix] StreamTask and OperatorChain properly clean up partially initialized resources upon failures during initialization
new b81598e [hotfix] [core] TypeExtractor correctly handles non-public types as generic types (rather than failing with an exception)
new ca8c73d [hotfix] Proper exception chaining in key/value state access of StreamingRuntimeContext
new da159ef [FLINK-2846] [streaming] Emit downstream checkpoint barriers at beginning of the checkpoint scope
new 3b7fb63 [FLINK-2550] [tests] Add an end-to-end failure/recovery test for fast path processing time windows
new 4ee5b4c [hotfix] [tests] Make StreamTaskTimerTest more robust
new bb1f5fd [hotfix] [streaming scala] Expose key type information for key selectors on connected data streams
new 7c20543 [FLINK-2550] [streaming] Allow multiple key/value states per operator on top of the new state backend
new d68c8b1 [hotfix] [streaming] Remove obsolete internal state handle classes
new 34c232e [hotfix] [storm compatibility] Deactivate tests for split stream field grouping, which do not work in teh runtime and are now caught earlier
new c78aded [FLINK-2855] [gelly] Add documentation for the Gelly library algorithms and improved javadocs for the library constructors.
new 728df39 [hotfix] Fix DataSet API programming guide
new a8eeb3b [FLINK-2863] [kafka connector] Kafka connector propagates async producer exceptions
new df44862 [FLINK-2844] [web frontend] Remove old web interface
new 4593109 [FLINK-2844] [web frontend] Make web frontend URLs relative for YARN support
new 5ae0d12 [hotfix] Removed broken dependency to flink-spargel.
new 580768c [FLINK-2841] [docs] Correcting ML roadmap link to point to confluence.
new b443cb6 [FLINK-2714] [gelly] Copy triangle counting logic from EnumTrianglesOpt.java to Gelly library. Also reorganizing classes to use Gelly's Graph APIs.
new d047ddb [FLINK-2714] [gelly] add the algorithm description in the gelly docs; update test to get the directed graph as input
new d6567a0 [hotfix] Add debug output to (rarely) failing TimestampITCase
new da071bc [FLINK-2611][yarn] do not fail application in shutdown hook
new 03579bb [FLINK-2731][web-dashboard] add access to JobManager stdout and logs
new 8c1719c [FLINK-2844] remove old config entry from flink-conf.yaml
new 6491559 [FLINK-2809] [scala-api] Added UnitTypeInfo and UnitSerializer.
new da248b1 [FLINK-2725] Add Max/Min/Sum aggregation for mutable types.
new 640e63b [FLINK-2857] [gelly] Improve Gelly API and documentation. - Improve javadocs of Graph creation methods - Add fromTuple2 creation methods - Rename mapper parameters to vertexInitializer. - Improve javadocs and parameter names of joinWith* methods - Improve javadocs of neighborhood methods - Update docs to reflect api changes
new c900577 [FLINK-2842] [documentation] Remove Flink S3FileSystem, extend documentation to use Hadoop S3FileSystem.
new 5671c77 [FLINK-2107] Add hash-based strategies for left and right outer joins.
new b233946 [FLINK-2652] [tests] Temporary ignore flakey PartitionRequestClientFactoryTest
new 3aaee1e [FLINK-2792] [jobmanager, logging] Set actor message log level to TRACE
new 73c73e9 [FLINK-2354] [runtime] Add job graph and checkpoint recovery
new c2989f2 [FLINK-2354] [runtime] Remove state changing futures in JobManager
new c3a4d1d [FLINK-2805] [blobmanager] Write JARs to file state backend for recovery
new d18f580 [FLINK-2804] [runtime] Add blocking job submission support for HA
new 77fc0cc [FLINK-2793] [runtime-web] Redirect to leader in non-standalone mode
new e3ad962 [FLINK-2793] [runtime-web] Rework JobManagerRetriever to avoid race conditions
new 630798d [FLINK-2852] [test-stability] Fix ScalaShellITSuite and ScalaShellLocalStartupITCase
new a6890b2 [FLINK-2354] [runtime] Replace old StateHandleProvider by StateStorageHelper in ZooKeeperStateHandleStore
new 6c44d93 [FLINK-2865] remove upper direct memory size bound
new e711969 [FLINK-2873] detect & serve the job manager log files correctly
new 4442269 [FLINK-2864] Make State of General-Purpose Window Operators Fault-Tolerant
new f760b61 Replace Trigger.onTime by Trigger.onProcessingTime/onEventTime
new 8b2d4f8 [FLINK-2872] [Documentation] Update the documentation for Scala part to add ExecutionEnvironment.readFileOfPrimitives.
new 42a3d8c [FLINK-2885][python] fix path building of Python resources
new 06f6ac5 [FLINK-2877] Move Streaming API out of Staging package
new 22510f0 [hotfix] Add shortcuts for creating Time objects
new 5fb1c47 [FLINK-2743] Add XORShfitRandom and use it in RandomSamplers.
new e3cabe7 [docs] Fix documentation for building Flink with Scala 2.11 or 2.10
new dd3264e [FLINK-2834] Global round-robin for temporary directories
new 7a959bc [FLINK-2880] [streaming] Allow DeserializationSchema to forward exceptions.
new 6666ea5 [FLINK-2876] Minutiae
new 4c1cffd [FLINK-2820] Configuration not passed to JobGraphGenerator
new 30c46ed [FLINK-2886] [runtime] Fix config key for number of threads in NettyClient
new 3cad56d [FLINK-2878] [webmonitor] Fix unexpected leader address pattern
new b198c33 [contrib, tests] Disable sys out logging in operator stats tests
new 42a4df2 [hotfix] Fix shaky EventTimeAllWindowCheckpointITCase
new 2122cf4 [tools] update release script
new 56146ae [FLINK-2887] [gelly] make sendMessageToAllNeighbors respect the EdgeDirection if set in the configuration
new 201f55b [FLINK-2891] Set KV-State key upon Window Evaluation in General Windows
new 4db2706 [FLINK-2206] [webui] Fix incorrect counts of finished, canceled, and failed jobs in new web dashboard
new 32b0dfd [FLINK-2668] [DataSet] [api-breaking] Chained Projections are no longer appended
new 17e7b42 [FLINK-2874] Fix Avro getter/setter recognition
new cd7ed8e [FLINK-2874] Fix recognition of Scala default setters
new 3385fa3 [hotfix] Fix processing time triggering on Window Operator
new 0c03e9a [release] update version to 1.0-SNAPSHOT
new 7ff071f [release] change quickstart and docs version to 1.0-SNAPSHOT
new 3c8a658 [FLINK-1982] [record-api] Remove dependencies on Record API from flink-runtime tests
new ab2895f [FLINK-2893] [runtime] Consistent naming of recovery config parameters
new d2e4a27 [FLINK-2898] [build] Invert Travis CI build order
new bbb75c5 [FLINK-2895] Duplicate immutable object creation
new d056f11 Add copy() to Tuple base class.
new 256a88a [hotfix] Fix broken copy in OperatorChain
new c36977f [hotfix] Fix Mutable Object window aggregator/Disable Object Copy
new e18cdd0 [hotfix] Add Window Parameter in Trigger.onEventTime/onProcessingTime
new e696937 [hotfix] Improve handling of Window Trigger results
new 4a31516 [docs] add information on how to use Kerberos
new fa88d9e [FLINK-2862] [Storm Compatibility] FlinkTopologyBuilder should use proper generic types
new 2d64715 [FLINK-2866] [runtime] Eagerly close FSDataInputStream in file state handle
new 6424ce5 [FLINK-2888] [streaming] State backends return copies of the default values
new 3dc7423 [FLINK-2891] [streaming] Set keys for key/value state in window evaluation of fast-path windows.
new daa357a [FLINK-2411] [gelly] Add Summarization Algorithm
new 75a5257 [FLINK-2890] Port StringSerializationSpeedBenchmark to JMH. [FLINK-2889] Port LongSerializationSpeedBenchmark to JMH.
new e5ee55b [FLINK-2853] Port MutableHashTablePerformanceBenchmark to JMH.
new 7265d81 [FLINK-2919] Port FieldAccessMinibenchmark to JMH.
new 6a8e90b [FLINK-2827] Close FileInputStream through try-with-resources to avoid unused open stream.
new 6a838db [hotfix] Fix issue with spaces in Path in start-*-streaming.sh
new 5dba971 [release] fix remaining and recently introduced old version artifacts
new 7414e31 [release][scripts] replace quickstart archetype version
new 5cfd49e Add org.apache.httpcomponents:(httpcore, httpclient) to dependency management
new 3db5317 [FLINK-2927] [runtime] Provide default required configuration keys in flink-conf of binary distribution
new 4687932 [release][scripts] automate changing of docs version
new edd1914 [release][scripts] use perl instead of sed for portability
new a39aa52 [scala-shell][docs] add scala sources in earlier phase
new 2b8303c [FLINK-1610][docs] fix javadoc building for aggregate-scaladoc profile
new b654e98 [FLINK-2800] [kryo] Fix Kryo serialization to clear buffered data
new 3abbcd1 [FLINK-2869] [tests] Port IOManagerPerformanceBenchmark to JMH.
new a8f1be9 [FLINK-2920] [tests] Port KryoVersusAvroMinibenchmark to JMH.
new 2ff04ba [FLINK-2900] [hadoop-compat] Remove Record API code from Hadoop Compat module
new ec7bf50 [FLINK-2932] Examples in docs now download shell script using https instead of http
new 680b5a9 [FLINK-2559] Clean up JavaDocs
new 1fd386e [FLINK-2934] Remove placeholder pages for job.statistics, taskmanager.log and taskmanager.stdout
new 676854b [FLINK-2902][web-dashboard] Sort finished jobs by their end time, running jobs by start time
new 7fdaa4e [release][scripts] shade away curator correctly with different Scala versions
new bf29de9 [streaming] delegate JobGraph generation to Client class
new d662ede [checkstyle] link suppressions file in checkstyle file
new 0ffe9dc [tez] remove unused hash variable
new 0845529 [travis] remove javadoc skip
new 458009d [FLINK-2912] [web-runtime-web] Add comment to StaticFileServerHandler
new dd66e61 remove flink-benchmark due to licensing issues
new 95a1abd [hotfix] remove Special LICENSE/NOTICE for binary release
new 5e40c6d [FLINK-2953] fix chaining of sortPartition() calls in Scala DataSet API
new 143e5e0 [FLINK-2939] add cancel button to web frontend
new 044bd42 [web-frontend] Fix README to to reflect the latest changes
new 474153d [hotfix] Add list_deps.py tool
new ede80e2 [hotfix,doc] Fix link to coding guidelines, again
new 66b4420 [release][scripts] deploy Scala 2.11 version to Maven
new f340bc7 [docker] move the #!bash to first line
new aa1c145 [FLINK-2930] Respect ExecutionConfig execution retry delay
new 8f74718 [FLINK-2958] Remove hard coded number of execution retries
new 30a832e [FLINK-2918] [api-extending] Add methods to read Hadoop SequenceFiles.
new 76bebd4 [FLINK-2964] [runtime] Fix broken spilling of MutableHashTable
new 1b2963c0 [FLINK-2943][web-dashboard] Rename bytes/records read/written to received/sent. [hotfix][web-dashboard] Fix taskmanager charts legend.
new 50ab9a3 [FLINK-2903][web-dashboard] Format numeric values of received/sent counters.
new 752ace6 [FLINK-2898] Adopt deploy to maven script to new build order
new 5968590 [FLINK-2968] [streaming] Let AbstractUdfStreamOperator forward output type information to WindowFunction
new 9f30108 [release][scripts] fix typo in release script
new 54b1d2c [FLINK-2957][web-dashboard] Improve the appearance of cancel button
new b32c97a [FLINK-2938] [docs] Update docs for key/value state
new 0ca425a [doc] fix spelling mistakes in the transformations guide
new b80d89a [FLINK-2951] [Table API] add union operator to Table API.
new f33f332 [FLINK-2981] [docs] update requirements in docs/README
new 90b7a9e [docs] Fix typos in streaming documentation
new 061e929 [FLINK-2979] Fix RollingSink truncate for Hadoop 2.7
new 044fe5f [FLINK-2986] Fix typo in KvState interface snapshot method
new c607549 [FLINK-2752] Documentation is not easily differentiable from the Flink homepage - added auto-redirect for coding_guidelines and how_to_contribute pages (to keep external links working) - updated menu links to point directly to coding_guidelines and how_to_contribute on Flink project page (only improvement on FLINK-2752; does not resolve it)
new 3ade4c7 [FLINK-2905] [gelly] Add Graph Intersection method
new ed73f66 [FLINK-2730] remove Apache License incompatible chart library
new 4462f53 [FLINK-2982][cli] Fix to show streaming plans via info option.
new ccf4ebd [FLINK-2990] Fix Flink on YARN for Scala 2.11
new a684e23 [FLINK-2987] Remove jersey-core and jersey-client dependency exclusion to make Flink on Hadoop 2.6.0+ work
new b6f00f9 [hotfix] Check for null in StreamSource.cancel()
new e058abb [FLINK-2992] Remove use of SerializationUtils
new d7da7d4 [FLINK-2966][web-dashboard] Improve the way job duration is reported
new da4aa9d [hotfix] [tests] Fix manual tests to properly start testing cluster.
new f7ed3d3 [hotfix] [tests] Tests in flink-tests suppress log output by default
new a1bbcfd [hotfix] Remove DEPENDENCIES file.
new 2bb5799 [dist] Bring LICENSE file up to speed
new 0de13b5 [misc] Minor fixed to config docs and minor code cleanups in Client
new 976bacc [FLINK-2994] [client] Report error cause when jobs switch to failing.
new 6019f08 [FLINK-2826] [runtime] Fix race condition and locking in BroadcastVariableMaterialization#decrementReferenceInternal
new 2063fa1 [license] remove flink-benchmark due to licensing issues
new 824074a [FLINK-2901] Move PythonAPI to flink-libraries
new 955ce53 [Documanation] Fix constructor name of WordWithCount example.
new 946e8f6 [docs] Update HA docs with YARN and state backend configuration
new 30647a2 [FLINK-2432] Custom serializer support
new b7cf642 [FLINK-2797][cli] Add support for running jobs in detached mode from CLI
new 00e44ed [FLINK-2850] Limit the types of jobs which can run in detached mode
new 9a911c8 [FLINK-2994] minor correction for newlines
new feb6994 [FLINK-3017] [Docu] Fix broken 'Slots' link on Streaming Guide.
new aba3779 [FLINK-2977] Using reflection to load HBase Kerberos tokens
new 14c24e7 FLINK-3022: Broken link 'Working With State' in Fault Tolerance Section of Stream Programming Guide
new bdb306a [FLINK-3024] Fix TimestampExtractor.getCurrentWatermark() Behaviour
new a654760 [FLINK-3025] [kafka consumer] Bump transitive ZkClient dependency to 0.7 for bugfixes
new e692a10 [hotfix] [utils] Change the parameter 'numSample' in DataSetUtils.sampleWithSize() to 'numSamples', remove redundant Java 6 code
new 1f52899 [hotfix] [runtime] Minor javadoc fix in JobManager
new 442fcb1 [FLINK-2914] [runtime] Add missing break Statement in ZKJobGraphStore
new ffb8aec [FLINK-2879] [docs] Fixed broken links on the architecture page
new a45212d [FLINK-2967] Increase timeout for LOCAL_HOST address detection strategy, give the local host address a higher priority
new 99d52cc [hotfix][docs] Replace Count.of() with appropriate Count(Trigger|Evictor).of()
new 5d37fe1 [FLINK-2441] Introduce Python OperationInfo
new ee64892 [FLINK-3013] [gelly] Incorrect package declaration in GellyScalaAPICompletenessTest.scala
new b1cf626 [FLINK-3036] [gelly] Fix Graph.fromCsvReader method in Gelly's Scala API
new 1f45c87 [doc] Fix JavaDoc of ElasticsearchSink
new 7beb011 [FLINK-2233] Update InputF nextRecord javadocs
new 2ea4588 [FLINK-2937] Fix Typo in Scala Quickstart Guide (SBT)
new 08318e1 [FLINK-2989] job cancel button doesn't work on YARN
new fc6fec7 [FLINK-2942] [web dashboard] Fix dangling operators in dataflow visualization
new bd61f2d [FLINK-2692] Untangle CsvInputFormat
new 3cf78aa [travis] use new artifacts tool to upload snapshot binaries
new 8325bc6 [FLINK-2955] [Documentation] Add operators description in Table API page.
new 3c5f363 [hotfix] [streaming] Fix instantiation of state backends from state backend factory.
new 8b086eb [FLINK-3040] [docs] Add docs for State Backends
new 891a1b9 [hotfix] Fix concurrent processing-time Trigger in WindowOperator
new 40cb4e0 [docs] Add note about Znode root config for HA setups
new c1dd960 [FLINK-1945][py] Python Tests less verbose
new dc61c7a FLINK-3041: Twitter Streaming Description section of Streaming Programming guide refers to an incorrect example 'TwitterLocal'
new 8cfc232 [docs] remove snapshot information from front page
new 6888c9c [travis] correct target path of uploaded snapshot artifact
new 6b253d9 [FLINK-3002] Add Either type, EitherTypeInfo, and EitherSerializer to the Java API
new 2061206 [FLINK-3005] [core] Bump commons-collections version to fix object deserialization remote command execution vulnerability
new 864357b [FLINK-3043] [docs] Fix description of Kafka Consumer and Producer.
new ff52d28 [FLINK-2913] [runtime] Ensure file streams are properly closes in FsStateBackend
new 9362200 [FLINK-3048] [tests] Increase stability of DataSinkTaskTest
new d8ab8bc [FLINK-3032] Fix jackson-core dependency conflict with Hadoop 2.7.1.
new a402002 [FLINK-3011] [runtime] Disallow ExecutionGraph state transition from FAILED to RESTARTING
new ceabbd0 [FLINK-3011] [runtime, tests] Translate ExecutionGraphRestartTest to Java
new 5a86a0a [FLINK-3011] [runtime] Fix cancel during restart
new 9abbeac [FLINK-3019] [client] List restarting jobs with scheduled jobs
new c64fe3e [FLINK-3028] [runtime-web] Show cancel button for restarting jobs
new 38cf0c6 [hotfix] [core] Fix assignment of strictly local splits to host instances
new 2f013a2 [hotfix] [docs] Fix errors in streaming docs for fold()
new 177df41 [FLINK-3021] Fix class loading issue for streaming sources
new 8dc70f2 [FLINK-3052] [optimizer] Fix instantiation of bulk iteration candidates
new 5864e4f [FLINK-2974] Add periodic offset committer for Kafka when checkpointing is disabled
new a7111cd [doc] Fix Documentation formatting for recently added ExecutionEnvironment.readSequenceFile()
new 0943303 [FLINK-2860] [ml] [docs] Remove an undefined argument in FlinkML documentation
new 8801cbc [FLINK-3009] Add dockerized jekyll environment
new 1600fe2 [hotfix][docs] Fix default config value, highlight detail in config
new 68a69c7 [FLINK-2429] [streaming] Deprecate the "enableCheckpointing()" method with no interval argument.
new cd7963c [FLINK-2947] [scala shell] Add color support to Scala Shell
new 601e8c6 [FLINK-2017] Add predefined required parameters to ParameterTool
new 8cabe67 [FLINK-3020][streaming] set number of task slots to maximum parallelism in local execution
new ad6f826 [FLINK-2916] [streaming] Expose operator and task information to StateBackend
new 75a7c4b [FLINK-2924] [streaming] Out-of-core state backend for JDBC databases
new 347e6f7 [FLINK-2924] [streaming] Improved sharding logic
new c254bda [FLINK-2924] [streaming] Use timestamps to store checkpoints so it supports job shutdown/restart
new 43b8e57 [FLINK-2924] [streaming] Improve compacting logic
new cd8be0b [FLINK-2924] [streaming] Use short job id for table names
new db2a964 [FLINK-2924] [streaming] Execute compactions in background thread + keep connections alive on empty snapshots
new 89b1d23 [FLINK-2956] [tests] Migrate integration tests for Table API
new 85e7b28 [FLINK-3045] Properly expose the key of a Kafka message
new 4c46b2f [FLINK-2861] Fields grouping on split streams fails
new f02369a [docs, setup] Add note about (task|job)manager scripts
new f887ba8 [FLINK-3070] Add AsynchronousStateHandle
new a65bcef [hotfix] fix shaded reference
new 54e642b [docs, setup] Add missing parenthesis
new 66b5def [streaming] [ml] Code cleanup: unused imports, fix javadocs
new d2b4391 [FLINK-3064] [core] Add size check in GroupReduceOperatorBase
new 5558e76 [FLINK-2996] Introduce configuration parameter for BlobServer port
new 3333f84 Remove Record API program tests
new 50ced5e Remove ITCases for Record API operators
new 8543dd9 Move operator ITCases into correct package
new b640c01 Remove Record API dependencies from CC iteration tests
new d353ef4 Remove Record API dependencies from WordCount compiler test
new 348d501 Remove deprecation warning suppressions
new 8abae2c [FLINK-2901] Remove Record API dependencies from flink-tests #1
new ebba20d [FLINK-2901] Remove Record API dependencies from flink-tests #2
new 49f5a01 [FLINK-2686] Show exchange mode in JSON plan
new 25ef324 [FLINK-2318] Union can be used as BroadcastVariable
new 90c76ad [FLINK-3072] [streaming] Ensure Derby server starts before running any tests
new aad99f2 [FLINK-3000] Adds shutdown hook to clean up lingering yarn sessions
new 008060f [hotfix] Register signal handler for JobManager and TaskManager
new 2c507f9 [FLINK-3067] Enforce zkclient 0.7 for Kafka
new 6216acf [github] change tab size to 4 spaces
new 8fddbf0 [docs][streaming] fix code examples which use 'implements'
new c787a03 [FLINK-2906] Remove Record API
new e03e60d [FLINK-3059] Improve JavaDocs for DataSet.writeAsText()
new 804611c [typo-fix] Fix typo in DelimitedInputFormat.java
new dcce6de [docs][hotfix] Fix wrong window definitions in the docs
new 4097666 [hotfix] Java-7-ify the ExecutionConfig class
new 55fd5f3 [FLINK-3051] [streaming] Add mechanisms to control the maximum number of concurrent checkpoints
new d359a97 [FLINK-3082] Fixed confusing error about an interface that no longer exists
new e4a4eff [FLINK-3085] [runtime] Initialize state backends as part of "invoke()"
new e69d145 [hofix] Properly set state backend from execution environment to stream graph
new f73a12e [FLINK-3046] Integrate the Either Java type with the TypeExtractor
new 7691368 [tools] add more defaults to .editorconfig
new 09ea3dd [FLINK-3054] Remove R (return) type variable from SerializationSchema
new e9a2bc9 [hotfix] Fix SimpleStringSchema serialization issue
new a997dd6 [FLINK-3081] Properly stop periodic Kafka committer
new 31a2de8 [FLINK-2961] [table] Add support for basic type Date in Table API
new 3e9d33e [FLINK-3075] Change Either creation method names and expose Right/Left classes
new 209ae6c [FLINK-3061] Properly fail Kafka Consumer if broker is not available
new 20ebad0 [FLINK-3088] [serialization] Fix copy method of TypeSerializer which use Kryo
new 2b358cd [tests] Activate ChaosMonkeyITCase
new cf91347 [FLINK-3083] [docs] Add docs on how to configure streaming fault tolerance.
new b80ecfd [FLINK-2904] [web-dashboard] Fix truncation of task counts when the number is large.
new 6bac921 [FLINK-2351] [core] Remove IOFormat ConfigBuilders
new 8051222 [FLINK-3056] [web-dashboard] Represent bytes in more readable form.
new d5a6b13 [FLINK-2950] [ml] [docs] Fix markdown rendering problem in SVM documentation
new cd899f3 [FLINK-2972] [JavaAPI] Remove Chill dependency from flink-java.
new d1ea365 [FLINK-3084] [streaming] FsStateBackend backs up very small state directly with the metadata.
new 19b2a8e [hotfix] Declare env and insertStatement transient in DbStateBackend
new 5a3d072 [FLINK-3092] [docs] Fix Scala API quick start word count example
new 31f6a74 [tests] Decrease verbosity of ChaosMonkeyITCase
new b630580 [FLINK-2624] RabbitMQSource uses MessageAcknowledgingSourceBase
new 9215b72 [FLINK-2624] improvements to the RabbitMQ source
new 20fe2af [FLINK-3087] [Table API] support multi count in aggregation.
new 8863679 [FLINK-2837][storm] various improvements for the compatibility layer
new f8b456b [FLINK-2115] [Table API] support no aggregation after groupBy.
new 04b3802 [FLINK-3080] Relax restrictions of DataStream.union()
new 0ccbd27 [FLINK-3071] Add asynchronous state materialization thread
new 0ccab95 [FLINK-2440][py] Expand Environment feature coverage
new 4e59232 [FLINK-3100] signal handler prints error on normal shutdown of cluster
new 2cf4893 [hotfix] [tests] Temporarily ignore ChaosMonkeyITCase
new 8bd98e0 [FLINK-3096] Retry cleaned checkpoint directory check
new 9849a57 [FLINK-3098] [Table API] Cast Data to Long throw compile error.
new b9639eb [FLINK-2954] Add config parameter for passing environment variables to YARN
new 477651b [docs] Add import statements to DataStream example programs (Java/Scala)
new 1ec0d10 [docs] Fix TumblingTimeWindows.of(AbstractTime) examples
new a1f4dd1 [FLINK-3125] [web dashboard] Web server starts also when JobManager log files cannot be accessed.
new 4003352 [FLINK-3055] [runtime] Remove redundant version of "Executionvertex.getSubTaskIndex()"
new 526e5af [hotfix] Minor JobManager doc fix
new fe5e2e1 [docker-flink] Bumped the docker container to the latest version.
new e8734b2 [FLINK-2488] [FLINK-2524] [FLINK-3124] Expose Attempt Number in RuntimeContext and add TaskInfo to hold all task related parameters.
new 868f97c [FLINK-2963] Forbid commons lang 3 SerializationUtils as well
new 22ac65b [FLINK-2897] [runtime] Use distinct initial indices for OutputEmitter round-robin
new 0cae3ea [FLINK-1278] [runtime] Remove record emitter special code paths for deprecated Record API
new d144e86 [FLINK-3112] Remove unused RecordModelPostPass and replace JavaPlan by Plan.
new 9547f08 [FLINK-3113] Remove unused and unsupported global-order methods from GenericDataSinkBase
new 4dbb10f [FLINK-3108] [java] JoinOperator's with() calls the wrong TypeExtractor method
new fc8be1c [FLINK-3102] Allow reading from multiple topics with one FlinkKafkaConsumer instance
new 718a17b [FLINK-3136] Fix shaded imports in ClosureCleaner.scala
new 4f12356 [FLINK-3073] Replace Streaming Mode by Memory Allocation Mode
new 3de49f5 [FLINK-3155][docker] update Flink version to 0.10.1
new e28b62e [FLINK-3143] update Closure Cleaner's ASM references to ASM5
new b2aa1d9 [FLINK-3145][storm] pin Kryo version of transitive dependencies
new 1190f3b [Storm Compatibility] Updated README.md and documenation
new 74b535d [FLINK-3074] Add config option to start YARN AM on port range
new c4a2d60 [FLINK-3156] Fix NPE in KafkaConsumer when reading from SOME empty topics/partitions
new 4b64887 [FLINK-2936] Fix ClassCastException for Event-Time source
new 6bd5714 [FLINK-3121] Emit Final Watermark in Kafka Source
new 0f98a8e [FLINK-3023][web-dashboard] Display version and commit information on Overview Page.
new 61cff8e [FLINK-3077][cli] Add version option(-v, --version) to Cli.
new 7d2394d [FLINK-2769] [runtime-web] Set allow-origin header
new 44eb58e [FLINK-2769] [runtime-web] Add configurable job manager address to HTTP requests
new f414e55 [hotfix] Minor cleanups in classes FileSystem, OperatingSystem, CopyableValue, GenericCsvInputFormat
new daad577 [hotfix] Add comments to BroadcastVariableInitializer and SplittableIterator
new bd657e6 [hotfix] Add missing Override annotations to RichFoldFunction and RichReduceFunction
new a8c4c48 [hotfix] Remove unused FileDataSourceBase and FileDataSinkBase
new 4a26cce [hotfix] Remove unused ValueUtil
new 066913e [FLINK-3169] Move Record Type Utils from flink-java to flink-runtime/test
new d9a061c [FLINK-3171] [misc] Consolidate zoo of wrapper classes for input/output-stream to data-input/output-view.
new e20c639 [hotfix] Fix Long.MAX_VALUE watermark emit
new e248618 [hotfix] respect default local number of task managers
new b9ce8ab [FLINK-2882] [core] Improve performance of string conversions - Memoize string representations of AbstractID. - Use lookup table for byte-to-hex conversion in StringUtils.
new 19cbc78 [FLINK-3147] Expose HadoopOutputFormatBase fields as protected
new 8f6f294 [contrib, connector-wikiedits] Add WikipediaEditsSource
new 7f01f56 [fix] Resolve code warnings in JobManager and TaskManager
new d6e9fa0 [docs] trivial typo in docker-flink/README.md
new 4e52fe4 [FLINK-3134][yarn] asynchronous YarnJobManager heartbeats
new aec6ded [CLI] Set current class loader to user-class loader and disable class initialization. Enalbes submission of Flink programs written in Clojure.
new f5957ce [FLINK-7] Add range partitioning with automatic sampling of key distribution
new a6a0528 [FLINK-7] Prevent range partitioning inside iterations.
new ba2aba8 [FLINK-3116] Remove RecordOperator
new af99630 [FLINK-3180] [runtime] Log direct memory usage in MemoryLogger
new c08bcf1 [FLINK-2622] [streaming] Align Scala streaming writeAsCsv API call with Java API
new da751e8 [FLINK-3103] [runtime] Remove unnecessary synchronization in FsStateBackend.FsCheckpointStateOutputStream
new afd2016 [hotfix] Trivial WriteMode comment fix
new 4fca1db [FLINK-3185] [tests] Don't swallow test failure Exception
new 7cb25cb [FLINK-3185] [runtime, tests] Log error on failure during recovery
new c246ff2 [FLINK-3166] [runtime] The first program in ObjectReuseITCase has the wrong expected result, and it succeeds - TestEnvironment now honors configuration of object reuse - Fixed reduce transformations to allow the user to modify and return either input
new 2ac1e19 [hotfix] [tests] Clean up and simplify ObjectReuseITCase
new 8e95214 [FLINK-3173] Bump httpclient and httpcore to version 4.2.6 to solve bug in http client
new f7b113d [FLINK-2837] [Storm Compatibility] FlinkTopologyBuilder cannot handle multiple input streams - removed BoltWrapperTwoInputs - add generic multi-input stream bolt wrapper - updated FlinkTopology to translate multi-input bolts correctly - added multi-input union test wrapper - updated FlinkTopology to translate multi-input bolts correctly - added multi-input union test
new a50eb73 [FLINK-3181] [gelly] avoid unnecessary messages in SSSP examples and library method
new 74d10ca [FLINK-3131] [contrib, runtime, streaming-java] Add long getStateSize() to StateHandle and KvStateSnapshot
new 2c7e63a [FLINK-3131] [core, runtime] Add checkpoint statistics tracker
new 002e0ab [FLINK-3131] [runtime-web] Add checkpoint statistics handlers
new 73e8586 [FLINK-3131] [runtime-web] Add checkpoint statistics to web frontend
new 4f8c5e8 [FLINK-3067] [kafka connector] Use curator for committing offsets to ZK from Kafka
new 72f9a6c [FLINK-2978] [web-dashboard] Integrate web client into Web Frontend
new 6f2d9d7 [hotfix] [web-dashboard] Various dashboard code cleanups
new 0038b69 [FLINK-3157] [web dashboard] Remove author tag to be compliant with Apache code style
new 4df90ce [hotfix] [core] Remove environment checks for Java 6
new 93d392a [hotfix] [core] Minor cleanup in SignalHandler.
new ca9b2b5 [FLINK-3186] [core] Deprecate DataSink.sortLocalOutput() methods
new 4f128e3 [FLINK-3194] [web client] Remove standalone web client
new 47cd9fd [FLINK-3194] Remove obsolete web client config keys
new dcf86c2 [FLINK-3188] Pass deletes to KeyedDeserializationSchema
new c674a65 [FLINK-3093] Introduce annotations for interface stability in flink-core
new 54b89b9 [refactor] Change if-else conditions to switch-case statements.
new 5b27cea [codestyle] Improve code style of PoissonSampler
new 3da24a0 [FLINK-3176] Improve documentation for window apply
new d31b00d [javaDocs] Fix JavaDoc examples in tumbling and sliding time windows
new 08c8137 [docs] Add "Iterator Data Sink" section to DataStream guide.
new 009146c [FLINK-1737] [ml] Add outer product to Vector class
new ebbc85d [FLINK-3050] [runtime] Add UnrecoverableException to suppress job restarts
new a3c0185 [FLINK-2976] [docs] Add docs about savepoints
new ad7b21b [FLINK-2976] [streaming-java, streaming-scala] Set JobVertexID based on stream node hash
new 2533b4f [FLINK-2976] [runtime] Add StateStore<T>
new 9260aaa [FLINK-2976] [core, runtime, streaming-java] Add ApplicationID to ExecutionGraph
new 6bdf9d0 [FLINK-2976] [runtime] Add setCount(long newCount) to CheckpointIDCounter
new d739ee2 [FLINK-2976] [runtime, tests] Add SavepointCoordinator
new 3607575 [FLINK-2976] [clients] Add savepoint commands to CliFrontend
new 7734885 [FLINK-2976] [streaming-contrib] Use ApplicationID in DbStateBackend instead of JobID
new b9a6a5c [FLINK-3212] [tests] Add RetryOnFailure rule to JobManagerCheckpointRecoveryITCase
new a065ed0 [Docs] Fixed code example in streaming docs
new a5b0556 [FLINK-3189] Fix argument parsing of CLI client INFO action
new ee0bc13 [FLINK-3218] Fix overriding of user parameters when merging Hadoop configurations
new b474da6 [FLINK-3224] [DataStream] Call setInputType() on output formats that implement InputTypeConfigurable
new dbbab0a [FLINK-3192] [TableAPI] Add explain support to print the sql-execution plan.
new e04ab25 [FLINK-3118] [Gelly] Consider ResultTypeQueryable in MessageFunction and GatherFunction
new d92e422 [hotfix, runtime] Downgrade to Netty version 4.0.27.Final
new 62938c1 [FLINK-2342] [ml] Add a new fit operation for Vector with Double value to StandardScaler
new d0e1d63 [FLINK-3195] [examples] Consolidate batch examples into one project, unify batch and streaming examples under on parent project
new b7520a5 [FLINK-3195] Rework quickstart example & some cleanups on the new examples
new e9bf13d [FLINK-1712] Remove "flink-staging" module
new e4d8944 [FLINK-2962] Cluster startup script refers to unused variable
new d1c93d2 [FLINK-2586] Unstable Storm Compatibility Tests - added BLOCKING flag to FlinkLocalCluster - added NullTerminatingSpout and SpoutOutputCollectorObserver plus tests - reworked test accordingly - set BLOCKING flag for ITCases - make infinite spouts finite using NullTerminatingSpout - removed sleep time to get stable - fixed bug in BoltSplitITCase and SpoutSplitITCase - exception in VerifyAndEnrichBolt is swallowed and test would not fail (replaced by errorF [...]
new be055b7 [Storm-Compatibility] Forward Storm Kryo registrations to Flink
new 615cf42 [FLINK-2984] [ml] Extend libSVM file format support
new a65cd8d [hotfix] moved files to correct folder to match package statements
new 388c280 [hotfix] Remove unnecessary dependencies in flink-runtime.
new 0ae46b5 [FLINK-3236] [runtime] Flink user code classloader as parent classloader from Flink core classes
new 9915b33 [hotfix] Remove docs for the now removed web client.
new 16cf8b1 [hotfix] Remove outdated README for the quickstart projects.
new 8b8dfc1 [FLINK-3235] Remove Flink on Tez code
new 0937be0 [FLINK-3232] [runtime] Add option to eagerly deploy channels
new e9a5358 [FLINK-3219] [java scala] Implement DataSet.count and DataSet.collect using a single operator
new 9365441 [hotfix] Minor cleanup of warnings, comments, and code style in the Java API Utils
new 2c556f7 [FLINK-3197] [core] Close InputStream in BinaryInputFormat#createStatistics reliably
new cfcb5d7 [hotfix] Use AccumulatorSnapshot's class loader for deserializing accumulators
new cf7045c [FLINK-3074] [yarn] Fix port range retry termination condition
new 21882af [FLINK-3073] [dist] Fix JobManager command line argument
new e43b970 [FLINK-3172] [core, runtime, yarn] Allow port range for job manager with high availability
new ad267a4 [FLINK-3132] [docs] Initial docs restructure
new 98fad04 [hotfix] Fix missing license in new doc files
new a8be52a [FLINK-2716] [gelly] [apis] New checksum method on DataSet and Graph
new c0fd36b [FLINK-2671] [tests] Fix unstable StreamCheckpointNotifierITCase
new 17fa6a9 [hotfix] Clean up CliFrontend after removing web client
new adbeec2 [hotfix] Fix reference to batch Java examples in flink-java8
new db4d139 [FLINK-3184] [timeouts] Set default cluster side timeout to 10 s and the client side timeout to 60 s
new 1c3bbe4 [hotfix] [docs] Remove copy-paste and author comments
new 117ba95 [FLINK-3251] [runtime] Return empty stats for unknown operator
new 39a4b5a [FLINK-3253] [runtime-web] Properly display checkpoint stats
new a5bba3c [FLINK-3250] [runtime] Remove too strict parallelism check in SavepointCoordinator
new 7d7d8b6 [FLINK-3244] [runtime] Add debug log messages to SavepointCoordinator
new 153a678 [hotfix] Exclude 'flink-annotations' from fat jars in quickstart poms.
new 544abb9 [Refactor] [DataSet] Refactor key selector translation in DataSet API. Clean up several compiler warnings.
new 8f0c47d [FLINK-3241] Fix SNAPSHOT deployment for Scala 2.11
new 82ff716 [FLINK-3220] Remove javax.servlet exclusions from hadoop2 fat jar to fix Flink on HDP
new 046f044 [FLINK-2831] [Storm Compatibility Tests] Fixed instable test
new 018f1fe [FLINK-3241] Fix Scala 2.11 build by moving some flink-table classes into the right directory
new 0ac5d40 [FLINK-3165] [py] Windows OS support
new fc4d946 [FLINK-3057] Bidrectional plan connection
new c7ada8d [FLINK-3014] Replace InStr.read() calls with DataInStr.readFully()
new 54b52c9 [FLINK-3063][py] Remove combiner
new ab84707 [FLINK-2501] [py] Remove the need to specify types for transformations
new ac42d15 [FLINK-2439] [py] Expand DataSet feature coverage
new 83fb2fa [hotfix] [webserver] Add sanity check to avoid NPE in case the web server could not be instantiated
new 81320c1 [FLINK-3058] Add support for Kafka 0.9.0.0
new e11cb5a [FLINK-3122] [Gelly] Generic vertex value in label propagation
new 283aa6c [hotfix] [test] Add a test case for Filter.
new d00739b [FLINK-3269] [py] Replace DataInStr.read() with DataInStr.readFully()
new 48c32dd test protection of master branch
new 99be433 [hotfix] remove temporary file
new e1e577c [hotfix] [ml] Fix SVM documentation
new 85ad491 [FLINK-2972][java-api] remove Chill dependency from the test scope
new c57111c [FLINK-3206] fix heap size for non-pre-allocated off-heap memory
new 184a454 [docs] add disclaimer for Kerberos concerning the Hadoop version
new 9c2f516 [FLINK-1994] [ml] Add different learning rate calculation schemes to SGD
new 4d10be1 [FLINK-1994] [ml] Remove decay parameter from IterativeSolver
new 1a5ce4d [FLINK-3259] [docs] Redirect programming guides to new layout
new 893a62f [FLINK-3261] Allow Task to decline checkpoint request if not ready
new 257f0b1 [hotfix] [docs] Add missing licenses to programming guide redirects.
new 6823895 [hotfix] Remove use of StringUtils.stringifyException() where used is counterindicated
new 4806158 [tests] Add test for a program with very fast failure rates.
new 7ee719f [FLINK-3255] [streaming] Disable parallelism-dependent chaining optimization
new 37787ca [FLINK-3246] Remove unnecessary '-parent' suffix from projects 'flink-contrib' and 'flink-streaming-connectors'.
new 10eb16a [hotfix] Undo DEBUG log setting for Blob Server in runtime tests
new ed3810b [FLINK-3267] Disable reference tracking in Kryo fallback serializer
new 4406188 [FLINK-3256] Fix colocation group re-instantiation
new 7338474 [FLINK-3284, hotfix] [docs] Fix various broken links
new 0240c8e [FLINK-3135] Add chainable driver for UNARY_NO_OP strategy
new 2ad1d5e [hotfix] [docs] Tidy up documentation. Fix some non-idiomatic usage of return in scala code.
new 4280e1f [FLINK-3285][maven] Skip deployment of flink-java8 module
new cf75f42 [FLINK-3209] Remove Unused ProcessingTime, EventTime and AbstractTime
new 36d6572 [FLINK-3274] Make accumulator names of Kafka connector unique
new d398926 [FLINK-3280] Change Boolean.getBoolean to Boolean.valueOf
new 9840136 [cleanup] Remove spark repl detection code from closure cleaner
new af029e7 [FLINK-1666][FLINK-1903][FLINK-3233] Refactor expression keys.
new 5914e9a [FLINK-1045][dataSet] Remove Combinable annotation.
new 902d420 [FLINK-3198][dataSet] Renames and documents better the use of the getDataSet() in Grouping.
new 1e67a05 [FLINK-3289][docs] References to flink-contrib merged
new a7d4334 [hotfix] Remove references to deprecated junit.framework.Assert from tests
new eaf540f [FLINK-2871] support outer join for hash on build side.
new 2c4e4d1 [FLINK-2933][maven] add suffix to Scala dependent modules
new 48fa72a [maven] add script to verify Scala suffixes
new 8b34d21 [docs] add Scala suffix for Maven artifact names
new c4e83c1 [docs] Add warning about artifact name changes
new ace25c8 [docs] Fix broken links and remove duplicate page
new fb25cd8 [hotfix] Fix interaction of Async calls/checkpointing/canceling
new 92a2544 [FLINK-3258] [runtime] Don't request partition on channel update if no requests yet
new f681d9b [FLINK-3258] [runtime, streaming-java, tests] Move registerInputOutput code to invoke and remove registerInputOutput
new 499b60f [FLINK-3290] [py] Generalize OperationInfo transfer
new 440137c [FLINK-3140] [table] NULL value data layout in Row Serializer/Comparator
new 40422d5 [FLINK-3275] [py] Support for DataSet.setParallelism()
new 1ea5e13 [FLINK-3262] [web-dashboard] Remove fuzzy versioning from Bower dependencies
new 9637ee7 [hotfix] [kafka connector] Replace funky loop with simple division in FixedPartitioner
new 2e23307 [hotfix] [streaming] Processing timer errors are not logged unless the task is actually running.
new c4e5a55 [FLINK-3178] Don't Emit In-Flight Windows When Closing Window Operator
new f6d2ce9 [FLINK-3196] InputStream should be closed in EnvironmentInformation#getRevisionInformation()
new 83b88c2 [FLINK-3242] Also Set User-specified StateBackend without Checkpointing
new d97fcda [FLINK-3292]Fix for Bug in flink-jdbc. Not all JDBC drivers supported
new 6b01a89 [FLINK-3265] [rabbitmq] Fix concurrency bug in RabbitMQ
new 85ac6d3 [docs] Harmonizes watermark terminology between docs and java docs
new 086acf6 [streaming] [scala] Exposed environment from DataStream
new 2a49eaa [FLINK-3300] fix concurrency bug in YarnJobManager
new ef58cf3 [hotfix] fix non-exhaustive match warning
new 8c8f1c4 [hotfix] [streaming] Tasks print subtask in log statements
new d902d16 [hotfix] Clean up warnings in Serializers util class
new c4bc47a [FLINK-3306] [core] Fix auto-type registry util
new b6110dc [FLINK-3305] [core] Remove limited and inconsistent auto-magic for Joda Time
new 5e2fb3c [hotfix] Add deprecation message to old Key interface
new 83e6a2b Revert "[FLINK-3265] [rabbitmq] Fix concurrency bug in RabbitMQ"
new 67b380d [FLINK-3265][tests] adapt RMQSource checkpointing test to runtime behavior
new 92efcd3 [hotfix] Remove 'ByteArrayInputView' and replace deserialization in TypeInformationSerializationSchema with more efficient reusable buffers.
new 6c0a83e [fix] [docs] Fix typo in savepoints documentation
new 233c014 [FLINK-3281] IndexOutOfBoundsException when range partition on empty DataSet
new f867746 [FLINK-3208] [gelly] rename vertex-centric iteration model to scatter-gather
new 682d8d5 [FLINK-3175][Kafka 0.8] Relax test condition
new 79058ed [FLINK-3216] [FLINK-3217] [cep] Adds CEP operator for pattern recognition
new cb1a5ec [FLINK-3287] Shade Curator dependency into flink-connector-kafka-0.8
new 360f02b [FLINK-3247] Remove * exclude from quickstarts
new 5474386 [FLINK-3049] [api breaking] Move 'Either' type to 'flink-core / org.apache.flink.types'
new 7081836 [FLINK-3303] [core] Move Tuple classes to flink-core
new 21a7158 [FLINK-3303] [core] Move all type utilities to flink-core
new 6f042e7 [hotfix] Reduce the heavy sysout verbosity for certain tests
new bfff86c [FLINK-2348] Fix unstable IterateExampleITCase.
new 168532e [hotfix] [streaming] Various cleanups in StreamTask - Clean up generics - Clean and safe disposal of initialized resources - Add names to asynchronous materialization threads - Fix concurrent modification of materialization threads set
new b90542e [hotfix] Remove old sysout debug message in UdfAnalyzerTest
new c356ef3 [hotfix] Fix warnings concerning joda-time in "flink-tests"
new 8fc7e7a [FLINK-3314] [streaming] Fix case where early cancel messages do not properly cancel a stream operator.
new 95f9bc8 [hotfix] Fix typos in Trigger.java
new 4f8b9bb [FLINK-3313] [kafka] Fix TypeInformationSerializationSchema usage in LegacyFetcher
new 87f54b3 [streaming] remove dummy FlumeSource
new 077dd55 [FLINK-3325] [cep] Close input stream in CEPPatternOperator.restoreState
new 35ec26c [docs] Move libraries to batch and streaming guides
new 680c2c3 [hotfix, yarn] Exit JVM after YARN actor system shut down
new caf4672 [FLINK-3201] Enhance Partitioned State Interface with State Types
new 67ca4a4 [FLINK-3200] Use Partitioned State in WindowOperator
new 524e56b [FLINK-3278] Add Partitioned State Backend Based on RocksDB
new 6f75596 [FLINK-3201] Add operator state to make change backwards compatible
new e4d05f7 [FLINK-3312] Add accessors for various state types to RuntimeContext
new 456d0ab [FLINK-3200] Fix Triggers by introducing clear() method to clean up state/triggers
new 180cd3f [FLINK-3312] Add simple constructors for State Descriptors
new 1198664 [FLINK-3201] Adjust CEP code for changes state interfaces
new 934774f [FLINK-3293] [yarn] Respect custom CLI Yarn name in JobManager mode
new f7d1911 [FLINK-3161] [dist] Externalize cluster start-up and tear-down when available
new aabb268 [FLINK-3254] [dataSet] Adding functionality to support the CombineFunction contract.
new 7378f01 [FLINK-3328] Incorrectly shaded dependencies in flink-runtime
new f8f747f [FLINK-3268] [tests] Enhance stability of ZooKeeperTestEnvironment.deleteAll()
new 69f7f6d [FLINK-2845] Fix TimestampITCase.testWatermarkPropagation()
new 116337f [streaming] [scala] Revert removing getJavaStream() from DataStream
new 4852302 [streaming] [scala] Scala wrapper for DataStreamUtils
new 5d75954 [FLINK-3329] Auto-Close BackupEngine in AbstractRocksDBState
new b953a9b [hotfix] [docs] Fixed typo in process model illustration
new 8e3e2f8 [FLINK-3342] [runtime] Fix checkpoint statistics state size overflow
new fe0c3b5 [FLINK-3330] [ml] Fix SparseVector support in GradientDescent
new 2eb2a0e [FLINK-3338] [kafka] Use proper classloader when cloning the deserialization schema.
new b54499b [FLINK-3093] Introduce annotations for interface stability in remaining modules
new 4c1f447 [hotfix] Relax test condition in ExternalProcessRunnerTest
new 168c1f0 [FLINK-3120] [runtime] Manually configure Netty's ByteBufAllocator
new 7eb6edd [FLINK-2721] [Storm Compatibility] Add Tuple meta information
new e0fd489 [FLINK-3286] [build] Remove not maintained JDEB profile from flink-dist
new 6d83c9d [FLINK-3362] [runtime] Fix possible overflow in multiplication
new 7469c17 [FLINK-3339] Make ValueState.update(null) act as ValueState.clear()
new 9f6a8b6 [FLINK-3336] Add Rescale Data Shipping for DataStream
new 412dcbd [hotfix] Remove @Experimental from DataStream.forward()
new af425b2 [FLINK-3348][scripts] remove bc dependency in startup script
new 20f8911 [FLINK-3353] CSV-related tests may fail depending on locale
new 4147040 [hotfix] [runtime] Create TestingJobManager in TestingUtils
new d69fe30 [hotfix] [docs] Add config docs about checkpoint stats
new b7e70da [FLINK-3310] [runtime-web] Add back pressure statistics to web monitor (backend)
new ba13caa [FLINK-3310] [runtime-web] Add back pressure statistics to web dashboard (frontend)
new 22423e2 [hotfix][doc] Add note on how to use custom loggers with a per-job-yarn cluster
new 4cc4f60 [FLINK-3337] [runtime] mvn test fails on flink-runtime because curator classes not found
new af3e689 [FLINK-3361] [jobmanager] Fix error messages about execution delay and max heartbeat pause
new a277543 [FLINK-3363] [jobmanager] Properly shut down executor thread pool when JobManager shuts down
new 457cb14 [FLINK-3365] [taskmanager] Properly shut down cleanup timer thread
new d51bec1 [FLINK-3334] [conf] Include year-month-day in the log output
new 5c47f38 [hotfix] typo IllegalArgumentException
new 28feede [FLINK-3357] [core] Drop AbstractID#toShortString()
new e9c83ea [hotfix] Update comments in 'ChainingStrategy' and remove outdated 'FORCE_ALWAYS' constant
new 28c6254 [hotfix] Cleanup routing of records in OperatorChain
new 9ee1679 [FLINK-3355] [rocksdb backend] Allow passing options to the RocksDB backend.
new a4f0692 [FLINK-3286] Remove the files from the debian packaging as well
new c57a7e9 [FLINK-3373] [build] Bump version of transitine HTTP Components dependency to 4.4.4 (core) / 4.5.1 (client)
new 72f8228 [hotfix] Add missing entries to condif reference doc and removed outdated webclient entries
new de231d7 [FLINK-3373] [build] Revert HTTP Components versions because of incompatibility with Hadoop >= 2.6.0
new 59b237b [build system] Skip javadoc generation for java8 and snapshot deployments
new 572855d [FLINK-3366] Rename @Experimental annotation to @PublicEvolving
new 0a63797 [FLINK-3234] [dataSet] Add KeySelector support to sortPartition operation.
new aeee6ef [docs] Fixed typo in Storm Compatibility page
new 8ccd754 [FLINK-3373] [build] Shade away Hadoop's HTTP Components dependency
new 9173825 [FLINK-3341] Make 'auto.offset.reset' compatible with Kafka 0.8 and 0.9
new b8f4025 [FLINK-3350] [tests] Increase default test Akka ask and ZooKeeper timeouts
new 3a643c0 [hotfix] [tests] Ignore ZooKeeper logs in process tests
new 756cbaf [hotfix] [tests] Log retry rule failures on warn level
new 48b7454 [hotfix] [tests] Reset state to allow retry on failure
new 6968a57 [FLINK-3260] [runtime] Enforce terminal state of Executions
new 8df0bba [FLINK-3107] [runtime] Start checkpoint ID counter with periodic scheduler
new 50bd65a [FLINK-3371] [api-breaking] Move TriggerResult and TriggerContext to dedicated classes
new fd324ea [FLINK-3384] [kafka] Add ClosableQueue for message exchanges between Kafka Threads
new cf3ae88 [FLINK-3369] [runtime] Make RemoteTransportException instance of CancelTaskException
new ed7d3da [FLINK-3391] [tests] Fix typo in test config
new dcea46e [FLINK-3364] [runtime, yarn] Move SavepointStore initialization out of JobManager constructor
new 82c7383 [FLINK-3271] [build] Don't exclude jetty-util dependency from the Hadoop dependencies
new be72758 [FLINK-3389] [rocksdb] Add pre-defined option profiles.
new edae793 [FLINK-3358] [FLINK-3351] [rocksdb] Add simple constructors and automatic temp path configuration
new 1dee62b [hotfix][travis] deploy snapshots only for master branch
new b6bfcf0 [FLINK-3270] Add Kafka example
new d93b154 [hotfix] Minor code cleanups in AbstractStateBackend
new 94cba89 [FLINK-2991] Add Folding State and use in WindowOperator
new e927ec0 [FLINK-2991] Adjust RocksDB Folding State to latest RocksDBStateBackend
new c47cb7a [FLINK-3392] [kafka] Fix unsynchronized access in ClosableBlockingQueue
new 31310cd [FLINK-3359] Make RocksDB File Copies Asynchronous
new f5d7190 [FLINK-3352] Use HDFS Config in RocksDB Copy Utilities
new 8b7caaa [hotfix] Fix field names in RocksDBStateBackend
new 8e55bbd [FLINK-3393] [core] ExternalProcessRunner wait to finish copying error stream
new 937963e [FLINK-3107] [runtime] Defer start of checkpoint ID counter
new e5f33b6 [FLINK-3367] Add PublicEvolving and Internal annotations to flink-java and flink-scala
new 53f8d77 [FLINK-3367] Add PublicEvolving and Internal annotations to flink-core
new c9db63b [FLINK-3367] Add PublicEvolving and Internal annotations to flink-streaming-java and flink-streaming-scala
new b2f6f8c Revert "[FLINK-3369] [runtime] Make RemoteTransportException instance of CancelTaskException"
new babf84c [hotfix] [web-dashboard] Make build idempotent
new 73bc35f [FLINK-3160] [web-dashboard] Aggregate operator statistics by TaskManager
new b17632d [FLINK-3354] Determine correct size for RocksDB snapshots
new 5eae47f [FLINK-3187] [restart] Introduce RestartStrategy to ExecutionGraph
new bdd4024 [FLINK-2111] Add "stop" signal to cleanly shutdown streaming jobs
new f60f8fb [FLINK-2111] Make stoppable stream task and stoppable stream source operator type safe
new 9053254 [hotfix] Add better error reporting in case of wrongly specified retry delay
new ca11c1c [hotfix] Annotate StoppableFunction as PublicEvolving
new 65d0805 [FLINK-3158] Enforce maven version to be < 3.3 when building a release
new c658763 [FLINK-3304] Making the Avro Schema serializable.
new 76d3a63 FLINK-2380: allow the specification of a default filesystem scheme in the flink configuration file.
new 8486c3c [hotfix] Add Scala version suffix to flink-cep module
new 2714aaf [FLINK-3296] Remove 'flushing' behavior of the OutputFormat support of the DataStream API
new 932a49d [hotfix] [docs] Complete sentences in cluster_execution.md
new 489e653 [hotfix] [streaming] Remove unused code fragment from DataStream.union() function.
new 75dcfc0 [hotfix] [rocksdb] Update predefined RocksDB option profiles.
new 5b1231d [hotfix] [streaming] Remove some unused internal classes
new 8cce136 [FLINK-3413] [streaming] Remove implicit Seq -> DataStream conversion
new a66458e [hotfix] [streaming] Add check in StreamRecord for reserved timestamp values
new 401837b [FLINK-3308] [py] Remove debug mode
new ebab470 [FLINK-3420] [api-breaking] Remove utility functions 'readTextFileWithValue' and 'readFileOfPrimitives' from StreamExecutionEnvironment
new ce8f966 [FLINK-3243] Fix Interplay of TimeCharacteristic and Time Windows
new 134b5c2 [FLINK-3403] Create Section "Working with Time" in Streaming Guide
new be4601e [FLINK-3402] Refactor Common Parts of Stream/Batch Documentation
new c1412dd Add (basic) RocksDB State Backend Documentation
new 74c2b80 [FLINK-3379] [FLINK-3415] [streaming] Refactor TimestampExtractor into two separate classes
new e08d7a6 [FLINK-3401] [streaming] [api breaking] AscendingTimestampExtractor only logs violations of ascending timestamp order.
new 50a166d [FLINK-3299] Remove ApplicationID from Environment
new 97d1f4a [hotfix] Fixes to flink-annotations JavaDocs
new bd137ae [hotfix] Properly declare ComplexIntegrationTest as an Integration Test Case
new 6dda531 [FLINK-3413] [streaming] Make implicit conversions from Java DataStream to Scala DataStream explicit
new a8afec3 [FLINK-3421] [streaming scala] Remove unneeded ClassTag context bounds
new 06a42bf [FLINK-3419] [streaming] Drop 'partitionByHash' function, subsumed by 'keyBy()'
new a4e8fcb [hotfix] Auto-select actor system port in TestingCluster to prevent port collisions
new cee135a [FLINK-3430] Remove "no POJO" warning in TypeAnalyzer
new c97a63e3 [FLINK-3400] Move RocksDB Copy Utils to flink-streaming-java
new 41b826b [FLINK-3436] Remove ComplexIntegrationITCase
new 06e3dd1 [FLINK-3423] [tests] Fixed ExternalProcessRunnerTest on Windows
new 7278e87 [FLINK-3424] [tests] Close InputStream in FileStateBackendTest#validateBytesInStream
new 138334a [hotfix] [tests] Increase timeouts in WebFrontendITCase for stability on CI infrastructure
new 0c6c723 [docs] fix typos in quickstart and CEP docs
new d48bb59 [FLINK-3368][Kafka 0.8] Handle leader changes in Kafka Consumer.
new 3a8717f [FLINK-3386] Ensure Flink Kafka 0.8 is correctly using 'auto.offset.reset'
new 0b7c2db [FLINK-3368][Kafka 0.8] Some improvements to the Legacy Fetcher
new 8912fb0 [FLINK-3386][FLINK-3368][Kafka 0.8] Cleanup Kafka Connector
new 59f978f [FLINK-3381] [runtime] Handle ConnectionLoss in ZooKeeper test util
new a3b9d97 [tests] Try to improve CI test stability
new 5aa7c25 [FLINK-3446] [runtime-web] Don't trigger back pressure sample for archived job
new 5117bc6 [hotfox] Fix javadoc of getState to comply with constructor changes
new 7f9ade4 [FLINK-3453] [runtime, runtime-web] Report partial stack trace sample for cleared tasks
new 9bdee1b [FLINK-3248] add constructor params and generic ConnectionFactory
new 60d65ce [cleanup] remove RMQTopology file
new 9691d95 [FLINK-3453] [runtime] Fix TaskManagerTest stability
new 80c0c65 [FLINK-3439] Remove final Long.MAX_VALUE Watermark in StreamSource
new bfc14eb [FLINK-3450] Duplicate TypeSerializer in StateDescriptor.writeObject
new 8656ed5 [FLINK-3455] Bump Kafka to 0.9.0.1 and 0.8.2.2
new 03923c3 [hotfix] [runtime] Fix processing unmatched build-side when all buckets spilled
new 1c48e34 [FLINK-3385] [runtime] Fix outer join skipping unprobed partitions
new de21630 FLINK-2213: Makes the number of vcores per YARN container configurable.
new 8626971 [FLINK-3440][Kafka 0.8] Commit also offsets retrieved from Kafka into the OffsetStore (ZK)
new 1bb8013 [tests] Add log statements to JobManagerHAJobGraphRecoveryITCase
new dedcd2d [runtime] Log restart strategy on job submission
new 407c285 [FLINK-3416] [py] Support for spaces in flink path
new b204888 [FLINK-3458] [build] Disable shade-flink execution in flink-shaded-hadoop
new 3b47ad2 [FLINK-3459] [build] Fix conflicting dependencies commons-collections, commons-beanutils and commons-beanutils-core
new 939768a [FLINK-3460] [build] Set Flink dependencies in flink-streaming-connectors, flink-batch-connectors, cep, gelly and flink-ml modules to provided
new 8b29c14 [FLINK-3438] ExternalProcessRunner fails to detect ClassNotFound exception because of locale settings
new 77c1dee [FLINK-3433] AvroOutputFormat#readObject uses readFully()
new 6323ed4 [FLINK-3410] [restart] Choose NoRestart strategy if the number of retries is set to 0
new ff8535c [FLINK-3464] [docs] Add SBT template documentation to the quickstart documentation
new ff4fbf9 [FLINK-3425] FileOutputFormat closes outStream in case of failure
new eb19c67 [docs] Fix typos in jobmanager HA documentation
new 271a715 [hotfix][release script] make sure the quickstart depends on scala 2.10
new 7ddc078 [FLINK-3418] Don't run RocksDB copy utils in external process
new dc4d147 [FLINK-3426] Fix JobManagerLeader[Re]ElectionTest.testleaderElection on Windows
new c40cfd3 [FLINK-3315] Fix Slot Sharing in Streaming API
new 0629e25 [FLINK-2021] Rework examples to use ParameterTool
new ac0135a [dist] Link plan visualizer to project website
new eaa9050 [FLINK-3478] [runtime-web] Don't serve files outside of web folder
new 4e35d2c [FLINK-3483] [runtime-web] Bump dagre-d3 version to 0.4.17
new cec7fbb [FLINK-3490] Bump Chill version to 0.7.4
new be68b17 [hotfix] Add logging for RocksDB backup durations
new af2091c [FLINK-3499] [runtime] Clear ZooKeeper references on recovery
new 004eb00 [docs] Move state and windows guide to separate pages
new ceb6424 [FLINK-3435] [streaming] Proparly separate IngestionTime and EventTime
new b94d99d [hotfix] Expose current watermark to Triggers
new e811e6e [FLINK-3500] [test] Fix possible instability in ExecutionGraphRestartTest
new 56e660d [hotfix][build scripts] Ensure that the hadoop1 version is set properly everywhere
new a5ecb18 [hotfix] [cep] Fix serialization problem and single state NFAs
new d90672f [FLINK-3513] [runtime] Fix interplay of automatic Operator UID and Changing name of WindowOperator
new c9cba27 [FLINK-3512] [runtime] Savepoint backend should not revert to 'jobmanager'
new 930a266 [FLINK-3510] [cep] Fix typo in Pattern class level comment
new db6fda6 [FLINK-3485][core] implement toString for SerializedListAccumulator
new ee76fc4 [FLINK-3437] [web-dashboard] Fix UI router state for job plan
new fa8b001 [FLINK-3340] [runtime] Fix object juggling in drivers
new 9692c83 [FLINK-3509] Update Hadoop minor versions to latest & sync travis and release scripts
new 0fb6e0d [FLINK-3434] Prevent NPE in ClientFrontend#getClient()
new 725f746 [FLINK-3449] createInput() no longer swallows exception
new de9a878 [FLINK-3520] [streaming] Periodic watermark operator emits current watermark in close()
new 2d64ca2 [hotfix][deploy script] Deploy 'release-*' branches as well
new 677425e [FLINK-3518] Stale docs for quickstart setup
new 016644a [hotfix] fix PageRank example to run with no args; some doc fixes
new c2a43c9 [FLINK-3390] [runtime, tests] Restore savepoint path on ExecutionGraph restart
new 4eabd4d [hotfix] Make DataStream property methods properly Scalaesk
new 6a28a6f [FLINK-3522] [storm compat] PrintSampleStream prints a proper message when involked without arguments
new 5e769b3 [FLINK-3525] [runtime] Fix call to super.close() in TimestampsAndPeriodicWatermarksOperator
new 7a5dde7 [hotfix] Remove remaining unused files from the old standalone web client
new 4f12dee [license] Update LICENSE file for the latest version
new 4a08a77 [hotfix] [build] Disable exclusion rules when using build-jar maven profile.
new e0328e4 [FLINK-3511] [gelly] Introduce flink-gelly-examples module
new 0f55d67 [FLINK-3511] [avro] Move avro examples to test scope
new de4a0be [FLINK-3511] [hadoop-compatibility] Move hadoop-compatibility examples to test scope
new f22f64a [FLINK-3511] [jdbc] Move jdbc examples to test scope and add flink-clients dependency
new 9cc1544 [FLINK-3511] [nifi, elasticsearch] Move nifi and elasticsearch examples to test scope
new 69eeefa [FLINK-3511] [twitter] Move twitter examples to test scope
new 64519e1 [FLINK-3526] [streaming] Fix Processing Time Window Assigner and Trigger
new 27b5c49 [FLINK-3521] Make Iterable part of method signature for WindowFunction
new 20884c0 [FLINK-3528] Add FoldingWindowBuffer for Non-Keyed Windows
new adddcd8 [FLINK-3527] Add Scala DataStream.transform()
new 9924c3a [docs] fix typos in Basic Concepts documentation
new febcb7f [FLINK-3461] [runtime] Remove redundant check in ZooKeeperLeaderElectionService
new 4906982 [FLINK-3461] [runtime] Fix space indentation in ZooKeeperLeaderElectionService
new e840bbf [FLINK-3517] [dist] Only count active PIDs in start script
new 512c84f Bump version to 1.1-SNAPSHOT
new f881e70 [FLINK-3532] [gelly] Fix artifact ID of flink-gelly-examples module
new 405d222 [hotfix] Properly copy stream record in ReducingWindowBuffer and FoldingWindowBuffer
new 5f0af06 [docs] Update readme with current feature list and streaming example
new 734ba01 [FLINK-3534] [runtime] Prevent canceling Execution from failing
new 9580b8f [FLINK-3535] [runtime-web] Decrease log verbosity of StackTraceSampleCoordinator
new 0ac2b1a [FLINK-3538] [api-breaking] Streamline Scala DataStream.join/coGroup
new 9922d10 [FLINK-3536] Make clearer distinction between event time and processing time
new 51fc298 [FLINK-3540] Shade org.htrace in flink-shaded-hadoop to get rid of its Guava dependency
new a922473 [FLINK-3548] [api-breaking] Remove unnecessary generic parameter from SingleOutputStreamOperator
new e8e88af [docs] fix readme typos; use the same scala style in the examples
new c8f81ba [FLINK-3556] [runtime] Remove false check in HA blob store configuration
new 7b8275a [FLINK-3559] [dist] Don't print INFO if no active process
new 93733cc [FLINK-3557] [stream, scala] Introduce secondary parameter list for fold function
new ff80dc0 [FLINK-3554] [streaming] Emit a MAX Watermark after finite sources finished
new 8a50524 [hotfix] Removed deprecated and commented code in SourceFunctionTest
new 8d67aa5 [FLINK-2788] [apis] Add TypeHint class to allow type-safe generic type parsing
new 80ae750 [hotfix] [docs] Remove Java example code from Scala docs
new 0ff286d [FLINK-3422][streaming][api-breaking] Scramble HashPartitioner hashes.
new f0f93c2 [FLINK-3422][streaming] Update tests reliant on hashing
new 072da7d [maven] add module to force execution of Shade plugin
new 7fbfab6 [hotfix] Fix JavaDocs for SourceFunction
new b02ee76 [FLINK-3496] Fix ML test discovery on Windows
new a52f9d8 [FLINK-3432] Fixed ZookeeperOffsethandlerTest on Windows
new d18224b [FLINK-3484] Add setSlotSharingGroup documentation
new 7b2f540 [FLINK-3570] [runtime] Use InetAddress.getLocalHost() as heuristic to find local address
new dbe9e59 [hotfix] Make 'force-shading' deployable
new bb62ab0 [FLINK-3569] [build] Adjust test cases due to shading plugin base directory changes
new 7bdac1a [FLINK-3578] [streaming scala] Support RichFunctions for Scala WindowFunction and AllWindowFunction
new 628bafa [docs] Active tab caption is now displaying blue
new b10bd92 [docs] Fix javascript exception caused by disqus and fix typos in cluster execution.
new e650d13 [FLINK-3575] [docs] Update 'Working With State' section in docs
new e3835a8 [docs] Add documentation about Event Time, Timestamp Assigners, Watermark Generation
new c986357 [FLINK-3491] [tests] Prevent URIException in HDFSCopyTest and disable HDFSCopyUtilitiesTest on Windows
new b0befc4 [FLINK-3495] [tests] Disable RocksDB tests on Windows
new 434e88f [FLINK-3566] [FLINK-3563] [core] TypeExtraction input type validation fixes
new 271071a [FLINK-3550] [examples] Rework WindowJoin to properly demonstrate continuous window joins (Java + Scala)
new 986d536 [FLINK-3552] [examples] Add a properly windowed word count reading from a socket (Java + Scala)
new cf9a0ae [FLINK-3533] [docs] fix broken links to examples and cluster execution in Gelly guide
new f9b01ba [docs] update "build from source" page
new f158f3d [docs] Move connectors page to batch guide
new c413b23 [FLINK-3383] move snapshot deployment from Travis CI to ASF Jenkins
new d3808c7 [FLINK-3585][tools] let deploy scripts work with spaces in paths
new 945fc02 [FLINK-3309] [py] Resolve Maven warnings
new d7aa989 [FLINK-3321] TupleSerializer.getLength() can return fixed-length size
new fe117af [FLINK-3169] Remove Key class
new 09ce3dc [hotfix] Improve exception message in TaskManagerTest#testRemotePartitionNotFound
new 5777bbc [FLINK-3883] fail immediately on deploy errors
new 35ad197 [FLINK-3591] Replace Quickstart K-Means Example by Streaming Example
new be1cf9d [FLINK-3592] [docs] Update setup quickstart
new bbc9068 [docs] Update stack figure on docs start page
new e34ac03 [docs] Add first steps to docs start page
new ab17b72 [tests] Add TestLogger to StreamCheckpointNotifierITCase
new ec6ee04 [hotfix] Rename UnrecoverableException to SuppressRestartsException
new cdc8f0a [FLINK-3396] [runtime] Suppress job restart if adding to job graph store fails
new e0947cc [docs] Add description and illustration about Watermarks in streams
new 728463b [docs] Remove 'Working with Time' page
new f6e6924 [FLINK-3561] remove unused timestampsEnabled flag
new 5fbedff [FLINK-3577] [docs] Display anchor links when hovering over headers.
new 9165393 [quickstart] fix links to documentation
new 5aca6f4 [build] Consolidate scala checkstyle usage and update version to 0.8.0
new 34110fe [FLINK-3594] [runtime] Make sure exceptions during checkpoints are handled properly
new c41ee94 [hotfix] [runtime] Guard async recovery operation in try-catch
new c9e0761 [hotfix] [tests] Remove verbose logging in SavepointITCase
new 3bbe59c [FLINK-2671] [tests] Fix test instability in StreamCheckpointNotifierITCase
new d0a390f [docs] Fix netcat arguments in Setup quickstart
new 0f8d76c [FLINK-3327] ExecutionConfig to JobGraph
new acb051d [tests] Fix unstable test WebFrontendITCase
new 2e78a36 [FLINK-3590] [jdbc] Hide derby log in JDBC tests
new e719eddb [FLINK-3472] [jdbc] Give a better exception if jdbc column has a null value
new 4870fd6 [FLINK-3467] [runtime] Remove superfluous objects from DataSourceTask.invoke
new 48151b1 [hotfix] [docs] Remove unnecessary whitespace in start-local.sh command
new 09d1fc4 [FLINK-3333] [docs] Improve documentation of DataSet object-reuse modes.
new c0d5ba3 [FLINK-3583] User configuration visible in webdashboard when job is runnnig
new 4f11b40 [FLINK-2523] Make the task cancellation interval configurable
new 543c049 [FLINK-3272] [Gelly] Generic value in Connected Components
new 40d5205 [FLINK-3621] [docs] Improve documentation of memory configuration parameters
new 33f4311 [FLINK-3620] [streaming] Remove DbStateBackend
new e70d49e [FLINK-1964] Reimplement TwitterSource
new d8dcfac [hotfix][docs] fs.hdfs.hadoopconf typo
new edafb3e [hotfix][examples] Add zookeeper.connect to usage line
new f866de6 [FLINK-3629] Fix quick start description for the ".timeWindow()" function call
new d107105 [hotfix] [docs] Fix typo 'seperate'
new f42f4da [hotfix] Fix typo 'JobManger'
new 6968d07 [hotfix] [docs] Fix broken link for time.htm, changed to event_time.html
new 9381c43 [FLINK-3223] Translate Table API calls to Calcite RelNodes.
new 71a7d20 Renamed Table.scala to table.scala
new d0611b9 [FLINK-3282] add FlinkRelNode interface.
new dee1876 [FLINK-3225] Implemented optimization of Table API queries via Calcite
new 5388d7b [FLINK-3225] Enforce translation to DataSetNodes
new 5b28a50 [FLINK-3226] Add DataSet scan and conversion to DataSet[Row]
new ba27832 [FLINK-3226] Implement a CodeGenerator for an efficient translation to DataSet programs
new b8028db [Flink-3226] Translate logical plan FlinkRels into physical plan DataSetRels.
new 7972426 [FLINK-3226] implement GroupReduce translation; enable tests for supported operations
new 670ec6a [FLINK-3226] implement getUniqueName method in TranslationContext
new f89d303 [FLINK-3226] Translate logical joins to physical
new 7a46bfa [FLINK-3226] Translation from and to POJOs for CodeGenerator
new f05f8fb [FLINK-3226] Casting support for arithmetic operators
new 907a095 [FLINK-3226] Translation of explicit casting
new 674fcc2 [FLINK-3226] Translation of scalar function substring()
new 10d3a31 [FLINK-3508] Add more test cases to verify the rules of logical plan optimization.
new 3e3f076 [FLINK-3463] implement calc translation
new b5d6a56 [FLINK-3226] Improvements for expected types
new 4f6b91e [FLINK-3482] implement union translation - implement custom JoinUnionTransposeRules because Calcite's only match with LogicalUnion
new ab16e3c [FLINK-3502] Add test case. Bug was resolved by a previous commit.
new ad3a636 [FLINK-3537] Fix code gen for disjunctions.
new 8fa4a99 [FLINK-3504] Fix join translation. Equality predicates may only reference fields.
new 805e425 [FLINK-3486] [tableAPI] Fix broken renaming of all fields.
new 7afa755 [FLINK-3498] Implement TRIM, SUBSTRING as reference design for Table API
new 49699f0 [FLINK-3567] Fix selection on grouping. Only grouping keys or aggregates allowed.
new 7cab28d [FLINK-3564] [table] Implement distinct() for Table API
new b211d16 [FLINK-3474]: Enable partial aggregate in Table API -- add new Aggregate interface which support partial aggregate -- implement SUM/COUNT/AVG/MIN/MAX aggregate functions implementation -- sorted-based runtime support
new 2e694c5 [FLINK-3573] [table] Implement more String functions for Table API
new a5d8ae2 [FLINK-3593][tableAPI] Fix failing DistinctITCase
new b1b0e3f [FLINK-3596] DataSet RelNode refactoring
new c7463ea [FLINK-3596] Finalized DataSet RelNode refactoring
new 1646009 [FLINK-3604][tableAPI] Enable and fix ignored tests.
new a779d5c [FLINK-3597][tableAPI] Set relational expressions as DataSet operator names.
new 89d48f5 [FLINK-3603][tableAPI] Enable and fix Table API explain.
new 316932c [FLINK-3574] Implement math functions for Table API
new 63c6dad [FLINK-3489] TableAPI refactoring and cleanup
new 074ea70 [FLINK-3612] remove PageRank Table example
new e430dee [FLINK-3609] [tableAPI] Reorganize selection of optimization rules
new 2c62546 [hotFix] [tableAPI] Improve naming of DataSetRelNodes
new da4431d [FLINK-3503] [tableAPI] Add cost model for DataSet RelNodes to improve plan selection.
new b9f1ff0 [docs][tableAPI] update TableAPI docs
new 29fb3d2 [tableAPI] Cleaned up tests
new 3b76ffc [FLINK-3622] [tableAPI] Improve execeptions for invalid joins
new 59d2437 [tableAPI] fix JoinITCase non-equality tests
new f09d68a [FLINK-3636] Add ThrottledIterator to WindowJoin jar
new 6078923 [hotfix] Fix ContinuousProcessingTimeTrigger
new 35892ed [hotfix][Kafka 0.9] Avoid committing offsets to closed consumer
new c5ffb5d [FLINK-3207] [gelly] add pregel iteration abstraction to gelly
new 77eb4f0 [FLINK-3207] [gelly] add a pregel SSSP example with combiner
new cc1a797 [FLINK-3207] [gelly] add compiler and translation tests
new 048cda7 [FLINK-3207] [gelly] add pregel methods to gelly-scala
new 34a4268 [hotfix] [docs] Update python.md
new ede7fdc Add JavaDoc to StreamTask.checkTimerException to clarify what it does
new 9c8747d [FLINK-3645] [tests] Force HDFSCopyUtilitiesTest to use local file system
new 77c867a [FLINK-3611] [docs] Correct link in CONTRIBUTING.md
new 7785288 [FLINK-3602] Fix TypeExtractor and add support for recursive types
new 22d327f [FLINK-3631] [tableAPI] Check type compatibility for comparison expressions in CodeGenerator
new 76da442 [FLINK-3179] [dataSet][optimizer] Log a WARN message if combiner is not added in front of PartitionOperator
new f7a3c81 FLINK-3115: Update ElasticSearch connector to 2.x
new 8e4a001 [FLINK-2445] Add tests for HadoopOutputFormats
new bcb34dd [FLINK-2445] Improve HadoopOutputFormatTests
new a6c3778 [FLINK-2444] Add tests for HadoopInputFormats
new b8299bf [FLINK-2997] [dataSet] Add support for range partitioning with custom data distribution.
new 27dfd86 [FLINK-3653] [docs] Add recovery.zookeeper.storageDir docs to config page
new f0b6ba4 [FLINK-3663] [kafka] Fix logPartitionInfo log statement
new c77e5ec [FLINK-3658][Kafka] Allow producing into multiple topics
new 5108f68 [FLINK-2935] [scala-shell] Allow Scala shell to connect Flink cluster on YARN
new 2da562b [FLINK-3639] add methods for registering datasets and tables in the TableEnvironment
new b21e63c [hotfix] [docs] Fix a couple of typos in YARN documentation
new 92ff2b1 [FLINK-3544][runtime] introduce ResourceManager component
new 4405235 [FLINK-3545][yarn] integrate ResourceManager support
new f773fe0 [FLINK-3547] add support for DataStreamTable
new 2e4498b [FLINK-3676][docs] sync docs with the WebClient removal
new 580a177 [FLINK-3651] Fix faulty RollingSink Restore
new f08b7c9 [hotfix] [cep] Add sanity check for erroneously pruned elements
new 833339f [FLINK-3681] [cep, typeextractor] Generalize TypeExtractor to support more lambdas
new bdf55b9 [FLINK-3682] [cep] Assign processing timestamp in CEP operators
new e3759a5 [FLINK-3684] [cep] Add proper watermark emission to CEP operators
new baf9678 [hotfix] [docs] Update CEP documentation
new 82b5824 [FLINK-3678] [dist, docs] Make Flink logs directory configurable
new 0331882 [FLINK-3633] Fix user code de/serialization in ExecutionConfig
new 9aa207c [docs] Add "concepts" documentation page
new c2f2122 [FLINK-3689] fix shutdown of JM when RM is not available
new 4584d32 [docs] Add top links and sub headings to Concepts
new f7d48cd [docs] Add top-nav link to concepts
new 8e8438f [docs] Rename Guides->Concepts to API Concepts
new a6a53a4 [docs] Move quickstart top nav link
new 81fa9ad [FLINK-3635] [connectors] Potential null deference in TwitterExample#SelectEnglishAndTokenizeFlatMap#flatMap
new 0dbe05d [FLINK-3638][docs] fix default task manager port
new 93d9384 [hotfix][examples] Remove System.exit() from Kafka example
new c759584 [FLINK-3524] [kafka] Add JSONDeserializationSchema
new 21480e2 [FLINK-3571] [tests] Add debug output to SavepointITCase
new 9e7c664 [FLINK-3693] [tests] Wait for task manager to register before submitting job
new 76968c6 [hotfix] Fix some typos in "concepts" doc
new 138dc8f [FLINK-3619] [runtime] Increase timeout in SavepointCoordinatorTest
new 8976bf1 [docs] Remove JS from concepts page
new 3465580 [FLINK-3595] [runtime] Eagerly destroy buffer pools on cancelling
new 5cb84f1 [FLINK-1159] [Scala API] Add API extension to support case-style anonymous functions
new 6593e48 [hotfix] Updates the AssignerWithPunctuatedWatermarks and the AssignerWithPeriodicWatermarks javadocs
new 641a0d4 [FLINK-3623] [runtime] Adjust MurmurHash Algorithm
new b1e5086 [hotfix] [core] Improve error messages of the Java Closure Cleaner
new 505512d [FLINK-3614] Remove Non-Keyed Window Operator
new 6cd8ceb [FLINK-3174] Add MergingWindowAssigner and SessionWindows
new 02a3dfd [FLINK-3283] Improve Kafka test stability
new 051fa2b [docs] Add separate AWS setup page
new 13c53f2 [docs] Remove obsolete Flink on Tez figures
new b04d51a [docs] Fix broken links in Concepts
new 5a60ae4 [docs] Add missing license to new page
new 142912b [FLINK-3689] do not shutdown test ActorSystem
new 24f89b7 FLINK-3529 Add template for pull requests
new b3186b6 [FLINK-3637] Refactored output stream handling from RollingSink.
new db8c5cc [docs] Add back pressure monitoring page
new d7948fa [FLINK-2522] Streaming support for Flink-Scala-Shell
new 593463b [FLINK-2522] improve welcome message of Scala shell for streaming
new 02ef68f [FLINK-3523] [Storm-Compatibility] Added SplitStreamMapper to program to get rid of SplitStreamType wrapper - additionally reworked split ITCases * unified to single test * make Windows compatible (using tmp files) * added test case for embedded splitting
new a341502 [hotfix] Fix EvictingWindowOperator to work with MergingWindowAssigner
new e5b93da [FLINK-3711][docs] Documentation of Scala fold()() uses correct syntax
new 3fe53d3 [FLINK-3654] Disable Write-Ahead-Log in RocksDB State
new 9f52422 [FLINK-3697] Properly access type information for nested POJO key selection
new a234719 [FLINK-3688] WindowOperator.trigger() does not emit Watermark anymore
new b368cb2 [FLINK-3712] Make all dynamic properties available to the CLI frontend
new ed1e52a [FLINK-3640] Add support for SQL in DataSet programs
new 76f95f7 [FLINK-3634] [docs] Fix documentation for DataSetUtils.zipWithUniqueId()
new e16ca84 [FLINK-3469] [docs] Improve documentation for grouping keys
new 9e05439 [FLINK-3579] Improve String concatenation in the Table API
new ef7f9ac [FLINK-3640] [docs] extend the Table API docs and add a section about embedded SQL mode
new 2e63d1a [FLINK-3492] Configurable interval between Checkpoints
new 24817c8 [FLINK-3731] make embedded SQL outer joins fail during translation
new 427de66 [hotfix] Minor edits to comments in code
new ba46ab6 [FLINK-3736] [tableAPI] Move toRexNode logic into each expression's implementation.
new f315c57 [FLINK-3721] Min and max accumulators
new 272fd12 [FLINK-3700] [build] Add 'findbugs' (javax.annotation) annotations as a core dependency.
new 885d543 [FLINK-3700] [core] Add 'Preconditions' utility class.
new 0ac1549 [FLINK-3375] [kafka connector] Add per-Kafka-partition watermark generation to the FlinkKafkaConsumer
new 3c93103 [FLINK-3375] [kafka connector] Rework/simplify Kafka Connector and have a WatermarkExtractor object per partition
new af79988 [FLINK-3716] [kafka consumer] Decreasing socket timeout so testFailOnNoBroker() will pass before JUnit timeout
new d20eda1 [hotfix] [kafka consumer] Increase Kafka test stability by validating written data before consuming
new 693d5ab [FLINK-3541] [Kafka Connector] Clean up workaround in FlinkKafkaConsumer09
new 6bb085e [FLINK-3444] [APIs] Add fromElements method with based class type to avoid the exception.
new b188637 [FLINK-3644] [web monitor] Add new config option to set web monitor tmp dir
new 342db48 [FLINK-3737] [tests] Adding comment about SOCKS proxy server for WikipediaEditsSourceTest
new db85f38 [FLINK-3126] [core] Remove accumulator type from "value" in web frontend
new db6528b [FLINK-3730] Fix RocksDB Local Directory Initialization
new 8e036c3 [FLINK-3735] Make DataSetUnionRule match only for union-all
new e7d78e6 [hotfix] [storm] Add proper exception forwarding to FlinkTopology.copyObject
new 6c06168 [hotfix] [tests] Add cross transformation to OverwriteObjects manual test
new 5350bc4 [FLINK-3589] Allow setting Operator parallelism to default value
new b0a7a1b [FLINK-2909] [gelly] Graph Generators
new 2728f92 [hotfix] [kafka consumer] Increase Kafka test stability
new 8570b6d [FLINK-3745] [runtime] Fix early stopping of stream sources
new e40e29d [FLINK-3747] Consolidate TimestampAssigner Methods in Kafka Consumer
new 2dcd27f [FLINK-3375] [Kafka Connector] Add tests for per-kafka-partition watermarks.
new 1a34f21 [FLINK-3743] upgrading breeze from 0.11.2 to 0.12
new 494212b [FLINK-3760] Fix StateDescriptor.readObject
new 50d8797 [FLINK-3739] [table] Add a null literal to Table API
new 1b93b32 [hotfix] Make initial currentWatermark==Long.MIN_VALUE everywhere
new 760a0d9 [FLINK-3700] [core] Remove Guava dependency from flink-core
new 1acd844 [FLINK-3738] [table] Refactor TableEnvironments. Remove Translators and TranslationContext.
new 722155a [FLINK-3759] [table] Throw exception if NULL literal is encountered in non-null mode.
new f3d3a44 [FLINK-3732] [core] Fix potential null deference in ExecutionConfig#equals()
new dc78a74 [FLINK-3762] [core] Enable Kryo reference tracking
new d938c5f [FLINK-2544] [docs] Add Java 8 version for building PowerMock tests to docs
new 5f993c6 [FLINK-3657] [dataSet] Change access of DataSetUtils.countElements() to 'public'
new 6d53bbc [FLINK-2732] Display TM logs in Dashboard
new fabc5f9 [FLINK-3773] Scanners are left unclosed in SqlExplainTest
new 7eb5877 [FLINK-3664] Create DataSetUtils method to easily summarize a DataSet of Tuples
new 367687d [FLINK-3587] Bump Calcite version to 1.7.0
new 85fcfc4 [FLINK-3770] [gelly] Fix TriangleEnumerator performance
new 4be297e [FLINK-3748] [table] Add CASE function to Table API
new 716d832 [FLINK-3764] [tests] Improve LeaderChangeStateCleanupTest stability
new 7462a5b [hotfix] [cep] Make cep window border treatment consistent
new 409c346 [FLINK-3230] Add producer for Amazon Kinesis Streams into Flink
new 77f1a2e [docs] Update AWS S3 docs
new c33325e [FLINK-3718] Add Option For Completely Async Backup in RocksDB State Backend
new d8fb230 [FLINK-3665] [dataSet] Add support for sort orders in range partitioning.
new 605b6d8 [FLINK-2998] [dataSet] Add support for explicit range partitioning for joins and coGroup.
new a43bade [FLINK-3781] Ensure BlobClient is closed.
new d636bf7 [FLINK-3798] [streaming] Clean up RocksDB backend field/method access
new d45cb69 [FLINK-3790] [streaming] Use proper hadoop config in rolling sink
new 7478cba [hotfix] [FLINK-3798] Make RocksDB state classes also public
new 51ff4a0 [FLINK-3727] Add support for embedded streaming SQL (projection, filter, union)
new 4b06b01 [FLINK-3794] Add checks for unsupported operations in streaming table API
new 3574834 [hotfix] [zk] Add logging for connection state changes in ZooKeeperLeaderElection/RetrievalService
new 0088885 [hotfix] [core] Standardize min and max accumulators
new e48a5f1 [hotfix] [java] Allow setting DataSink parallelism to default value
new f2f5bd5 [FLINK-3740] Make Session Window State Checkpointed
new 44c2d2f [FLINK-3560] [examples] Remove unchecked output of usage statement in examples
new 3f4e2f8 This closes #1925
new 0ee7c79 [FLINK-3774] [shell] Forwards Flink configuration to PlanExecutor
new 7498d3e [FLINK-3778] [shell] Forward configuration from FlinkILoop to ScalaShellRemoteStreamEnvironment
new 8305c17 [hotfix] [tableAPI] Fix DataStreamScanRule, fix indention, improve class names.
new 8330539 [FLINK-3803] [runtime] Pass CheckpointStatsTracker to ExecutionGraph
new 7abf8ef [FLINK-3775] [shell] Load Flink configuration before forwarding it
new 0cf0410 [FLINK-3756] [state] Add state hierarchy to CheckpointCoordinator
new 172fcfa [FLINK-3811] [tableAPI] Use only Java ExecutionEnvironments in TableEnvironments
new 55a88a4 [FLINK-3810] Add missing breaks in ZKElectionService
new 4a69f72 [FLINK-3809] Add missing breaks in ZKRetrievalService
new a58cd80 [Doc] added note to fix Eclipse build
new 06bf4bf [FLINK-3799] [gelly] Graph checksum should execute single job
new 879bb1b [hotfix] Disable WAL in RocksDB state "clear"
new ac2137c [FLINK-3777] Add openIF/closeIF methods to IF lifecycle
new e293e68 [FLINK-3804][docs] Fix YARN and Kafka docs
new 1ccc798 [hotfix] OptionSerializer.duplicate to respect stateful element serializer
new 2bd6212 [hotfix] [build] Replace maven-scala-plugin with newer scala-maven-plugin
new e29ac03 [FLINK-3708] [cep] Add Scala CEP API
new 28c57c3 [FLINK-3800] [jobmanager] Terminate ExecutionGraphs properly
new e6cc862 [hotfix] [scala-cep] Remove unnecessary testing dependency
new 9ea4159 [FLINK-3817] Remove unused guava dependency from RocksDb backend
new 91a956e [FLINK-3819] Replace Guava Preconditions usage in flink-gelly-scala
new 6ef08cf [FLINK-3818] Remove Guava dependency from flink-gelly-examples
new eed6f0f [FLINK-3815] Replace Guava Preconditions usage in flink-gelly
new 445d5e3 [FLINK-3815] Replace Guava Preconditions usage in flink-clients
new 16059ea [FLINK-3086] [table] ExpressionParser does not support concatenation of suffix operations
new 8ad264d [hotfix] minor: make type explicit to allow Scala test to compile in Eclipse
new 7ec1300 [FLINK-3824] ResourceManager may repeatedly connect to outdated JobManager
new 130a22d [FLINK-3601] increase timeout for JobManagerTest methods
new 80b09eae [FLINK-3835] [optimizer] Add input id to JSON plan to resolve ambiguous input names.
new 4f5dbc2 [FLINK-2828] [tableAPI] Add TableSource interfaces for external tables.
new a1968f0 [FLINK-3840] Remove Testing Files in RocksDB Backend
new 6225aa6 [FLINK-3428] Adds a fixed time trailing watermark extractor.
new c81151e [FLINK-3428] Minor fixes
new a5ad7d9 [FLINK-2946] Add support for orderBy() to batch Table API and SQL.
new 204ccc5 [FLINK-3846] [gelly] Graph.removeEdges also removes duplicate edges
new b48d2ca [FLINK-3853] [gelly] Reduce object creation in Gelly utility mappers
new 290a566 [FLINK-3847] Restructure flink-table test packages.
new b3231ac [FLINK-3786] [core] [api-extending] Add BigDecimal and BigInteger as Basic types
new 8be1a02 [docs] Replace Markdown in HTML with HTML
new a0f5397 [FLINK-3837] [table] Create FLOOR/CEIL function
new 08e4bf9 [FLINK-3771] [gelly] Methods for translating Graphs
new 9c7a659 [FLINK-3845] [gelly] Gelly allows duplicate vertices in Graph.addVertices
new 47faa90 [FLINK-3793][docs] re-organize table API and SQL docs
new e7586c3 [FLINK-3669] Timer coalescing across keys and cleanup of unused trigger tasks
new af20655 [FLINK-3860] [connector-wikiedits] Add retry loop to WikipediaEditsSourceTest
new 97470aa [FLINK-3825] [cep, doc] Documentation for CEP Scala API.
new 9d6194f [FLINK-3825] [cep, doc] Make Scala code examples less verbose
new 8ec47f1 [FLINK-3876] improve documentation of Scala Shell
new 13bce31 [FLINK-1996] [tableApi] Add TableSink interface to emit tables to external storage.
new f186446 [FLINK-3519] [core] Add warning about subclasses to Tuple JavaDocs.
new 70978f5 [FLINK-1827] [tests] Move test classes in test folders and fix scope of test dependencies.
new 5c4cb45 [FLINK-3691] [avro] Extend AvroInputFormat to support Avro GenericRecord
new e97f4e6 [docs] Document difference between 'stop' and 'cancel'
new 17953d2 [docs] Add note about S3AFileSystem 'buffer.dir' property
new afd0f16 [FLINK-3881] [docs] Java 8 Documetation Sample Correction
new a522c7a [docs] Adjust network buffer config for slots and add tl;dr
new 70181b2 [FLINK-3772] [gelly] Graph algorithms for vertex and edge degree
new a27208d [FLINK-3877] [gelly] Create TranslateFunction interface for Graph translators
new 9fccd6e [FLINK-3880] remove mutex for user accumulators hash map
new 05c765e [FLINK-3155] Update Flink Dockerfile
new 15f5211 [FLINK-3821] [dataSet] Remove Guava usage in flink-java non-test files.
new 7ed0793 [hotfix] [tableAPI] Fix SQL queries on TableSources.
new 08e8054 [FLINK-3842] [tableApi] Fix handling null record/row in generated code
new 43bd6f6 [FLINK-3882] [docs] Fix errors in sample Java code for the Elasticsearch2 sink
new bbd02d2 [FLINK-3856] [core] [api-extending] Create types for java.sql.Date/Time/Timestamp
new 780c7f3 [FLINK-3855] Upgrade and unify to Jackson 2.7.4
new 3c90d36 [FLINK-3878] Fix support multiple identical temp directories in FileCache
new 099fdfa [FLINK-3776] Flink Scala shell does not allow to set configuration for local execution
new 48b469a [FLINK-3701] enable reuse of ExecutionConfig
new 96b353d [FLINK-3856] adapt test assertion to type stack changes
new a9fc71d [FLINK-3912] [docs] Fix errors in Batch Scala API Documentation, Join section
new c71675f [FLINK-3768] [gelly] Local Clustering Coefficient
new bd1c245 [FLINK-3488] [tests] Fix flakey test Kafka08ITCase.testBigRecordJob
new 6c0c0a5 [FLINK-3782] [tests] Properly close streams in CollectionInputFormatTest
new 3080ea4 [FLINK-3852] [quickstart] Add skeleton StreamingJob
new 91a845d [FLINK-3826] [tests] Fix test condition in StreamCheckpointingITCase
new 1e9fff4 [hotfix] [kafka tests] Build a flink-connector-kafka-0.9 test-jar
new 4fbd8eb [FLINK-3913] [docs] Clean up spelling mistakes.
new f2e6057 [FLINK-3900] [tableAPI] Set nullCheck=true as default in TableConfig.
new f0d543f [FLINK-3754] [tableAPI] Add validation phase to Table API before construction of RelNodes.
new 8673cee [FLINK-3229] Initial working version for FlinkKinesisConsumer.
new fd3dba6 [FLINK-3229] Shade Google Protobuf into Kinesis connector to avoid runtime version conflict
new f916ef4 [FLINK-3926] [core] Fix NumberFormatException in TupleTypeInfo.getFieldIndex()
new a24df98 [FLINK-3914] [runtime] Fix race when attempting to create temp dir in BlobUtils.
new 09b428b [FLINK-3750] [jdbcConnector] Refactor JdbcInputFormat and JdbcOutputFormat.
new 960f4ac [hotfix] [tableAPI] Adapt tests to changed null-value support default
new 3d6ce29 [FLINK-3934] [tableAPI] Check for equi-join predicates before translation.
new 853a535 [FLINK-3935] [optimizer] Fix check of key fields and ordering in PartitionNode.
new 996ad4e [hotfix] [docs] Remove misleading sentence from DataSet.union() description.
new 010265b [script] Simple fix of typo from JobManager to TaskManager in taskmanager.sh file
new 92e1c82 [FLINK-3933] [streaming API] Add AbstractDeserializationSchema that handles produced type extraction.
new 5dfb8a0 [FLINK-3892] ConnectionUtils may die with NullPointerException
new 9b8de6a [FLINK-3893] improve LeaderChangeStateCleanupTest stability
new 38698c0 [FLINK-3909] replace Maven Failsafe with Surefire
new 9a4fdd5 [FLINK-3938] re-enable Yarn tests
new 7237669 [FLINK-3928] [gelly] Potential overflow due to 32-bit int arithmetic
new 8ed3685 [FLINK-3780] [gelly] Jaccard Index
new 003ce18 [FLINK-1502] [core] Add basic metric system
new 707606a [FLINK-1502] [core] Various improvements to the metrics infrastructure code
new 017106e [FLINK-3927][yarn] make container id consistent across Hadoop versions
new 5fdf39b [FLINK-3953][maven] rename unit-tests execution to default-test
new 173d24d [FLINK-3939] [tableAPI] Prevent translation of unsupported distinct aggregates and grouping sets.
new 905ac6e [hotfix] [tableAPI] Throw helpful exception for unsupported ORDER BY features.
new 53949d1 [hotfix] [tableAPI] Throw helpful exception for unsupported outer joins.
new 9cc6296 [FLINK-3632] [tableAPI] Clean up TableAPI exceptions.
new 885fbaf [docs] Fix outdated default value for akka.ask.timeout
new 343d05a [hotfix] [tableAPI] Moved tests to correct package.
new 829c75c [FLINK-3955] [tableAPI] Rename Table.toSink() to Table.writeToSink().
new 78f5511 [FLINK-3728] [tableAPI] Improve error message and documentation for unsupported SQL features.
new 98a9395 [FLINK-3960] ignore EventTimeWindowCheckpointingITCase for now
new cbee4ef [FLINK-3963] Removed shaded import
new 5b98724 [FLINK-3963] AbstractReporter uses wrong ConcurrentHashMap
new af0f418 [FLINK-3586] Fix potential overflow of Long AVG aggregation.
new ec38a21 [FLINK-2044] [gelly] Implementation of HITS algorithm.
new 5784f39 [FLINK-3936] [tableAPI] Add MIN/MAX aggregation for Boolean.
new ef5832d [FLINK-3941] [tableAPI] Add support for UNION to Table API.
new 5a7f4e3 [hotfix] Remove leftover config key constant from ExecutionConfig
new bf256c7 [hotfix] Fix access to temp file directories in SpillingAdaptiveSpanningRecordDeserializer
new 573a92f [FLINK-3962] [core] Properly initialize I/O Metric Group
new cbc5f83 [Flink-2971] [tableAPI] Add outer joins to the Table API and SQL.
new 6c07936 [FLINK-3129] Bring infrastructure for ensuring interface stability in place
new b0acd97 [FLINK-3129] Fix breaking changes in flink-core
new 08eca76 [FLINK-3129] Fix ES2 issue
new 4d41bd8 [FLINK-3972] subclasses of ResourceID may not to be serializable
new fc6dc48 [FLINK-3923] [connector-kinesis] Unify configuration conventions of the Kinesis producer to the same as the consumer
new 23d1cba [FLINK-3923] Minor cleanups and enhancements
new 254054f [hotfix] Fix doc link to "Working with Time"
new 9328006 [FLINK-3981] don't log duplicate TaskManager registrations
new 1212b6d [FLINK-3982] let only ResourceManager of leading JobManager register
new 858ca14 [FLINK-1745] [ml] Add exact k-nearest-neighbor join
new 4a5af42 [FLINK-1745] [ml] Use QuadTree to speed up exact k-nearest-neighbor join
new 035f629 [FLINK-1745] [ml] Adjust k-nearest-neighbor-join code formatting
new 77afe28 [FLINK-2829] [runtime] Clarify error message when Flink cannot deploy task to slot
new d3e3bd5 [hotfix] [contrib] Fix robustness of DataStreamUtils stream collecting
new 7ad8375 [FLINK-1502] [core] Cleanups, robustness, and performance improvements in the metrics system
new 6511557 [FLINK-1502] [core] Temporarily set no default metrics reporter (instead of JMX)
new da23ee3 [hotfix] [yarn tests] Fix deadlock between YARN Session CLI tests and Surefire
new c60326f [FLINK-2673] [core] Add a comparator for Scala Option type
new aec8b5a [FLINK-3887] improve dependency management for building docs
new 43ad1a2 [docs] Add notes about shipped log4j properties files
new 546b64f [FLINK-3975] [docs] Override baseurl when serving docs locally
new 8a6bdf4 [FLINK-3887] fix quoting issue with bundler command
new bcf5f46 [FLINK-3607] decrease default forkCount for tests
new 6db9e6a [FLINK-3886] [clients] Give a better error when the application Main class is not public.
new 5b02879 [FLINK-3978] [core] Add hasBroadcastVariable method to RuntimeContext
new ad52a5f [FLINK-3979] [docs] Add import statements for last code sample in the quickstart docs.
new b849da1 [hotfix] [tests] Minor style fix in FlinkTestBase
new aedc0fd [FLINK-3994] [ml, tests] Fix flaky KNN integration tests
new bce068c [hotfix] [runtime] Disable restart suppression on cancelAndClearEverything
new b201f86 [FLINK-3993] [py] Add Environment.generateSequence()
new 36ad78c [FLINK-3806] [gelly] Revert use of DataSet.count()
new 65545c2 [FLINK-3945] [gelly] Degree annotation for directed graphs
new ccc3e44 [hotfix] [core] Fix scope format keys for metrics
new cfffdc8 Revert "[FLINK-3960] ignore EventTimeWindowCheckpointingITCase for now"
new 61d69a2 [FLINK-3948] Protect RocksDB cleanup by cleanup lock
new 9c561fb [FLINK-4026] Fix code, grammar, and link issues in the Streaming documentation
new 2145497 [FLINK-3980] [core] Remove ExecutionConfig.PARALLELISM_UNKNOWN
new a611271 [FLINK-3925] [gelly] GraphAlgorithm to filter by maximum degree
new 7160a68 [FLINK-4013] [gelly] GraphAlgorithms to simplify directed and undirected graphs
new 8da1a75 [FLINK-3906] [gelly] Global Clustering Coefficient
new 1bbc1fb [FLINK-4003] [core] Use intrinsics for MathUtils logarithms
new ea64921 [FLINK-4025] RMQ Streaming: Possibility to customize queue
new 65ee28c [FLINK-4011] Keep UserCodeClassLoader in archived ExecutionGraphs
new ae679bb [FLINK-4000] [RabbitMQ] Fix for checkpoint state restore at MessageAcknowledgingSourceBase
new 6afb2b0 [FLINK-4000] [RabbitMQ] Style cleanups in MessageAcknowledgingSourceBase
new 38362c4 [FLINK-3405] [nifi] Extend NiFiSource with interface StoppableFunction
new b08b64a [hotfix] [nifi] Minor style cleanups in NiFi source
new e1b55f0 [FLINK-3922] [core] Fix case of infinite recursion in TypeExtractor
new 297d75c [FLINK-2832] [tests] Hardens RandomSamplerTest
new fce64e1 [FLINK-4031] include sources in Maven snapshot deployment
new 042ad7b [hotfix] Fix JSONDeserializationSchema for Kafka
new b5e2e36 [hotfix] Improve ParameterTool exception
new c532638 [FLINK-3854] Support Avro key-value rolling sink writer
new 776253c [hotfix] [streaming-java] Harden IterateTest
new 86a8033 [FLINK-3763] RabbitMQ Source/Sink standardize connection parameters
new 6cc1c17 [FLINK-3763] Some RMQ cleanups
new ccc86e9 [FLINK-3530] Fix Kafka08 instability: Avoid restarts from SuccessException
new d760bbc [hotfix] [core] Re-enable JMX metrics as the default.
new 8696e79 [FLINK-4052] [runtime] Improve test stability for ConnectionUtilsTest
new e90ea9c [hotfix] [py] Fix PythonPlanBinder not copying additional files
new 76dcbd4 [FLINK-4002] [py] Improve testing infrastructure
new 393bceb [FLINK-4049] Mark (open/close)IF() @PublicEvolving
new 2bffd7b [hotfix] [core] Make sure Dropwizard reporters do not block operator creation/teardown while reporting
new 85793a2 [FLINK-3944] [tableAPI] Add rewrite rules to reorder Cartesian products and joins.
new e0b9e8d [revert] [FLINK-3944] [tableAPI] Reverts "Add rewrite rules to reorder Cartesian products and joins."
new fdf4360 [FLINK-3971] [tableAPI] Fix handling of null values in aggregations.
new bc19486 [FLINK-3896] Allow a StreamTask to be Externally Cancelled
new d353895 [FLINK-2314] Make Streaming File Sources Persistent
new 8227b0f [FLINK-3323] [docs] Add documentation for NiFi connector.
new c8fed99 [FLINK-4030] Revert Surefire version to 2.18.1
new 279777f [FLINK-3969] Log Exceptions by Invokable
new c4bbed9 [FLINK-4032] Replace all usage of Guava Preconditions
new 867be9b [FLINK-4028] Create correct TimeWindow in AbstractAlignedProcessingTimeWindowOperator
new d874797 [FLINK-3908] [core] Fix resetting of FieldParser error state.
new fe0eb60 [FLINK-4024] [streaming] Fix InputFormat lifecycle in FileSourceFunction.
new 1049585 [FLINK-4063] Add Metrics Support for Triggers
new c78b3c4 [FLINK-3949] Collect Metrics in Runtime Operators
new 57ef6c3 [FLINK-3317] [cep] Introduce timeout handler to CEP operator
new a28a2d0 [FLINK-3332] Add Exactly-Once Cassandra connector
new 5930622 [FLINK-3311] Add At-Least-Once Cassandra connector
new b63e19b [FLINK-3332] Address pull request review comments
new 7cc6943 [FLINK-3650] [dataSet] Add maxBy/minBy to Scala DataSet API
new 298c009 [FLINK-3649] [docs] Add documentation for DataSet minBy / maxBy.
new efc344a [FLINK-4077] [tableAPI] Register Pojo DataSet/DataStream as Table with field references.
new f9b52a3 [FLINK-3667] refactor client communication classes
new 9e98424 [FLINK-3863] Yarn Cluster shutdown may fail if leader changed recently
new 875d4d2 [FLINK-3937] implement -yid option to Flink CLI
new f4ac852 [FLINK-3937] programmatic resuming of clusters
new ec6d975 [FLINK-4079] YARN properties file used for per-job cluster
new fc4abd7 [FLINK-4075] ContinuousFileProcessingCheckpointITCase failed on Travis
new 07a7b73 [FLINK-4056] [tests] Harden SavepointITCase
new 4d8cbec [FLINK-4009][tests] fix Scala Shell external library tests for IntelliJ
new 1a6bab3e [FLINK-2733] [tests] Harden ZooKeeperLeaderElectionTest
new bce3550 [FLINK-2259] [ml] Add Splitter for train, validation and test data set generation
new 18744b2 [FLINK-3977] [dataStream] InternalWindowFunctions implement OutputTypeConfigurable.
new 5a0c268 [FLINK-3949] [metrics] Add numSplitsProcessed counter metric.
new ba62df1 [FLINK-3641] Add documentation for DataSet distributed cache.
new 6a1144e [FLINK-4083] [dataSet] Introduce closure cleaning in Join.where() and equaltTo()
new 78d3c61 [FLINK-4078] [dataSet] Introduce closure cleaning in CoGroup.where() and equaltTo()
new e6320a4 [FLINK-4089][yarn] fix null check in Yarn client
new f2e9c52 [FLINK-4090] Close of OutputStream should be in finally clause
new 34a8b03 [FLINK-3714] Add Support for "Allowed Lateness"
new 0104a92 [FLINK-3714] Remove Unneccesary Timer in EventTimeTrigger
new 62c5a3c [FLINK-3714] Rename getCleanupTimeForWindow to cleanupTime in WindowOperator
new 87195a8 [FLINK-3714] Extend comments in WindowOperatorTest
new 09e2810 [hotfix] Remove "initialTime" in WindowOperatorTest
new d2d37cd [FLINK-4012] [docs] Fix link to Iterations in Basic Concepts page
new 56216d5 [hotfix] [docs] Fix link to ResultTypeQueryable
new a4d35d7 [FLINK-3973] [docs] Emphasize Table/SQL links
new bc427d5 [FLINK-4038] [dist] Escape JVM arguments in TaskManager startup script
new bce3a68 [FLINK-4082] Add Setting for enabling/disabling LargeRecordHandler
new 7e206f4 [FLINK-4091] Fix Guava shading in Cassandra connector
new e04239d [FLINK-4092] [py] Fix Stringify function's implicit string type conversion problem
new 93c61c0 [FLINK-3626] [py] Add zipWithIndex()
new e7dfa28 [FLINK-4076] BoltWrapper calls super.dispose()
new a973d84 [FLINK-4097] Fix NullPointerException on CassandraSinkBase and CassandraTupleWriteAheadSink's close()
new 7ec6d7b [FLINK-3752] Add Per-Kafka-Partition Watermark Generation to the docs
new 08b075a [FLINK-3868] [core] Specialized CopyableValue serializers and comparators
new 63504a3 [FLINK-3919] [ml] Implement DistributedRowMatrix
new 3ac080f [FLINK-3872] [table, connector-kafka] Add JsonRowDeserializationSchema
new 479be14 [FLINK-3872] [table, connector-kafka] Add KafkaTableSource
new b6e6b81 [FLINK-4040] [dist] Allow JobManager/TaskManager-specific JVM args
new 37defbb [FLINK-3859] [table] Add BigDecimal/BigInteger support to Table API
new cfe6293 [FLINK-4046] [runtime] Add direct state transition from RESTARTING to FAILED
new 6420c1c [FLINK-3800] [runtime] Introduce SUSPENDED job status
new 3b59363 [FLINK-3667] additional cleanups in YarnClusterClient
new 5b2ad7f [FLINK-1946] reduce verbosity of Yarn cluster setup
new dfecca7 [FLINK-3838] upgrade commons-cli to fix parsing of jar args
new 9c15406 [FLINK-3757] clarify JavaDoc for addAccumulator method
new a5aa4e1 [FLINK-4041] reduce log level for JobManager->ResourceManager timeouts
new d92aeb7 [FLINK-3864][yarn] check for prohibited strings in log output
new d34bdaf [FLINK-3907] [gelly] Directed Clustering Coefficient
new 35b4da2 [FLINK-4121] Add timeunit (ms) to docs for timestamps and watermarks
new 6744b85 [hotfix][docs] Add warning to Cassandra documentation
new 9487fcb [FLINK-4119] Refactor null checks in Cassandra IOF
new 56cdec7 [FLINK-4074] Make metric reporters less blocking
new 19ff8db [hotfix] [metrics] Prevent registration exceptions
new 62cb954 [FLINK-4087] [metrics] Improved JMX port handling
new d43bf8d [FLINK-4093] Expose metric interfaces
new ee3c7a8 [FLINK-3951] Add Histogram metric type
new cb2b76d [FLINK-3974] Fix object reuse with multi-chaining
new 4b5a789 [FLINK-3464] Use Processing-Time Clock in Window Assigners/Triggers
new 819fb27 [FLINK-3647] Change StreamSource to use Processing-Time Clock Service
new 8803d15 Fixing typos in the javadocs.
new 90cfe0a Fix test formatting and move WindowAssignerContext to WindowAssigner
new f9552d8 [FLINK-3898] [gelly] Adamic-Adar Similarity
new a6feea3 [FLINK-4113] [runtime] Always copy first value in ChainedAllReduceDriver
new 76ba2d1 [FLINK-4099] Fix CliFrontendYarnAddressConfigurationTest failures
new 6ec9b0f [hotfix] Remove JavaConversions from TaskManager
new 2028ba5 [cli] print correct help for savepoint command
new 10898a9 [gelly-doc] Correct Scala code example
new 40749dd [FLINK-3277] [gelly] Use Value types in Gelly API
new e64237d [FLINK-3879] [gelly] Native implementation of HITS algorithm
new 6979d06 [FLINK-3580] [table] Reintroduce Date/Time and implement scalar functions for it
new dbe41f4 [FLINK-4126] [tests] Increase timeout for ZooKeeperLeaderElectionTest.testZooKeeperReelection
new fa42cda [FLINK-4080] Guarantee exactly-once for Kinesis consumer for failures in the middle of aggregated records
new 256c9c4 [FLINK-4033] Polish up Kinesis connector documentation
new 123be22 [FLINK-4085][Kinesis] Set Flink-specific user agent
new 53630da [hotfix][metrics] Harden JMXAvailability test
new 5709bf6 [docs] Add transition between Canceling and Failing to job_status.svg
new bd273a8 [FLINK-4075] Fix unstable ContinuousFileProcessingCheckpointITCase
new a9733a9 Revert recent change to WrapperSetupHelperTest
new 6c6b17b Remove polluting log message in ContinuousFileReaderOperator
new 918e5d0 [FLINK-3618] [gelly] Rename abstract UDF classes in Scatter-Gather implementation
new 7324b9c [FLINK-4132] [gelly] Fix boxed comparison in CommunityDetection algorithm
new 913dc8d [FLINK-4128] [build system] Fix directory for git-commit-id-plugin
new a11c1c6 [FLINK-4062] Update Windowing Documentation
new a3a9fd1 [FLINK-456] Basic JM Metric Infrastructure
new fafb981 [FLINK-1550] JM JVM Metrics
new 8829f97 [FLINK-4057] Slots/regTaskManagers/numJobs
new 9e540da [FLINK-4057] Checkpoint Metrics
new 4c4a6f1 [hotfix] Refactor TM Metric instantiation
new 96590ff [FLINK-4122] Disable root shading in Cassandra jar
new 44b3bc4 [FLINK-4139][yarn] adjust task slots to parallelism correctly
new a3aea27 [FLINK-3667] print JobID on submission
new cfd48a6 [FLINK-3667] change log level for JobNotFound to debug
new b674fd5 [FLINK-3937] allow -yid without -m yarn-cluster
new 8d58962 [FLINK-3667] delay connection to JobManager until job execution
new 0e8be41 [FLINK-3964] add hint to job submission timeout exception message
new 0483ba5 [FLINK-3675][yarn] improvements to library shipping
new f36aa6f [hotfix] Fx TestingyYarnJobManager constructor
new 16cdb61 [FLINK-3675][yarn] use classpath paths relative to the application home
new f722b73 [FLINK-4141] remove leaderUpdated() method from ResourceManager
new 7ab6837 [FLINK-4144] Yarn properties file: replace hostname/port with Yarn application id
new 149e7a0 [FLINK-3965] [gelly] Delegating GraphAlgorithm
new 0efa644 [FLINK-4135] [gelly] Replace ChecksumHashCode as GraphAnalytic
new 5ca0640 [hotfix] [runtime] Fix tests for JobManager metrics
new bdfcf10 [hotfix] [clients] Replace test IP with reserved address
new ffaf10d [FLINK-4118] Update docker image to 1.0.3 and remove unneeded deps
new 7206b0e [FLINK-4027] Flush FlinkKafkaProducer on checkpoints
new 7ee0425 [hotfix] Fix NPE in NetworkStackThroughputITCase
new b40cba6 [hotfix] Fix AbstractKeyedCEPPatternOperator.restoreState()
new bf6df12 [FLINK-4109] [tableAPI] Change the name of ternary condition operator 'eval' to '?'
new e34fea5 [FLINK-4134] Retire Late Windows/Elements in WindowOperator
new 429b844 [FLINK-4086] [tableAPI] Hide internal methods of Expressions from Table API.
new 18995c8 Merge branch 'FLINK-4086'
new 647b4c5 [FLINK-4145] Harden JMX tests
new a3d1a17 [FLINK-4115] Skip filesystem checks for filesystems with no built-in support
new 989c67a [FLINK-4115] Remove filesystem initialisation from FsStateBackend constructor
new 5c0c7e3 Change Validation Exception to LOG.warn() in FsStateBackend
new 4b71e0e [FLINK-3995] [build] Properly structure test scopes and dependencies
new b9f42e9 [FLINK-3995] [build] flink-test-utils also contains the streaming test utilities.
new 8a2c03e [FLINK-3995] [build] Fix failing tests and add missing dependencies
new 0c80928 [FLINK-4133] Reflect streaming file source changes in documentation
new 424c082 [FLINK-4146] Fix YARN test failure
new 17dfd68 [FLINK-3231] FlinkKinesisConsumer rework to handle Kinesis resharding
new 49ce6f7 [hotfix] [core][gelly] Fix license formatting
new a13ba7b Add proper web monitor shutdown to standalone mode
new f149938 [FLINK-4151] Split test execution on travis into two groups (The groups being tests starting from A-N and N-Z)
new 6be0a50 Correct typos in Table API docs; update enumeration of supported table sources
new cdd5e4c [FLINK-4137] Tell Akka to shut down the JVM on fatal errors
new 515148f [FLINK-4158] Fix Scala QS StreamingJob import
new aea86ac [hotfix] Quickstart docs respect artifactId
new 1e8c852 [FLINK-4160][yarn] Show input validation errors
new cb78245 [tools] Update copy files function in release script
new 3ab9e36 [FLINK-3034] Redis Sink Connector
new 9fa54cc [hotfix] [streaming-connectors] Fix Kinesis connector test-utils dependency
new 2302f74 [hotfix] [build] Include Kinesis tests in CI builds
new 7fb9417 [FLINK-3648] Introduce Trigger Test Harness
new 230847d [FLINK-4176][kinesis-connector] Remove Java8-specific `Long.hashCode()` method from Kinesis connector
new 0dce038 [hotfix][metrics] Declare all used dependencies
new aaa6c7a [hotfix][metrics] Fix typos
new 815bc83 [FLINK-3942] [tableAPI] Add support for INTERSECT and update document
new 474ec96 [FLINK-4171] [metrics] Replace : chars in StatsD metric names
new 6c5eebb [FLINK-4172] [gelly] Don't proxy a ProxiedObject
new 68277a4 [FLINK-4019][kinesis-connector] Use Kinesis records' approximateArrivalTimestamp
new 221ab8e [FLINK-4116] Metrics documentation
new 9178076 [FLINK-4116][metrics] Move config keys to ConfigConstants
new 8f68762 [FLINK-4096] Ensure JarOutputStream is always closed
new 20aecf0 [hotfix][metrics] Remove leftover comment Registry
new da9a16d [hotfix] fix errors and formatting in NiFi documentation
new 5df0b27 [FLINK-4185] Reflecting rename from Tachyon to Alluxio.
new 9753393 [FLINK-3943] [table] Add support for EXCEPT operator
new 36aad48 [FLINK-4157] Catch Kafka metrics serialization exceptions
new 81cf229 [FLINK-4154] [core] Correction of murmur hash breaks backwards compatibility
new a7274d5 [FLINK-3190] failure rate restart strategy
new 662b458 [FLINK-4191] Expose shard information in kinesis deserialization schema
new f0387ac [FLINK-4018][kinesis-connector] Add configuration for idle time between get requests to Kinesis shards
new 971dcc5 [hotfix][docs] Add note about Kinesis producer limitations
new 1b327f1 [FLINK-3916] [table] Allow generic types passing the Table API
new cc9ee2c [hotfix] [execution graph] Null restart strategy field in ExecutionGraph when archiving
new 508965e [FLINK-4111] [table] Flink Table & SQL doesn't work in very simple example
new 5c2da21 [FLINK-4123] Cassandra sink checks for exceptions in ack phase
new 74b09ce [FLINK-4123] [cassandra] Fix concurrency issue in CassandraTupleWriteAheadSink
new 6b7bb76 [FLINK-4127] Check API compatbility for 1.1 in flink-core
new 435ffd9 [FLINK-4200] [Kafka Connector] Kafka consumers logs the offset from which they restore
new 90658c8 [FLINK-4159] Remove Quickstart exclusions for unused dependencies
new 790a654 [FLINK-4143][metrics] Configurable delimiter
new e9f576c [hotfix] [documentation] Add missing Gem
new 21d6a29 [hotfix] Reuse getMaxJvmHeapMemory() in EnvironmentInformation#getSizeOfFreeHeapMemory()
new d17fe4f [FLINK-4167] [metrics] Make IOMetricGroup register its metrics at the parent metric group
new 565f941 [hotfix] [network] Add DEBUG log messages to intermediate results
new bc3a96f [FLINK-4197] Allow Kinesis endpoint to be overridden via config
new ca5016ce [hotfix][kinesis-connector] Remove duplicate info in KinesisDeserializationSchema
new 52e191a [FLINK-3477] [runtime] Add hash-based combine strategy for ReduceFunction
new 0db804b [FLINK-2246] [runtime] Add ChainedReduceCombineDriver
new cc60ba4 [FLINK-4206][metrics] Remove alphanumeric name restriction
new f1d79f1 [FLINK-4170] Simplify Kinesis connecter config keys to be less overly verbose
new 64aa7c8 [doc] [hotfix] Fix Gelly readCsvFile example
new f8cd9ba [hotfix] [kafka connector] Minor code cleanups in the Kafka Producer
new 2477161 [hotfix] [runtim] Minor code cleanups.
new de6a3d3 [FLINK-4196] [runtime] Remove the 'recoveryTimestamp' from checkpoint restores.
new 91d5c63 [FLINK-4214] [web dashboard] Properly increment the exceptions counter
new 2346468 [FLINK-4216] [docs] Fixed example.
new 273f54ba [FLINK-3666] Remove all remaining Nephele references
new 9a20573 [FLINK-3630] [docs] Little mistake in documentation
new 7f95800 [hotfix] [metrics] Prevent log flooding from collisions
new d08b189 [FLINK-4142][docs] Add warning about YARN HA bug
new 45edafd [licenses] Remove not included dependency from LICENSE
new a0c3b87 [FLINK-4053] Add tests for RMQ sink and check connection for null
new 2218cb4 [FLINK-4017] [py] Add Aggregation support to Python API
new 70094a1 [FLINK-4184] [metrics] Replace invalid characters in ScheduledDropwizardReporter
new 41f5818 [FLINK-4186] Use Flink metrics to report Kafka metrics
new 2837c60 [FLINK-3466] [tests] Add serialization validation for state handles
new e9f660d [FLINK-3466] [runtime] Make state handles cancelable.
new a4c9d66 Replace StreamEvent by StreamRecord in CEP Tests
new ac06146 [FLINK-4149] Fix Serialization of NFA in AbstractKeyedCEPPatternOperator
new 254379b [FLINK-4162] Fix Event Queue Serialization in Abstract(Keyed)CEPPatternOperator
new 3d8d192 Fix Displayed CEP Operator Names
new 7329074 [FLINK-4165] Add warning about equals/hashCode to CEP doc
new 4e6d89c Allow Setting StateBackend in OneInputStreamOperatorTestHarness
new a710fc3 [FLINK-4169] Fix State Handling in CEP
new e1e8c2d [FLINK-4209] Change hostname resolution from IP to name
new a9a75ce [FLINK-4209] Separate build dependencies in the docker image and remove them once it is ready
new 4ffda0f [FLINK-4209] Add debug information of the build steps
new 7d53902 [FLINK-4209] Simplify docker-compose script (volumes are now local)
new bd8d7f5 [FLINK-4209] Remove supervisord dependency for the docker image
new b67e508 [FLINK-3713] [clients, runtime] Use user code class loader when disposing savepoint
new ea13637 [hotfix] correct typo in method name
new ceef8ad [hotfix] fix warning b/c of unspecified exception type
new de8406a [FLINK-4232] Make sure ./bin/flink returns correct pid
new 5758c91 [FLINK-2985] [table] Allow different field names for unionAll() in Table API
new dd53831 [FLINK-4130] [table] CallGenerator could generate illegal code when taking no operands
new e85f787 [FLINK-4183] [table] Move checking for StreamTableEnvironment into validation layer
new 17589d4 [FLINK-4199] fix misleading CLI messages during job submission
new 082d87e [FLINK-4166] [Distributed Coordination] zookeeper namespaces (cli parameter -z)
new 2391683 [hotfix] Fixes broken TopSpeedWindowing scala example
new 130511f [FLINK-4070] [table] Support literals on left side of binary expressions
new 6ab96a7 [FLINK-3729] [table] Several SQL tests fail on Windows OS
new 25b6f22 [FLINK-3956] Make FileInputFormats independent from Configuration
new 19dae21 [FLINK-4229] Do not start any Metrics Reporter by default
new 78af1e9 [FLINK-4230] [DataStreamAPI] Add Session Windowing ITCase
new ccd4fd9 [FLINK-4230] [DataStreamAPI] PR feedback on Session Windowing ITCase
new f81cda3 [FLINK-4237] [runtime] Cancel savepoints on declined snapshots
new d3bc556 [FLINK-4238] Only allow/require query for Tuple Stream in CassandraSink
new 5dd85e2 [FLINK-4202] Add restarting time JM metric
new 73836f7 [FLINK-4229] [metrics] Only start JMX server when port is specified
new b3fa459 [FLINK-4202] [metrics] Update restarting time metric documentation
new 54f02ec [FLINK-4201] [runtime] Forward suspend to checkpoint coordinator
new e2ef74e [FLINK-4213] [gelly] Provide CombineHint in Gelly algorithms
new b71ac35 [FLINK-4217] [gelly] Gelly drivers should read CSV values as strings
new 2818ee0 [hotfix] Prevent CheckpointCommitter from failing job
new 3213016 [FLINK-4150] [runtime] Don't clean up BlobStore on BlobServer shut down
new c5d1d12 [FLINK-3901] [table] Create a RowCsvInputFormat to use as default CSV IF in Table API
new 2f9a28a [FLINK-3901] [table] Convert Java implementation to Scala and fix bugs
new b6f9308 [FLINK-3891] [table] Add a class containing all supported Table API types
new 588830a [FLINK-4244] [docs] Field names for union operator do not have to be equal
new 177168b [FLINK-2125][streaming] Delimiter change from char to string
new 0360fb9 [hotfix] [gelly] Reduce maximum number of generator blocks
new 7e309ee [FLINK-4103] [table] Modify CsvTableSource to implement StreamTableSource
new 110bba3 [FLINK-4103] [table] Add CsvTableSource docs and Java accessibility
new f0ac261 [FLINK-4067] [runtime] Add savepoint headers
new 0b4c04d [FLINK-4239] Set Default Allowed Lateness to Zero and Make Triggers Non-Purging
new e4fe89d [FLINK-4210][metrics] Move close()/isClosed() out of MetricGroup
new e3fec1f [FLINK-4192] [metrics] Move metrics classes out of 'flink-core'
new c6715b7 [travis] remove outdated comment regarding snapshots
new 2648bc1 [FLINK-4152] Allow re-registration of TMs at resource manager
new cd232e6 [FLINK-4261][tools] retry in case of failed snapshot deployment
new 9bcbcf4 [FLINK-4246] Allow Specifying Multiple Metrics Reporters
new 884d3e2 [FLINK-4258] fix potential NPE in SavepointCoordinator
new 12bf7c1 [FLINK-4207] WindowOperator becomes very slow with allowed lateness
new 5eb0e38 [FLINK-3904] enhancements to GlobalConfiguration
new ec4c9be [FLINK-4179] [table] Update TPCHQuery3Table example
new 185b5f6 [FLINK-4179] [table] Additional TPCHQuery3Table example improvements
new 5d7e949 [FLINK-4259] Added statement in FileCache to close the FSDataOutputStream object
new 7359ffe [hotfix] [docu] Add missing tick
new 12dc39e [hotfix] [docu] Fix System Metrics table
new d618b13 [FLINK-4269] [webfrontend] Decrease log level in RuntimeMonitorHandler
new a30ec83 [docs] require at least Ruby 1.9.0 for building
new 6edc7f1 [FLINK-4279] [py] Set flink dependencies to provided
new 3537579 [FLINK-4277] Fix TaskManagerConfigurationTest#testDefaultFsParameterLoading
new 4bfc20a [FLINK-4289] Unset -x flag for .java files
new aed56ae [FLINK-4284] [docu] Fix broken links
new 0f92a6b Revert "[FLINK-4154] [core] Correction of murmur hash breaks backwards compatibility"
new 10642f7 [FLINK-4296] Fixes failure reporting of consumer task scheduling when producer has already finished
new 7ea9c01 [FLINK-4299] show loss of job manager in Client
new 8847955 [hotfix] [docs] Remove obsolete file 'plotPoints.py'
new ba12a75 [FLINK-4285] [docs] Update the setup quickstart guide with the new SocketWindowWordCount example
new 923c6a7 [FLINK-4292] [batch connectors] Fix setup of HCatalog project by adding Scala SDK dependency
new f52d11a [FLINK-4251] [Rabbit MQ] Allow users to override queue setup in order to customize queue config
new cb98256 [hotfix] Remove various '.hidden' files that seem to have been accidentally committed
new 4456453 [hotfix] [build] Update LICENSE file with new URL of simplejmx dependency
new 0ea2596 [FLINK-4298] [storm compatibility] Clean up unnecessary dependencies in 'flink-storm'
new 873d6cd [FLINK-4290] [Cassandra Connector] Skip CassandraConnectorTest on Java 7 builds
new 4b8f288 [cleanup] remove unused code
new 45df1b2 [FLINK-4298] [storm compatibility] Add proper repository for Closure dependencies.
new 123c637 [FLINK-4180] [FLINK-4181] [table] add Batch SQL and Stream SQL and Stream Table API examples
new a1fef27 [FLINK-4180] [FLINK-4181] [table] Ensure examples consistency
new 3f1e8b9 [FLINK-4203] [table] [docs] Improve Table API documentation
new 5d2c465 [hotfix] Fix exception message
new 8775189 [FLINK-4306] [storm compatibility] Fix dependencies in flink-storm and flink-storm-examples
new 36c09b0 [hotfix] [tests] Fix minor test instability in ConnectionUtilsTest
new 31837a7 [hotfix] Fix failing Table API test and checkstyle violation
new d5a06b4 [FLINK-4307] [streaming API] Restore ListState behavior for user-facing ListStates
new 036f4d0 [build] Bump version to 1.2-SNAPSHOT
new 6025157 [build] Bump docs and tools to version 1.2-SNAPSHOT
new 745b393 [FLINK-4161] [build] Add Quickstart exclusion for flink-dist dependencies
new 245f02b [build] Move GitHub specific files to '.github', update release script
new 6590a4c [FLINK-4219] [scripts] Quote PDSH opts in start-cluster.sh
new 0870007 [FLINK-4314] [tests] Fix test instability in JobManagerHAJobGraphRecoveryITCase
new 8d4a64d [FLINK-4308] [web frontend] Add optional config parameter 'jobmanager.web.uploaddir' to specifiy job jar location
new 119364c [FLINK-4094] [core] Add a warning to only use off heap memory with pre-allocation=true
new e629b2e [FLINK-4310] [build] Selectively run API compatibility checks in API projects.
new c7a8554 [FLINK-4297] [yarn] Decode URL encoded fat jar path
new 2a4b222 [hotfix] [tests] Fix minor JavaDoc warnings
new c9b0dad [FLINK-4256] [distributed runtime] Clean up serializability of ExecutionGraph
new 8d25c64 [FLINK-4304] [runtime-web] Jar names that contain whitespace cause problems in web client
new ff77708 [FLINK-3138] [types] Method References are not supported as lambda expressions
new 27232fe [hotfix] Add try-catch around test tearDown
new 6a88377 [hotfix][kinesis] Fix build instructions
new 0e0c40d [FLINK-4226] Typo: Define Keys using Field Expressions example should use window and not reduce
new a2219b0 [FLINK-4276] Fix TextInputFormatTest#testNestedFileRead
new f1e9dae [FLINK-4291] [metrics] Add log entry for scheduled reporters
new 862e7f0 [hotfix] [distributed runtime] Add overflow check for ZooKeeper checkpoint ID counter.
new cd98e85 [FLINK-4329] [distributed runtime] Clean up ScheduleMode
new 3f3bab1 [FLINK-4332] [checkpoints] Fix SavepointV1Serializer read() / readFully()
new 9a84b04 [FLINK-4333] [checkpoints] Clean up naming mixups for SavepointV0 / SavepointV1 / SavepointV01
new 50cf131 [hotfix][build] Fix release script
new 5133c89 [build] disable travis cache
new 46b427f [FLINK-4212] [scripts] Lock PID file when starting daemons
new b5d5893 [FLINK-2090] [core] Truncate 'toString()' of CollectionInputFormat when the collection is huge
new a909adb [FLINK-3779] [runtime] Add getSerializedValue(byte[]) to KvState
new 63c9b8e [FLINK-3779] [runtime] Add KvStateRegistry for queryable KvState
new af07eed [FLINK-3779] [runtime] Add KvState network client and server
new 775a787 [FLINK-3779] [runtime] Add KvStateLocation lookup service
new 329610d [FLINK-3779] [runtime] Add QueryableStateClient
new 490e7eb [FLINK-3779] [streaming-java, streaming-scala] Add QueryableStateStream to KeyedStream
new aed7a28 [FLINK-4337] [build] Remove unnecessary Scala Suffix from Hadoop 1 shaded artifact
new 2ab6d46 [build] [hadoop compatibility] Remove unneeded dependency to 'flink-clients'
new a2f9aab [FLINK-4316] [core] [hadoop compatibility] Make flink-core independent of Hadoop
new 5910af5 [FLINK-4342] [build] Fix dependencies of flink-connector-filesystem
new cd94aad [hotfix] [runtime] Remove unneeded check in KvStateClientTest
new dc50625 [docs] Remove deprecated variables
new 0472cb9 [FLINK-3940] [table] Add support for ORDER BY OFFSET FETCH
new bdd7a11 [FLINK-3940] [table] Additional improvements
new e9b8657 [hotfix][docs] Fix RMQ Sink code example
new c2a4043 [FLINK-4270] [table] 'as' in front of join does not work
new 8ccee48 [FLINK-4242] [table] Improve validation exception messages
new f0992aa [maven] fix snapshot deployment of hadoop1 version
new f170e04 [FLINK-4359] [table] Add INTERVAL type
new 726d7c7 [FLINK-4236] fix error handling for jar files with no main method
new 79cc30f [FLINK-4387] [runtime] Ignore test in KvStateClientTest
new 83c4b97 [FLINK-4385] [table] Union on Timestamp fields does not work
new 90fdae4 [FLINK-3097] [table] Add support for custom functions in Table API
new 5ccd907 [FLINK-4394] RMQSource: QueueName accessible for subclasses
new ad34540 [FLINK-4309] Fix potential NPE in DelegatingConfiguration
new 6cdf06c [FLINK-4388] [core] Make MemorySegmentFactory check and initialization atomic.
new ffe4065 [FLINK-4366] Add 'forceNonParallel()' to stream transformations and enforce parallelism=1 for AllWindowedStream
new 9623027 [hotfix] [tests] Let SlotCountExceedingParallelismTest use the TestLogger
new dff986d [FLINK-4293] Fix malformatted license headers
new b19648e [FLINK-4104] [docs] Restructure Gelly docs
new 1050847 [FLINK-4411] [py] Properly propagate chained dual input children
new 84d28ba [FLINK-4412] [py] Chaining properly handles broadcast variables
new c8f5745 [hotfix] [metrics] Refactor constructors and tests
new c5a9a3e [FLINK-4302] [metrics] Add documentation to MetricConfig
new c894896 [FLINK-4409] [build] Exclude JSR 305 from Hadoop dependencies
new 889c63e [FLINK-3155] Update docker flink container to the latest release
new 9f928d1 [FLINK-4287] Ensure the yarn-session.sh classpath contains all Hadoop related paths
new 7ce42c2 [FLINK-4281] [table] Wrap all Calcite Exceptions in Flink Exceptions
new f791680 [FLINK-4387] [runtime] Don't wait on termination future on KvStateServer shutdown
new 76ca1a7 [FLINK-4322] [checkpointing] Unify CheckpointCoordinator and SavepointCoordinator
new 47acdea [FLINK-4322] [checkpointing] Add and fix tests for unified Checkpoint/Savepoint Coordinator
new e9a0672 [hotfix] Fix Redis Sink to fail at opening if Redis is not initialized.
new cc7450d [FLINK-4189] [table] Introduce symbols for internal use
new 0d53daa [hotfix] Minutiae
new 8854d75 [FLINK-4322] [checkpointing] Ignore minimum delay for savepoints
new 5d7f880 [FLINK-4322] [checkpointing] Extend CheckpointCoordinatorTest
new 6615ee7 [FLINK-4021] [network] Consume staged buffers on shutdown
new 7dbcffb [FLINK-4021] [network] Add test for staged buffers auto read behaviour
new 266c76b [FLINK-3319] [cep] Add or function to CEP's pattern api
new f0fef6f [FLINK-3319] [cep] Add documentation for or function
new b7ae3e5 Add ManualWindowSpeedITCase For Assessing State Performance
new 3be9a28 [FLINK-4402] Changed the documentation for the metrics in the System Scope Section
new 0977462 [FLINK-4282] Add Offset Parameter to WindowAssigners
new 7e8de77 [FLINK-4282] Add doc for WindowAssigner offset parameter
new 59eb433 [FLINK-4431] [core] Introduce a "VisibleForTesting" annotation.
new cbbd800 [FLINK-4245] Expose all defined variables
new ebda2e0 [hotfix] [metrics] Rename host format constant
new 7eb0861 [hotfix] Correct typo in StreamExecutionEnvironment
new 1c3666a [hotfix] [metrics] Fix AbstractMetricGroupTest#testGetAllVariables
new a497ebc [FLINK-4222] Support automatic AWS Credentials discovery.
new 502ae58 [FLINK-3866] StringArraySerializer does not treat type as immutable.
new 1619e01 [hotfix] Remove unused legacy code
new 863dc180 [FLINK-4435] Replace Guava's VisibleForTesting annotation with Flink's annotation
new c09ff03 [FLINK-4441] Make RocksDB backend return null on empty state + add test for all backends
new 844c874 [FLINK-4317, FLIP-3] [docs] Restructure docs
new 7206455 [FLINK-4454] always display JobManager address using LeaderRetrievalService
new 01ffe34 [FLINK-4253] [config] Rename 'recovery.mode' key to 'high-availability'
new 58165d6 [FLINK-4253] [config] Clean up renaming of 'recovery.mode'
new 28743cf [FLINK-4452] [metrics] TaskManager network buffer gauges
new ad8e665 [FLINK-4231] [java] Switch DistinctOperator from GroupReduce to Reduce
new 58850f2 [FLINK-4264] [gelly] New GraphMetrics driver
new 42f65e4 [FLINK-4453] [docs] Scala code example in Window documentation shows Java
new 4e45659 [hotfix] Reduce string concatenations in ExecutionVertex
new 4da40bc [FLINK-4437] [checkpoints] Properly lock the triggerCheckpoint() method
new 4e9d177 [FLINK-4417] [checkpoints] Checkpoints are subsumed by CheckpointID not, by timestamp
new 635c869 [FLINK-4457] Make ExecutionGraph independent of actors.
new addad1a [hotfix] [tests] Fix mini cluster usage and logging/printing in CustomDistributionITCase
new d16dcd2 [FLINK-3899] [docs] Add examples for incremental window computation.
new 444315a [FLINK-3823] Fix travis log upload & upload logs to transfer.sh (14 days)
new 259a3a5 [FLINK-4273] Modify JobClient to attach to running jobs
new 4810910 [FLINK-3677] FileInputFormat: Allow to specify include/exclude file name patterns
new abb4496 [FLINK-3874] [tableApi] Add KafkaJsonTableSink
new b05ea69 [FLINK-4273] adapt JobRetrievalITCase to lazy classloader reconstruction
new 6a456c6 [FLINK-3580] [table] Implement FLOOR/CEIL for time points
new 53f5a8c [FLINK-4418] [client] Improve resilience when InetAddress.getLocalHost() throws UnknownHostException
new 3505316 [FLINK-4480] [elasticsearch connector] Fix link to elastic.co in documentation
new 7a539c0 [FLINK-3677] Remove Guava dependency from flink-core
new 7b574cf [FLINK-4341] Let idle consumer subtasks emit max value watermarks and fail on resharding
new c2585c6 [hotfix][quickstarts] Remove Jodatime exclusion
new 1f17886 [FLINK-4420] [table] Introduce star(*) to select all of the columns in the table
new 1d53a40 [hotfix][docs] fixed timestamp extractor documentation Java example
new 578e80e [FLINK-4525] [core] Drop special cases for 'StrictlyLocalAssignment' and 'PredeterminedAssignment'
new d9b2be0 [FLINK-1984] Mesos ResourceManager - T1 milestone
new 67be9e0 [FLINK-1984] Mesos ResourceManager - T1 milestone (2)
new 59eeea4 [FLINK-1984] Mesos ResourceManager - T1 milstone (3)
new 38a9534 [FLINK-1984] Mesos ResourceManager - T1 milestone (4)
new 842e3e7 [FLINK-1984] port Mesos code to latest master
new 87114cd [FLINK-4488][yarn] only automatically shutdown clusters for detached jobs
new ab1df63 [FLINK-4486] detached YarnSession: wait until cluster startup is complete
new 31c88a5 [FLINK-4526][yarn] remove redundant proxy messages
new 6226108 [hotfix] fix Checkstyle error
new 8195001 [FLINK-3950] Add Meter interface
new e99949a [FLINK-4190] Generalise RollingSink to work with arbitrary buckets
new b13db27 [hotfix] remove Guava dependency from flink-mesos
new 96b6359 [maven] update checkstyle plugins
new 2a20229 [FLINK-4271] [DataStream API] Enable CoGroupedStreams and JoinedStreams to set parallelism.
new 78d9ae9 [FLINK-4271] [DataStream API] Extends JavaDocs for 'apply(...)' and 'with(...)' functions.
new b7d8389 [FLINK-4514][kinesis-connector] Handle unexpected ExpiredIteratorExceptions
new db919a5 [hotfix] [table] Add docs about SQL's lexical policy
new 97a83a1 [FLINK-4539] [runtime] Reuse functionality for Physical Memory size in 'Hardware' and 'EnvironmentInformation'.
new 7cd9bb5 [hotfix] [cassandra connector] Fix minor issues in CassandraConnectorTest.
new ec975aa [FLINK-4380] Introduce KeyGroupAssigner and Max-Parallelism Parameter
new 847ead0 [FLINK-4381] Refactor State to Prepare For Key-Group State Backends
new 516ad01 [FLINK-4380] Add tests for new Key-Group/Max-Parallelism
new 4809f53 [FLINK-3761] Refactor State Backends/Make Keyed State Key-Group Aware
new addd084 [FLINK-3761] Refactor RocksDB Backend/Make Key-Group Aware
new 2b7a8d6 [FLINK-3755] Ignore QueryableStateITCase
new 6d43061 [FLINK-4380] Remove KeyGroupAssigner in favor of static method/Have default max. parallelism at 128
new f44b57c [FLINK-3755] Fix variety of test problems cause by Keyed-State Refactoring
new f7ef82b [FLINK-3755] Extended EventTimeWindowCheckpointITCase to test the boundaries of maxParallelism.
new bdf9f86 [hotfix] Improve Logging in CheckpointCoordinator, StreamTask, State Code
new 4a100fa [hotfix] Fixes unstable ContinuousFileMonitoringTest.
new cb89ba1 [hotfix] [test-stability] Properly fail if ZooKeeperTestEnvironment cannot delete ZNodes
new e1443d7 [hotfix] [tests] Fix CassandraConnectorITCase on Java 7 profiles
new bc9d523 [FLINK-4570] revert Scalastyle version to 0.5.0
new 78f2a15 [FLINK-4455] [FLINK-4424] [networkenv] Make NetworkEnvironment independent of ActorGateway and JobManager association
new dc3337a [FLINK-3497] [table] Add IS (NOT) TRUE/IS (NOT) FALSE functions
new c251efc [FLINK-4570] disable Scalastyle for flink-mesos Utils file
new 761d0a0 [FLINK-4567] [runtime] Enhance SerializedThrowable to properly mimic Exception causes
new e227b10 [FLINK-4566] [network runtime] Properly preserve exception causes for ProducerFailedException
new 34cda87 [FLINK-4490] [distributed coordination] (part 1) Change InstanceConnectionInfo to TaskManagerLocation
new aaa474a [FLINK-4490] [distributed coordination] (part 2) Make slots independent of 'Instance'.
new eac6088 [FLINK-4490] [distributed coordination] (part 3) Rename methods on 'Instance' to have more intuitive names
new fb8f2c9 [FLINK-4525] [core] (followup) Remove remaining redundant code for pre-defined strictly local assignments.
new e376c00 [FLINK-3580] [table] Add current time point functions
new 502a79d [FLINK-4570] remove conflicting Unicode character
new 6e40f59 [FLINK-4459] [distributed runtime] Introduce SlotProvider for Scheduler
new 9bbb8fa [hotfix] Delete leftover (superseded) StreamTaskAsyncCheckpointTest
new 2f87f61 [FLINK-4073] fix stability of TaskManagerFailure test
new 87aea72 [FLINK-4073] remove unstable testing code in TaskManagerFailure test
new cab76f6 [FLINK-4559][kinesis-connector] Fix AWSUtil.getCredentialsProvider() to not return null
new 66d4b87 [FLINK-4265] [dataset api] Add a NoOpOperator
new 7e07bde [FLINK-4436] Unclosed DataOutputBuffer in Utils#setTokensFor()
new 920cda4 [FLINK-4595] Close FileOutputStream in ParameterTool
new 02b852e [FLINK-4458] Replace ForkableFlinkMiniCluster by LocalFlinkMiniCluster
new 0735b5b [FLINK-4456] Replace Akka specific types by interfaces in Task
new 95ad865 [FLINK-4522] [docs] Gelly link broken in homepage
new 8210ff4 [FLINK-4257] [gelly] Handle delegating algorithm change of class
new bdd3c0d [FLINK-4571] [gelly] Configurable little parallelism in Gelly drivers
new 95b673f [FLINK-3497] [table] Add POSITION/OVERLAY functions
new e92f91a [FLINK-4601] [java] Check for empty string properly
new 8c0d624 [FLINK-4592] [table] Fix flaky test ScalarFunctionsTest.testCurrentTimePoint
new 9420a77 [FLINK-3580] [table] Add QUARTER function
new 5fdc720 [FLINK-3497] [table] Add SQRT function
new 545b72b [FLINK-4599] [table] Add 'explain()' also to StreamTableEnvironment
new 70704de [FLINK-4389] Expose metrics to WebFrontend
new 0492dcc [hotfix] [metrics] Add missing @Internal annotations
new 7143a24 [FLINK-4589] [DataStream API] Fix Merging of Covering Window in MergingWindowSet
new 1586fc8 [FLINK-4626] Add missing break in MEtricStore#add()
new f06930b [FLINK-4612] Close FileWriter using try with resources
new 9046374 [FLINK-4608] Use short-circuit AND in Max/Min AggregationFunction
new db90580 [FLINK-4607] Close FileInputStream in ParameterTool and other
new d7b59d7 [FLINK-4622] Include 'savepoint' in the CLI help message
new 4b1a9c7 [FLINK-4081] [core] [table] FieldParsers should support empty strings
new 5066125 [FLINK-4625] [core] Add a safety net to forcibly terminate JVM is clean shutdown freezed.
new 5901bf3 [FLINK-4610] [core] Replace keySet/getValue with entrySet in UdfAnalyzerUtils
new 0975d9f [FLINK-4247] [table] CsvTableSource.getDataSet() expects Java ExecutionEnvironment
new 7a25bf5 [FLINK-4638] [core] Fix exception message for MemorySegment
new 470b752 [FLINK-4609] [java-api] Remove redundant check for null in CrossOperator
new 4f84a02 [FLINK-4594] [core] Validate lower bound in MathUtils.checkedDownCast
new e58fd6e [FLINK-4572] [gelly] Convert to negative in LongValueToIntValue
new 5c02988 [FLINK-4268] [core] Add a parsers for BigDecimal/BigInteger
new 303f6fe [FLINK-2662] [dataSet] [optimizer] Fix merging of unions with multiple outputs.
new 25a622f [FLINK-3929] Added Keytab based Kerberos support to enable secure Flink cluster deployment(addresses HDHS, Kafka and ZK services)
new 285b6f7 [FLINK-3929] conditionally skip RollingSinkSecuredITCase
new 68709b0 [FLINK-3929] additional fixes for keytab security
new 4cc38fd [FLINK-3042] [FLINK-3060] [types] Define a way to let types create their own TypeInformation
new 7212202 [FLINK-4654] [docs] Small improvements to the docs.
new db45da7 [hotfix] [docs] Parametrized version of quickstart script and artifacts in the quickstart docs
new 349d06d [hotfix] [streaming api] Add proper deprecation JavaDocs
new 82ef021 [FLINK-4645] [core] Adjust signatures of 'registerTypeWithKryoSerializer(...)' methods to allow simpler passing of classes without generic casting.
new 4d4eb64 [FLINK-4640] [streaming api] Ensure that the state descriptors properly initialize the serializers.
new 5f67b54 [hotfix] [tests] Fix race condition in RescalingITCase that could make the test stuck in a blocking call until timeout
new b516056 [docs] Update docs on data types and serialization, to include type hints, type registration, and serializer registration.
new 3507d59 [FLINK-4248] [core] [table] CsvTableSource does not support reading SqlTimeTypeInfo types
new e6fbda9 [FLINK-3580] [table] Add OVERLAPS function
new 3b8fe95 [FLINK-4603] [checkpoints] Fix user code classloading in KeyedStateBackend
new 345b252 [FLINK-4628] [core] Provide user class loader during input split assignment
new 4ee048b [hotfix] Minor code cleanup in StreamTask
new 181b545 [FLINK-4556] [distributed runtime] Make Queryable State Key-Group Aware
new 335a282 [FLINK-4663] [jdbc] Fix JDBCOutputFormat log message
new 37c9512 [FLINK-4665] [misc] Remove unnecessary boxing/unboxing of primitive types in various places
new 568845a [FLINK-4666] [core] Declare constants as final in ParameterTool
new 4779c7e [FLINK-4496] Refactor the TimeServiceProvider to take a Trigerable instead of a Runnable.
new ffff299 [FLINK-4494] Expose the TimeServiceProvider from the Task to each Operator.
new 51a5048 [hotfix] Replace registerTimer/getTime by TimeServiceProvider in Context
new ecbccd9 [FLINK-4550] [table] Clearly define SQL operator table
new 9a1bc02 [FLINK-4549] [table] Test and document implicitly supported SQL functions
new 5d0358a [FLINK-4482] [checkpoints] Make numUnsuccessfulCheckpointsTriggers an atomic integer
new dd90abe [FLINK-4664] [gelly] Add translator to NullValue
new 40c978b [FLINK-4668] [clients] Fix positive random int generation
new 1e4b7eb [FLINK-4555] wait for ResourceManager to cleanly unregister application
new cd43dd5 [FLINK-4485] close and remove user class loader after job completion
new 4a8e944 [FLINK-4485] close classloader in absence of reference holders
new 28ff5a3 [hotfix] Fix restart strategy class loading by using not lower cased class name
new 6f237cf [FLINK-4672] [taskmanager] Do not decorate Actor Kill messages
new 95e9004 [FLINK-4218] [checkpoints] Do not rely on FileSystem to determing state sizes
new 8fa313c [FLINK-4662] Bump Calcite version up to 1.9
new 70e71c1 [FLINK-4684] [checkpoints] Remove redundant class loader from CheckpointCoordinator
new 7eb45c1 [FLINK-4590] [table] Some Table API tests are failing when debug lvl is set to DEBUG
new f150f98 [FLINK-4252] [table] Validate input and output classes of Table API
new ef15984 [FLINK-4241] [table] Cryptic expression parser exceptions
new e5d62da [FLINK-4671] [table] Table API can not be built
new 6ea9284 [FLINK-4696] [core] Limit number of Akka threads in local minicluster setups
new b1642e3 [FLINK-4685] [checkpoints] Gather sync/async duration and alignment information for task checkpoints
new 6e123d2 [hotfix] [tests] Speed up streaming state tests by skipping default retry delay.
new f8138f4 [FLINK-4361] Introduce Flink's own future abstraction
new 7b88f1a [FLINK-4690] Replace SlotAllocationFuture with flink's own future
new 84672c2 [FLINK-4690] Use direct executor to run slot allocation future handler
new f1b5b35 [FLINK-4695] Introduce MetricRegistryConfiguration to encapsulate MetricRegistry parameters
new b928935 [FLINK-4560] [build] Enforcer Java version >= 1.7 via Maven enforcer plugin
new 9090291 [FLINK-4543] [network] Fix potential deadlock in SpilledSubpartitionViewAsyncIO.
new 62d4af8 [FLINK-3656] [table] Reduce number of ITCases
new 84af0b9 [FLINK-4710] [build] Remove Guice Dependency from Hadoop2
new 8243138 [FLINK-4708] [build] Properly scope Kerberos Test Cluster dependency for tests
new 7758571 [FLINK-3656] [table] Consolidate ITCases
new 477d1c5 [FLINK-4711] Let the Task trigger partition state requests and handle their responses
new 2afc092 [FLINK-4573] [web dashboard] Fix potential resource leak due to unclosed RandomAccessFile in TaskManagerLogHandler
new 53ed6ad [FLINK-4379] [checkpoints] Introduce rescalable operator state
new 6f8f5eb [FLINK-4379] [checkpoints] Fix minor bug and improve debug logging
new 92f4539 [FLINK-4702] [kafka connector] Commit offsets to Kafka asynchronously and don't block on polls
new ae219a8 [FLINK-4618] [kafka-connector] Incremented the commited offset by one to avoid duplicate read message.
new 9dbd1e3 [FLINK-4618] [kafka-connector] Minor improvements to comment and variable naming
new a79efdc [FLINK-4624] [gelly] Support null values in Graph Summarization
new 95c08ea [FLINK-4643] [gelly] Average Clustering Coefficient
new 171d109 [FLINK-3656] [table] Convert expression tests to unit tests
new a711339 [FLINK-4068] [table] Move constant computations out of code-generated
new f00e1e7 [FLINK-4068] [table] Reduce expression also for filter/project
new 72e6b76 [FLINK-4546] [table] Remove STREAM keyword in Stream SQL
new eece0dd [hotfix] [kafka] Fix NPE in Kafka09Fetcher
new 5a573c6 [FLINK-4732] remove maven junction plugin
new efb40cf [hotfix] [kafka] Committed offset value set in KafkaTopicPartitionState should also be incremented by 1.
new 825ef3b [FLINK-3874] Rewrite Kafka JSON Table sink tests
new 8c7c42f [FLINK-4677] fail if user jar contains no executions
new bb34133 [FLINK-4729] [gelly] Use optional VertexCentric CombineFunction
new 1577e89 [FLINK-4734] [gelly] Remove use of Tuple setField for fixed position
new 7c9bc1e [FLINK-4740] [tests] Upgrade testing libraries
new 56cba7e [FLINK-4744] [streaming api] Introduce usercode class loader to deserialize partitionable operator state
new 10a42f9 [FLINK-4744] [streaming api] Followup: Unify names for operator state access methods and comments.
new 9206b48 [FLINK-4728] [core,optimizer] Replace reference equality with object equality
new 28b37ef [FLINK-4709] [core] Fix resource leak in InputStreamFSInputWrapper
new c62776f [hotfix] [core] Minor code cleanup and correction of javadocs for filesystem input stream classes.
new 8ff451b [FLINK-4329] [streaming api] Fix Streaming File Source Timestamps/Watermarks Handling
new 954ef08 [hotfix] Various code cleanups around time service and asynchronous exceptions
new 81aec41 [FLINK-4737] [core] Add support for bz2 and xy compression in flink-core.
new 7a76328 [FLINK-4737] [core] Ensure that Flink and its Hadoop dependency pull the same version of 'commons-compress'
new 8000b64 [FLINK-4718] [docs] Fix figure about parallel watermarks.
new beb31fc [FLINK-4739] [elasticsearch connector] Adding packaging details for the Elasticsearch connector
new dd3416f [FLINK-4748] [streaming api] Make timers in Ingestion Time source context properly cancelable.
new 9d24d51 [hotfix] [streaming api] Cleanup watermark initialization in window operator
new 47e4977 [FLINK-4749] [streaming api] Remove redundant processing time timer sets from window operator
new 1cd8d4f [hotfix] [streaming api] Remove obsolete and unused InputTypeSerializer from WindowOperator
new 8aea8c8 [FLINK-4750] [runtime] Cleanly await end of all currently executing processing time timers when finite streams finish.
new 4fc54e3 [FLINK-4700] [tests] Expand and harden TimeServiceProvider test
new 417c5a4 [hotfix] [tests] Remove leftover sysout logging code
new 98710ea [FLINK-4751] [futures] Add thenCombineAsync function to Flink's futures
new fee1430 [hotfix] Make KeyGroupsStateHandle implement StreamStateHandle
new 241d47b [hotfix] Minor cleanup in FlinkKafkaConsumerBase and Test
new 0dac7ad [FLINK-4730] Introducing CheckpointMetaData
new 6efb7c2 [FLINK-4736] [core] Don't duplicate fields in Ordering
new 97c7167 [hotfix] [streaming api] Re-register timers in open() instead of restore()
new 8d953bf [FLINK-4731] Fix HeapKeyedStateBackend Scale-In
new 706dc13 [FLINK-4318][docs] change default version in config
new b949d42 [FLINK-4777] catch IOException in ContinuousFileMonitoringFunction
new 5e30ba3 [FLINK-4745] [table] Convert KafkaTableSource test to unit tests
new ed96cb5 [FLINK-4776] [distributed coordination] Move ExecutionGraph initialization into the dedicated class ExecutionGraphBuilder
new 877c267 [hotfix] [tests] Increase robustness of Fast Time Window Operator Tests
new 14e5ecb [FLINK-4786] [tests] Fix BarrierBufferTest validation of alignment time computation
new c1825e3 [hotfix] [tests] Remove leftover sysout logging from AccumulatingAlignedProcessingTimeWindowOperatorTest
new 33c36e6 [hotfix] [tests] Fix PowerMock warnings concerning log4j
new cdebb0e [FLINK-4764] [core] Introduce Config Options
new abc1657 [FLINK-4768] [core] Migrate high-availability configuration parameters to ConfigOptions
new 1836e08 [FLINK-4439] Validate 'bootstrap.servers' config in flink kafka consumer 0.8
new 9e17cbd [FLINK-4788] [streaming api] Fix state backend classloading from configuration
new 3f87279 [FLINK-4311] [hbase] Fix TableInputFormat to correctly process multiple input splits.
new cf22006 [FLINK-2765] [hbase] Bump HBase versions and fix tests.
new 2061852 [FLINK-3656] [table] Add test base for logical unit testing.
new a079259 [FLINK-4778] [docs] Fix WordCount parameters in CLI examples.
new 63859c6 [FLINK-4035] Add support for Kafka 0.10.x.
new 6731ec1 [FLINK-4035] Refactor the Kafka 0.10 connector to be based upon the 0.9 connector
new 1dda3ad [FLINK-4793] [types] Improve lambda constructor reference handling
new 7b79c8b [FLINK-3706] Fix YARN test instability
new 15df71b [FLINK-4799] re-add 'build-target' symlink on Unix systems
new 744f8eb [hotfix][kafka] Undo DataGenerators changes (use inline kafka producer again
new 3d5bca0 [hotfix][kafka] Backport Kafka09FetcherTest for Kafka010
new c7d1a3b [FLINK-4791] [table] Fix issues caused by expression reduction
new fd410d9 [FLINK-4512] [FLIP-10] Add option to persist periodic checkpoints
new 5783671 [FLINK-4717] Add CancelJobWithSavepoint
new f6d8668 [FLINK-4373] [cluster management] Introduce AllocationID, ResourceProfile, and AllocatedSlot
new 21e8e2d [FLINK-4720] Implement archived ExecutionGraph
new 9948d48 [FLINK-4774] [metrics] Fix scope concatenation in QueryScopeInfo
new a648f88 [FLINK-4827] [docs] Fix scala Streaming Table example
new a612b99 [FLINK-3660] Measure latency and exposes them via a metric
new 436c333 [hotfix] Fix ArchivedExecutionGraphTest
new 5dc624b [FLINK-3660][hotfix] Add missing default value in ConfigConstants
new 85b5344 [FLINK-4564] [metrics] Configurable delimiter per reporter
new 5bd4701 [FLINK-3932] Added ZK ACL configuration for secure cluster setup
new 6d4dd75 [FLINK-4667] Fix for using correct ZK namespace in Yarn deployment
new a2e999b [FLINK-4667] add import for config entry
new a85d8e5 [FLINK-4506] [DataSet] Fix documentation of CsvOutputFormat about incorrect default of allowNullValues
new dc99deb [FLINK-4108] [scala] Respect ResultTypeQueryable for InputFormats.
new dffde7e [FLINK-4771] [avro] Add support for compression to AvroOutputFormat.
new 069de27 [FLINK-3931] Implement Transport Encryption (SSL/TLS)
new f46ca39 [FLINK-4723] [kafka] Unify committed offsets to Kafka to be next record to process
new 783dca5 [FLINK-4829] protect user accumulators against concurrent updates
new d95929e [FLINK-4829] snapshot accumulators on a best-effort basis
new e4343ba [FLINK-4727] [kafka] Set missing initial offset states with starting KafkaConsumer position
new b05c3c1 [FLINK-4619] Answer with JobResultFailure if savepoint restore fails during submission
new 398bd9b [FLINK-4510] [checkpoint] Always create CheckpointCoordinator
new ebcedc4 [hotfix] Fix JobSubmitTest
new 27c25d0 [FLINK-4792] [docs] Update ML quickstart import
new cb78d70 [FLINK-4652] [streaming connectors] Automatically refresh AWS credentials
new 428419d [FLINK-4586] [core] Broken AverageAccumulator
new cab9cd4 [FLINK-4844] Partitionable Raw Keyed/Operator State
new 1e475c7 [FLINK-4842] Introduce test to enforce order of operator / udf lifecycles
new 6f0faf9 [FLINK-4857] Remove throws clause from ZooKeeperUtils functions
new af96c07 [FLINK-4795] [py] Fix CsvStringify for nested tuples
new 2ece925 [FLINK-4805] [py] Fix implicit type conversion in CsvStringify
new 41d5167 [FLINK-4794] [py] Fix partition_by_hash() implicit key usage
new 5c83e78 [FLINK-4804] [py] Fix first() failing when applied to groupings
new 3ab97ae [FLINK-4784] Unique MetricQueryService actor names
new 8085aa9 [FLINK-3888] allow registering a custom convergence criterion in delta iterations
new 45c3d9b [FLINK-4129] [gelly] HITSAlgorithm should test for element-wise convergence
new 3137bf7 [FLINK-4780] Make GraphiteReporter protocol configurable
new e30e7a6 [FLINK-4772] [metrics] Store metrics as strings in MetricStore
new 0d29035 [FLINK-4775] [metrics] Simplify MetricStore access
new a27451d [FLINK-4833] properly log exceptions in CountMinHeavyHitter
new 58a16c1 [FLINK-4881][docker] remove shared volume for configuration
new 7398fdb [FLINK-4878][tests] Log test failure cause on INFO level
new 71d2e3e [FLINK-4852] Remove Non-Multiplexing StreamRecordSerializer
new e112a63 [FLINK-4877] Rename TimeServiceProvider to ProcessingTimeService
new 3055475 [FLINK-4877] Refactor OperatorTestHarness to always use TestProcessingTimeService
new 0859a69 [FLINK-4877] Use OperatorTestHarness and TestProcessingTimeService in Kafka Tests
new f305baa [FLINK-4877] Refactor Operator TestHarnesses to use Common Base Class
new 81b19e5 [FLINK-3674] Add an interface for Time aware User Functions
new 94a3f25 [FLINK-4877] Rename Triggerable to ProcessingTimeCallback
new 770f2f8 [FLINK-4877] Rename ProcessingTimeCallback.trigger() to onProcessingTime()
new f0e451a [FLINK-4581] [table] Fix Table API throwing "No suitable driver found for jdbc:calcite"
new 227cdc82 [FLINK-4838] [docs] Remove STREAM keyword in StreamSQLExample
new b0753f1 [FLINK-4875] [metrics] Use correct operator name
new 2c20b39 [FLINK-4866] [streaming] Make Trigger.clear() Abstract to Enforce Implementation
new d443d6b [hotfix] Force Non-Parallel for Non-Keyed CEP Operators
new d5b97b0 [FLINK-4891] Remove flink-contrib/flink-operator-stats module
new 2b31ec9 [FLINK-4843] Test for FsCheckpointStateOutputStream::getPos()
new e332437 [FLINK-4879] Make KafkaTableSource public
new 4576216 [FLINK-4862] fix Timer register in ContinuousEventTimeTrigger
new c4783c8 [FLINK-4824] [client] CliFrontend shows misleading error message
new c4f9f0d [FLINK-4204] [gelly] Clean up gelly-examples
new 77258a0 [FLINK-4773] [metrics] [refactor] Rename IOMetricGroup to TaskIOMetricGroup
new 022ceb5 [FLINK-4773] [metrics] [refactor] Introduce OperatorIOMetricGroup
new dc0b343 [FLINK-4639] [table] Introduce CalciteConfig to make Calcite features more pluggable.
new 11fa089 [FLINK-4762] [table] Use plural in time interval units
new 307eae6 [hotfix] [kafka] Fix RackAwareMode instantiation in Kafka 0.10 tests
new 1db14fc [FLINK-3950] Implement MeterView
new 1d46c9d [hotfix] Fix unnecessary stream wrapping for Netty Error Message Frames
new fa14986 [hotfix] [kafka consumer] Improve logging For Kafka Consumer 0.8 shutdown
new baf057a [hotfix] [gelly] Driver usage and configuration
new 44f3977 [FLINK-4691] [table] Add group-windows for streaming tables to Table API.
new de03e0c [FLINK-4691] [table] Rework window property extraction.
new fe1654c [FLINK-4924] Simplify Operator Test Harness Constructors
new d0c6842 [FLINK-4892] Change TestHarness.snapshot() to return OperatorStateHandles
new c0192ec [FLINK-4892] Snapshot TimerService using Key-Grouped State
new b673760 [FLINK-4892] Re-enable RescalingITCase
new e3b5d33 [FLINK-4892] Parameterize HeapInternalTimerServiceTest
new 9dc2635 [FLINK-4892] Add Key-Group Ranges Test in HeapInternalTimerServiceTest
new e396a5a [FLINK-4907] Add Num-Subtasks/Subtask-Index Parameter to Operator Test Harnesses
new 94c65fb [FLINK-4907] Add State Reshuffling in Operator Test Harness
new fa664e5 [FLINK-4907] Add Test for Timers/State Provided by AbstractStreamOperator
new b5938b0 [FLINK-4283] Use new InfiniteDelayRestartStrategy instead of FixedDelayRestartStrategy to avoid blocking threads
new fc730bb [FLINK-4579] [RocksDB backend] Add StateBackendFactory and config shortcut for the RocksDB Backend
new 2b600d3 [FLINK-4913][yarn] include user jars in system class loader
new b410c39 [FLINK-4800] Introduce the TimestampedFileInputSplit for Continuous File Processing
new 1e1e4dc [FLINK-4903] [futures] Introduce synchronous future operations
new cbdb784 [FLINK-4894] [network] Don't request buffer after writing to partition
new d2168b6 [FLINK-4715] Remove superfluous test
new 27fd249 [FLINK-4715] Fail TaskManager with fatal error if task cancellation is stuck
new 09ff410 [FLINK-4889] [InstanceManager] Remove ActorRef dependency from InstanceManager
new fd08ad2 Revert "[FLINK-4894] [network] Don't request buffer after writing to partition"
new f8b162e [FLINK-4378] Allow Setting Custom Configuration in RollingSink
new e9b20ec [FLINK-4378] Allow Setting Custom Configuration in BucketingSink
new 2fb6009 [FLINK-4787] [runtime-web] Return generic HttpResponse in RequestHandler
new 3bc9cad [FLINK-4787] [runtime-web] Add JobCancellationWithSavepointHandlers
new a582882 [FLINK-4925] [metrics] Integrate meters into IOMetricGroups
new 211f5db [hotfix] [docs] Add documentation for TaskManager's registration configuration parameters
new 3ce8596 [FLINK-4631] Prevent NPE in OneInputStreamTask
new 5b54009 [FLINK-4544[ Refactor JM/TM metrics
new 344fe94 [FLINK-4923] [metrics] Expose Task's input/output buffer queue lengths and bufferPool usage as a metrics
new 94d1b63 [FLINK-4245] JMXReporter exposes all defined variables
new 9f4be44 [hotfix] [metrics] Make JmxMeter class static
new 094b747 [hotfix] Improved test stability of RescalingITCase
new 99f1dc3 [FLINK-4972] Fix CoordinatorShutdownTest
new 1f4f6f9 [FLINK-4733] Reuse operator IO metrics for task
new cf4f364 [FLINK-4733] Port TaskManager metrics
new ba2d007 [FLINK-4733] Port Task IO metrics
new 59a5551 [hotfix] Fixes the TimestampedInputSplit.EOS comparison.
new 18507de [FLINK-4932] [distributed coordination] Failing in state RESTARTING only fails terminally if no more restarts are possible
new 3e85fc6 [FLINK-4894] [network] Don't request buffer after writing to partition
new 649f957 [FLINK-4659] [core] Closed the jassConfStream object to prevent resource leaks
new 1574249 [FLINK-4933] [exec graph] Don't let the EG fail in case of a failing scheduleOrUpdateConsumers call
new cfb3790 [FLINK-4887] [execution graph] Introduce TaskManagerGateway to encapsulate communcation logic
new ca68d2e [FLINK-4884] Eagerly Store MergingWindowSet in State in WindowOperator
new 4955441 [FLINK-4447] [docs] Include NettyConfig options on Configurations page
new 74c0770 [FLINK-4445] [client] Add allowNonRestoredState flag to CLI
new c0e620f [FLINK-4445] [checkpointing] Add option to allow non restored checkpoint state
new c6c88ce [FLINK-4935] [webfrontend] Submit job with savepoint
new c335d28 [FLINK-4923] [metrics] Initializes all task's gauges in TaskIOMetricGroup and extract the used buffers interface for BufferPool
new d1fea26 [FLINK-4845] [runtime-web] Fix Job Exception page
new 2b369d3 [FLINK-4398] [query] Improve logging and error message in failing KvStateServerHandlerTest
new b4bf99d [FLINK-4398] [query] Fix race in KvStateServerHandlerTest
new 223b0aa [FLINK-4945] FlinkKafkaConsumer logs wrong warning about confirmation for unknown checkpoint
new 30a53ef [FLINK-4991] [taskmanager] Fix too aggressive timeout and improve logging in TaskTest
new da991ae [FLINK-4850] [ml] FlinkML - SVM predict Operation for Vector and not LaveledVector
new 6346a89 [FLINK-4996] [core] Make CrossHint @Public
new ed6a602 [FLINK-4943] Fix typo ConfigConstants JavaDocs: YYARN -> YARN
new d60fe72 [FLINK-4623] [table] Add physical execution plan to StreamTableEnvironment explain().
new 4565170 [FLINK-4743] [table] Add support for power(DOUBLE, DECIMAL) function.
new 7d61e1f [FLINK-4315] [dataSet] [hadoopCompat] Annotate Hadoop-related methods in ExecutionEnvironment as @Deprecated.
new bb26c9e [yarn] fix debug string displayed for failed applications
new f4c336b [hotfix] [checkpointing] Fix error message in SavepointLoader
new c385897 [FLINK-4960] Add AbstractStreamOperatorTestHarness.repackageState()
new cd610a9 [hotfix] Don't Swallow Exception in RocksDBAsyncSnapshotTest
new 67c2868 [hotfix] [tests] Simplify mocking of the ResultPartitionWriter
new 852c529 [FLINK-4977] [core] Fix enum serializer to use proper access to enum constants
new ac39979 [FLINK-4596] Fallback restart strategy config to let jobs choose restart configuration set at cluster level
new 1c0c668 [FLINK-4998][yarn] fail if too many task slots are configured
new e480762 [FLINK-3813][yarn] wait for CLI to complete before checking output
new 3a4fc53 [FLINK-4221] Show metrics in WebFrontend + general improvements
new 448d7f0 [FLINK-5004] [runtime] Add option to disable queryable state
new 7274849 [hotfix] Remove unnecessary ConfigOptions#key() calls
new a725910 [hotfix] Remove noisy log message in TaskCancelerWatchDog
new 718f6e4 [FLINK-4876] [webfrontend] Allow to bind to a specific interface
new 132d8f1 [hotfix] Add Check for Keyed Operator in getInternalTimerService()
new b9173b3 [FLINK-4951] Fix Javadoc of KeyedStream.flatMap(TimelyFlatMapFunction)
new f0ef370 [FLINK-4952] [scala] Add KeyedStream.flatMap(TimelyFlatMapFunction)
new 06fb9f1 [FLINK-4955] Add Translations Tests for KeyedStream.flatMap(TimelyFlatMapFunction)
new 0b873ac [FLINK-4957] Remove Key Serializer Parameter getInternalTimerService()
new 891950e [FLINK-4957] Provide API for TimelyCoFlatMapFunction
new 1a57865 [FLINK-5028] [streaming] StreamTask skips clean shutdown logic upon cancellation
new c21ecae [FLINK-5032] Fix CsvOutputFormatTest on Windows OS
new d390824 [FLINK-5022] Suppress RejectedExecutionExceptions if the ExecutorService has been shut down
new d450bee [FLINK-5014] [RocksDB backend] Add toString for RocksDBStateBackend
new d9ddcb4 [hotfix] [RocksDB backend] Minor cleanups to constructors and comments in RocksDBStateBackend
new 6a6eeb9 [hotfix] [tests] Clean up (mostly redundant) PowerMock runners, preparations, and exclusions
new f025c45 [FLINK-4963] [gelly] Tabulate edge direction for directed VertexMetrics
new 0a79dd5 [FLINK-4984] [checkpointing] Add Cancellation Barriers as a way to signal aborted checkpoints
new 48a4813 [FLINK-4985] [checkpointing] Report canceled / declined checkpoints to the Checkpoint Coordinator
new 07ab9f4 [FLINK-4975] [checkpointing] Add a limit for how much data may be buffered in alignment.
new 1440682 [FLINK-5019] Proper isRestored result for tasks that did not write state
new ccf35cf [hotfix] Properly Await Termination in SavepointITCase
new 7a51895 [hotfix] Move logging of JobStatus changes into the ExecutionGraph
new ddba618 [FLINK-5037] Fixed instability in AbstractUdfStreamOperatorLifecycleTest
new 616c4f5 [FLINK-5038] [streaming runtime] Make sure Canceleables are canceled even them "cancelTask" throws an exception
new 029fda2 [FLINK-5033] [cep] Advance time with incoming watermarks at CEP operator
new 6516938 [FLINK-5027] FileSource finishes successfully with a wrong path
new 22958fb [hotfix] Fix duplicate "ms" time unit in RestartStrategy.
new 0145950 [hotfix] [tests] Fix boxed Integer comparison with != in PartitionerITCase.
new a88b613 [hotfix] [tests] Fix wrong argument order of assertNotNull in ClassLoaderITCase.
new 5767167 [hotfix] [docs] [tableAPI] Fix typos in Table API documentation.
new 332f823 [FLINK-4946] [scripts] Load jar files from subdirectories of lib
new 2d325b3 [FLINK-4970] [gelly] Parameterize vertex value for SSSP
new ed09dba [hotfix] [gelly] Flip ordering of TriangleListing bitmask
new 86a3dd5 [FLINK-4934] [gelly] Triadic Census
new 58204da [FLINK-5046] [tdd] Preserialize TaskDeploymentDescriptor information
new 0d2e8b2 Revert "[FLINK-3232] [runtime] Add option to eagerly deploy channels"
new 2742d5c [FLINK-5040] [jobmanager] Set correct input channel types with eager scheduling
new 5d5637b [FLINK-5040] [taskmanager] Adjust partition request backoffs
new 9918839 [FLINK-5012] Expose Timestamp in Timely FlatMap Functions
new 98a6176 [FLINK-5021] Remove the special EOS TimestampedFileInputSplit.
new 5a90c6b [FLINK-5021] Guarantee PROCESS_ONCE works correctly after recovering.
new b2e8792 [FLINK-5021] Make the ContinuousFileReaderOperator rescalable.
new 381bf59 [FLINK-4939] WriteAheadSink: Decouple creation and commit of a pending checkpoint
new 62523ac [FLINK-4177] Harden CassandraConnectorITCase
new 5fa3890 [hotfix] [cassandra] Fix CassandraSinkBase serialization issue
new 57208e6 [hotfix] [metrics] Supply name to view/reporter thread
new 62192c7 [hotfix] [metrics] Prevent concurrency issues in MeterView
new 74bb7bb [FLINK-4174] Enhance evictor functionality
new 1adefee [hotfix] [cassandra] [tests] Show error log messages
new bd2fce6 [FLINK-4174] Add accessor for current watermark in Evictor Context
new 6f09ecd [FLINK-4801] [types] Input type inference is faulty with custom Tuples and RichFunctions
new 5845d29 [hotfix] Remove unused ProcessingTimeService from Evictor
new 53aae50 [FLINK-5013] [kinesis] Shade AWS dependencies to work with older EMR versions
new 611412c [hotfix] [metrics] MetricRegistry threadNumber starts at 1
new fa1864c [hotfix] [Kafka Consumer] Clean up some code confusion and style in the Fetchers for Kafka 0.9/0.10
new a66e7ad [FLINK-5048] [kafka consumer] Change thread model of FlinkKafkaConsumer to better handel shutdown/interrupt situations
new cf78542 Revert "[hotfix] [cassandra] [tests] Show error log messages"
new 95d640b Revert "[hotfix] [cassandra] Fix CassandraSinkBase serialization issue"
new 02c10d3 Revert "[FLINK-4177] Harden CassandraConnectorITCase"
new a5ec849 [hotfix] [tests] Corrected log4j files.
new bf06a1c [FLINK-5057] [taskmanager] Read cancellation timeout from task manager config
new 72b295b [FLINK-5063] [checkpointing] Discard state handles of declined or expired state handles
new a1362c3 [FLINK-5006] [streaming] Remove assumption of order in SystemProcessingTimeServiceTest
new 836fe97 [FLINK-4263] [table] SQL's VALUES does not work properly
new 5398809 [hotfix] [checkpoints] Enhance debug logging in exactly-once and at-least-once checkpoint stream aligners
new df0d057 [hotfix] [docs] Fix incorrect URL.
new a67d3f8 [FLINK-5058] [scala-shell] Set correct value for TaskManager memory parameter.
new 13ebb36 [FLINK-5054] [FLINK-5056] Make the BucketingSink rescalable.
new 5836f7e [FLINK-5071][yarn] adjust vcore validation check
new fb6ecd2 [hotfix] [streamExamples] Fix typo in comment.
new fdb134c [hotfix] [docs] Fix broken links, figures, and code examples.
new e450968 [FLINK-4294] [table] Allow access of composite type fields
new a42eafb [FLINK-5123] [docs] Add description how to build a properly shaded build with different Maven versions
new 1f9c0cf [FLINK-4155] [kafka] Move partition list fetching to open() for Kafka producers
new 698e53e [FLINK-3869] Replace WindowedStream.apply() by reduce()/fold()
new ae4b274 [FLINK-5082] Pull ExecutorService lifecycle management out of the JobManager
new 3fb92d8 [FLINK-5073] Use Executor to run ZooKeeper callbacks in ZooKeeperStateHandleStore
new c590912 [FLINK-5085] Execute CheckpointCoordinator's state discard calls asynchronously
new ba8ed26 [FLINK-4910] Introduce safety net for closing file system streams
new f5af7f1 [FLINK-5107] Introduced limit for prior execution attempt history
new 4c23879 [FLINK-5107] Handle evicted execution attempts in request handlers
new 4653ad3 [FLINK-5124] [table] Support more temporal arithmetic
new 0d3ff88 [FLINK-2608] Updated Twitter Chill version.
new 3e3a90d [FLINK-5010] [akka] Introduce default configuration values for Akka's deathwatch
new 4656350 [FLINK-5000] Rename Methods in ManagedInitializationContext
new e8318d6 [FLINK-4900] flink-master: Allow to deploy TM with container
new 7d91b9e [FLINK-2662] [optimizer] Fix computation of global properties of union operator.
new 06d252e [FLINK-5143] [table] Add EXISTS to list of supported SQL operators.
new 74e0971 [FLINK-4937] [table] Add incremental group window aggregation for streaming Table API.
new 3458a66 [hotfix][docs] Stream joins don't support tuple position keys
new 16ee4a5 [hotfix] [streaming] Fix type extraction for joined streams.
new 2029c14 [FLINK-5149] let ContinuousEventTimeTrigger fire at the end of the window
new f5f4f7a [FLINK-5075] [kinesis] Make connector fail-proof to incorrect Kinesalite API behaviour
new 5d2da12 [FLINK-2608] remove expensive integration tests previously introduced
new 1f04542 [FLINK-3702] Make FieldAccessors support nested field expressions.
new 870e219 [FLINK-3702] FieldAccessor refactor to static factory
new 1b2f3c0 [FLINK-5055][security] skip Hadoop UGI login if unsecured
new 2eacfba [FLINK-5112] [ExecutionGraph] Remove unused accumulator aggregation code from ArchivedExecutionJobVertex
new 7d34f65 [hotfix] Fix condition in CoGroupRawDescriptor
new 333da3a [FLINK-4741] Proper shutdown the ServerBootstrap WebRuntimeMonitor
new e2b93f6 [FLINK-5096] Make the RollingSink rescalable.
new 1875cac [FLINK-4993] Don't Allow Trigger.onMerge() to return TriggerResult
new 652309c [FLINK-4993] Remove Unused Import in TriggerResult
new 973ce7d [FLINK-5050] [build] Remove transitive JSON.org dependency
new 8e76322 [hotfix] [tests] Harden timeout logic for TaskManager registration in AbstractTaskManagerProcessFailureRecoveryTest
new 3d13a05 [hotfix] Flush in CsvOutputFormat before closing, to increase CI stability
new 3542019 [FLINK-5168] Scaladoc annotation link use [[]] instead of {@link}
new fe6b835 [hotfix] [docs] Add a rouch description about internal types of states and state backends
new 60a4ab3 [FLINK-5181] Add Tests in StateBackendTestBase that verify Default-Value Behaviour
new 3a27f55 [FLINK-4872] [types] Type erasure problem exclusively on cluster execution
new 910f733 [FLINK-5026] Rename TimelyFlatMap to Process
new db441de [FLINK-4825] [table] Implement a RexExecutor that uses Flink's code generation.
new 0bb6847 [FLINK-5184] [table] Fix compareSerialized() of RowComparator.
new ecfb5b5 [FLINK-4832] [table] Fix global aggregation of empty tables (Count/Sum = 0).
new bcef8a3 [FLINK-4260] [table] Allow SQL's LIKE ESCAPE
new 90acbe5 [FLINK-4921] Upgrade to Mesos 1.0.1
new ae0975c [FLINK-5197] [jm] Ignore outdated JobStatusChanged messages
new ac7d871 [FLINK-4895] Drop Hadoop1 support and remove related build infrastructure
new 8cdb406 [FLINK-5123] [task] Add missing @Override to Task#failExternally
new 673c724 [FLINK-4826] add keytab support to mesos container
new fe602ea [FLINK-4918] add SSL handler to artifact server
new a41a37d [hotfix] [webfrontend] Rebuild
new 16c08b5 [FLINK-3680] [web frontend] Remove "(not set)" text in the Job Plan UI
new bd62fe1 [FLINK-3719][web frontend] Moving the barrier between graph and stats
new 3223a16 [hotfix] [webfrontend] Organize job pane tabs
new 8228ac6 [FLINK-5194] [logging] Log heartbeats on TRACE level
new dc5650a [FLINK-5201] [logging] Log loaded config properties on INFO level
new 67bd827 [FLINK-5196] [logging] Don't log InputChannelDeploymentDescriptor
new dc7d8ec [FLINK-5198] [logging] Improve TaskState toString
new f91dd9f [FLINK-5199] [logging] Improve logging in ZooKeeperSubmittedJobGraphStore
new bf859e7 [FLINK-5207] [logging] Decrease HadoopFileSystem logging
new 7d66aae [FLINK-5192] [logging] Improve log config templates
new b181662 [FLINK-5216] [checkpoints] 'Min Time Between Checkpoints' references timestamp after checkpoint
new dbe7073 [FLINK-5159] [table] Add single-row broadcast nested-loop join.
new f728129 [FLINK-5169] [network] Make consumption of InputChannels fair
new d3ac0ad [FLINK-5169] [network] Adjust tests to new consumer logic
new c0cdc5c [FLINK-5169] [network] Add tests for channel consumption
new 2fcef5e [FLINK-5169] [network] Fix spillable subpartition buffer count
new a2cb5df [hotfix] IOUtils.closeQuietly() closes absolutely quietly.
new d260717 [hotfix] Fix test instability in AbstractTaskManagerProcessFailureRecoveryTest
new cc006ff [FLINK-5218] [state backends] Add test that validates that Checkpoint Streams are eagerly closed on cancellation.
new de4fe3b [FLINK-4676] [connectors] Merge batch and streaming connectors into common Maven module.
new 3eeb35d [FLINK-5158] [table] Refactor BatchScan, DataSetScan, and BatchTableSourceScan.
new 85a19bd [hotfix] [jdbc] Set flink-table dependency to optional to avoid pulling in Calcite if not needed.
new 3229dc0 [FLINK-5228] [network] Fix LocalInputChannel re-trigger request and release deadlock
new 45b770b [FLINK-5128] [kafka] Get Kafka partitions in FlinkKafkaProducer only if a partitioner is set
new 4e336c6 [FLINK-5209] [webfrontend] Fix TaskManager metrics
new 6e98a93 [FLINK-5173] Upgrade RocksDB dependency
new e4f802d [FLINK-5146] Improved resource cleanup in RocksDB keyed state backend
new 08e7ba4 [FLINK-5109] [webfrontend] Fix invalid content-encoding
new 136294c [docs] Replace broken download link
new 7fbd757 [FLINK-2844] [docs] Remove obsolete 'new-web-frontend' option
new e288617 [FLINK-5016] [checkpointing] Split EventTimeWindowCheckpointingITCase
new 4dee8fe [FLINK-5248] [tests] Catch restore failures in SavepointITCase
new 3b85f42 [FLINK-5262][docs] Introduce Gemfile.lock to avoid dependency range conflicts
new 230bf17 [FLINK-5091] Formalize the Mesos AppMaster environment for docker compatibility
new 8d7c3ff [test-utils] cleanup and improve method to set the environment
new 8134f44 [hotfix] Check for null in OperatorSnapshotResult#cancel
new 96239b3 [FLINK-5249] [docs] Fix description of datastream rescaling to match the figure.
new ebe228d [FLINK-5259] [docs] Fix wrong execution environment in batch retry delays example.
new 6f9633c [FLINK-5257] [table] Include optimized logical plan in explain().
new 98d1826 [FLINK-5251] [table] Decouple StreamTableSourceScan from TableSourceTable.
new e5f4e3d [FLINK-5179] [metrics] Close TaskManagerMetricGroup on JobManager dissociation
new f7f7b48 [FLINK-5261] [metrics] Clean up meters in ScheduledDropwizardReporter
new ba6b087 [FLINK-4983] [webfrontend] Add favicon
new 0eb46eb [FLINK-4921] Upgrade to Mesos 1.0.1
new a6e80da [hotfix][webfrontend] Added non-binary image assets to license check exceptions
new af3bf83 [FLINK-5041] Savepoint backwards compatibility 1.1 -> 1.2
new 91414d9 [docs] clarify default restart behavior when checkpointing is enabled
new c024b0b [docs] Note that numberOfExecutionRetries and executionRetryDelay are deprecated.
new e139f59 [FLINK-4469] [table] Add support for user defined table function in Table API & SQL
new 684defb [FLINK-4469] [table] Minor improvements
new 555a687 [FLINK-5274] [network] Handle reader release in LocalInputChannel
new 4410c04 [FLINK-5275] [execgraph] Give more detailed error message if InputChannel deployment fails
new 13150a4 [FLINK-4631] Prevent NPE in TwoInputStreamTask
new 4414008 [FLINK-4554] [table] Add support for array types
new fe843e1 [FLINK-5164] Disable some Hadoop-compat tests on Windows
new 86f784a [FLINK-4563] [metrics] scope caching not adjusted for multiple reporters
new 4eb7192 [FLINK-5020] Make the GenericWriteAheadSink rescalable.
new 55d6061 [FLINK-5169] [network] Fix String formats in spillable partition
new 677d0d9 [FLINK-5226] [table] Use correct DataSetCostFactory and improve DataSetCalc costs.
new 2d8f03e [FLINK-5039] Bump Avro version to 1.7.7.
new f2186af [FLINK-3921] Add support to set encoding in CsvReader and StringParser.
new 41d5875 [FLINK-3921] Add support to set encoding in CsvReader and StringParser.
new d3f19a5 [FLINK-5285] Abort checkpoint only once in BarrierTracker
new ea70807 [FLINK-5278] Improve task and checkpoint related logging
new add3765 [FLINK-5193] [jm] Harden job recovery in case of recovery failures
new 0c42d25 [FLINK-5158] [ckPtCoord] Handle exceptions from CompletedCheckpointStore in CheckpointCoordinator
new 9ab494a [hotfix] properly encapsulate the original exception in JobClient
new 365cd98 [FLINK-4646] [gelly] Add BipartiateGraph
new 36bf993 [FLINK-5211] [metrics] [docs] Include example reporter configuration
new 4befbb8 [FLINK-5206] [py] Use random file names in tests
new dc5dd51 [FLINK-4906] [metrics] Introduce constants for IO metrics
new 47db9cb [FLINK-5147] Prevent NPE in LocalFS#delete()
new a078666 [FLINK-5114] [network] Handle partition producer state check for unregistered executions
new 609c046d [FLINK-5310] [RocksDB] Harden the JNI library loading
new 57f7747 [hotfix] [tests] Add re-tries to the result verification via files.
new 38ab716 [FLINK-5007] [checkpointing] Retain externalized checkpoint on suspension
new d965d5a [FLINK-5326] [network] Check release flag of parent in reader
new 3698379 [docs] Add docs about externalized checkpoints
new 685c4f8 [FLINK-5163] Port the ContinuousFileMonitoringFunction to the new state abstractions.
new d24833d [FLINK-5163] Port the FromElementsFunction to the new state abstractions.
new 956ffa6 [FLINK-5163] Port the MessageAcknowledgingSourceBase to the new state abstractions.
new 81d8fe1 [FLINK-5163] Port the StatefulSequenceSource to the new state abstractions.
new fc62723 [FLINK-5328] [logging] Add Thread name to FileSystem disposeFileSystemCloseableRegistryForTask
new 1cc887e [FLINK-5145] WebInterface only polls selected metrics
new 270140a [FLINK-5326] [network] Log errors in sending Netty handler
new da4af12 [FLINK-5304] [table] Rename crossApply/outerApply to join/leftOuterJoin in Table API.
new 5c86efb [FLINK-5223] [doc] Add documentation of UDTF in Table API & SQL
new 5baea3f [FLINK-3848] [table] Add ProjectableTableSource and push projections into BatchTableSourceScan.
new 8a7288e [FLINK-5300] Add more gentle file deletion procedure
new 6cfc841 [FLINK-5290] Ensure backwards compatibility of the hashes used to generate JobVertexIds
new 47a6105 [hotfix] [tests] Improve exception message for file-based result verification in 'TestBaseUtils'
new 3560f2e [FLINK-5327] Remove IOException from StateObject::getStateSize
new 7ecf6c8 [hotfix] Clean up structure and comments in 'FileSystem'
new 3feea13 [hotfix] [core] Minor code cleanups in 'LocalFileSystem'.
new 790153c [tests] Add 'CheckedThread' as a common test utility
new 2f3ad58 [FLINK-5332] [core] Synchronize FileSystem::initOutPathLocalFS() to prevent lost files when called concurrently.
new c906ad9 [FLINK-5289] [streaming] Give meaningful exceptions when using value state on non-keyed stream
new a4ff480 [tests] Remove redundant copies of the JUnit RetryRules
new 22a8204 [FLINK-5307] [metrics] Log reporter configuration
new a5cf88f7 [FLINK-5002] [network] Renamed getNumberOfUsedBuffers() method to bestEffortGetNumOfUsedBuffers()
new ef6b473 [FLINK-5330] [tests] Harden KafkaConsumer08Test to fail reliably with unknown host exception
new e4c767a [hotfix] [core] Fix typo in variable name
new 79d7e30 [FLINK-5258] [docs] Reorganize the docs to improve navigation and reduce duplication
new 8038ae4 [FLINK4429] Remove redis connector (now in Apache Bahir)
new bf2874e [FLINK-5240][tests] ensure state backends are properly closed
new 35f4ea7 [FLINK-5283] Fix closing streams when restoring old savepoint in keyed backends
new 8cda6a2 [FLINK-5282] Fix closing streams on exception in SavepointV0Serializer
new e95fe56 [FLINK-5041] Savepoint Backwards Compatibility 1.1 -> 1.2
new 21d1d8b [FLINK-5051] Add Serde Proxies for Serializers and State Backend Data
new 09e0817 [FLINK-4936] [gelly] Operator names for Gelly inputs
new 5dab934 [FLINK-5335] Allow ListCheckpointed user functions to return null
new 15e7f0a [FLINK-5266] [table] Inject projection of unused fields before aggregations.
new 86f8a25 [FLINK-5187] [core] Port Row and related type utils to Java and move them to flink-core.
new a9e6ec8 [FLINK-5189] [table] Delete Row and its related classes from flink-table.
new 4d27f8f [FLINK-5188] [table] [connectors] [core] Adjust imports and method calls to new Row type.
new d84599e [FLINK-4446] Remove Flume connector (now in Bahir)
new 4666e65 [FLINK-4611] [kinesis] Make "AUTO" credential provider as default for Kinesis Connector
new 88e458b [FLINK-5097][gelly] Add missing input type information to TypeExtractor in MapVertices, mapEdges, fromDataSet, and groupReduceOnEdges
new 3d41f2b [FLINK-5311] [gelly] [docs] Add user documentation for bipartite graph
new 7957b2d [hotfix] Fix Table API doc typo
new 48ef46a [FLINK-5011] [types] TraversableSerializer does not perform a deep copy of the elements it is traversing
new ffe9ec8 [FLINK-4704] [table] Refactor package structure of flink-table.
new cc34c14 [FLINK-5343] [table] Add support to overwrite files with CsvTableSink.
new d5c7bf6 [FLINK-5255] [table] Generalize detection of single row inputs for DataSetSingleRowJoinRule.
new ef575e8 [FLINK-3848] [table] Add projection push down for StreamTableSource.
new 22af6cf [FLINK-3848] [table] follow-up: Refactor TableSource tests.
new 67c4be6 [FLINK-5008] [docs] Update IDE setup and quickstart documentation.
new 6e1e139 [docker] improve Dockerfile host configuration
new 9da0b0e [FLINK-4922][docs] document how to use Flink on Mesos
new becd270 [FLINK-5091] cleanup unused Mesos configuration entries
new 0506a63 [FLINK-5350] don't overwrite an existing JAAS config
new e9e6688 [maven] properly attach the CEP Scala source code
new 27ebdf7 [FLINK-2821] use custom Akka build to listen on all interfaces
new 4a27d21 [FLINK-5344] Fixed the dockerized doc build, which has been broken for a while. Fixed the -p option. Reverted the main Gemfile back to ruby 1.9 to make the build bot happy, and created a new Gemfile in ruby2/Gemfile to keep the incremental build option available.
new f528307 [FLINK-4391] Add asynchronous I/O operations
new ad603d5 [FLINK-4391] Polish asynchronous I/O operations
new 6c5a871 [FLINK-4391] Add timeout parameter for asynchronous I/O
new bfdaa38 [FLINK-4391] Add Scala API for asynchronous I/O operations
new 32f300f [FLINK-5292] Add CheckpointedRestoringOperator interface.
new 896fbae [FLINK-5292] Expose some SavepointV0Serializer methods for use in tests
new f9b4f91 [FLINK-5292] Add "restoreFromLegacySnapshot" in AbstractStreamOperatorTestHarness.
new b0e2a2c [FLINK-5294] Make WindowOperator backwards compatible with 1.1 snapshots
new e0819dc [FLINK-5295] Migrate the AlignedWindowOperators to the WindowOperator.
new ac134d6 [FLINK-5294] Add tests for WindowOperator restore from 1.1 snapshot
new 074d80c [FLINK-5294] Test aggregating aligned window op restore from 1.1
... 4263 lines suppressed ...