You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/10/16 18:18:43 UTC
Build failed in Jenkins: beam_PerformanceTests_JDBC #1220
See <https://builds.apache.org/job/beam_PerformanceTests_JDBC/1220/display/redirect?page=changes>
Changes:
[echauchot] [BEAM-4553] Implement graphite sink for MetricsPusher
[david.moravek] #! Init Euphoria 0.5.0
[david.moravek] #! minor code cleanup
[david.moravek] #! Fix dead lock when executing many tasks
[david.moravek] #! Split partition description from its reader
[david.moravek] #! Call Reader#close upon end-of-stream
[david.moravek] #! Initial draft of KafkaStreamSource
[david.moravek] #! Correct typo in classname
[david.moravek] #! Upgrade PrintStreamSink to a general purpose utility
[david.moravek] #! Revise comments in example code
[david.moravek] #! Allow kafka configuration through properties resource
[david.moravek] #! Fix compilation error in IDEA
[david.moravek] #! Propose readable variable/parameter name
[david.moravek] #! Hadoop input formats adapter
[david.moravek] #! Hadoop input format - clone Writable instances between
[david.moravek] #! Unify input/output creation
[david.moravek] #! Provide easy access to nested configuration settings
[david.moravek] #! Make dataset aware of its consumers
[david.moravek] #! added basic test for retrieving dataset's consumers
[david.moravek] #! fix typo in comment
[david.moravek] #! Make kafka source configurable through settings
[david.moravek] #! Make StdoutSink#dump-partition-id parameter optional again
[david.moravek] #! DataSink API polishing
[david.moravek] #! Do not close stdout through StdoutSink
[david.moravek] #! Log swallowed exceptions
[david.moravek] #! InMemExecutor - fix potential concurrency issue
[david.moravek] #! InMemExecutor - rollback all sinks when any of the tasks fails
[david.moravek] #! Add inmemory filesystem skeleton
[david.moravek] #! Apply InMemFileSystem as SoR in test
[david.moravek] #! Drop obsolete/unused method
[david.moravek] #! Rework iteration towards java8 streams
[david.moravek] #! Remove unused imports
[david.moravek] #! Working join operator
[david.moravek] #! git pull --rebase origin master
[david.moravek] #! minor polishing and removing of warnings
[david.moravek] #! polishing after code review
[david.moravek] #! correct calling of constructor of ReduceStateByKey from
[david.moravek] #! pair moved package
[david.moravek] #! Hadoop output format adapter
[david.moravek] #! clone datasets to all consumers in inmem executor
[david.moravek] #! KafkaStreamSource -> KafkaSource
[david.moravek] #! Initial draft of a non-tx-aware kafka-sink
[david.moravek] #! Correct Pair class reference
[david.moravek] #! comment typo
[david.moravek] #! first part of code review changes
[david.moravek] #! core of realtime stats
[david.moravek] #! Ensure writing out EOS token
[david.moravek] #! DRY on computing sum
[david.moravek] #! implemented remarks from code review
[david.moravek] #! Get reasonable logging output during tests
[david.moravek] #! InMemFileSystem.Factory -> InMemFileSystem.SourceFactory
[david.moravek] #! Sink into the InMemFileSystem for unit testing purposes
[david.moravek] #! Drop CompositeKey#equals implementation
[david.moravek] #! Avoid eye-bleeding
[david.moravek] #! Avoid doubled output
[david.moravek] #! added tests for flatmap, repartition and union, slightly cleaned code
[david.moravek] #! more correct commit of ListDataSink's Writer
[david.moravek] #! get rid of batch code in client API
[david.moravek] #! changes after review
[david.moravek] #! Staless Windowing (Windowing.Count working; others commented out)
[david.moravek] #! Attempt at merging
[david.moravek] #! Fix state merging
[david.moravek] #! Drop Window#add/getState
[david.moravek] #! Shorten test code
[david.moravek] #! Aligned count window
[david.moravek] #! Add Join implementation
[david.moravek] #! Finish up join implementation
[david.moravek] #! fixed test for sort in reducestatebykey
[david.moravek] #! Various styling issue; thanks to review feedback
[david.moravek] #! Add more debugging support through stdout-sink
[david.moravek] #! Correct output format
[david.moravek] #! added tests for reducestatebykey - non aggregating and unaligned
[david.moravek] #! changes after review
[david.moravek] #! Provide more debugging info through stdout-sink
[david.moravek] #! Add (failing) proof-of-concept test
[david.moravek] #! Allowing windowing by item specific event-item
[david.moravek] #! Add VoidSink for debugging purposes
[david.moravek] #! Prefer UnaryFunction over EventTimeFn
[david.moravek] #! Prevent timer thread to die
[david.moravek] #! Prepare window storage
[david.moravek] #! Faster retrieval of active windows
[david.moravek] #! added tests for inmem, added sliding window
[david.moravek] #! fixed copying inputs in multi consumer pipeline
[david.moravek] #! SlidingWindow constructor made private
[david.moravek] #! Fix import
[david.moravek] #! Fix type reference
[david.moravek] #! changed triggering to allow event time
[david.moravek] #! added watermark triggering with basic test
[david.moravek] #! fixed tests, code polishing
[david.moravek] #! simplified tests, added element discarding on closed windows
[david.moravek] #! better handling of bounded inputs with triggering
[david.moravek] #! API - refactor operator builders + unit tests
[david.moravek] #! Propage window labels to operator output
[david.moravek] #! Drop needles consistency methods
[david.moravek] #! Correct variable name
[david.moravek] #! Attached/DefaultWindowing emission
[david.moravek] #! Add test
[david.moravek] #! EndOfPane -> EndOfWindow
[david.moravek] #! Put State#collector behind a getter
[david.moravek] #! Move EndOfWindow skiping directly into InMemExecutor
[david.moravek] #! Drop DatumCleanupSink
[david.moravek] #! Move InMemExecutor into a dedicated package
[david.moravek] #! Drop obsolete PersistableDataset
[david.moravek] #! Tighten test condition; provide explanation
[david.moravek] #! Drop prepared logging in test
[david.moravek] #! Tune test
[david.moravek] #! Forward end-of-window only when arriving on all input partitions
[david.moravek] #! Broadcast EoW to every output partition
[david.moravek] #! Drop forgotten debug message
[david.moravek] #! Fix emitting EoW too frequently
[david.moravek] #! Do not synchronize when invoking
[david.moravek] #! Prepare for EoW tracking
[david.moravek] #! Avoid broadcasting too many times
[david.moravek] #! Drop debugging log messages
[david.moravek] #! Fix trigger rescheduling in WatermarkTriggering
[david.moravek] #! Style changes
[david.moravek] #! Resolve merging of obsolete windows
[david.moravek] #! added tests applicable on all executors
[david.moravek] #! removed operator Mapwindow
[david.moravek] #! added simple wordcloud application
[david.moravek] #! Use attached windowing in Stats
[david.moravek] #! Enable watermarking in Stats again
[david.moravek] #! compilability after rebase
[david.moravek] #! Attempt at nailing down random test failure
[david.moravek] #! Allow unified access to .output()
[david.moravek] #! Fluent flow builder (proof-of-concept)
[david.moravek] #! Fluent example
[david.moravek] #! Move fluent api to a submodule
[david.moravek] #! Rename OutputProvider to OutputBuilder
[david.moravek] #! Another attempt at nailing down random test failure
[david.moravek] #! Attempt at fixing flipping test
[david.moravek] #! polishing after review
[david.moravek] #! Update maven repo pointers
[david.moravek] #! Fix maven-project-info-reports-plugin version
[david.moravek] #! early triggering of window (replaces aggregating windows)
[david.moravek] #! Thread-safe access to #activeTasks
[david.moravek] #! Javadoc improvement and minor bug fixes after review
[david.moravek] #! Windowing API requires fixed order of builder methods
[david.moravek] #! Allow reading kafka a whole topic as one partition (for easier
[david.moravek] #! Utilize eventTime and earlyTriggering in Stats (WatermarkWindowing
[david.moravek] #! Revert back to time-sliding
[david.moravek] #! Allowing limiting the RSBK key space
[david.moravek] #! Drop verbose debug message
[david.moravek] #! Hide implementation details and make public input based on Triples
[david.moravek] #! Fix evaluating optional setting
[david.moravek] #! Introduce session windowing
[david.moravek] #! Rename span -> createSpanned
[david.moravek] #! Fix merging fully enclosed windows
[david.moravek] #! Speed up ordering
[david.moravek] #! Test for session window labels
[david.moravek] #! Fix time-sliding and session-windowing in combination with
[david.moravek] #! Allow consuming kafka topics from any earlier offset
[david.moravek] #! Print debug to log instead of stderr
[david.moravek] #! Add failing proof-of-bug test
[david.moravek] #! Fix DAG traversal
[david.moravek] #! Prefer duration over millis in time based APIs
[david.moravek] #! Required TimeSliding step to be a duration in favor of millis
[david.moravek] #! Make up session across searches and clicks
[david.moravek] #! Resuse Either#lift
[david.moravek] #! Make TopPerKey a proper operator
[david.moravek] #! Suppress unchecked warnings; Fix "grouped" flag in RBK
[david.moravek] #! Fix indentation
[david.moravek] #! Fix typo
[david.moravek] #! Make CompositeKey public and reuse inside inmem executor
[david.moravek] #! Fix inmem executing R(S)BK on a grouped dataset
[david.moravek] #! Flink executor skeleton
[david.moravek] #! fix compilation error
[david.moravek] #! refactoring after review
[david.moravek] #! DataSource adapter for Flink executor
[david.moravek] #! DataSink adapter for Flink executor
[david.moravek] #! Support logging during flink tests
[david.moravek] #! DataSink#rollback throws IOException
[david.moravek] #! fix test
[david.moravek] #! ListDataSink stores data in static context
[david.moravek] #! Favor cz.seznam.euphoria:guava-shaded over com.google.guava:guava
[david.moravek] #! Rebase on FlinkIO
[david.moravek] #! ListDataSink review
[david.moravek] #! Flink implementation of ReduceByKey (no windowing)
[david.moravek] #! ReduceByKey has isCombinable() method
[david.moravek] #! ReduceByKey uses custom partitioner just in case it's different from
[david.moravek] #! testapps - WordCount implementation
[david.moravek] #! Remove explicit parallelism from OperatorTranslator interface
[david.moravek] #! Comment
[david.moravek] #! Avoid casts for readability reasons
[david.moravek] #! [euphoria-flink] Dump execution plan prio to flow execution
[david.moravek] #! Type-safe HadoopInputFormatAdapter.
[david.moravek] #! Type-safe HadoopOutputFormatAdapter.
[david.moravek] #! Refactoring.
[david.moravek] #! Make HadoopDataSource public.
[david.moravek] #! Add SequenceFile factories.
[david.moravek] #! Add proof-of-concept test
[david.moravek] #! [euphoria-flink] Fix operator-input-dataset-mapping
[david.moravek] #! Add printing element type for debugging purposes
[david.moravek] #! Avoid non-implemented windowing in proof-of-concept test
[david.moravek] #! [euphoria-flink] Separation of streaming and batch executors
[david.moravek] #! Rename items for clarity reasons
[david.moravek] #! Tighten method signature to expected operator type
[david.moravek] #! Javadoc
[david.moravek] #! Move #getExecutionEnvironment to parent class
[david.moravek] #! Remove garbage
[david.moravek] #! [euphoria-flink] batch input format adapter (without data locality)
[david.moravek] #! [euphoria-flink] batch output format adapter
[david.moravek] #! [euphoria-flink] batch ReduceByKey implementation
[david.moravek] #! [euphoria-hadoop] Make HadoopDataSource serializable
[david.moravek] #! [euphoria-flink] Make batch-word-count work (on
[david.moravek] #! [euphoria-flink] Add an upper bound to parallelism on operators
[david.moravek] #! [euphoria-core] Conditional partitioning in fluent style
[david.moravek] #! refactored window to windowcontext and windowid
[david.moravek] #! fixed test for time sliding window
[david.moravek] #! moved Datum to public API and changed its name
[david.moravek] #! likvidace unchecked warningu
[david.moravek] #! refactored windowing stuff to separate package
[david.moravek] #! refactored windowing types to separate classes
[david.moravek] #! unified AttachedWindowing with all other windowings
[david.moravek] #! unified ElementWindowing and Windowing
[david.moravek] #! refactored data passing inside inmem pipelines, failing tests related
[david.moravek] #! rebased on master
[david.moravek] #! inmem working on watermarks and regular attached windowing
[david.moravek] #! incorporated changes after review
[david.moravek] #! [euphoria-inmem] Emit watermarks with every input item
[david.moravek] #! Extract diff of jenda/16255-add-watermarking-to-inmem and master
[david.moravek] #! Make euphoria-flink compile (temporary work-around)
[david.moravek] #! Increase read-timeout way over watermarking triggering in the inmem
[david.moravek] #! [euphoria-core] Drop obsolete field
[david.moravek] #! fix watermark triggering and associated tests
[david.moravek] #! code polishing
[david.moravek] #! removed unneeded synchronization
[david.moravek] #! [euphoria-flink] Partial progress on window-element envelopes
[david.moravek] #! [euphoria-flink] Handle window-element envelopes in Repartition
[david.moravek] #! tuned generic windowing for use with sliding windows
[david.moravek] #! code formatting
[david.moravek] #! [euphoria-flink] Handle window-element envelopes in batch mode
[david.moravek] #! [euphoria-flink] Perform conversion to/from window-elements in
[david.moravek] #! [euphoria-flink] Attempt fixing window leak
[david.moravek] #! [euphoria-flink] Fix emiting label to windowed-pairs.
[david.moravek] #! Split operator
[david.moravek] #! commit kafka consumer offsets
[david.moravek] #! Split operator
[david.moravek] #! post-review cleanup
[david.moravek] #! refactoring
[david.moravek] #! [euphoria-flink] Add context to error message
[david.moravek] #! [euphoria-testapps] WordCloud Server/Client/Sink
[david.moravek] #! [euphoria-flink] Initial sketch of JoinTranslator
[david.moravek] #! [euphoria-flink] Correctly emit Pair instances out of join
[david.moravek] #! add support for state backend to flink
[david.moravek] #! [euphoria-flink] Handle windowed-element in join operator
[david.moravek] #! tuned stats for inmem and new windowing
[david.moravek] #! stats tuned on inmem for event time, latecomers and correct distinct
[david.moravek] #! fixed ReduceWindow operator
[david.moravek] #! simplified stats flow, fixed some bugs and minor refactored code and
[david.moravek] #! [euphoria-flink] implementation of ReduceStateByKey for streaming API
[david.moravek] #! [euphoria-flink] avoid "Invalid lambda deserialization" in
[david.moravek] #! [euphoria-flink] RSBK closes state after flush()
[david.moravek] #! [euphoria-flink] implementation of ReduceStateByKey for batch API
[david.moravek] #! codestyle after review
[david.moravek] #! [euphoria-flink] Fix NPE due to ReduceWindow
[david.moravek] #! validate that no two operators use the same sink
[david.moravek] #! [euphoria-flink] Fix class-cast-exception
[david.moravek] #! [euphoria-flink] Have StreamingWindowedElement flow through the
[david.moravek] #! [euphoria-flink] Drop support for processing time
[david.moravek] #! [euphoria-flink] Add support for transfering window emission
[david.moravek] #! [euphoria-flink] Add support for attached windowing to ReduceByKey
[david.moravek] #! [euphoria-flink] Suppress unchecked warnings
[david.moravek] #! [euphoria-flink] Fix attached window emission (was too early)
[david.moravek] #! [euphoria-flink] Stabilize test
[david.moravek] #! [euphoria-flink] Fix label for time-sliding windows on flink
[david.moravek] #! [euphoria-flink] Add TODO
[david.moravek] #! [euphoria-flink] Allow tuning window emission parameters
[david.moravek] #! [euphoria-flink] Align flink and euphoria-core time sliding labeling
[david.moravek] #! [euphoria-flink] Fix streaming MapElements
[david.moravek] #! [euphoria-flink] Tune windowing parameters for test
[david.moravek] #! [euphoria-flink] Descrease presure for jenkins
[david.moravek] #! [euphoria-flink] Descrease presure for jenkins
[david.moravek] #! [euphoria-flink] Correct test setting
[david.moravek] #! [euphoria-flink] Correct auto-watermark-interval setting
[david.moravek] #! [euphoria-flink] Have StreamingWindowedElement flow through RSBK impl
[david.moravek] #! [euphoria-flink] Integrate attached-windowing into RSBK impl
[david.moravek] #! [euphoria-flink] Handle negative watermarks
[david.moravek] #! Move TimeInterval out of Time
[david.moravek] #! Make TimeSliding using TimeInterval as a window label
[david.moravek] #! [euphoria-flink] WindowedElement to StreamingWindowedElement in
[david.moravek] #! [euphoria-flink] Drop native join translator (rely on RBSK)
[david.moravek] #! Drop dead comments
[david.moravek] #! Centralize flink version
[david.moravek] #! review
[david.moravek] #! moved flink operator testkit to the euphoria-flink package
[david.moravek] #! implemented state storage for states in inmem executor
[david.moravek] #! implemented state storage in flink, not well tested
[david.moravek] #! small polishing
[david.moravek] #! code polishing after review
[david.moravek] #! State is not required to be Serializable
[david.moravek] #! [euphoria-flink] implementation of non-combining ReduceByKey for
[david.moravek] #! small formatting changes
[david.moravek] #! refactored statestorage to work on storage descriptors
[david.moravek] #! changes after review
[david.moravek] #! [euphoria-flink] Upgrade flink to 1.1.2
[david.moravek] #! [euphoria-flink] Switch time and time-sliding to euphoria
[david.moravek] #! [euphoria-flink] Correct forwarding operator parallelism
[david.moravek] #! [euphoria-testapps] Emit only top-200 words from word-count
[david.moravek] #! [euphoria-flink] Fix memory leak on window triggers
[david.moravek] #! [euphoria-flink] Attempt to fix clear-window-state leak in backend
[david.moravek] #! [euphoria-core, euphoria-flink] Align trigger behavior in inmem and
[david.moravek] #! [euphoria-flink] Testify early triggering
[david.moravek] #! [euphoria-flink] Schedule window only once
[david.moravek] #! [euphoria-flink] Rename FlinkTrigger to FlinkWindowTrigger
[david.moravek] #! [euphoria-flink] Fully integrate generic windowing
[david.moravek] #! [euphoria-flink] Fix type annotation
[david.moravek] #! [euphoria-flink] Fix after rebase
[david.moravek] #! [euphoria-flink] Reduce noise on unchecked warnings
[david.moravek] #! [euphoria-flink] Small refactoring
[david.moravek] #! Stabilize flipping test
[david.moravek] #! distinct operator test from testkit moved on event time
[david.moravek] #! countByKey tested by operator test in flink
[david.moravek] #! sumbykey and reducebykey on event time windows
[david.moravek] #! tuned operator testkit for flink, passes on batch inputs
[david.moravek] #! flink keys have to be comparable or exception is thrown
[david.moravek] #! TimeInterval is Comparable
[david.moravek] #! functional all operator tests on flink
[david.moravek] #! changes after review
[david.moravek] #! WIP: #16426 Remove GROUP from Windowing
[david.moravek] #! [euphoria-core] Avoid needless allocation during WindowID#hashCode
[david.moravek] #! [euphoria-core] Make inmem RSBK handle groupless windows
[david.moravek] #! [euphoria-operator-testkit] Remove GROUP from windowing
[david.moravek] #! [euphoria-core] Drop global count window test (feature discontinued)
[david.moravek] #! [euphoria-flink] Remove GROUP from windowing
[david.moravek] #! [euphoria-flink] code style
[david.moravek] #! [euphoria-core] Rename Collector -> Context
[david.moravek] #! [euphoria-core] Provide Context#getWindow
[david.moravek] #! [euphoria-flink] Provide Context#getWindow
[david.moravek] #! [euphoria-*] Drop WindowedPair
[david.moravek] #! [euphoria-*] Avoid using the term "windowed pair"
[david.moravek] #! [euphoria-flink] Fix windowing for batched based R(S)BK translators
[david.moravek] #! forward stamp with each element in inmem executor
[david.moravek] #! [eurphoria-core] Added tests for earlytriggered session windowing,
[david.moravek] #! [euphoria-core] FIXME: overridden time windowing for element-time
[david.moravek] #! Passing element time within pipelines in inmem executor
[david.moravek] #! [euphoria-ios] added IOS application module
[david.moravek] #! [euphoria-ios] refactored module structure, separated server from
[david.moravek] #! [euphoria-ios] added core for demonstration of lambda architecture
[david.moravek] #! [euphoria-ios review] removed several FIXMEs added test for
[david.moravek] #! Trigger API redesigned
[david.moravek] #! [euphoria-inmem] ReduceStateByKey against new trigger api
[david.moravek] #! [euphoria-inmem] Implement MergingWindowing support
[david.moravek] #! [euphoria-inmem] Enable sort-state test
[david.moravek] #! [euphoria-inmem] Attempt to fix fliping test
[david.moravek] #! [euphoria-inmem] Make Windowing#trigger not return null
[david.moravek] #! [euphoria-flink] Executor uses new Trigger API
[david.moravek] #! [euphoria-flink] Minor cleanup
[david.moravek] #! [euphoria-ios] Get compilation right
[david.moravek] #! [euphoria-flink] Forward element timestamp
[david.moravek] #! [euphoria-inmem] Fix trigger state merging
[david.moravek] #! [euphoria-inmem] Create a new instance of trigger state during merge
[david.moravek] #! [euphoria-core] PeriodicTimeTrigger is aligned with window start
[david.moravek] #! [euphoria-core] Fixed timer registration in PeriodicTimeTrigger
[david.moravek] #! [euphoria-core] Drop logging in periodic-time-triggering
[david.moravek] #! [euphoria-inmem] Ensure calling onElement on merged windows
[david.moravek] #! [euphoria-core] added serializable Supplier #! [euphoria-hadoop]
[david.moravek] #! [euphoria-kafka], [euphoria-core], [euphoria-hadoop] changed life
[david.moravek] #! [euphoria-ios] review and tuning
[david.moravek] #! [euphoria-kafka] renamed all euphoria kafka artifact references to
[david.moravek] #! Upgrade to Flink 1.1.3
[david.moravek] #! [euphodia-ios] remove the module from parent pom
[david.moravek] #! [euphoria-flink] RBK: Support for merging windows (streaming)
[david.moravek] #! [euphoria-flink] RSBK: Verify correct behaviour during
[david.moravek] #! [euphoria-core] Require MergingWindowing#W being Comparable
[david.moravek] #! [euphoria-hadoop] Fix TaskID retrieval from Hadoop context
[david.moravek] #! [euphoria-core] correct discarding of latecomers
[david.moravek] #! [euphoria-flink] Code style; apply diamond operator
[david.moravek] #! [euphoria-flink] Fix non-combining RBK on bounded input
[david.moravek] #! [euphoria-core] fixed latecomers - review
[david.moravek] #! small fixes
[david.moravek] #! [euphoria-hadoop] DataSourceInputFormat/DataSinkOutputFormat don't
[david.moravek] #! [euphoria-spark] Spark executor implementation for bounded datasets
[david.moravek] #! [euphoria-core] Add operator type annotations
[david.moravek] #! [euphoria-core] state complexity and number of repartitions in
[david.moravek] #! [euphoria-ios] added module for command line tools
[david.moravek] #! [euphoria-ios] added description of lambda and kappa architecture,
[david.moravek] #! [euphoria-ios] added support for spark, finished presentation
[david.moravek] #! [euphoria-ios] performance tuning of Trends application
[david.moravek] #! [euphoria-ios] slightly optimized spark RSBK, IOS presentation
[david.moravek] #! [euphoria-ios] rebased on master
[david.moravek] #! [euphoria-ios] review and removed duplicate code
[david.moravek] #! [euphoria-flink] Support window merging in batch mode
[david.moravek] #! [euphoria-core/flink] Align element timestamp with window emission
[david.moravek] #! flink batch repartition + repartition batch tests
[david.moravek] #! partitioning with default partitioner
[david.moravek] #! Executor API
[david.moravek] #! inmem and flink executor implementation
[david.moravek] #! spark executor
[david.moravek] #! cleaning
[david.moravek] #! DefaultPartitioner as its own type
[david.moravek] #! [euphoria-core] Required explicit windowing if not joining batches
[david.moravek] #! [euphoria-flink] Fix logic in evaluating RBK translation
[david.moravek] #! [euphoria-core] Make WindowingRequiredException a top-level class for
[david.moravek] #! [euphoria-core] Javadoc; Remove reference to seznam internal
[david.moravek] #! [euphoria-core] Javadoc; Make promise about failing upon
[david.moravek] #! Event time extractor function at operator level
[david.moravek] #! minor refactoring after review
[david.moravek] #! [euphoria-testkit] Demo testkit junit integration
[david.moravek] #! [euphoria-testkit] Processing annotation
[david.moravek] #! [euphoria-testkit] Add more tests to demo testkit
[david.moravek] #! [euphoria-flink] ModuloSplitAssigner for testkit
[david.moravek] #! [euphoria-testkit] Use NG jUnit runner
[david.moravek] #! Spark executor - full support of ReduceByKey/ReduceStateByKey
[david.moravek] #! Remove GroupBy operator
[david.moravek] #! Avoid flink stream hanging upon cancellation
[david.moravek] #! [euphoria-spark] Fix partitioner when partitionId is negative
[david.moravek] #! TimeInterval windows are right-open intervals (not overlapping
[david.moravek] #! [euphoria-hadoop] Remove MultiReader from HadoopDataSource
[david.moravek] #! [euphoria-hadoop] Remove SerializableWritable from public constructor
[david.moravek] #! [euphoria-flink] Use LocatableInputSplitAssigner for batch inputs
[david.moravek] #! README.md proposal
[david.moravek] #! Prevent windowing with zero duration
[david.moravek] #! Drop KafkaSource#batchSize #! #! The same effect is achievable
[david.moravek] #! Provide easy-to-use hadoop based data-source/-sinks
[david.moravek] #! Update README
[david.moravek] #! Fix few TODOs
[david.moravek] #! Add convenience hadoop data sink around text files
[david.moravek] #! Provide simple-hadoop-text-file-data-source
[david.moravek] #! Javadoc
[david.moravek] #! Drop "Data" from the name of hadoop data-sources/-sinks
[david.moravek] #! Imperative to functional style
[david.moravek] #! Extract inmem executor into a dedicated module
[david.moravek] #! Drop unneccessary dependency on commons-io
[david.moravek] #! Upgrade to guava 21.0
[david.moravek] #! [euphoria-testapps] Resolve conflict on kryo
[david.moravek] #! [euphoria-flink] Use key type Tuple2 instead of ComparablePair
[david.moravek] #! benchmarks unification
[david.moravek] #! Add LICENSE (APLv2.0)
[david.moravek] #! Ensure LICENSE/NOTICE files in produced artifacts/jars
[david.moravek] #! Drop guava shading
[david.moravek] #! Move euphoria-testapps to a dedicated, top-level repo
[david.moravek] #! Remove obsolete dependency definitions
[david.moravek] #! Upgrade maven jar plugin; Cleanup debian package dependencies #! #!
[david.moravek] #! Polish README
[david.moravek] #! Get rid of szn specific stuff
[david.moravek] #! Integrate licensing headers mechanism
[david.moravek] #! Apply license headers
[david.moravek] #! Update new SCM information; Drop obsolete SZN specifics
[david.moravek] #! Support custom artifact deployments
[david.moravek] #! Correct spelling
[david.moravek] #! [euphoria-kafka] Properly quit read loop when interrupted
[david.moravek] #! Correct name of copyright owner
[david.moravek] #! Temporarily remove documentation section
[david.moravek] [WIP] Prepare maven central deploy (#3)
[david.moravek] #! Link documentation from within README
[david.moravek] #! Add self-contained euphoria-examples module for demoing purposes
[david.moravek] #! Add link to examples
[david.moravek] WIP: Integration with travis-ci.org (#6)
[david.moravek] #! [euphoria-spark] Upgrade to Spark 2.1.0
[david.moravek] #! Drop obsolete "hudson" profiles
[david.moravek] #! Cleanup obsolete gitignore patterns
[david.moravek] #! Add Travis CI badge into README
[david.moravek] #! Drop obsolete class
[david.moravek] #! [euphoria-core] Cleanup inmem specific classes
[david.moravek] #! Sanitze javadocs
[david.moravek] #! Drop obsolete class
[david.moravek] #16 Replace Dataset#getPartitioning() with Dataset#getNumPartitions()
[david.moravek] #16 Move Partitioning related classes to a dedicated package
[david.moravek] #! Attempt automatic deployments
[david.moravek] #! Exclude continuous-deliver folder from being license validated
[david.moravek] #! Set execution flag on deploy scripts
[david.moravek] #! Add missing <name/> <description/>
[david.moravek] [maven-release-plugin] prepare release v0.5.0
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] #! Avoid running tests twice
[david.moravek] #! Mention maven dependencies in README.md
[david.moravek] #8 Suppress safe unchecked warnings
[david.moravek] #! Rename StorageDescriptorBase to StorageDescriptor
[david.moravek] #18 Fix a few minor bugs after static code analysis
[david.moravek] #18 Fail build when troubling error is found by FindBugs analysis
[david.moravek] #18 Use @Nullable annotation
[david.moravek] #10 Improve documentation around URI based data-sources/-sinks
[david.moravek] #10 Fix typos
[david.moravek] #! Add contribution section to README
[david.moravek] #! [euphoria-flink] Allow enabling object reuse
[david.moravek] #48 Move most maven plugins under the "regular-build" profile (active by
[david.moravek] #! Document regular-build profile
[david.moravek] #27 [euphoria-flink] Rewrite windowing to native implementation of
[david.moravek] #! [euphoria-flink] Avoid extra shuffle when windowing on streaming
[david.moravek] #47 [euphoria-flink] Alternatively execute windowing/valueOf fully after
[david.moravek] #! [euphoria-flink] Allow specifying latency tracking interval
[david.moravek] #! Make WindowedElement an interface
[david.moravek] #! Drop WindowedElementImpl from euphoria-core
[david.moravek] #! Make window-element-factory use-case specific
[david.moravek] #! [euphoria-kafka] No sync commit
[david.moravek] #14 [euphoria-flink] Don't send timestamp along with each element. Use
[david.moravek] #! Add link to gitter chat
[david.moravek] #14 review cleanup
[david.moravek] #14 [euphoria-flink] Allow WindowAssigner operator chaining
[david.moravek] #60 Prefer ValueStorage instead of ListStorage for combining RSBK
[david.moravek] #! Register Either for serialization
[david.moravek] #! Suppress safe casts
[david.moravek] #! Add a dedicated interface for event-time extraction to reduce
[david.moravek] #! Register Triple and clean up in TopByKey
[david.moravek] #47 Windowing#assignWindowsToElement returns Iterable instead of Set
[david.moravek] #47 [euphoria-core] TimeSliding window assigner generates custom
[david.moravek] #! Make storage descriptors static
[david.moravek] #! [euphoria-flink] Do not cache states
[david.moravek] #! Drop Supplier from public API
[david.moravek] #67 [euphoria-flink] Avoid descriptors cache infinitely growing
[david.moravek] #67 [euphoria-flink] Avoid flushing empty states due to "localMode"
[david.moravek] #67 [euphoria-flink] Fix window merging
[david.moravek] #67 [euphoria-flink] Avoid inlining processTriggerResult
[david.moravek] #! Include link to FAQ wiki page
[david.moravek] #! Add shaded-guava for internal use within euphoria
[david.moravek] #! Add javadoc generation
[david.moravek] #! Switch over to shaded guava
[david.moravek] #51 Do _not_ store storage-provider in states by default
[david.moravek] #51 Move StateFactory to the state package
[david.moravek] #51 StateFactory interface revised
[david.moravek] #51 Replace StateCombiner with StateMerger
[david.moravek] #51 Drop obsolete TODO
[david.moravek] #51 [euphoria-core] Skip processing empty window merge sets
[david.moravek] #19 [euphoria-flink] Avoid extra shuffle (on the batch executor)
[david.moravek] # [euphoria-flink] Fix trigger state clean-up of merged windows
[david.moravek] #! [euphoria-examples] Example of web server log aggregation
[david.moravek] #! [euphoria-examples] Fix license header
[david.moravek] #61 [euphoria-flink] Unit test covering out-of-order stream with allowed
[david.moravek] #79 [euphoria-core] Trigger#onMerge does not return TriggerResult
[david.moravek] #! InputSplit#toString - especially useful on spark
[david.moravek] #! Add convenience hadoop sink
[david.moravek] #! Generalize HadoopStringSink to accept any type of object
[david.moravek] #! [euphoria-flink] Warn about failing execution scenario
[david.moravek] #! Update copyright
[david.moravek] #85 Move findbugs plugin execution to the process-classes phase
[david.moravek] #77 Import trends benchmarks
[david.moravek] #77 Drop obsolete shell script
[david.moravek] #77 - parsing fix
[david.moravek] #! Variable year in license header
[david.moravek] #! [euphoria-core] Avoid clearing count state twice
[david.moravek] #! Fix typo
[david.moravek] #95 Rename Batch to GlobalWindowing
[david.moravek] #! Drop Map.Entry from Pair
[david.moravek] #! Add @Experimental for easier API evolution
[david.moravek] #21 [euphoria-core] Code/Javadoc style
[david.moravek] #21 [euphoria-core] Javadocs for FlatMap
[david.moravek] #21 [euphoria-core] Javadocs for Union
[david.moravek] #! Add contact information to README.md
[david.moravek] #99 Sort operator support
[david.moravek] #21 [euphoria-core] Javadocs for Repartition
[david.moravek] #21 [euphoria-core] Javadocs for ReduceStateByKey
[david.moravek] Update README.md
[david.moravek] Update README.md
[david.moravek] #! Remove obsolete class
[david.moravek] #! Do not allow derivations from Pair/Triple
[david.moravek] #98 [euphoria-flink] Do not allow object re-use
[david.moravek] #! - javadoc refactoring
[david.moravek] #13 [euphoria-flink] Batch executor uses hash code as a key in shuffles
[david.moravek] #13 [euphoria-flink] Fix bug in batch ReduceByKeyTranslator and add unit
[david.moravek] #13 Fix race condition in batch ReduceStateByKeyTranslator
[david.moravek] #13 [euphoria-flink] Copy input instance in ReduceByKeyTranslator
[david.moravek] #! some corrections/formatting
[david.moravek] #13 [euphoria-flink] Avoid hash code collisions in batch
[david.moravek] #105 Add (failing) proof-of-concept test
[david.moravek] #105 Rework StateFactory API; Stabilize JoinState implementation
[david.moravek] #43 Annotate experimental Session#earlyTriggering
[david.moravek] #105 Do not read entire disk storage into memory
[david.moravek] #105 Provide an experimental "early emitting" join state implementation
[david.moravek] #105 Simplify closing spilling file
[david.moravek] #105 Document some more experiment dangers
[david.moravek] #! [benchmarks/native-flink] Filter out invalid entries
[david.moravek] #! Upgrade to flink 1.2.1
[david.moravek] #! Prevent deleting wrong timers
[david.moravek] #! polish: removed unnecessary null check, variable reuse
[david.moravek] #105 Add reference to future solution
[david.moravek] #! Prepare for 0.6.0 release
[david.moravek] [maven-release-plugin] prepare release v0.6.0
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] #! Prepare for next dev iteration on master
[david.moravek] #! Update README regarding new release
[david.moravek] #! Fix loading configuration
[david.moravek] #! [euphoria-examples] Explain in details the word-count-example
[david.moravek] #! [euphoria-examples] Explain in details the access-log-count
[david.moravek] #! [euphoria-examples] Correct typos
[david.moravek] #! [euphoria-flink] Stabilize test
[david.moravek] #! Stabilize sort-test
[david.moravek] #! Stabilize count-by-key-test
[david.moravek] #119 [euphoria-core/-inmem] Rework event time assignment
[david.moravek] #119 [euphoria-flink] Rework event time assignment
[david.moravek] #119 [euphoria-spark] Rework event time assignment
[david.moravek] #119 Add missing license headers
[david.moravek] #119 [euphoria-examples] Rework event time assignment
[david.moravek] #119 [euphoria-benchmarks] Rework event time assignment
[david.moravek] #! Stabilize inmem-executor join test
[david.moravek] #121 Allow multiple elements to be emitter from ReduceByKey
[david.moravek] #121 changes requested by review
[david.moravek] #121 fixed comment
[david.moravek] #113 [euphoria-spark] Implement disk splitting list-storage
[david.moravek] #113 [euphoria-flink] Unify disk spilling implementation for
[david.moravek] #113 Add missing license headers
[david.moravek] #113 [euphoria-spark] Drop obsolete warning suppression
[david.moravek] #113 [euphoria-testkit] Enable accidently disabled RBK tests
[david.moravek] #113 [euphoria-core] Support try-with-resources for
[david.moravek] #113 [euphoria-testkit] Allow different local spill file allocation
[david.moravek] #113 [euphoria-flink] Support a wider area of types during
[david.moravek] #113 [euphoria-core] Testify FsSpillingListStorage
[david.moravek] #113 Add missing license header
[david.moravek] #31 [euphoria-core] Implementation of accumulator API + integration with
[david.moravek] #31 Refactored according to review feedback
[david.moravek] #133 [euphoria-spark] Accumulator API supported in Spark executor
[david.moravek] #133 [euphoria-inmem] Accumulator API supported in in-mem executor
[david.moravek] #133 [euphoria-spark] Collector should be transient in
[david.moravek] #135 Add SingleJvmAccumulatorFactory
[david.moravek] #135 Demostrates usage of accumulators validation in operator testkit
[david.moravek] #135 Fix histogram accumulation
[david.moravek] #135 GetSnapshot -> Snapshotable
[david.moravek] #135 Add tests covering accumulator usage
[david.moravek] #135 Fix failing tests on the spark executor
[david.moravek] #134 [euphoria-spark] Implemented support for Spark native accumulators
[david.moravek] #134 [euphoria-core] Fix misleading log warning in
[david.moravek] #134 [euphoria-spark] Clone accumulator factory before flow execution
[david.moravek] #134 [euphoria-spark] Make SparkAccumulatorHolder thread-safe
[david.moravek] [maven-release-plugin] prepare release v0.7.0
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] #! Version up
[david.moravek] #! Fix Javadoc warnings
[david.moravek] #! Fix Findbugs warnings
[david.moravek] #! [euphoria-spark] Correctly transfer global state to executed UDFs
[david.moravek] #! Pete dropping out
[david.moravek] [maven-release-plugin] prepare release v0.7.1
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] [euphoria-spark] Propagate exception in SparkFlowTranslator
[david.moravek] [euphoria-hadoop] fix SequenceFileSource
[david.moravek] [euphoria-hadoop] wrap hadoop config in SequenceFileSource, so it cannot
[david.moravek] [euphoria-core] Remove IORegistry.
[david.moravek] [euphoria] add links to license-header.txt from subprojects
[david.moravek] [euphoria] exclude license-header.txt itself from the license header
[david.moravek] [euphoria-flink] #159 fix default parallelism in local flink runner to
[david.moravek] add support for Join operator hints
[david.moravek] [euphoria-core] #160 remove partitioning from stateful operators, bump
[david.moravek] [euphoria-core] #160 drop explicit partitions from ListDataSink
[david.moravek] [euphoria-operator-testkit] #160 compilable testkit after partitioning
[david.moravek] [euphoria-kafka] #160 module compilable after changes
[david.moravek] [euphoria-hadoop] #160 module compilable after changes
[david.moravek] [euphoria-examples] #160 module compilable after changes
[david.moravek] [euphoria-flink] #160 module compilable after changes
[david.moravek] [euphoria-fluent] #160 module compilable after change
[david.moravek] [euphoria-core] #160 removed partitioning and repartition operator
[david.moravek] [euphoria-inmem] #160 compilable, but with failing tests
[david.moravek] [euphoria-inmem] #160 more tests working after code change
[david.moravek] [euphoria-inmem] #160 build passing tests after changes
[david.moravek] [euphoria-spark], [euphoria-flink] #160 modules compilable after
[david.moravek] [euphoria] #160 build passing including tests
[david.moravek] [euphoria] #160 remove mentions of partitions where no longer makes
[david.moravek] [euphoria-hadoop] remove sneakythrows
[david.moravek] [euphoria-kafka] remove groupid from kafkasource
[david.moravek] [euphoria-benchmarks] make benchmarks part of the build
[david.moravek] [euphoria-operator-testkit] activate mistakenly ignored test
[david.moravek] [euphoria-core] add Audience annotation
[david.moravek] [euphoria-core] remove checkpointing from datasets - unusable feature
[david.moravek] added IOUtils to help iterate over methods throwing IOException
[david.moravek] added license
[david.moravek] [euphoria-core] #158 add `withSortedValues` to `ReduceByKey` operator
[david.moravek] [euphoria-core] #158 basic non configurable implementation of value
[david.moravek] [euphoria-core] #158 add StateContext and validate on inmem executor
[david.moravek] [euphoria] #158 implemented external sorter for flink and spark
[david.moravek] [euphoria-core] #157 implement possibility for DataSink to modify
[david.moravek] [euphoria-core] #157 review
[david.moravek] [euphoria-local] #173 changed InMemExecutor to LocalExecutor
[david.moravek] [euphoria-core] #177 added MultiDataSink
[david.moravek] [euphoria-core] #177 MultiDataSink renamed vars
[david.moravek] Move to gradle.
[david.moravek] Add euphoria-examples module to gradle
[david.moravek] Do not ignore spotbugs failures.
[david.moravek] [euphoria] add maxTimestamp to generic Window
[david.moravek] [euphoria-local] fix findbug warning regarding random reuse
[david.moravek] [euphoria] #156 distinguish batch and stream sources
[david.moravek] [euphoria-core] #156 Add split to boundedsource
[david.moravek] [euphoria-core] #161 replace Iterable with Stream in reducing
[david.moravek] [euphoria-local] fix non deterministic test
[david.moravek] Fix javadoc.
[david.moravek] [euphoria-core] DataSinkWrapper is now Serializable
[david.moravek] Shade guava
[david.moravek] Fix shadow jar publishing.
[david.moravek] Fix guava
[david.moravek] [euphoria-build] remove unused protobuf plugin
[david.moravek] [euphoria-core] bugfix building of RBK with no windowing
[david.moravek] [euphoria-hbase] #181 add HBase module
[david.moravek] #181 Code review.
[david.moravek] [euphoria] add compileOnly to testCompile
[david.moravek] [euphoria-core] Union can accept more than two data sets
[david.moravek] Update readme.
[david.moravek] [euphoria-operator-testkit] Reduce by key bounded parallel test.
[david.moravek] [euphoria-operator-testkit] Code review.
[david.moravek] [euphoria-core] Join operator API improvements.
[david.moravek] [euphoria-core] Join operator hint tests.
[david.moravek] [euphoria-core] Join operator hint tests - equals, hash code.
[david.moravek] [euphoria-core] Join operator. Cleanup.
[david.moravek] [euphoria-core] Code review.
[david.moravek] [euphoria-hbase] #181 add bulk loading to hbase sink
[david.moravek] [euphoria-spark] broadcast join.
[david.moravek] [euphoria-spark] broadcast join code review.
[david.moravek] [euphoria-core] Publish test jar.
[david.moravek] [euphoria-hadoop] wrapping hadoopConfig in SequenceFileSink
[david.moravek] Added outputValues() to operators producing pairs
[david.moravek] Updated tests for outputValues
[david.moravek] [euphoria-core] Test ouputValues on all executors.
[david.moravek] [euphoria-core] make sure that windowBy() can be appliedIf()
[david.moravek] [euphoria-hbase] HFileSink uses raw types
[david.moravek] Fix javadoc.
[david.moravek] [euphoria-hbase] add windowing to hfilesink
[david.moravek] [euphoria-flink] move to flink 1.4
[david.moravek] [euphoria-core] Optimize ReduceWindow operator for attached windowing
[david.moravek] [euphoria-hadoop] add failing test case
[david.moravek] [euphoria-hadoop] Refactoring, tests and fixes.
[david.moravek] [euphoria-hadoop] Check output specs during HadoopSink initialization.
[david.moravek] [euphoria-hadoop] Update exception and hadoop utils.
[david.moravek] [euphoria-sink] Fix test.
[david.moravek] [euphoria-hadoop] Test DataSinkOutputFormat.
[david.moravek] [euphoria-hadoop] Make sure initialize is called only once.
[david.moravek] [euphoria-hadoop] Make sure initialize is called exactly once.
[david.moravek] [euphoria-hadoop] Code review.
[david.moravek] [euphoria-hadoop] Code review.
[david.moravek] Bump gradle version
[david.moravek] [euphoria-core] remove getDefaultParallelism from BoundedDataSource
[david.moravek] [euphoria-testing] Init.
[david.moravek] [euphoria-testing] Add comments.
[david.moravek] [euphoria-testing] Code review.
[david.moravek] [euphoria-core] performance tuning
[david.moravek] [euphoria-core] add test for applyIfNot
[david.moravek] [euphoria-hadoop] small fixes
[david.moravek] [euphoria-hbase] fix bulkloading
[david.moravek] [euphoria-spark] register default classes
[david.moravek] [euphoria-spark] Introduce executor builder.
[david.moravek] [euphoria-spark] Simplify.
[david.moravek] [euphoria-flink] register common classes by default
[david.moravek] [euphoria-spark] fix build
[david.moravek] Update README.md
[david.moravek] [euphoria-spark] Add hash map to default classes for kryo.
[david.moravek] [euphoria-spark] Add default parallelism to local mode.
[david.moravek] [euphoria-core] #21 add builder javadocs to operators
[david.moravek] [euphoria-core] Fix javadoc.
[david.moravek] [euphoria-hadoop] InputSplit doesn't have to be Writable
[david.moravek] [euphoria-examples] add hfileloader
[david.moravek] [euphoria-examples] Code review
[david.moravek] Happy new year!!
[david.moravek] [euphoria-hadoop] SequenceFileSink builder
[david.moravek] [euphoria-hadoop] SequenceFileSink builder refactor
[david.moravek] [euphoria-hadoop] sequencefilesink builder consistent with other
[david.moravek] added api example
[david.moravek] [thirdparty-guava] use shaded jar with shadow classifier
[david.moravek] [euphoria] fix javadoc and unchecked warnings
[david.moravek] [euphoria-build] add maven build for releasing
[david.moravek] [euphoria-hadoop] fix build
[david.moravek] [euphoria-hbase] make sure hfiles have correct permissions before
[david.moravek] Hbase bulk load add ALL permissions for Hbase user
[david.moravek] [euphoria-flink] flink register classes with serializers
[david.moravek] check kafka partitions availability
[david.moravek] Check if leader is available in KafkaSource
[david.moravek] Correct indentation
[david.moravek] Test KafkaSource reaction to no consumer partitions
[david.moravek] add licence to KafkaSourceTest
[david.moravek] Add tests in KafkaSourceTest
[david.moravek] Add tests in KafkaSourceTest 2
[david.moravek] Fix KafkaSourceTest
[david.moravek] [euphoria-flink] #260 Flink - broadcast hash join
[david.moravek] [euphoria-flink] #260 reformatting and corrections
[david.moravek] [euphoria-flink] #260 small changes
[david.moravek] Upgrade kafka to 1.0.0
[david.moravek] javadoc fixes
[david.moravek] [euphoria-spark] #243 RDD are cached when used more than once in flow
[david.moravek] [euphoria-core] #259 Hints are not runtime specific. Hints describe
[david.moravek] [euphoria-core] #259 Hints are now in operator, not Dataset
[david.moravek] broadcastHashJoin fix
[david.moravek] broadcastHashJoin fix - util class renamed
[david.moravek] AVRO read example
[david.moravek] sq
[david.moravek] Fix code in README.md
[david.moravek] [euphoria-examples] better exception handling in SimpleWordCount and
[david.moravek] [euphoria-spark] Optimize kryo serialization.
[david.moravek] [euphoria-spark] Singleton serializer test.
[david.moravek] [euphoria-spark] Synchronize singleton serializer.
[david.moravek] Add support for expensive computation hint.
[david.moravek] [euphoria-spark] Fix RDDCaching test.
[david.moravek] [euphoria-spark] Improved RBK translation.
[david.moravek] [euphoria-spark] Fix cache RDD test.
[david.moravek] [euphoria-spark] Remove timestamped element.
[david.moravek] Core changes.
[david.moravek] beam wip
[david.moravek] Rebase on master
[david.moravek] wip
[david.moravek] wip
[david.moravek] wip
[david.moravek] WIP: RBK non deterministic, need tuning of FlowUnfolder
[david.moravek] [euphoria-beam] PoC of beam integration
[david.moravek] [euphoria-beam] add Dataset#persist() listener
[david.moravek] [euphoria-beam] cleanup
[david.moravek] [euphoria-beam] correctly pass coders from inputs
[david.moravek] sq
[david.moravek] [euphoria-beam] BeamFlow is forced to be backed up by Pipeline
[david.moravek] [euphoria-beam] add trigger to window in RBK (missing correct trigger
[david.moravek] [euphoria-beam] bump beam to 2.4.0
[david.moravek] [euphoria-beam] annotations are provided
[david.moravek] Missing test dependencies added. Beam version updated to last release
[david.moravek] Small change to fix error InteliJ Idea is wrongly reporting.
[david.moravek] Wrong merge during rebasing fix.
[david.moravek] [euphoria-beam] wip
[david.moravek] First attempts to run ReduceByKey tests in BeamOperatorsTestSuite. Some
[david.moravek] Small typo fix. ReduceByKeyTest in BeamOperatorsSuite disabled again.
[david.moravek] [euphoria-beam] beamphoria corrections
[david.moravek] [euphoria-beam] Avoid unneccessary lamda allocation with each element in
[david.moravek] [euphoria-beam] Add tranformation names.
[david.moravek] [euphoria-spark] Fix windowing signature in RBK translator.
[david.moravek] beamphoria integration part 1
[david.moravek] [BEAM-3900] removed old licenses
[david.moravek] [BEAM-3900] integrating to gradle build system
[david.moravek] [BEAM-3901] code reformat to comply beam code standard
[david.moravek] [BEAM-3901] findbugs fixes
[david.moravek] [BEAM-3902] euphoria-core checkstyle corrections
[david.moravek] BEAM-3900 Code in euphoria-local package modified to comply with
[david.moravek] BEAM-3900 Code in euphoria-testing package modified to comply with
[david.moravek] [BEAM-3902] euphoria-core checkstyle corrections 2
[david.moravek] [BEAM-3902] euphoria-fluent checkstyle corrections
[david.moravek] [BEAM-3900] Code in euphoria-operator-testkit package modified to comply
[david.moravek] [BEAM-3900] Code in euphoria-operator-testkit package modified to comply
[david.moravek] [BEAM-3900] Code in euphoria-beam package modified to comply with
[david.moravek] [BEAM-3902] Fix license headers and remove unused poms.
[david.moravek] [BEAM-3902] Move euphoria to apache namespace.
[david.moravek] [BEAM-3902] Move euphoria to apache namespace.
[david.moravek] [BEAM-3900] Allow for Beam windowing to be set through Euphoria API.
[david.moravek] [BEAM-3900] Missing licence header added.
[david.moravek] [BEAM-4294] Join translator empty shell added.
[david.moravek] [BEAM-4294] Crude Join operator translation implemented. Still work in
[david.moravek] [BEAM-4294] Inner join translation implemented.
[david.moravek] [BEAM-4294] Left, right and full joins implemeted.
[david.moravek] [BEAM-4294] BeamOperatorsSuite now includes tests of Join operator.
[david.moravek] [BEAM-4360] ReduceStateByKey tests adaptation to beam. - Work in
[david.moravek] [BEAM-4360] Most tests are passing. Some are still ignored mostly due to
[david.moravek] [BEAM-4294] [BEAM-4360] Join translation and ReduceByKey test suite
[david.moravek] [BEAM-4294] [BEAM-4360] Checkstyle warning fixes.
[david.moravek] [BEAM-4394] Pull request review fixes.
[david.moravek] [BEAM-4294] [BEAM-4360] Pull request review fixes. OperatorTranslator
[david.moravek] [BEAM-4294] [BEAM-4360] Circular dependency fix.
[david.moravek] [BEAM-4294] [BEAM-4360] Missing licenses added.
[david.moravek] [BEAM-4294] [BEAM-4360] Fix of local executor module compile error.
[david.moravek] [BEAM-4410] added BroadcastJoinTranslator
[david.moravek] [BEAM-4410] checkstyle fix
[david.moravek] [BEAM-4419] Update Operator Testkit Testkit was moved into
[david.moravek] [BEAM-4366] Two sources of test flipps found and fixed. First was wrong
[david.moravek] [BEAM-4366] Dynamic dependency versions.
[david.moravek] [BEAM-4366] Fully serializable `Pair` (including key and value)
[david.moravek] [BEAM-4443] Builders of Join operators extended to be able to expose
[david.moravek] [BEAM-4443] Builders of ReduceByKey operators extended to be able to
[david.moravek] [BEAM-4443] Builders of ReduceStateByKey operators extended to be able
[david.moravek] [BEAM-4443] Windowing builders now implements Builders.* interfaces
[david.moravek] [BEAM-4443] Builders of CountByKey and SumByKey operators extended to be
[david.moravek] [BEAM-4443] Windowing in parameters of operator builders unified.
[david.moravek] [BEAM-4443] Builders of Distinct operator extended to be able to expose
[david.moravek] [BEAM-4443] Builders of ReduceWindow operator extended to be able to
[david.moravek] [BEAM-4443] Builders of TopPerKey operator extended to be able to expose
[david.moravek] [BEAM-4443] Euphoria to Beam translators updated to reflect changes in
[david.moravek] [BEAM-4443] Tests adapted to new windowing API.
[david.moravek] [BEAM-4443] Euphoria's local executor removed.
[david.moravek] [BEAM-4443] Build fixes (checkstyle, failing tests, findbugs).
[david.moravek] [BEAM-4443] All `WindowBy` builders now contains backward compatible
[david.moravek] [BEAM-4443] All `windowBy` builders now implements
[david.moravek] [BEAM-4443] Javadods updates. Several classes moved to more fitting
[david.moravek] [BEAM-4478] Code review fixes.
[david.moravek] [BEAM-4478] Accumulators translation to Beam Metrics
[david.moravek] [BEAM-4478] added operator name as namespace
[david.moravek] [BEAM-4478] corrections
[david.moravek] [BEAM-4478] Second review fixes.
[david.moravek] [BEAM-4529] MapElementsTest, DistinctTest, CountByKeyTest, SumByKeyTest,
[david.moravek] [BEAM-4560] `PTransform` can now be described in Euphoria API
[david.moravek] [BEAM-4529] Typo fix.
[david.moravek] [BEAM-4530] Executors concept removed.
[david.moravek] [BEAM-4530] The `BeamMetricsTranslationTest` modified to run without
[david.moravek] [BEAM-4530] Code review fixes.
[david.moravek] [BEAM-4428] added Javadoc and updated README
[david.moravek] [BEAM-4428] `BeamFlow.create()` renamed to `BeamFlow.of()`.
[david.moravek] [BEAM-4428] `euphoria-beam` -> `euphoria-core` package merge. All
[david.moravek] [BEAM-4429] add type hint
[david.moravek] [BEAM-4429] added typeHints to valueBy
[david.moravek] [BEAM-4429] TypeHint changed to TypeDescriptor
[david.moravek] [BEAM-4609] Race condition was removed from translation of combinable
[david.moravek] [BEAM-3900] Circular dependency fix.
[david.moravek] [BEAM-3900] Adaptation of build process after rebase above beam/master.
[david.moravek] [BEAM-3900] Formating changes done by `./gradlew spotlessJavaApply`.
[david.moravek] [BEAM-3900] Compilation warnings resolved. Some remnants of euphoria
[david.moravek] [BEAM-3900] `testArtifact` configuration swapped for `shadowTest` as
[david.moravek] [BEAM-3900] Fix javadocs.
[david.moravek] [BEAM-4478] Accumulators translation to Beam Metrics
[david.moravek] [BEAM-4585] New `RegisterCoders` class introduced to allow convinient
[david.moravek] [BEAM-4585] `BeamFlow` now exposes new methods to register `Coders`.
[david.moravek] classAwareKryoCoder failing test
[david.moravek] [BEAM-4705] `ClassAwareKryoCoder` fixed to not colide with other coders.
[david.moravek] [BEAM-4585] Some changes required by code review. Other items will be
[david.moravek] [BEAM-4585] Spotless autoformating.
[david.moravek] [BEAM-3900] Spotless autoformating.
[david.moravek] [BEAM-4705] Kryo integration was enhanced. Api needs review since it is
[david.moravek] [BEAM-4705] Failing test added to prove bug in functionality of
[david.moravek] [BEAM-4705] `KryoRegistrar` wrapped into `IdentifiedRegistrar` in order
[david.moravek] [BEAM-4705] Spotless auto formatting.
[david.moravek] [BEAM-4851] All operators now carry their output and key (if applicable)
[david.moravek] [BEAM-4851] All operators now carry their value type (if applicable).
[david.moravek] [BEAM-4851] So far unsucessfull attempt to use return type extracted
[david.moravek] [BEAM-4851] Test to assert type parameters propagation added.
[david.moravek] [BEAM-4851] Spotless auto formatting. Compilaion warnings fixed.
[david.moravek] [BEAM-5077] Translators now use type information from `Operators`
[david.moravek] [BEAM-5099] `Pair` and `PairCoder` removed in favor of `KV`. Unnecesarry
[david.moravek] [BEAM-5123] Wrong implicit classes imports from the same package in
[david.moravek] [BEAM-5124] Documentation examples added. Join windowing check removed
[david.moravek] [BEAM-5124] Minor redeability improvement.
[david.moravek] [BEAM-5160] Failing test fixed. Another test to confirm the fix added.
[david.moravek] [BEAM-5161] FindBugs enabled. All warnings sorted out. Some remnants
[david.moravek] [BEAM-5124] Minor redeability improvement.
[david.moravek] [BEAM-3900] Cleanup, spotless formating and test adaptation.
[david.moravek] [BEAM-5195] Decomposition of `TopPerKey` was fixed. Documentatioin
[david.moravek] [BEAM-5205] `KryoCoder` now use Kryo's chunked input and output.
[david.moravek] [BEAM-5205] Improved logging to make it easier to debug problems with
[david.moravek] [BEAM-5220] TODOs resolved whenever possible withing several minutes
[david.moravek] [BEAM-5245] Error message improved. New tests added.
[david.moravek] [BEAM-5248] Translators modified so they do not set coders to input
[david.moravek] [BEAM-5276] `ListDataSource` now supports data supplier to lazy fetch
[david.moravek] [BEAM-5287] Attempt to build `ReduceByKey` operator with sorted values
[david.moravek] [BEAM-5263] `SingleValueCollector` now supports accumulators.
[david.moravek] [BEAM-3900] Javadoc, typos, formatting, missing file fixes.
[david.moravek] [BEAM-5306] User defined join functions now can ouputs more than one
[david.moravek] [BEAM-3900] Cleanup before merge.
[vaclav.plajt] [BEAM-3900] Auto formating, CheckStyle and FindBugs fixes.
[echauchot] [BEAM-3310] Extract CustomQueryResults to be used in all metrics sinks
[echauchot] [BEAM-3310] Introduce NetworkMockServer to be used for all metrics sinks
[echauchot] [BEAM-4553] Test Graphite metrics sink
[echauchot] [BEAM-3310] improve http sink test
[echauchot] [BEAM-4553] support runners that do not support committed metrics
[vaclav.plajt] [BEAM-5124] Documentation examples update.
[vaclav.plajt] [BEAM-3900] Build and test fixes.
[vaclav.plajt] [BEAM-5124] Euphoria API documentation updated.
[vaclav.plajt] [BEAM-5124] Readme update.
[marek.simunek] [BEAM-3900] CountByKey TypeDescriptor fix
[vaclav.plajt] [BEAM-3900] Compilation warning fixes.
[vaclav.plajt] [BEAM-3900] Unwanted edits removed.
[scott] Remove .jenkins subdirectory from website/
[scott] Remove symlinking in :stageWebsite task.
[rohde.samuel] Change incompatible message from referencing the output collection to
[github] [BEAM-1251] Add a link to Python 3 Conversion Quick Start Guide to the
[mike] Regression test WithDefaultPreserversesSideInputs
[mike] Fixed withDefaults and withFanout removing side inputs
[ankurgoenka] [BEAM-4176] Enable Post Commit JAVA PVR tests for Flink
[ankurgoenka] [BEAM-4176] Adding start method back to the FlinkJobserverDriver
[melissapa] Add new page for Google BigQueryIO
[echauchot] [BEAM-4553] Refactor MetricsGraphiteSink for code deduplication.
[echauchot] [BEAM-3310] Replace Thread.sleep with a CountDownLatch in all metrics
[scott] Add Apache header to new BigQuery documentation
[github] Inform contributors to tag PRs with R: @reviewer
------------------------------------------
[...truncated 259.94 KB...]
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:94)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:79)
at org.apache.commons.dbcp2.DataSourceConnectionFactory.createConnection(DataSourceConnectionFactory.java:44)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:256)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:868)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn.startBundle(JdbcIO.java:791)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn$DoFnInvoker.invokeStartBundle(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.startBundle(SimpleDoFnRunner.java:226)
at com.google.cloud.dataflow.worker.SimpleParDoFn.reallyStartBundle(SimpleParDoFn.java:301)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:311)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.SimpleParDoFn$1.output(SimpleParDoFn.java:271)
at org.apache.beam.runners.core.SimpleDoFnRunner.outputWindowedValue(SimpleDoFnRunner.java:309)
at org.apache.beam.runners.core.SimpleDoFnRunner.access$700(SimpleDoFnRunner.java:77)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:621)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:609)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn.processElement(TestRow.java:74)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:275)
at org.apache.beam.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:240)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:324)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:200)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:158)
at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:75)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:393)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:362)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:290)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:94)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:79)
at org.apache.commons.dbcp2.DataSourceConnectionFactory.createConnection(DataSourceConnectionFactory.java:44)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:256)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:868)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn.startBundle(JdbcIO.java:791)
Caused by: java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.postgresql.core.PGStream.<init>(PGStream.java:69)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:94)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:79)
at org.apache.commons.dbcp2.DataSourceConnectionFactory.createConnection(DataSourceConnectionFactory.java:44)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:256)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:868)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn.startBundle(JdbcIO.java:791)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn$DoFnInvoker.invokeStartBundle(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.startBundle(SimpleDoFnRunner.java:226)
at com.google.cloud.dataflow.worker.SimpleParDoFn.reallyStartBundle(SimpleParDoFn.java:301)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:311)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.SimpleParDoFn$1.output(SimpleParDoFn.java:271)
at org.apache.beam.runners.core.SimpleDoFnRunner.outputWindowedValue(SimpleDoFnRunner.java:309)
at org.apache.beam.runners.core.SimpleDoFnRunner.access$700(SimpleDoFnRunner.java:77)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:621)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:609)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn.processElement(TestRow.java:74)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:275)
at org.apache.beam.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:240)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:324)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:200)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:158)
at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:75)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:393)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:362)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:290)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Workflow failed. Causes: S01:GenerateSequence/Read(BoundedCountingSource)+ParDo(DeterministicallyConstructTestRow)+JdbcIO.Write/ParDo(Write) failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
jdbcioit0testwritethenrea-10161113-ztgo-harness-3kjf,
jdbcioit0testwritethenrea-10161113-ztgo-harness-3kjf,
jdbcioit0testwritethenrea-10161113-ztgo-harness-3kjf,
jdbcioit0testwritethenrea-10161113-ztgo-harness-3kjf
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at org.apache.beam.sdk.io.jdbc.JdbcIOIT.runWrite(JdbcIOIT.java:125)
at org.apache.beam.sdk.io.jdbc.JdbcIOIT.testWriteThenRead(JdbcIOIT.java:103)
Finished generating test XML results (0.023 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.025 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:beam-sdks-java-io-jdbc:integrationTest (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 5 mins 16.418 secs.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
65 actionable tasks: 14 executed, 51 up-to-date
Publishing build scan...
https://gradle.com/s/pxkm3dbykxstk
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-io-jdbc:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-jdbc:integrationTest'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 33 more
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 48s
2018-10-16 18:18:41,712 cda75395 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 720, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 581, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-10-16 18:18:41,713 cda75395 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-10-16 18:18:41,713 cda75395 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/config-beam-performancetests-jdbc-1220> delete -f <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml> --ignore-not-found
2018-10-16 18:18:42,599 cda75395 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 861, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 720, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 581, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-10-16 18:18:42,599 cda75395 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-10-16 18:18:42,634 cda75395 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-10-16 18:18:42,635 cda75395 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runs/cda75395/pkb.log>
2018-10-16 18:18:42,635 cda75395 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runs/cda75395/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Jenkins build is back to normal : beam_PerformanceTests_JDBC #1222
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_JDBC/1222/display/redirect?page=changes>
Build failed in Jenkins: beam_PerformanceTests_JDBC #1221
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_JDBC/1221/display/redirect?page=changes>
Changes:
[huangry] Python support for worker jar.
[mwylde] Work on a streaming impulse source
[mwylde] fix example job
[mwylde] Review updates
[mwylde] Message count for StreamingImpulseSource is now cluster-wide rather than
[huangry] Use getattr() instead of hasattr() when checking a field exists or not.
[songb] Add a not_use_test_runner_api argument to allow running TestPipeline
[ccy] Fix parentheses on website download page
[mwylde] Fix style errors
------------------------------------------
[...truncated 262.83 KB...]
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:94)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:79)
at org.apache.commons.dbcp2.DataSourceConnectionFactory.createConnection(DataSourceConnectionFactory.java:44)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:256)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:868)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn.startBundle(JdbcIO.java:791)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn$DoFnInvoker.invokeStartBundle(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.startBundle(SimpleDoFnRunner.java:226)
at com.google.cloud.dataflow.worker.SimpleParDoFn.reallyStartBundle(SimpleParDoFn.java:301)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:311)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.SimpleParDoFn$1.output(SimpleParDoFn.java:271)
at org.apache.beam.runners.core.SimpleDoFnRunner.outputWindowedValue(SimpleDoFnRunner.java:309)
at org.apache.beam.runners.core.SimpleDoFnRunner.access$700(SimpleDoFnRunner.java:77)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:621)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:609)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn.processElement(TestRow.java:74)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:275)
at org.apache.beam.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:240)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:324)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:200)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:158)
at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:75)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:393)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:362)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:290)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:257)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:94)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:79)
at org.apache.commons.dbcp2.DataSourceConnectionFactory.createConnection(DataSourceConnectionFactory.java:44)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:256)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:868)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn.startBundle(JdbcIO.java:791)
Caused by: java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.postgresql.core.PGStream.<init>(PGStream.java:69)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:156)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:49)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:195)
at org.postgresql.Driver.makeConnection(Driver.java:452)
at org.postgresql.Driver.connect(Driver.java:254)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:94)
at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:79)
at org.apache.commons.dbcp2.DataSourceConnectionFactory.createConnection(DataSourceConnectionFactory.java:44)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:256)
at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:868)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435)
at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363)
at org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn.startBundle(JdbcIO.java:791)
at org.apache.beam.sdk.io.jdbc.JdbcIO$Write$WriteFn$DoFnInvoker.invokeStartBundle(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.startBundle(SimpleDoFnRunner.java:226)
at com.google.cloud.dataflow.worker.SimpleParDoFn.reallyStartBundle(SimpleParDoFn.java:301)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:311)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.SimpleParDoFn$1.output(SimpleParDoFn.java:271)
at org.apache.beam.runners.core.SimpleDoFnRunner.outputWindowedValue(SimpleDoFnRunner.java:309)
at org.apache.beam.runners.core.SimpleDoFnRunner.access$700(SimpleDoFnRunner.java:77)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:621)
at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.output(SimpleDoFnRunner.java:609)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn.processElement(TestRow.java:74)
at org.apache.beam.sdk.io.common.TestRow$DeterministicallyConstructTestRowFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:275)
at org.apache.beam.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:240)
at com.google.cloud.dataflow.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:324)
at com.google.cloud.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:43)
at com.google.cloud.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:48)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:200)
at com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:158)
at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:75)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:393)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:362)
at com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:290)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Workflow failed. Causes: S01:GenerateSequence/Read(BoundedCountingSource)+ParDo(DeterministicallyConstructTestRow)+JdbcIO.Write/ParDo(Write) failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
jdbcioit0testwritethenrea-10161713-jvk6-harness-4jmm,
jdbcioit0testwritethenrea-10161713-jvk6-harness-4jmm,
jdbcioit0testwritethenrea-10161713-jvk6-harness-4jmm,
jdbcioit0testwritethenrea-10161713-jvk6-harness-4jmm
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at org.apache.beam.sdk.io.jdbc.JdbcIOIT.runWrite(JdbcIOIT.java:125)
at org.apache.beam.sdk.io.jdbc.JdbcIOIT.testWriteThenRead(JdbcIOIT.java:103)
Finished generating test XML results (0.032 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.031 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest>
:beam-sdks-java-io-jdbc:integrationTest (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 4 mins 35.067 secs.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
65 actionable tasks: 14 executed, 51 up-to-date
Publishing build scan...
https://gradle.com/s/puz2gvc3v4twa
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-io-jdbc:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-jdbc:integrationTest'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/sdks/java/io/jdbc/build/reports/tests/integrationTest/index.html>
at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 33 more
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 13s
2018-10-17 00:18:17,276 e8b79389 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 720, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 581, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-10-17 00:18:17,278 e8b79389 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-10-17 00:18:17,278 e8b79389 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/config-beam-performancetests-jdbc-1221> delete -f <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml> --ignore-not-found
2018-10-17 00:18:18,469 e8b79389 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 861, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 720, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 581, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-10-17 00:18:18,470 e8b79389 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-10-17 00:18:18,516 e8b79389 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-10-17 00:18:18,517 e8b79389 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runs/e8b79389/pkb.log>
2018-10-17 00:18:18,518 e8b79389 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_JDBC/ws/runs/e8b79389/completion_statuses.json>
Build step 'Execute shell' marked build as failure