You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/10/16 16:30:37 UTC
Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #1396
See <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/1396/display/redirect?page=changes>
Changes:
[david.moravek] #! Init Euphoria 0.5.0
[david.moravek] #! minor code cleanup
[david.moravek] #! Fix dead lock when executing many tasks
[david.moravek] #! Split partition description from its reader
[david.moravek] #! Call Reader#close upon end-of-stream
[david.moravek] #! Initial draft of KafkaStreamSource
[david.moravek] #! Correct typo in classname
[david.moravek] #! Upgrade PrintStreamSink to a general purpose utility
[david.moravek] #! Revise comments in example code
[david.moravek] #! Allow kafka configuration through properties resource
[david.moravek] #! Fix compilation error in IDEA
[david.moravek] #! Propose readable variable/parameter name
[david.moravek] #! Hadoop input formats adapter
[david.moravek] #! Hadoop input format - clone Writable instances between
[david.moravek] #! Unify input/output creation
[david.moravek] #! Provide easy access to nested configuration settings
[david.moravek] #! Make dataset aware of its consumers
[david.moravek] #! added basic test for retrieving dataset's consumers
[david.moravek] #! fix typo in comment
[david.moravek] #! Make kafka source configurable through settings
[david.moravek] #! Make StdoutSink#dump-partition-id parameter optional again
[david.moravek] #! DataSink API polishing
[david.moravek] #! Do not close stdout through StdoutSink
[david.moravek] #! Log swallowed exceptions
[david.moravek] #! InMemExecutor - fix potential concurrency issue
[david.moravek] #! InMemExecutor - rollback all sinks when any of the tasks fails
[david.moravek] #! Add inmemory filesystem skeleton
[david.moravek] #! Apply InMemFileSystem as SoR in test
[david.moravek] #! Drop obsolete/unused method
[david.moravek] #! Rework iteration towards java8 streams
[david.moravek] #! Remove unused imports
[david.moravek] #! Working join operator
[david.moravek] #! git pull --rebase origin master
[david.moravek] #! minor polishing and removing of warnings
[david.moravek] #! polishing after code review
[david.moravek] #! correct calling of constructor of ReduceStateByKey from
[david.moravek] #! pair moved package
[david.moravek] #! Hadoop output format adapter
[david.moravek] #! clone datasets to all consumers in inmem executor
[david.moravek] #! KafkaStreamSource -> KafkaSource
[david.moravek] #! Initial draft of a non-tx-aware kafka-sink
[david.moravek] #! Correct Pair class reference
[david.moravek] #! comment typo
[david.moravek] #! first part of code review changes
[david.moravek] #! core of realtime stats
[david.moravek] #! Ensure writing out EOS token
[david.moravek] #! DRY on computing sum
[david.moravek] #! implemented remarks from code review
[david.moravek] #! Get reasonable logging output during tests
[david.moravek] #! InMemFileSystem.Factory -> InMemFileSystem.SourceFactory
[david.moravek] #! Sink into the InMemFileSystem for unit testing purposes
[david.moravek] #! Drop CompositeKey#equals implementation
[david.moravek] #! Avoid eye-bleeding
[david.moravek] #! Avoid doubled output
[david.moravek] #! added tests for flatmap, repartition and union, slightly cleaned code
[david.moravek] #! more correct commit of ListDataSink's Writer
[david.moravek] #! get rid of batch code in client API
[david.moravek] #! changes after review
[david.moravek] #! Staless Windowing (Windowing.Count working; others commented out)
[david.moravek] #! Attempt at merging
[david.moravek] #! Fix state merging
[david.moravek] #! Drop Window#add/getState
[david.moravek] #! Shorten test code
[david.moravek] #! Aligned count window
[david.moravek] #! Add Join implementation
[david.moravek] #! Finish up join implementation
[david.moravek] #! fixed test for sort in reducestatebykey
[david.moravek] #! Various styling issue; thanks to review feedback
[david.moravek] #! Add more debugging support through stdout-sink
[david.moravek] #! Correct output format
[david.moravek] #! added tests for reducestatebykey - non aggregating and unaligned
[david.moravek] #! changes after review
[david.moravek] #! Provide more debugging info through stdout-sink
[david.moravek] #! Add (failing) proof-of-concept test
[david.moravek] #! Allowing windowing by item specific event-item
[david.moravek] #! Add VoidSink for debugging purposes
[david.moravek] #! Prefer UnaryFunction over EventTimeFn
[david.moravek] #! Prevent timer thread to die
[david.moravek] #! Prepare window storage
[david.moravek] #! Faster retrieval of active windows
[david.moravek] #! added tests for inmem, added sliding window
[david.moravek] #! fixed copying inputs in multi consumer pipeline
[david.moravek] #! SlidingWindow constructor made private
[david.moravek] #! Fix import
[david.moravek] #! Fix type reference
[david.moravek] #! changed triggering to allow event time
[david.moravek] #! added watermark triggering with basic test
[david.moravek] #! fixed tests, code polishing
[david.moravek] #! simplified tests, added element discarding on closed windows
[david.moravek] #! better handling of bounded inputs with triggering
[david.moravek] #! API - refactor operator builders + unit tests
[david.moravek] #! Propage window labels to operator output
[david.moravek] #! Drop needles consistency methods
[david.moravek] #! Correct variable name
[david.moravek] #! Attached/DefaultWindowing emission
[david.moravek] #! Add test
[david.moravek] #! EndOfPane -> EndOfWindow
[david.moravek] #! Put State#collector behind a getter
[david.moravek] #! Move EndOfWindow skiping directly into InMemExecutor
[david.moravek] #! Drop DatumCleanupSink
[david.moravek] #! Move InMemExecutor into a dedicated package
[david.moravek] #! Drop obsolete PersistableDataset
[david.moravek] #! Tighten test condition; provide explanation
[david.moravek] #! Drop prepared logging in test
[david.moravek] #! Tune test
[david.moravek] #! Forward end-of-window only when arriving on all input partitions
[david.moravek] #! Broadcast EoW to every output partition
[david.moravek] #! Drop forgotten debug message
[david.moravek] #! Fix emitting EoW too frequently
[david.moravek] #! Do not synchronize when invoking
[david.moravek] #! Prepare for EoW tracking
[david.moravek] #! Avoid broadcasting too many times
[david.moravek] #! Drop debugging log messages
[david.moravek] #! Fix trigger rescheduling in WatermarkTriggering
[david.moravek] #! Style changes
[david.moravek] #! Resolve merging of obsolete windows
[david.moravek] #! added tests applicable on all executors
[david.moravek] #! removed operator Mapwindow
[david.moravek] #! added simple wordcloud application
[david.moravek] #! Use attached windowing in Stats
[david.moravek] #! Enable watermarking in Stats again
[david.moravek] #! compilability after rebase
[david.moravek] #! Attempt at nailing down random test failure
[david.moravek] #! Allow unified access to .output()
[david.moravek] #! Fluent flow builder (proof-of-concept)
[david.moravek] #! Fluent example
[david.moravek] #! Move fluent api to a submodule
[david.moravek] #! Rename OutputProvider to OutputBuilder
[david.moravek] #! Another attempt at nailing down random test failure
[david.moravek] #! Attempt at fixing flipping test
[david.moravek] #! polishing after review
[david.moravek] #! Update maven repo pointers
[david.moravek] #! Fix maven-project-info-reports-plugin version
[david.moravek] #! early triggering of window (replaces aggregating windows)
[david.moravek] #! Thread-safe access to #activeTasks
[david.moravek] #! Javadoc improvement and minor bug fixes after review
[david.moravek] #! Windowing API requires fixed order of builder methods
[david.moravek] #! Allow reading kafka a whole topic as one partition (for easier
[david.moravek] #! Utilize eventTime and earlyTriggering in Stats (WatermarkWindowing
[david.moravek] #! Revert back to time-sliding
[david.moravek] #! Allowing limiting the RSBK key space
[david.moravek] #! Drop verbose debug message
[david.moravek] #! Hide implementation details and make public input based on Triples
[david.moravek] #! Fix evaluating optional setting
[david.moravek] #! Introduce session windowing
[david.moravek] #! Rename span -> createSpanned
[david.moravek] #! Fix merging fully enclosed windows
[david.moravek] #! Speed up ordering
[david.moravek] #! Test for session window labels
[david.moravek] #! Fix time-sliding and session-windowing in combination with
[david.moravek] #! Allow consuming kafka topics from any earlier offset
[david.moravek] #! Print debug to log instead of stderr
[david.moravek] #! Add failing proof-of-bug test
[david.moravek] #! Fix DAG traversal
[david.moravek] #! Prefer duration over millis in time based APIs
[david.moravek] #! Required TimeSliding step to be a duration in favor of millis
[david.moravek] #! Make up session across searches and clicks
[david.moravek] #! Resuse Either#lift
[david.moravek] #! Make TopPerKey a proper operator
[david.moravek] #! Suppress unchecked warnings; Fix "grouped" flag in RBK
[david.moravek] #! Fix indentation
[david.moravek] #! Fix typo
[david.moravek] #! Make CompositeKey public and reuse inside inmem executor
[david.moravek] #! Fix inmem executing R(S)BK on a grouped dataset
[david.moravek] #! Flink executor skeleton
[david.moravek] #! fix compilation error
[david.moravek] #! refactoring after review
[david.moravek] #! DataSource adapter for Flink executor
[david.moravek] #! DataSink adapter for Flink executor
[david.moravek] #! Support logging during flink tests
[david.moravek] #! DataSink#rollback throws IOException
[david.moravek] #! fix test
[david.moravek] #! ListDataSink stores data in static context
[david.moravek] #! Favor cz.seznam.euphoria:guava-shaded over com.google.guava:guava
[david.moravek] #! Rebase on FlinkIO
[david.moravek] #! ListDataSink review
[david.moravek] #! Flink implementation of ReduceByKey (no windowing)
[david.moravek] #! ReduceByKey has isCombinable() method
[david.moravek] #! ReduceByKey uses custom partitioner just in case it's different from
[david.moravek] #! testapps - WordCount implementation
[david.moravek] #! Remove explicit parallelism from OperatorTranslator interface
[david.moravek] #! Comment
[david.moravek] #! Avoid casts for readability reasons
[david.moravek] #! [euphoria-flink] Dump execution plan prio to flow execution
[david.moravek] #! Type-safe HadoopInputFormatAdapter.
[david.moravek] #! Type-safe HadoopOutputFormatAdapter.
[david.moravek] #! Refactoring.
[david.moravek] #! Make HadoopDataSource public.
[david.moravek] #! Add SequenceFile factories.
[david.moravek] #! Add proof-of-concept test
[david.moravek] #! [euphoria-flink] Fix operator-input-dataset-mapping
[david.moravek] #! Add printing element type for debugging purposes
[david.moravek] #! Avoid non-implemented windowing in proof-of-concept test
[david.moravek] #! [euphoria-flink] Separation of streaming and batch executors
[david.moravek] #! Rename items for clarity reasons
[david.moravek] #! Tighten method signature to expected operator type
[david.moravek] #! Javadoc
[david.moravek] #! Move #getExecutionEnvironment to parent class
[david.moravek] #! Remove garbage
[david.moravek] #! [euphoria-flink] batch input format adapter (without data locality)
[david.moravek] #! [euphoria-flink] batch output format adapter
[david.moravek] #! [euphoria-flink] batch ReduceByKey implementation
[david.moravek] #! [euphoria-hadoop] Make HadoopDataSource serializable
[david.moravek] #! [euphoria-flink] Make batch-word-count work (on
[david.moravek] #! [euphoria-flink] Add an upper bound to parallelism on operators
[david.moravek] #! [euphoria-core] Conditional partitioning in fluent style
[david.moravek] #! refactored window to windowcontext and windowid
[david.moravek] #! fixed test for time sliding window
[david.moravek] #! moved Datum to public API and changed its name
[david.moravek] #! likvidace unchecked warningu
[david.moravek] #! refactored windowing stuff to separate package
[david.moravek] #! refactored windowing types to separate classes
[david.moravek] #! unified AttachedWindowing with all other windowings
[david.moravek] #! unified ElementWindowing and Windowing
[david.moravek] #! refactored data passing inside inmem pipelines, failing tests related
[david.moravek] #! rebased on master
[david.moravek] #! inmem working on watermarks and regular attached windowing
[david.moravek] #! incorporated changes after review
[david.moravek] #! [euphoria-inmem] Emit watermarks with every input item
[david.moravek] #! Extract diff of jenda/16255-add-watermarking-to-inmem and master
[david.moravek] #! Make euphoria-flink compile (temporary work-around)
[david.moravek] #! Increase read-timeout way over watermarking triggering in the inmem
[david.moravek] #! [euphoria-core] Drop obsolete field
[david.moravek] #! fix watermark triggering and associated tests
[david.moravek] #! code polishing
[david.moravek] #! removed unneeded synchronization
[david.moravek] #! [euphoria-flink] Partial progress on window-element envelopes
[david.moravek] #! [euphoria-flink] Handle window-element envelopes in Repartition
[david.moravek] #! tuned generic windowing for use with sliding windows
[david.moravek] #! code formatting
[david.moravek] #! [euphoria-flink] Handle window-element envelopes in batch mode
[david.moravek] #! [euphoria-flink] Perform conversion to/from window-elements in
[david.moravek] #! [euphoria-flink] Attempt fixing window leak
[david.moravek] #! [euphoria-flink] Fix emiting label to windowed-pairs.
[david.moravek] #! Split operator
[david.moravek] #! commit kafka consumer offsets
[david.moravek] #! Split operator
[david.moravek] #! post-review cleanup
[david.moravek] #! refactoring
[david.moravek] #! [euphoria-flink] Add context to error message
[david.moravek] #! [euphoria-testapps] WordCloud Server/Client/Sink
[david.moravek] #! [euphoria-flink] Initial sketch of JoinTranslator
[david.moravek] #! [euphoria-flink] Correctly emit Pair instances out of join
[david.moravek] #! add support for state backend to flink
[david.moravek] #! [euphoria-flink] Handle windowed-element in join operator
[david.moravek] #! tuned stats for inmem and new windowing
[david.moravek] #! stats tuned on inmem for event time, latecomers and correct distinct
[david.moravek] #! fixed ReduceWindow operator
[david.moravek] #! simplified stats flow, fixed some bugs and minor refactored code and
[david.moravek] #! [euphoria-flink] implementation of ReduceStateByKey for streaming API
[david.moravek] #! [euphoria-flink] avoid "Invalid lambda deserialization" in
[david.moravek] #! [euphoria-flink] RSBK closes state after flush()
[david.moravek] #! [euphoria-flink] implementation of ReduceStateByKey for batch API
[david.moravek] #! codestyle after review
[david.moravek] #! [euphoria-flink] Fix NPE due to ReduceWindow
[david.moravek] #! validate that no two operators use the same sink
[david.moravek] #! [euphoria-flink] Fix class-cast-exception
[david.moravek] #! [euphoria-flink] Have StreamingWindowedElement flow through the
[david.moravek] #! [euphoria-flink] Drop support for processing time
[david.moravek] #! [euphoria-flink] Add support for transfering window emission
[david.moravek] #! [euphoria-flink] Add support for attached windowing to ReduceByKey
[david.moravek] #! [euphoria-flink] Suppress unchecked warnings
[david.moravek] #! [euphoria-flink] Fix attached window emission (was too early)
[david.moravek] #! [euphoria-flink] Stabilize test
[david.moravek] #! [euphoria-flink] Fix label for time-sliding windows on flink
[david.moravek] #! [euphoria-flink] Add TODO
[david.moravek] #! [euphoria-flink] Allow tuning window emission parameters
[david.moravek] #! [euphoria-flink] Align flink and euphoria-core time sliding labeling
[david.moravek] #! [euphoria-flink] Fix streaming MapElements
[david.moravek] #! [euphoria-flink] Tune windowing parameters for test
[david.moravek] #! [euphoria-flink] Descrease presure for jenkins
[david.moravek] #! [euphoria-flink] Descrease presure for jenkins
[david.moravek] #! [euphoria-flink] Correct test setting
[david.moravek] #! [euphoria-flink] Correct auto-watermark-interval setting
[david.moravek] #! [euphoria-flink] Have StreamingWindowedElement flow through RSBK impl
[david.moravek] #! [euphoria-flink] Integrate attached-windowing into RSBK impl
[david.moravek] #! [euphoria-flink] Handle negative watermarks
[david.moravek] #! Move TimeInterval out of Time
[david.moravek] #! Make TimeSliding using TimeInterval as a window label
[david.moravek] #! [euphoria-flink] WindowedElement to StreamingWindowedElement in
[david.moravek] #! [euphoria-flink] Drop native join translator (rely on RBSK)
[david.moravek] #! Drop dead comments
[david.moravek] #! Centralize flink version
[david.moravek] #! review
[david.moravek] #! moved flink operator testkit to the euphoria-flink package
[david.moravek] #! implemented state storage for states in inmem executor
[david.moravek] #! implemented state storage in flink, not well tested
[david.moravek] #! small polishing
[david.moravek] #! code polishing after review
[david.moravek] #! State is not required to be Serializable
[david.moravek] #! [euphoria-flink] implementation of non-combining ReduceByKey for
[david.moravek] #! small formatting changes
[david.moravek] #! refactored statestorage to work on storage descriptors
[david.moravek] #! changes after review
[david.moravek] #! [euphoria-flink] Upgrade flink to 1.1.2
[david.moravek] #! [euphoria-flink] Switch time and time-sliding to euphoria
[david.moravek] #! [euphoria-flink] Correct forwarding operator parallelism
[david.moravek] #! [euphoria-testapps] Emit only top-200 words from word-count
[david.moravek] #! [euphoria-flink] Fix memory leak on window triggers
[david.moravek] #! [euphoria-flink] Attempt to fix clear-window-state leak in backend
[david.moravek] #! [euphoria-core, euphoria-flink] Align trigger behavior in inmem and
[david.moravek] #! [euphoria-flink] Testify early triggering
[david.moravek] #! [euphoria-flink] Schedule window only once
[david.moravek] #! [euphoria-flink] Rename FlinkTrigger to FlinkWindowTrigger
[david.moravek] #! [euphoria-flink] Fully integrate generic windowing
[david.moravek] #! [euphoria-flink] Fix type annotation
[david.moravek] #! [euphoria-flink] Fix after rebase
[david.moravek] #! [euphoria-flink] Reduce noise on unchecked warnings
[david.moravek] #! [euphoria-flink] Small refactoring
[david.moravek] #! Stabilize flipping test
[david.moravek] #! distinct operator test from testkit moved on event time
[david.moravek] #! countByKey tested by operator test in flink
[david.moravek] #! sumbykey and reducebykey on event time windows
[david.moravek] #! tuned operator testkit for flink, passes on batch inputs
[david.moravek] #! flink keys have to be comparable or exception is thrown
[david.moravek] #! TimeInterval is Comparable
[david.moravek] #! functional all operator tests on flink
[david.moravek] #! changes after review
[david.moravek] #! WIP: #16426 Remove GROUP from Windowing
[david.moravek] #! [euphoria-core] Avoid needless allocation during WindowID#hashCode
[david.moravek] #! [euphoria-core] Make inmem RSBK handle groupless windows
[david.moravek] #! [euphoria-operator-testkit] Remove GROUP from windowing
[david.moravek] #! [euphoria-core] Drop global count window test (feature discontinued)
[david.moravek] #! [euphoria-flink] Remove GROUP from windowing
[david.moravek] #! [euphoria-flink] code style
[david.moravek] #! [euphoria-core] Rename Collector -> Context
[david.moravek] #! [euphoria-core] Provide Context#getWindow
[david.moravek] #! [euphoria-flink] Provide Context#getWindow
[david.moravek] #! [euphoria-*] Drop WindowedPair
[david.moravek] #! [euphoria-*] Avoid using the term "windowed pair"
[david.moravek] #! [euphoria-flink] Fix windowing for batched based R(S)BK translators
[david.moravek] #! forward stamp with each element in inmem executor
[david.moravek] #! [eurphoria-core] Added tests for earlytriggered session windowing,
[david.moravek] #! [euphoria-core] FIXME: overridden time windowing for element-time
[david.moravek] #! Passing element time within pipelines in inmem executor
[david.moravek] #! [euphoria-ios] added IOS application module
[david.moravek] #! [euphoria-ios] refactored module structure, separated server from
[david.moravek] #! [euphoria-ios] added core for demonstration of lambda architecture
[david.moravek] #! [euphoria-ios review] removed several FIXMEs added test for
[david.moravek] #! Trigger API redesigned
[david.moravek] #! [euphoria-inmem] ReduceStateByKey against new trigger api
[david.moravek] #! [euphoria-inmem] Implement MergingWindowing support
[david.moravek] #! [euphoria-inmem] Enable sort-state test
[david.moravek] #! [euphoria-inmem] Attempt to fix fliping test
[david.moravek] #! [euphoria-inmem] Make Windowing#trigger not return null
[david.moravek] #! [euphoria-flink] Executor uses new Trigger API
[david.moravek] #! [euphoria-flink] Minor cleanup
[david.moravek] #! [euphoria-ios] Get compilation right
[david.moravek] #! [euphoria-flink] Forward element timestamp
[david.moravek] #! [euphoria-inmem] Fix trigger state merging
[david.moravek] #! [euphoria-inmem] Create a new instance of trigger state during merge
[david.moravek] #! [euphoria-core] PeriodicTimeTrigger is aligned with window start
[david.moravek] #! [euphoria-core] Fixed timer registration in PeriodicTimeTrigger
[david.moravek] #! [euphoria-core] Drop logging in periodic-time-triggering
[david.moravek] #! [euphoria-inmem] Ensure calling onElement on merged windows
[david.moravek] #! [euphoria-core] added serializable Supplier #! [euphoria-hadoop]
[david.moravek] #! [euphoria-kafka], [euphoria-core], [euphoria-hadoop] changed life
[david.moravek] #! [euphoria-ios] review and tuning
[david.moravek] #! [euphoria-kafka] renamed all euphoria kafka artifact references to
[david.moravek] #! Upgrade to Flink 1.1.3
[david.moravek] #! [euphodia-ios] remove the module from parent pom
[david.moravek] #! [euphoria-flink] RBK: Support for merging windows (streaming)
[david.moravek] #! [euphoria-flink] RSBK: Verify correct behaviour during
[david.moravek] #! [euphoria-core] Require MergingWindowing#W being Comparable
[david.moravek] #! [euphoria-hadoop] Fix TaskID retrieval from Hadoop context
[david.moravek] #! [euphoria-core] correct discarding of latecomers
[david.moravek] #! [euphoria-flink] Code style; apply diamond operator
[david.moravek] #! [euphoria-flink] Fix non-combining RBK on bounded input
[david.moravek] #! [euphoria-core] fixed latecomers - review
[david.moravek] #! small fixes
[david.moravek] #! [euphoria-hadoop] DataSourceInputFormat/DataSinkOutputFormat don't
[david.moravek] #! [euphoria-spark] Spark executor implementation for bounded datasets
[david.moravek] #! [euphoria-core] Add operator type annotations
[david.moravek] #! [euphoria-core] state complexity and number of repartitions in
[david.moravek] #! [euphoria-ios] added module for command line tools
[david.moravek] #! [euphoria-ios] added description of lambda and kappa architecture,
[david.moravek] #! [euphoria-ios] added support for spark, finished presentation
[david.moravek] #! [euphoria-ios] performance tuning of Trends application
[david.moravek] #! [euphoria-ios] slightly optimized spark RSBK, IOS presentation
[david.moravek] #! [euphoria-ios] rebased on master
[david.moravek] #! [euphoria-ios] review and removed duplicate code
[david.moravek] #! [euphoria-flink] Support window merging in batch mode
[david.moravek] #! [euphoria-core/flink] Align element timestamp with window emission
[david.moravek] #! flink batch repartition + repartition batch tests
[david.moravek] #! partitioning with default partitioner
[david.moravek] #! Executor API
[david.moravek] #! inmem and flink executor implementation
[david.moravek] #! spark executor
[david.moravek] #! cleaning
[david.moravek] #! DefaultPartitioner as its own type
[david.moravek] #! [euphoria-core] Required explicit windowing if not joining batches
[david.moravek] #! [euphoria-flink] Fix logic in evaluating RBK translation
[david.moravek] #! [euphoria-core] Make WindowingRequiredException a top-level class for
[david.moravek] #! [euphoria-core] Javadoc; Remove reference to seznam internal
[david.moravek] #! [euphoria-core] Javadoc; Make promise about failing upon
[david.moravek] #! Event time extractor function at operator level
[david.moravek] #! minor refactoring after review
[david.moravek] #! [euphoria-testkit] Demo testkit junit integration
[david.moravek] #! [euphoria-testkit] Processing annotation
[david.moravek] #! [euphoria-testkit] Add more tests to demo testkit
[david.moravek] #! [euphoria-flink] ModuloSplitAssigner for testkit
[david.moravek] #! [euphoria-testkit] Use NG jUnit runner
[david.moravek] #! Spark executor - full support of ReduceByKey/ReduceStateByKey
[david.moravek] #! Remove GroupBy operator
[david.moravek] #! Avoid flink stream hanging upon cancellation
[david.moravek] #! [euphoria-spark] Fix partitioner when partitionId is negative
[david.moravek] #! TimeInterval windows are right-open intervals (not overlapping
[david.moravek] #! [euphoria-hadoop] Remove MultiReader from HadoopDataSource
[david.moravek] #! [euphoria-hadoop] Remove SerializableWritable from public constructor
[david.moravek] #! [euphoria-flink] Use LocatableInputSplitAssigner for batch inputs
[david.moravek] #! README.md proposal
[david.moravek] #! Prevent windowing with zero duration
[david.moravek] #! Drop KafkaSource#batchSize #! #! The same effect is achievable
[david.moravek] #! Provide easy-to-use hadoop based data-source/-sinks
[david.moravek] #! Update README
[david.moravek] #! Fix few TODOs
[david.moravek] #! Add convenience hadoop data sink around text files
[david.moravek] #! Provide simple-hadoop-text-file-data-source
[david.moravek] #! Javadoc
[david.moravek] #! Drop "Data" from the name of hadoop data-sources/-sinks
[david.moravek] #! Imperative to functional style
[david.moravek] #! Extract inmem executor into a dedicated module
[david.moravek] #! Drop unneccessary dependency on commons-io
[david.moravek] #! Upgrade to guava 21.0
[david.moravek] #! [euphoria-testapps] Resolve conflict on kryo
[david.moravek] #! [euphoria-flink] Use key type Tuple2 instead of ComparablePair
[david.moravek] #! benchmarks unification
[david.moravek] #! Add LICENSE (APLv2.0)
[david.moravek] #! Ensure LICENSE/NOTICE files in produced artifacts/jars
[david.moravek] #! Drop guava shading
[david.moravek] #! Move euphoria-testapps to a dedicated, top-level repo
[david.moravek] #! Remove obsolete dependency definitions
[david.moravek] #! Upgrade maven jar plugin; Cleanup debian package dependencies #! #!
[david.moravek] #! Polish README
[david.moravek] #! Get rid of szn specific stuff
[david.moravek] #! Integrate licensing headers mechanism
[david.moravek] #! Apply license headers
[david.moravek] #! Update new SCM information; Drop obsolete SZN specifics
[david.moravek] #! Support custom artifact deployments
[david.moravek] #! Correct spelling
[david.moravek] #! [euphoria-kafka] Properly quit read loop when interrupted
[david.moravek] #! Correct name of copyright owner
[david.moravek] #! Temporarily remove documentation section
[david.moravek] [WIP] Prepare maven central deploy (#3)
[david.moravek] #! Link documentation from within README
[david.moravek] #! Add self-contained euphoria-examples module for demoing purposes
[david.moravek] #! Add link to examples
[david.moravek] WIP: Integration with travis-ci.org (#6)
[david.moravek] #! [euphoria-spark] Upgrade to Spark 2.1.0
[david.moravek] #! Drop obsolete "hudson" profiles
[david.moravek] #! Cleanup obsolete gitignore patterns
[david.moravek] #! Add Travis CI badge into README
[david.moravek] #! Drop obsolete class
[david.moravek] #! [euphoria-core] Cleanup inmem specific classes
[david.moravek] #! Sanitze javadocs
[david.moravek] #! Drop obsolete class
[david.moravek] #16 Replace Dataset#getPartitioning() with Dataset#getNumPartitions()
[david.moravek] #16 Move Partitioning related classes to a dedicated package
[david.moravek] #! Attempt automatic deployments
[david.moravek] #! Exclude continuous-deliver folder from being license validated
[david.moravek] #! Set execution flag on deploy scripts
[david.moravek] #! Add missing <name/> <description/>
[david.moravek] [maven-release-plugin] prepare release v0.5.0
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] #! Avoid running tests twice
[david.moravek] #! Mention maven dependencies in README.md
[david.moravek] #8 Suppress safe unchecked warnings
[david.moravek] #! Rename StorageDescriptorBase to StorageDescriptor
[david.moravek] #18 Fix a few minor bugs after static code analysis
[david.moravek] #18 Fail build when troubling error is found by FindBugs analysis
[david.moravek] #18 Use @Nullable annotation
[david.moravek] #10 Improve documentation around URI based data-sources/-sinks
[david.moravek] #10 Fix typos
[david.moravek] #! Add contribution section to README
[david.moravek] #! [euphoria-flink] Allow enabling object reuse
[david.moravek] #48 Move most maven plugins under the "regular-build" profile (active by
[david.moravek] #! Document regular-build profile
[david.moravek] #27 [euphoria-flink] Rewrite windowing to native implementation of
[david.moravek] #! [euphoria-flink] Avoid extra shuffle when windowing on streaming
[david.moravek] #47 [euphoria-flink] Alternatively execute windowing/valueOf fully after
[david.moravek] #! [euphoria-flink] Allow specifying latency tracking interval
[david.moravek] #! Make WindowedElement an interface
[david.moravek] #! Drop WindowedElementImpl from euphoria-core
[david.moravek] #! Make window-element-factory use-case specific
[david.moravek] #! [euphoria-kafka] No sync commit
[david.moravek] #14 [euphoria-flink] Don't send timestamp along with each element. Use
[david.moravek] #! Add link to gitter chat
[david.moravek] #14 review cleanup
[david.moravek] #14 [euphoria-flink] Allow WindowAssigner operator chaining
[david.moravek] #60 Prefer ValueStorage instead of ListStorage for combining RSBK
[david.moravek] #! Register Either for serialization
[david.moravek] #! Suppress safe casts
[david.moravek] #! Add a dedicated interface for event-time extraction to reduce
[david.moravek] #! Register Triple and clean up in TopByKey
[david.moravek] #47 Windowing#assignWindowsToElement returns Iterable instead of Set
[david.moravek] #47 [euphoria-core] TimeSliding window assigner generates custom
[david.moravek] #! Make storage descriptors static
[david.moravek] #! [euphoria-flink] Do not cache states
[david.moravek] #! Drop Supplier from public API
[david.moravek] #67 [euphoria-flink] Avoid descriptors cache infinitely growing
[david.moravek] #67 [euphoria-flink] Avoid flushing empty states due to "localMode"
[david.moravek] #67 [euphoria-flink] Fix window merging
[david.moravek] #67 [euphoria-flink] Avoid inlining processTriggerResult
[david.moravek] #! Include link to FAQ wiki page
[david.moravek] #! Add shaded-guava for internal use within euphoria
[david.moravek] #! Add javadoc generation
[david.moravek] #! Switch over to shaded guava
[david.moravek] #51 Do _not_ store storage-provider in states by default
[david.moravek] #51 Move StateFactory to the state package
[david.moravek] #51 StateFactory interface revised
[david.moravek] #51 Replace StateCombiner with StateMerger
[david.moravek] #51 Drop obsolete TODO
[david.moravek] #51 [euphoria-core] Skip processing empty window merge sets
[david.moravek] #19 [euphoria-flink] Avoid extra shuffle (on the batch executor)
[david.moravek] # [euphoria-flink] Fix trigger state clean-up of merged windows
[david.moravek] #! [euphoria-examples] Example of web server log aggregation
[david.moravek] #! [euphoria-examples] Fix license header
[david.moravek] #61 [euphoria-flink] Unit test covering out-of-order stream with allowed
[david.moravek] #79 [euphoria-core] Trigger#onMerge does not return TriggerResult
[david.moravek] #! InputSplit#toString - especially useful on spark
[david.moravek] #! Add convenience hadoop sink
[david.moravek] #! Generalize HadoopStringSink to accept any type of object
[david.moravek] #! [euphoria-flink] Warn about failing execution scenario
[david.moravek] #! Update copyright
[david.moravek] #85 Move findbugs plugin execution to the process-classes phase
[david.moravek] #77 Import trends benchmarks
[david.moravek] #77 Drop obsolete shell script
[david.moravek] #77 - parsing fix
[david.moravek] #! Variable year in license header
[david.moravek] #! [euphoria-core] Avoid clearing count state twice
[david.moravek] #! Fix typo
[david.moravek] #95 Rename Batch to GlobalWindowing
[david.moravek] #! Drop Map.Entry from Pair
[david.moravek] #! Add @Experimental for easier API evolution
[david.moravek] #21 [euphoria-core] Code/Javadoc style
[david.moravek] #21 [euphoria-core] Javadocs for FlatMap
[david.moravek] #21 [euphoria-core] Javadocs for Union
[david.moravek] #! Add contact information to README.md
[david.moravek] #99 Sort operator support
[david.moravek] #21 [euphoria-core] Javadocs for Repartition
[david.moravek] #21 [euphoria-core] Javadocs for ReduceStateByKey
[david.moravek] Update README.md
[david.moravek] Update README.md
[david.moravek] #! Remove obsolete class
[david.moravek] #! Do not allow derivations from Pair/Triple
[david.moravek] #98 [euphoria-flink] Do not allow object re-use
[david.moravek] #! - javadoc refactoring
[david.moravek] #13 [euphoria-flink] Batch executor uses hash code as a key in shuffles
[david.moravek] #13 [euphoria-flink] Fix bug in batch ReduceByKeyTranslator and add unit
[david.moravek] #13 Fix race condition in batch ReduceStateByKeyTranslator
[david.moravek] #13 [euphoria-flink] Copy input instance in ReduceByKeyTranslator
[david.moravek] #! some corrections/formatting
[david.moravek] #13 [euphoria-flink] Avoid hash code collisions in batch
[david.moravek] #105 Add (failing) proof-of-concept test
[david.moravek] #105 Rework StateFactory API; Stabilize JoinState implementation
[david.moravek] #43 Annotate experimental Session#earlyTriggering
[david.moravek] #105 Do not read entire disk storage into memory
[david.moravek] #105 Provide an experimental "early emitting" join state implementation
[david.moravek] #105 Simplify closing spilling file
[david.moravek] #105 Document some more experiment dangers
[david.moravek] #! [benchmarks/native-flink] Filter out invalid entries
[david.moravek] #! Upgrade to flink 1.2.1
[david.moravek] #! Prevent deleting wrong timers
[david.moravek] #! polish: removed unnecessary null check, variable reuse
[david.moravek] #105 Add reference to future solution
[david.moravek] #! Prepare for 0.6.0 release
[david.moravek] [maven-release-plugin] prepare release v0.6.0
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] #! Prepare for next dev iteration on master
[david.moravek] #! Update README regarding new release
[david.moravek] #! Fix loading configuration
[david.moravek] #! [euphoria-examples] Explain in details the word-count-example
[david.moravek] #! [euphoria-examples] Explain in details the access-log-count
[david.moravek] #! [euphoria-examples] Correct typos
[david.moravek] #! [euphoria-flink] Stabilize test
[david.moravek] #! Stabilize sort-test
[david.moravek] #! Stabilize count-by-key-test
[david.moravek] #119 [euphoria-core/-inmem] Rework event time assignment
[david.moravek] #119 [euphoria-flink] Rework event time assignment
[david.moravek] #119 [euphoria-spark] Rework event time assignment
[david.moravek] #119 Add missing license headers
[david.moravek] #119 [euphoria-examples] Rework event time assignment
[david.moravek] #119 [euphoria-benchmarks] Rework event time assignment
[david.moravek] #! Stabilize inmem-executor join test
[david.moravek] #121 Allow multiple elements to be emitter from ReduceByKey
[david.moravek] #121 changes requested by review
[david.moravek] #121 fixed comment
[david.moravek] #113 [euphoria-spark] Implement disk splitting list-storage
[david.moravek] #113 [euphoria-flink] Unify disk spilling implementation for
[david.moravek] #113 Add missing license headers
[david.moravek] #113 [euphoria-spark] Drop obsolete warning suppression
[david.moravek] #113 [euphoria-testkit] Enable accidently disabled RBK tests
[david.moravek] #113 [euphoria-core] Support try-with-resources for
[david.moravek] #113 [euphoria-testkit] Allow different local spill file allocation
[david.moravek] #113 [euphoria-flink] Support a wider area of types during
[david.moravek] #113 [euphoria-core] Testify FsSpillingListStorage
[david.moravek] #113 Add missing license header
[david.moravek] #31 [euphoria-core] Implementation of accumulator API + integration with
[david.moravek] #31 Refactored according to review feedback
[david.moravek] #133 [euphoria-spark] Accumulator API supported in Spark executor
[david.moravek] #133 [euphoria-inmem] Accumulator API supported in in-mem executor
[david.moravek] #133 [euphoria-spark] Collector should be transient in
[david.moravek] #135 Add SingleJvmAccumulatorFactory
[david.moravek] #135 Demostrates usage of accumulators validation in operator testkit
[david.moravek] #135 Fix histogram accumulation
[david.moravek] #135 GetSnapshot -> Snapshotable
[david.moravek] #135 Add tests covering accumulator usage
[david.moravek] #135 Fix failing tests on the spark executor
[david.moravek] #134 [euphoria-spark] Implemented support for Spark native accumulators
[david.moravek] #134 [euphoria-core] Fix misleading log warning in
[david.moravek] #134 [euphoria-spark] Clone accumulator factory before flow execution
[david.moravek] #134 [euphoria-spark] Make SparkAccumulatorHolder thread-safe
[david.moravek] [maven-release-plugin] prepare release v0.7.0
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] #! Version up
[david.moravek] #! Fix Javadoc warnings
[david.moravek] #! Fix Findbugs warnings
[david.moravek] #! [euphoria-spark] Correctly transfer global state to executed UDFs
[david.moravek] #! Pete dropping out
[david.moravek] [maven-release-plugin] prepare release v0.7.1
[david.moravek] [maven-release-plugin] prepare for next development iteration
[david.moravek] [euphoria-spark] Propagate exception in SparkFlowTranslator
[david.moravek] [euphoria-hadoop] fix SequenceFileSource
[david.moravek] [euphoria-hadoop] wrap hadoop config in SequenceFileSource, so it cannot
[david.moravek] [euphoria-core] Remove IORegistry.
[david.moravek] [euphoria] add links to license-header.txt from subprojects
[david.moravek] [euphoria] exclude license-header.txt itself from the license header
[david.moravek] [euphoria-flink] #159 fix default parallelism in local flink runner to
[david.moravek] add support for Join operator hints
[david.moravek] [euphoria-core] #160 remove partitioning from stateful operators, bump
[david.moravek] [euphoria-core] #160 drop explicit partitions from ListDataSink
[david.moravek] [euphoria-operator-testkit] #160 compilable testkit after partitioning
[david.moravek] [euphoria-kafka] #160 module compilable after changes
[david.moravek] [euphoria-hadoop] #160 module compilable after changes
[david.moravek] [euphoria-examples] #160 module compilable after changes
[david.moravek] [euphoria-flink] #160 module compilable after changes
[david.moravek] [euphoria-fluent] #160 module compilable after change
[david.moravek] [euphoria-core] #160 removed partitioning and repartition operator
[david.moravek] [euphoria-inmem] #160 compilable, but with failing tests
[david.moravek] [euphoria-inmem] #160 more tests working after code change
[david.moravek] [euphoria-inmem] #160 build passing tests after changes
[david.moravek] [euphoria-spark], [euphoria-flink] #160 modules compilable after
[david.moravek] [euphoria] #160 build passing including tests
[david.moravek] [euphoria] #160 remove mentions of partitions where no longer makes
[david.moravek] [euphoria-hadoop] remove sneakythrows
[david.moravek] [euphoria-kafka] remove groupid from kafkasource
[david.moravek] [euphoria-benchmarks] make benchmarks part of the build
[david.moravek] [euphoria-operator-testkit] activate mistakenly ignored test
[david.moravek] [euphoria-core] add Audience annotation
[david.moravek] [euphoria-core] remove checkpointing from datasets - unusable feature
[david.moravek] added IOUtils to help iterate over methods throwing IOException
[david.moravek] added license
[david.moravek] [euphoria-core] #158 add `withSortedValues` to `ReduceByKey` operator
[david.moravek] [euphoria-core] #158 basic non configurable implementation of value
[david.moravek] [euphoria-core] #158 add StateContext and validate on inmem executor
[david.moravek] [euphoria] #158 implemented external sorter for flink and spark
[david.moravek] [euphoria-core] #157 implement possibility for DataSink to modify
[david.moravek] [euphoria-core] #157 review
[david.moravek] [euphoria-local] #173 changed InMemExecutor to LocalExecutor
[david.moravek] [euphoria-core] #177 added MultiDataSink
[david.moravek] [euphoria-core] #177 MultiDataSink renamed vars
[david.moravek] Move to gradle.
[david.moravek] Add euphoria-examples module to gradle
[david.moravek] Do not ignore spotbugs failures.
[david.moravek] [euphoria] add maxTimestamp to generic Window
[david.moravek] [euphoria-local] fix findbug warning regarding random reuse
[david.moravek] [euphoria] #156 distinguish batch and stream sources
[david.moravek] [euphoria-core] #156 Add split to boundedsource
[david.moravek] [euphoria-core] #161 replace Iterable with Stream in reducing
[david.moravek] [euphoria-local] fix non deterministic test
[david.moravek] Fix javadoc.
[david.moravek] [euphoria-core] DataSinkWrapper is now Serializable
[david.moravek] Shade guava
[david.moravek] Fix shadow jar publishing.
[david.moravek] Fix guava
[david.moravek] [euphoria-build] remove unused protobuf plugin
[david.moravek] [euphoria-core] bugfix building of RBK with no windowing
[david.moravek] [euphoria-hbase] #181 add HBase module
[david.moravek] #181 Code review.
[david.moravek] [euphoria] add compileOnly to testCompile
[david.moravek] [euphoria-core] Union can accept more than two data sets
[david.moravek] Update readme.
[david.moravek] [euphoria-operator-testkit] Reduce by key bounded parallel test.
[david.moravek] [euphoria-operator-testkit] Code review.
[david.moravek] [euphoria-core] Join operator API improvements.
[david.moravek] [euphoria-core] Join operator hint tests.
[david.moravek] [euphoria-core] Join operator hint tests - equals, hash code.
[david.moravek] [euphoria-core] Join operator. Cleanup.
[david.moravek] [euphoria-core] Code review.
[david.moravek] [euphoria-hbase] #181 add bulk loading to hbase sink
[david.moravek] [euphoria-spark] broadcast join.
[david.moravek] [euphoria-spark] broadcast join code review.
[david.moravek] [euphoria-core] Publish test jar.
[david.moravek] [euphoria-hadoop] wrapping hadoopConfig in SequenceFileSink
[david.moravek] Added outputValues() to operators producing pairs
[david.moravek] Updated tests for outputValues
[david.moravek] [euphoria-core] Test ouputValues on all executors.
[david.moravek] [euphoria-core] make sure that windowBy() can be appliedIf()
[david.moravek] [euphoria-hbase] HFileSink uses raw types
[david.moravek] Fix javadoc.
[david.moravek] [euphoria-hbase] add windowing to hfilesink
[david.moravek] [euphoria-flink] move to flink 1.4
[david.moravek] [euphoria-core] Optimize ReduceWindow operator for attached windowing
[david.moravek] [euphoria-hadoop] add failing test case
[david.moravek] [euphoria-hadoop] Refactoring, tests and fixes.
[david.moravek] [euphoria-hadoop] Check output specs during HadoopSink initialization.
[david.moravek] [euphoria-hadoop] Update exception and hadoop utils.
[david.moravek] [euphoria-sink] Fix test.
[david.moravek] [euphoria-hadoop] Test DataSinkOutputFormat.
[david.moravek] [euphoria-hadoop] Make sure initialize is called only once.
[david.moravek] [euphoria-hadoop] Make sure initialize is called exactly once.
[david.moravek] [euphoria-hadoop] Code review.
[david.moravek] [euphoria-hadoop] Code review.
[david.moravek] Bump gradle version
[david.moravek] [euphoria-core] remove getDefaultParallelism from BoundedDataSource
[david.moravek] [euphoria-testing] Init.
[david.moravek] [euphoria-testing] Add comments.
[david.moravek] [euphoria-testing] Code review.
[david.moravek] [euphoria-core] performance tuning
[david.moravek] [euphoria-core] add test for applyIfNot
[david.moravek] [euphoria-hadoop] small fixes
[david.moravek] [euphoria-hbase] fix bulkloading
[david.moravek] [euphoria-spark] register default classes
[david.moravek] [euphoria-spark] Introduce executor builder.
[david.moravek] [euphoria-spark] Simplify.
[david.moravek] [euphoria-flink] register common classes by default
[david.moravek] [euphoria-spark] fix build
[david.moravek] Update README.md
[david.moravek] [euphoria-spark] Add hash map to default classes for kryo.
[david.moravek] [euphoria-spark] Add default parallelism to local mode.
[david.moravek] [euphoria-core] #21 add builder javadocs to operators
[david.moravek] [euphoria-core] Fix javadoc.
[david.moravek] [euphoria-hadoop] InputSplit doesn't have to be Writable
[david.moravek] [euphoria-examples] add hfileloader
[david.moravek] [euphoria-examples] Code review
[david.moravek] Happy new year!!
[david.moravek] [euphoria-hadoop] SequenceFileSink builder
[david.moravek] [euphoria-hadoop] SequenceFileSink builder refactor
[david.moravek] [euphoria-hadoop] sequencefilesink builder consistent with other
[david.moravek] added api example
[david.moravek] [thirdparty-guava] use shaded jar with shadow classifier
[david.moravek] [euphoria] fix javadoc and unchecked warnings
[david.moravek] [euphoria-build] add maven build for releasing
[david.moravek] [euphoria-hadoop] fix build
[david.moravek] [euphoria-hbase] make sure hfiles have correct permissions before
[david.moravek] Hbase bulk load add ALL permissions for Hbase user
[david.moravek] [euphoria-flink] flink register classes with serializers
[david.moravek] check kafka partitions availability
[david.moravek] Check if leader is available in KafkaSource
[david.moravek] Correct indentation
[david.moravek] Test KafkaSource reaction to no consumer partitions
[david.moravek] add licence to KafkaSourceTest
[david.moravek] Add tests in KafkaSourceTest
[david.moravek] Add tests in KafkaSourceTest 2
[david.moravek] Fix KafkaSourceTest
[david.moravek] [euphoria-flink] #260 Flink - broadcast hash join
[david.moravek] [euphoria-flink] #260 reformatting and corrections
[david.moravek] [euphoria-flink] #260 small changes
[david.moravek] Upgrade kafka to 1.0.0
[david.moravek] javadoc fixes
[david.moravek] [euphoria-spark] #243 RDD are cached when used more than once in flow
[david.moravek] [euphoria-core] #259 Hints are not runtime specific. Hints describe
[david.moravek] [euphoria-core] #259 Hints are now in operator, not Dataset
[david.moravek] broadcastHashJoin fix
[david.moravek] broadcastHashJoin fix - util class renamed
[david.moravek] AVRO read example
[david.moravek] sq
[david.moravek] Fix code in README.md
[david.moravek] [euphoria-examples] better exception handling in SimpleWordCount and
[david.moravek] [euphoria-spark] Optimize kryo serialization.
[david.moravek] [euphoria-spark] Singleton serializer test.
[david.moravek] [euphoria-spark] Synchronize singleton serializer.
[david.moravek] Add support for expensive computation hint.
[david.moravek] [euphoria-spark] Fix RDDCaching test.
[david.moravek] [euphoria-spark] Improved RBK translation.
[david.moravek] [euphoria-spark] Fix cache RDD test.
[david.moravek] [euphoria-spark] Remove timestamped element.
[david.moravek] Core changes.
[david.moravek] beam wip
[david.moravek] Rebase on master
[david.moravek] wip
[david.moravek] wip
[david.moravek] wip
[david.moravek] WIP: RBK non deterministic, need tuning of FlowUnfolder
[david.moravek] [euphoria-beam] PoC of beam integration
[david.moravek] [euphoria-beam] add Dataset#persist() listener
[david.moravek] [euphoria-beam] cleanup
[david.moravek] [euphoria-beam] correctly pass coders from inputs
[david.moravek] sq
[david.moravek] [euphoria-beam] BeamFlow is forced to be backed up by Pipeline
[david.moravek] [euphoria-beam] add trigger to window in RBK (missing correct trigger
[david.moravek] [euphoria-beam] bump beam to 2.4.0
[david.moravek] [euphoria-beam] annotations are provided
[david.moravek] Missing test dependencies added. Beam version updated to last release
[david.moravek] Small change to fix error InteliJ Idea is wrongly reporting.
[david.moravek] Wrong merge during rebasing fix.
[david.moravek] [euphoria-beam] wip
[david.moravek] First attempts to run ReduceByKey tests in BeamOperatorsTestSuite. Some
[david.moravek] Small typo fix. ReduceByKeyTest in BeamOperatorsSuite disabled again.
[david.moravek] [euphoria-beam] beamphoria corrections
[david.moravek] [euphoria-beam] Avoid unneccessary lamda allocation with each element in
[david.moravek] [euphoria-beam] Add tranformation names.
[david.moravek] [euphoria-spark] Fix windowing signature in RBK translator.
[david.moravek] beamphoria integration part 1
[david.moravek] [BEAM-3900] removed old licenses
[david.moravek] [BEAM-3900] integrating to gradle build system
[david.moravek] [BEAM-3901] code reformat to comply beam code standard
[david.moravek] [BEAM-3901] findbugs fixes
[david.moravek] [BEAM-3902] euphoria-core checkstyle corrections
[david.moravek] BEAM-3900 Code in euphoria-local package modified to comply with
[david.moravek] BEAM-3900 Code in euphoria-testing package modified to comply with
[david.moravek] [BEAM-3902] euphoria-core checkstyle corrections 2
[david.moravek] [BEAM-3902] euphoria-fluent checkstyle corrections
[david.moravek] [BEAM-3900] Code in euphoria-operator-testkit package modified to comply
[david.moravek] [BEAM-3900] Code in euphoria-operator-testkit package modified to comply
[david.moravek] [BEAM-3900] Code in euphoria-beam package modified to comply with
[david.moravek] [BEAM-3902] Fix license headers and remove unused poms.
[david.moravek] [BEAM-3902] Move euphoria to apache namespace.
[david.moravek] [BEAM-3902] Move euphoria to apache namespace.
[david.moravek] [BEAM-3900] Allow for Beam windowing to be set through Euphoria API.
[david.moravek] [BEAM-3900] Missing licence header added.
[david.moravek] [BEAM-4294] Join translator empty shell added.
[david.moravek] [BEAM-4294] Crude Join operator translation implemented. Still work in
[david.moravek] [BEAM-4294] Inner join translation implemented.
[david.moravek] [BEAM-4294] Left, right and full joins implemeted.
[david.moravek] [BEAM-4294] BeamOperatorsSuite now includes tests of Join operator.
[david.moravek] [BEAM-4360] ReduceStateByKey tests adaptation to beam. - Work in
[david.moravek] [BEAM-4360] Most tests are passing. Some are still ignored mostly due to
[david.moravek] [BEAM-4294] [BEAM-4360] Join translation and ReduceByKey test suite
[david.moravek] [BEAM-4294] [BEAM-4360] Checkstyle warning fixes.
[david.moravek] [BEAM-4394] Pull request review fixes.
[david.moravek] [BEAM-4294] [BEAM-4360] Pull request review fixes. OperatorTranslator
[david.moravek] [BEAM-4294] [BEAM-4360] Circular dependency fix.
[david.moravek] [BEAM-4294] [BEAM-4360] Missing licenses added.
[david.moravek] [BEAM-4294] [BEAM-4360] Fix of local executor module compile error.
[david.moravek] [BEAM-4410] added BroadcastJoinTranslator
[david.moravek] [BEAM-4410] checkstyle fix
[david.moravek] [BEAM-4419] Update Operator Testkit Testkit was moved into
[david.moravek] [BEAM-4366] Two sources of test flipps found and fixed. First was wrong
[david.moravek] [BEAM-4366] Dynamic dependency versions.
[david.moravek] [BEAM-4366] Fully serializable `Pair` (including key and value)
[david.moravek] [BEAM-4443] Builders of Join operators extended to be able to expose
[david.moravek] [BEAM-4443] Builders of ReduceByKey operators extended to be able to
[david.moravek] [BEAM-4443] Builders of ReduceStateByKey operators extended to be able
[david.moravek] [BEAM-4443] Windowing builders now implements Builders.* interfaces
[david.moravek] [BEAM-4443] Builders of CountByKey and SumByKey operators extended to be
[david.moravek] [BEAM-4443] Windowing in parameters of operator builders unified.
[david.moravek] [BEAM-4443] Builders of Distinct operator extended to be able to expose
[david.moravek] [BEAM-4443] Builders of ReduceWindow operator extended to be able to
[david.moravek] [BEAM-4443] Builders of TopPerKey operator extended to be able to expose
[david.moravek] [BEAM-4443] Euphoria to Beam translators updated to reflect changes in
[david.moravek] [BEAM-4443] Tests adapted to new windowing API.
[david.moravek] [BEAM-4443] Euphoria's local executor removed.
[david.moravek] [BEAM-4443] Build fixes (checkstyle, failing tests, findbugs).
[david.moravek] [BEAM-4443] All `WindowBy` builders now contains backward compatible
[david.moravek] [BEAM-4443] All `windowBy` builders now implements
[david.moravek] [BEAM-4443] Javadods updates. Several classes moved to more fitting
[david.moravek] [BEAM-4478] Code review fixes.
[david.moravek] [BEAM-4478] Accumulators translation to Beam Metrics
[david.moravek] [BEAM-4478] added operator name as namespace
[david.moravek] [BEAM-4478] corrections
[david.moravek] [BEAM-4478] Second review fixes.
[david.moravek] [BEAM-4529] MapElementsTest, DistinctTest, CountByKeyTest, SumByKeyTest,
[david.moravek] [BEAM-4560] `PTransform` can now be described in Euphoria API
[david.moravek] [BEAM-4529] Typo fix.
[david.moravek] [BEAM-4530] Executors concept removed.
[david.moravek] [BEAM-4530] The `BeamMetricsTranslationTest` modified to run without
[david.moravek] [BEAM-4530] Code review fixes.
[david.moravek] [BEAM-4428] added Javadoc and updated README
[david.moravek] [BEAM-4428] `BeamFlow.create()` renamed to `BeamFlow.of()`.
[david.moravek] [BEAM-4428] `euphoria-beam` -> `euphoria-core` package merge. All
[david.moravek] [BEAM-4429] add type hint
[david.moravek] [BEAM-4429] added typeHints to valueBy
[david.moravek] [BEAM-4429] TypeHint changed to TypeDescriptor
[david.moravek] [BEAM-4609] Race condition was removed from translation of combinable
[david.moravek] [BEAM-3900] Circular dependency fix.
[david.moravek] [BEAM-3900] Adaptation of build process after rebase above beam/master.
[david.moravek] [BEAM-3900] Formating changes done by `./gradlew spotlessJavaApply`.
[david.moravek] [BEAM-3900] Compilation warnings resolved. Some remnants of euphoria
[david.moravek] [BEAM-3900] `testArtifact` configuration swapped for `shadowTest` as
[david.moravek] [BEAM-3900] Fix javadocs.
[david.moravek] [BEAM-4478] Accumulators translation to Beam Metrics
[david.moravek] [BEAM-4585] New `RegisterCoders` class introduced to allow convinient
[david.moravek] [BEAM-4585] `BeamFlow` now exposes new methods to register `Coders`.
[david.moravek] classAwareKryoCoder failing test
[david.moravek] [BEAM-4705] `ClassAwareKryoCoder` fixed to not colide with other coders.
[david.moravek] [BEAM-4585] Some changes required by code review. Other items will be
[david.moravek] [BEAM-4585] Spotless autoformating.
[david.moravek] [BEAM-3900] Spotless autoformating.
[david.moravek] [BEAM-4705] Kryo integration was enhanced. Api needs review since it is
[david.moravek] [BEAM-4705] Failing test added to prove bug in functionality of
[david.moravek] [BEAM-4705] `KryoRegistrar` wrapped into `IdentifiedRegistrar` in order
[david.moravek] [BEAM-4705] Spotless auto formatting.
[david.moravek] [BEAM-4851] All operators now carry their output and key (if applicable)
[david.moravek] [BEAM-4851] All operators now carry their value type (if applicable).
[david.moravek] [BEAM-4851] So far unsucessfull attempt to use return type extracted
[david.moravek] [BEAM-4851] Test to assert type parameters propagation added.
[david.moravek] [BEAM-4851] Spotless auto formatting. Compilaion warnings fixed.
[david.moravek] [BEAM-5077] Translators now use type information from `Operators`
[david.moravek] [BEAM-5099] `Pair` and `PairCoder` removed in favor of `KV`. Unnecesarry
[david.moravek] [BEAM-5123] Wrong implicit classes imports from the same package in
[david.moravek] [BEAM-5124] Documentation examples added. Join windowing check removed
[david.moravek] [BEAM-5124] Minor redeability improvement.
[david.moravek] [BEAM-5160] Failing test fixed. Another test to confirm the fix added.
[david.moravek] [BEAM-5161] FindBugs enabled. All warnings sorted out. Some remnants
[david.moravek] [BEAM-5124] Minor redeability improvement.
[david.moravek] [BEAM-3900] Cleanup, spotless formating and test adaptation.
[david.moravek] [BEAM-5195] Decomposition of `TopPerKey` was fixed. Documentatioin
[david.moravek] [BEAM-5205] `KryoCoder` now use Kryo's chunked input and output.
[david.moravek] [BEAM-5205] Improved logging to make it easier to debug problems with
[david.moravek] [BEAM-5220] TODOs resolved whenever possible withing several minutes
[david.moravek] [BEAM-5245] Error message improved. New tests added.
[david.moravek] [BEAM-5248] Translators modified so they do not set coders to input
[david.moravek] [BEAM-5276] `ListDataSource` now supports data supplier to lazy fetch
[david.moravek] [BEAM-5287] Attempt to build `ReduceByKey` operator with sorted values
[david.moravek] [BEAM-5263] `SingleValueCollector` now supports accumulators.
[david.moravek] [BEAM-3900] Javadoc, typos, formatting, missing file fixes.
[david.moravek] [BEAM-5306] User defined join functions now can ouputs more than one
[david.moravek] [BEAM-3900] Cleanup before merge.
[vaclav.plajt] [BEAM-3900] Auto formating, CheckStyle and FindBugs fixes.
[vaclav.plajt] [BEAM-5124] Documentation examples update.
[vaclav.plajt] [BEAM-3900] Build and test fixes.
[vaclav.plajt] [BEAM-5124] Euphoria API documentation updated.
[vaclav.plajt] [BEAM-5124] Readme update.
[marek.simunek] [BEAM-3900] CountByKey TypeDescriptor fix
[vaclav.plajt] [BEAM-3900] Compilation warning fixes.
[vaclav.plajt] [BEAM-3900] Unwanted edits removed.
[mike] Regression test WithDefaultPreserversesSideInputs
[mike] Fixed withDefaults and withFanout removing side inputs
------------------------------------------
[...truncated 52.56 KB...]
> Task :beam-sdks-python:validatesRunnerStreamingTests
Caching disabled for task ':beam-sdks-python:validatesRunnerStreamingTests': Caching has not been enabled for the task
Task ':beam-sdks-python:validatesRunnerStreamingTests' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'sh''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python> Command: sh -c . <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/bin/activate> && ./scripts/run_postcommit.sh ValidatesRunner,'!sickbay-streaming' streaming
Successfully started process 'command 'sh''
###########################################################################
# Build tarball and set pipeline options.
# Check that the script is running in a known directory.
if [[ $PWD != *sdks/python* ]]; then
echo 'Unable to locate Apache Beam Python SDK root directory'
exit 1
fi
# Go to the Apache Beam Python SDK root
if [[ "*sdks/python" != $PWD ]]; then
cd $(pwd | sed 's/sdks\/python.*/sdks\/python/')
fi
pwd | sed 's/sdks\/python.*/sdks\/python/'
RUNNER=${3:-TestDataflowRunner}
# Where to store integration test outputs.
GCS_LOCATION=${4:-gs://temp-storage-for-end-to-end-tests}
PROJECT=${5:-apache-beam-testing}
# Create a tarball
python setup.py -q sdist
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.9.0.dev' to '2.9.0.dev0'
normalized_version,
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: cmd: standard file not found: should have one of README, README.rst, README.txt, README.md
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Install test dependencies for ValidatesRunner tests.
echo "pyhamcrest" > postcommit_requirements.txt
echo "mock" >> postcommit_requirements.txt
# Options used to run testing pipeline on Cloud Dataflow Service. Also used for
# running on DirectRunner (some options ignored).
PIPELINE_OPTIONS=(
"--runner=$RUNNER"
"--project=$PROJECT"
"--staging_location=$GCS_LOCATION/staging-it"
"--temp_location=$GCS_LOCATION/temp-it"
"--output=$GCS_LOCATION/py-it-cloud/output"
"--sdk_location=$SDK_LOCATION"
"--requirements_file=postcommit_requirements.txt"
"--num_workers=1"
"--sleep_secs=20"
)
# Add streaming flag if specified.
if [[ "$2" = "streaming" ]]; then
>>> Set test pipeline to streaming
echo ">>> Set test pipeline to streaming"
PIPELINE_OPTIONS+=("--streaming")
else
echo ">>> Set test pipeline to batch"
fi
TESTS=""
if [[ "$3" = "TestDirectRunner" ]]; then
if [[ "$2" = "streaming" ]]; then
TESTS="--tests=\
apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it,\
apache_beam.io.gcp.pubsub_integration_test:PubSubIntegrationTest"
else
TESTS="--tests=\
apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it,\
apache_beam.io.gcp.pubsub_integration_test:PubSubIntegrationTest,\
apache_beam.io.gcp.big_query_query_to_table_it_test:BigQueryQueryToTableIT"
fi
fi
###########################################################################
# Run tests and validate that jobs finish successfully.
JOINED_OPTS=$(IFS=" " ; echo "${PIPELINE_OPTIONS[*]}")
IFS=" " ; echo "${PIPELINE_OPTIONS[*]}"
echo ">>> RUNNING $RUNNER $1 tests"
python setup.py nosetests \
--attr $1 \
>>> RUNNING TestDataflowRunner ValidatesRunner,!sickbay-streaming tests
--nologcapture \
--processes=8 \
--process-timeout=3000 \
--test-pipeline-options="$JOINED_OPTS" \
$TESTS
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.9.0.dev' to '2.9.0.dev0'
normalized_version,
running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
WARNING:root:snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:796: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options = pbegin.pipeline.options.view_as(DebugOptions)
Could not find a version that satisfies the requirement mock (from -r postcommit_requirements.txt (line 2)) (from versions: )
No matching distribution found for mock (from -r postcommit_requirements.txt (line 2))
test_as_list_and_as_dict_side_inputs (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ERROR
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:54: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
test_par_do_with_multiple_outputs_and_using_yield (apache_beam.transforms.ptransform_test.PTransformTest) ... ok
test_flatten_multiple_pcollections_having_multiple_consumers (apache_beam.transforms.ptransform_test.PTransformTest) ... ok
test_as_list_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
WARNING:root:Waiting indefinitely for streaming job.
test_as_singleton_with_different_defaults (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
test_as_dict_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
WARNING:root:Waiting indefinitely for streaming job.
test_par_do_with_multiple_outputs_and_using_return (apache_beam.transforms.ptransform_test.PTransformTest) ... ok
WARNING:root:Waiting indefinitely for streaming job.
WARNING:root:Waiting indefinitely for streaming job.
test_multiple_empty_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok
WARNING:root:Waiting indefinitely for streaming job.
test_undeclared_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok
test_as_singleton_without_unique_labels (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
test_flattened_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
test_iterable_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
test_default_value_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
test_empty_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok
======================================================================
ERROR: test_as_list_and_as_dict_side_inputs (apache_beam.transforms.sideinputs_test.SideInputsTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py",> line 205, in test_as_list_and_as_dict_side_inputs
pipeline.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 104, in run
result = super(TestPipeline, self).run(test_runner_api)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py",> line 403, in run
self.to_runner_api(), self.runner, self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py",> line 416, in run
return self.runner.run_pipeline(self)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 50, in run_pipeline
self.result = super(TestDataflowRunner, self).run_pipeline(pipeline)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 390, in run_pipeline
self.dataflow_client.create_job(self.job), self)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py",> line 184, in wrapper
return fun(*args, **kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",> line 490, in create_job
self.create_job_description(job)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",> line 519, in create_job_description
resources = self._stage_resources(job.options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",> line 452, in _stage_resources
staging_location=google_cloud_options.staging_location)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/stager.py",> line 161, in stage_job_resources
requirements_cache_path)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/portability/stager.py",> line 411, in _populate_requirements_cache
processes.check_output(cmd_args)
File "<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/utils/processes.py",> line 52, in check_output
return subprocess.check_output(*args, **kwargs)
File "/usr/lib/python2.7/subprocess.py", line 574, in check_output
raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/bin/python',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']' returned non-zero exit status 1
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 14 tests in 912.832s
FAILED (errors=1)
> Task :beam-sdks-python:validatesRunnerStreamingTests FAILED
:beam-sdks-python:validatesRunnerStreamingTests (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 15 mins 14.47 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build.gradle'> line: 326
* What went wrong:
Execution failed for task ':beam-sdks-python:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32m 17s
4 actionable tasks: 4 executed
Publishing build scan...
https://gradle.com/s/2wclaocdwnp4m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Jenkins build is back to normal : beam_PostCommit_Py_VR_Dataflow
#1397
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/1397/display/redirect?page=changes>