You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by nk...@apache.org on 2019/11/14 13:05:49 UTC
[flink] branch docs_experimental__docs updated (d0f462d -> d3004d5)
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a change to branch docs_experimental__docs
in repository https://gitbox.apache.org/repos/asf/flink.git.
from d0f462d [hotfix][coordination] Update field name
add 37f67b7 [FLINK-14053][table-planner-blink] Fix DenseRankAggFunction first row bug.
add 12996bd [FLINK-14408][table-planner] Fix open() is not called if UDF is reduced during optimization
add 1cefbb8 [FLINK-14524] [flink-jdbc] Fix syntax for PostgreSQL dialect "upsert" statement (#9990)
add bccc440 [FLINK-14321][sql-parser] Support to parse watermark statement in SQL DDL
add fbd5b63 [FLINK-14342][table][python] Remove method FunctionDefinition#getLanguage.
add 6df53ea [FLINK-14522] Revert FLINK-13985 (sun.misc.Cleaner is not available in Java 9+)
add bde1251 [hotfix][table-planner] Remove unused import in CalcITCase
add 7c11822 [FLINK-14381][table-planner] Remove dynamic partition shuffle support in legacy planner
add fcc4b7f [FLINK-14381][table-planner-blink] User table factory and catalog table to test partition source and sink
add ad4fd63 [FLINK-14381][table-planner-blink] Get partition keys from catalog table for PartitionableTableSink
add 8e0d8ac [FLINK-14381][table-planner-blink] Get partition keys from catalog table for PartitionableTableSource
add 335c4f7 [FLINK-14381][table-planner-blink] Remove getPartitionFieldNames in PartitionableTableSource and PartitionableTableSink
add 7d065eb [FLINK-14363][runtime] Prevent vertex from being affected by outdated deployment
add 76b6dd7 [hotfix][tests] TestingLogicalSlot should only respect the first slot release request
add 766315c [hotfix][runtime] Remove the unnecessary slot release logic for outdated deployment
add 1757c86 [FLINK-14449][tests] Use dedicated deadline for each test
add e136bff [FLINK-14497][python] Replace coder with typeserializer
add 7e68b18 [FLINK-14497][python] Support TinyIntType for Python UDF
add 3f638db [FLINK-14497][python] Support BooleanType for Python UDF
add 90d33d0 [FLINK-14497][python] Support SmallInt for Python UDF
add a13ee19 [FLINK-14497][python] Support IntType for Python UDF
add 9569c0e [FLINK-14497][python] Support FloatType for Python UDF
add c267440 [FLINK-14497][python] Support DoubleType for Python UDF
add 67413f9 [FLINK-14497][python] Support BinaryType/VarBinaryType for Python UDF
add 23a9694 [FLINK-14497][python] Support CharType/VarCharType for Python UDF
add dd3d9dc [FLINK-14497][python] Support DateType for Python UDF
add 098d5e2 [FLINK-14509][python] Improve the README.md in flink-python to prepare for PyPI release.
add 4ef6ba1 [hotfix] Enrich DispatcherRunnerFactory to pass in additional services
add 5201a05 [hotfix] Introduce JobManagerMetricGroupFactory and use for DispatcherServices creation
add d477ae3 [hotfix] Stop DispatcherResourceManagerComponent if Dispatcher completes shutDownFuture in MiniCluster
add 7035fbd [hotfix] Rework ZooKeeperLeaderElectionITCase to not rely on DispatcherResourceManagerComponent internals
add 1f5540d [hotfix] Remove unused methods from MiniCluster
add 8772b07 [hotfix] Improve logging in DispatcherResourceManagerComponent
add 89e9b6f [FLINK-11665] Add DispatcherRunnerImplTest for FLINK-11665
add 431e2a0 [FLINK-11843] Add test case for FLINK-11843
add 637a6e9 [FLINK-11843] Add DispatcherRunnerImplNG with DispatcherLeaderProcess abstraction
add d734ac0 [FLINK-11843] Add DispatcherLeaderProcessImpl
add 7956a14 [FLINK-11843] Add DispatcherRunnerImplNGFactory implementation
add 9d447ad [FLINK-11843] Allow to pass JobGraphStore into Dispatcher via DispatcherServices
add 90db87d [FLINK-11843] Remove JobGraphListener from Dispatcher
add 0b9382b [FLINK-11843] Allow passing collection of recovered jobs to Dispatcher
add 07c5b72 [FLINK-11843] Remove job recovery from Dispatcher
add 358d46c [FLINK-11843] Restrict Dispatcher to only use JobGraphWriter instead of JobGraphStore
add f67349d [FLINK-11843] Make Dispatcher a PermanentlyFencedRpcEndpoint
add cb5fba5 [FLINK-11843] Enable DispatcherRunnerImplNG
add 8467acc [FLINK-11665] Port ZooKeeperDispatcherRunnerImplTest to use DispatcherRunnerImplNG
add b6128ca [FLINK-11843] Enable DispatcherRunnerImplTest for DispatcherRunnerImplNG
add 7a23e02 [FLINK-11843] Port MiniDispatcherTest to not do leader election for the MiniDispatcher
add c5dee31 [FLINK-11843] Create AbstractDispatcherLeaderProcess
add c1f67ef [FLINK-11843] Add proper per-job mode support for DispatcherRunnerImplNG
add 17c42a7 [hotfix] Remove explicit JobGraphWriter from Dispatcher constructor
add 7851cb6 [FLINK-11843] Port and remove DispatcherTest
add 9bf0669 [FLINK-11843] Port DispatcherResourceCleanupTest
add 2e1731d [hotfix] Pass in DispatcherServices into TestingDispatcher
add a17b9c0 [FLINK-11843] Pass in explicit JobGraphWriter in DispatcherTests
add 2d3426f [FLINK-11843] Port and remove ZooKeeperHADispatcherTest#testStandbyDispatcherJobExecution
add a123c8f [FLINK-11843] Port and remove DispatcherHATest
add 4e9dd7f [FLINK-11843] Ignore duplicate job submission due to false positive onAddedJobGraph callbacks
add c867585 [FLINK-11843] Properly remove job graphs which have been removed from the JobGraphStore
add a805f1b [FLINK-11843] Forward shut down future from Dispatcher through to the DispatcherRunnerImplNG
add a5438ca [FLINK-11843] Move DispatcherService into AbstractDispatcherLeaderProcess
add cdd0c29 [FLINK-11843] Remove old DispatcherRunnerImpl and DispatcherRunnerFactoryImpl
add 1f29693 [FLINK-11843] Rename DispatcherRunnerImplNG into DefaultDispatcherRunner
add 7858346 [FLINK-11843] Move DispatcherRunnerImplTest#testJobRecoveryUnderLeaderChange to DefaultDispatcherRunnerITCase
add 717b77c [FLINK-11843] Various cleanups for DefaultDispatcherRunner and tests
add 06e79c8 [FLINK-11843] Introduce DispatcherRunnerLeaderElectionLifecycleManager
add e3f2026 [FLINK-11665] Various ZooKeeperDefaultDispatcherRunnerTest clean ups
add 7fcb64b [FLINK-11843] Remove unused dispatcher runner accessor from DispatcherResourceManagerComponent
add 401f5f3 [FLINK-11843] Remove unnecessary getDispatcherGateway method from DispatcherRunner
add 035c6a1 [FLINK-11843] Rename DispatcherLeaderProcess#getConfirmLeaderSessionFuture into getLeaderAddressFuture
add 32a3e5a [FLINK-11843] Various SessionDispatcherLeaderProcessTest clean ups
add f387e50 [hotfix] Remove Nonnull annotations from DispatcherFactory and sub classes
add 1c2097e [FLINK-11843] Rename DispatcherService into DispatcherGatewayService
add ca29aa5 [hotfix] Remove exception suppression from Dispatcher#stopDispatcherServices
add bd038c9 [hotfix][core] Introduce IterableUtils
add 2e427c0 [FLINK-14450][runtime] Refactor SchedulingTopology to extend base topology
add 7203316 [hotfix][runtime] Remove FailoverVertex#getExecutionVertexName which is not necessary.
add b84337a [FLINK-14451][runtime] Refactor FailoverTopology to extend base topology
add 6ef33b5 [hotfix][runtime] Rename ExecutionGraphToSchedulingTopologyAdapter to DefaultExecutionTopology
add b1034c0 [FLINK-14452][runtime] Keep only one execution topology in scheduler
add 08f31cc [FLINK-14453][runtime] Support building pipelined regions from base topology
add 101f3f8 [hotfix][runtime] Remove FailoverTopology dependency from PartitionReleaseStrategy
add ba2233b [FLINK-14518][coordination] Generalize TE->RM heartbeat payload
add a8619c5 [hotfix][tests] Fix TestingShuffleMaster usage
add bebd27d [FLINK-14475][coordination] Adjust TaskExecutor interface to accept promotions
add b6361a9 [FLINK-14417][table] Develop CoreModule to provide Flink built-in functions
add 23a34b8 [FLINK-14153][ml] Add to BLAS a method that performs DenseMatrix and SparseVector multiplication.
add 81e6493 [FLINK-14478][python] Optimize current python test cases to reduce test time.
add 5da3d3e [hotfix] fix java checkstyle exception
add b1b4e00 [FLINK-14040][travis] Enable NG scheduler testing in per-commit tests
add f61d223 [FLINK-14227][docs-zh] Translate "Checkpointing" page to Chinese
add a385254 [hotfix][runtime] Implement AvailabilityHelper for providing resetAvailable/Unavailble functions for InputGate
add ad70e06 [FLINK-14396][network] Implement rudimentary non-blocking network output
add 60ce77a [hotfix][tests] Fix the missing class reference in LocalInputChannelTest
add 27307b4 [FLINK-14415][table-common] ValueLiteralExpression#equals should take array value into account (#9915)
add ecc8020 [FLINK-14230][task] Change the endInput call of the downstream operator to after the upstream operator closes
add d4be257 [FLINK-14230][datastream] Remove the BoundedOneInput implementation of AsyncWaitOperator and ContinuousFileReaderOperator
add 8543334 [hotfix][test] Clean up the test code in SourceStreamTaskTest and OneInputStreamTaskTest
add 126cff6 [hotfix] Extract utils of CheckpointCoordinatorTest into a separate utils class and correct codestyle
add 22c3248 [hotfix] Split too large file CheckpointCoordinatorTest.java into several small files
add 3c84c05 [hotfix] Correct code style of CheckpointCoordinator
add 5ab6261 [FLINK-13904][checkpointing] Make trigger thread of CheckpointCoordinator single-threaded
add fc19673 [FLINK-13904][tests] Support checkpoint consumer of SimpleAckingTaskManagerGateway
add 41cda38 [FLINK-13904][checkpointing] Avoid competition between savepoint and periodic checkpoint triggering
add 00fe29b [FLINK-13904][checkpointing] Remove trigger lock of CheckpointCoordinator
add beb3fb0 [FLINK-13904][checkpointing] Encapsule and optimize the time relevant operation of CheckpointCoordinator
add 6e7bdc3 [FLINK-14370][kafka][test-stability] Fix the cascading test failure in KafkaProducerTestBase.
add 96640ca [hotfix][kafka][test-stability] Accelerate the KafkaProducerTest by reducing the timeout values.
add e18320b [FLINK-14397][hive] Failed to run Hive UDTF with array arguments
add 7420bdb [FLINK-14134][table-common] Introduce LimitableTableSource for optimizing limit
add 4bf46c5 [FLINK-14134][table-planner-blink] Introduce PushLimitIntoTableSourceScanRule to apply LimitableTableSource
add 005bda9 [FLINK-13513][ml] Add the Mapper and related classes for later algorithm implementations.
add b7cd6a9 [FLINK-14493][core] Introduce data types to ConfigOptions.
add 44c85e3 [FLINK-14490] Use ObjectIdentifier in TableOperations
add 54e69c3 [FLINK-14490][table-planner] Extract CalciteParser from FlinkPlannerImpl
add 0fe3fe1 [FLINK-14490][table-api] Introduce UnresolvedIdentifier
add 96a62d9 [FLINK-14490][table-planner] Extract parsing logic from Planner interface
add c0f4b7fa [FLINK-14490][table] Introduced temporary tables to CatalogManager
add 0c24cec [FLINK-14490][table-api] Add createTemporaryView
add 8d40df4 [FLINK-14490][table-api] Add drop temporary tables
add b286330 [FLINK-14490][table-api] Add from method
add fe966d4 [FLINK-14490][table-api] Rework insertInto method
add f71ce33 [FLINK-12223][Runtime]HeapMemorySegment.getArray should return null after being freed
add d5bb073 [hotfix] Fix typos in MemorySegment java docs
add 11ef253 [FLINK-12289][flink-runtime]Fix typos in Memory manager
add 6134cbc [FLINK-14318][travis] Compile with a single thread
add 5d92eb1 [FLINK-13756][table] Fix javadoc for findAndCreateTableSource method in TableFactoryUtil class
add 4571b31 [FLINK-12492][cep] Minor optimize the cep operator by avoiding unnecessary copy
add f79dda8 [FLINK-12092][docs] Clarify when onTimer(...) in ProcessFunction is called.
add 6378f82 [FLINK-10435][yarn] Fix client sporadically hangs after Ctrl + C
add 759b8cb [FLINK-14061][runtime] Introduce managed memory fractions to StreamConfig
add 6cc09ac [FLINK-14526][hive] Support Hive version 1.1.0 and 1.1.1
add 31e89c7 [FLINK-14218][table] support precise function reference in FunctionCatalog
add 4c87259 [FLINK-14398][table-planner] Further split input unboxing code into separate methods (#10000)
add 785b7b2 [FLINK-11405][rest] Add maxExceptions query parameter
add 16a815a [FLINK-12147][metrics][influxdb] Bump influxdb-java to 2.16
add 0518cdd [hotfix][docs] Fix REST label rotation in SSL figure
add a862dad [FLINK-14403][coordination] Remove legacy NotifyCheckpointComplete and TriggerCheckpoint
add 11eb7c4 [FLINK-14535][table-planner-blink] Fix cast exception when count distinct on decimal fields
add 1da3055 [FLINK-13869][table-planner-blink][hive] Fix Hive functions can not work in blink planner streaming mode (#10013)
add ef0dc509 [FLINK-14253][table-planner-blink] Add hash distribution and sort grouping only when dynamic partition insert
add 2352586 [FLINK-14532][coordination] Rename PartitionTracker
add 4bc56a4 [FLINK-14532][coordination] Split PartitionTracker
add 470fd2f [FLINK-14534][table] FunctionCatalog.getUserDefinedFunctions() should include temp functions
add 9029b25 [hotfix][runtime] Fix checkstyle violations in ExecutionVertex
add 2377de5 [hotfix][runtime] Add overloaded method CheckpointCoordinator#restoreLatestCheckpointedState
add 5faa81a [hotfix][tests] Introduce TestMasterHook
add 9a38946 [FLINK-14389][runtime] Restore task state before restarting tasks in DefaultScheduler
add ffe3a61 [FLINK-12526][runtime] Remove STATE_UPDATER in ExecutionGraph
add 1fd1c18 [FLINK-14219][table] support ambiguous function reference
add b4dfb3d [FLINK-14547][table-planner-blink] Fix UDF cannot in the join condition in blink planner for Table API.
add 6c6ada5 [FLINK-14556][python] Correct the package structure of cloudpickle
add e41c0fe [FLINK-14522] Introduce JavaGcCleanerWrapper to find Java GC Cleaner depending on JVM version
add d90e499 [FLINK-14302] [kafka] FlinkKafkaInternalProducer should not send `ADD_PARTITIONS_TO_TXN` request if `newPartitionsInTransaction` is empty when enable EoS
add 6ae3f25 [FLINK-14059][core] Introduce option allVerticesInSameSlotSharingGroupByDefault in ExecutionConfig
add 1f7655f [FLINK-14059][table] Blink batch executor disables allVerticesInSameSlotSharingGroupByDefault
add 782526e [FLINK-14476] Extend PartitionTracker to support promotions
add fe15dd5 [hotfix] Remove unused TaskManagerConfiguration in TaskExecutorTest
add 63b5c94 [FLINK-14557][python] Clean up the py4j package by removing the unused directory __MACOSX.
add f533694 [FLINK-14561] Don't write FLINK_PLUGINS_DIR env variable to Configuration
add e873ceb [hotfix] Fix checkstyle violations in FlinkDistributionOverlayTest
add 7422dd0 [hotfix] Fix checkstyle violations in FlinkDistributionOverlay
add 156cec0 [hotfix] Introduce ContainerSpecification#createDynamicProperty
add 9c7e7bd [hotfix] Fix checkstyle violations in ContainerSpecification
add 87d0a3c [hotfix] Rename and move MesosEntrypointUtils to o.a.f.mesos.util.MesosUtils
add f3af533 [hotfix] Rename ContainerSpecification#dynamicConfiguration to flinkConfiguration
add 80043ae [hotfix] Remove clone method from ContainerSpecification
add b7d0abf [hotfix][mesos] Remove dynamicProperties from ContainerSpecification
add c0f3c80 [FLINK-14074][mesos] Forward configuration to Mesos TaskExecutor
add 3a16b2b [hotfix][mesos] Add more logging information to LaunchableMesosWorker
add 3a69d5b8 [FLINK-14558][python] Fix ClassNotFoundException of PythonScalarFunctionOperator
add 8522f3b [FLINK-14544][runtime] Fixing race condition during task cancellation when closing mailbox / enqueuing poison letter.
add a966e44 [FLINK-14439][runtime] Enable RestartPipelinedRegionStrategy to leverage JM tracked partition availability
add 6a25bc5 [FLINK-14440][tests] Annotate BatchFineGrainedRecoveryITCase to enable scheduler NG testing for it
add d00fe06 [FLINK-14502] Change CustomCommandLine cluster client methods to get a configuration
add 71b056f [FLINK-14501] Change the log config file discovery
add 476b25a [FLINK-14501] Add the DeploymentOptions.TARGET
add 16d67e8 [FLINK-14501] Add the ClusterClientFactory and make it discoverable
add d1aa63f [FLINK-14501] Add Standalone and Yarn ClusterClientFactories
add e444874 [FLINK-14501] Wired ClusterClientFactories to production code
add 3c8af45 [hotfix] Do not expose Yarn dynamic options
add bf955c5 [FLINK-14501] Make YarnClusterDescriptor initialization self-contained
add ea6fdde [FLINK-14377] Parse the ProgramOptions to a Configuration.
add 20a0005 [hotfix] Rename T to ClusterID in CliFrontend and ExecutionContext
add 9241af0 [FLINK-14502] Use the newly introduced list ConfigOption wherever possible.
add 09f2f43 [FLINK-14154][ml] Add the class for multivariate Gaussian Distribution.
add bf5235e [FLINK-14496][client] Exclude detach flag from ClusterClient
add b090d66 [hotfix][docs] Fix paragraph tags
add 1ffbcfb [FLINK-14115][docs-zh] Translate DataStream Code Walkthrough into chinese (#9749)
add 3011bff [FLINK-14322][table-api] Add watermark information in TableSchema (#9994)
add a6afeb4 [FLINK-12939][docs-zh] Translate "Apache Kafka Connector" page into Chinese
add 7009ddb [hotfix][runtime] Fix code style violations in JobVertexD and IntermediateDataSetID
add dbbbcdc [FLINK-14312][runtime] Introduce LogicalTopology
add ee2fb10 [FLINK-14312][runtime] Introduce LogicalPipelinedRegion
add e627037 [FLINK-14312][runtime] Introduce DefaultLogicalTopology
add 8cc74a6 [FLINK-14488][python] Update python table API with temporary tables & views methods
add b6bb09a [FLINK-14488][python] Update python table API adding from_path method
add d83b58c [FLINK-14488][python] Update python table API with insert_into
add 6c81981 [hotfix][python] Deprecate TableEnvironment.register_table_source and TableEnvironment.register_table_sink
add b9f51de [hotfix][python] Clean up test_environment_completeness by removing the legacy excluded methods which are already supported
add 22930e3 [FLINK-14022][table-planner][table-planner-blink] Add python udf validation check in MatchRecognize
add 02bc04a [FLINK-14022][table-planner][table-planner-blink] Introduces SplitPythonConditionFromJoinRule which splits Python Functions from join conditions
add 84f830b [FLINK-14022][table-planner][table-planner-blink] Add python udf validation check in join condition
add 1fa4e3d [FLINK-14464] Introduce the AbstractUserClassPathJobGraphRetriever This abstract class is for the JobGraphRetriever, which wants to use the user's classpath.
add 9e13af6 [FLINK-14464] Simplify file listing implementation
add 34a9c10 [FLINK-14221][table] support drop temp system functions and temp catalog functions
add 15f8f3c [FLINK-14588][hive] Support Hive version 1.0.0 and 1.0.1
add 0828e29 [FLINK-14562] Let RabbitMQ source close consumer and channel on close
add ba068d5 [FLINK-14536][core] Sum the cpuCores when merging resource specs
add a96b3da [FLINK-14549][table-planner-blink] Improve exception message when schema is not matched between query and sink
add 7ffe265 [FLINK-14498][runtime]Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool. (#9993)
add 845fb95 [FLINK-14080][table-planner-blink] Introduce SqlTimestamp as internal representation of TIMESTAMP_WITHOUT_TIME_ZONE
add 76225ed [FLINK-14462][coordination] Remove JobGraph#allowQueuedScheduling flag because it is always true
add 7e3a92b [hotfix] Fix checkstyle violations in SchedulerIsolatedTasksTest
add ee32514 [hotfix] Fix checkstyle violation in SchedulerTestBase
add aa10ec8 [hotfix] Enable SchedulerTestBase to use different ComponentMainThreadExecutors
add 85d7374 [FLINK-14462] Enable ScheduleIsolatedTasksTest#testScheduleWithDyingInstances
add f242298 [FLINK-14372][tests] Add category AlsoRunWithSchedulerNG to KeyedStateCheckpointingITCase
add 9241a44 [FLINK-12527][runtime] Remove GLOBAL_VERSION_UPDATER in ExecutionGraph
add db8fd38 [FLINK-14583][runtime] Remove progressLock from ExecutionGraph
add a041920 [FLINK-14578][table] load/unloadModule() should throw RuntimeException rather than checked exception
add 047ba24 [hotfix][tests] Refactor SchedulerTestBase for removing dead code
add 503d5a2 [hotfix][runtime] Remove StreamGraphGenerator#isSlotSharingEnabled
add 466b824 [hotifx] Remove unused constructor of StreamingJobGraphGenerator
add fb7beb8 [hotfix][table, tests] Increase slot count in blink batch tests to avoid resource deadlocks if a job has multiple logical regions
add 299625a [FLINK-14060] Set vertex slot sharing based on logical pipelined regions
add 6d1ea0f [hotfix][runtime] Propagate execution graph execution state update result to JobMaster
add 044eb42 [hotfix][runtime] Invoke sendCancelRpcCall for internally detected failures after notifying it to scheduler
add 213ddb8 [FLINK-14375][runtime] Avoid notifying ineffective state update to scheduler
add 183113f [FLINK-14371][tests] Annotate WindowCheckpointingITCase with AlsoRunWithSchedulerNG category
add 99842a6 [FLINK-14371][tests] Annotate EventTimeWindowCheckpointingITCase with AlsoRunWithSchedulerNG category
add ef3dd92 [FLINK-14371][tests] Enable ClassLoaderITCase to pass with NG scheduler
add 08793a9 [FLINK-14418][hive] Create HiveModule to provide Hive built-in functions
add a970430 [FLINK-14419][table] Add ModuleFactory, ModuleDescriptor, ModuleDescriptorValidator for factory discovery service, and add implementations for CoreModule
add 2ea1416 [FLINK-14546][formats] Support map type in JSON format
add 9b43f13 [FLINK-14603][runtime] Notify the potential buffer consumer if the size of LocalBufferPool has been expanded.
add a9eff45 [FLINK-14600][runtime] Change type of field ExecutionGraph#verticesFinished to int
add b9e75dd [FLINK-13894][web] Add TE log link to subtask view
add 3a39d9c [FLINK-14580][hive] add HiveModuleFactory, HiveModuleDescriptor, and HiveModuleDescriptorValidator
add 051692a [FLINK-13034][state backends] Add isEmpty method for MapState
add 02c4f20 [FLINK-13469][state] Ensure resource used by StateMapSnapshot will be released if snapshot fails
add 60a066a [hotfix][tests] Replace mockito-based verification with property verification.
add 87df20d [hotfix][tests] Checkstyle and common style cleanups in CopyOnWriteStateMapTest
add 2678506 [FLINK-14586][tests] JobMasterBuilder as top-level class
add 603ad16 [FLINK-14586][tests] Factor out utility createSingleVertexJobGraph()
add 28b47b7 [FLINK-14586][tests] Move JM partition tests into separate class
add deb2a9d [FLINK-14586][tests] Refactor partition tests
add 0483ffc [FLINK-14586][coordination] JM issues promote calls on successful job
add b850069 [FLINK-12342][yarn] Remove container requests in order to reduce excess containers
add 155885c [FLINK-14589] Redundant slot requests with the same AllocationID leads to inconsistent slot table
add 28cf30d [FLINK-14608][formats] Remove java stream from JsonRowDeserializationSchema
add 59339ac [FLINK-13702][flink-table-planner] Fix NullSerializer & NullAwareMapSerializer snapshotting
add dcb29bd [FLINK-13702][flink-table-planner] Fix accumulator type of CollectAggFunction
add 960ac40 [FLINK-13702][flink-table-planner] Fix digest of GenericRelDataType
add 0b28e83 [FLINK-13702][table-planner-blink] Fixed BinaryGeneric & BinaryString materialization
add 6d865e2 [FLINK-14639][metrics][docs] Fix methods signature
add edeec8d [hotfix][runtime] Replace all occurrences of letter to mail to unify wording of variables and documentation.
add bf7a402 [hotfix][runtime] Replace MailboxStateException with IllegalStateException.
add 14fde46 [hotfix][runtime] Added TaskMailbox#drain and using it to implement MailboxProcessor. Also changed return types of TaskMailbox#close to Mail for unification.
add f4e78ef [hotfix][runtime] Simplified and tweaked TaskMailboxImpl.
add 05c6915 [FLINK-14304][runtime] Adding batch capabilities to TaskMailbox, moved mailbox thread ownership into mailbox to sharpen the threading model, and simplified hierarchy.
add 7111507 [hotfix][runtime/core] Cleaning up MailProcessor and adding utility method to WrappingRuntimeException.
add f62d98e [hotfix][runtime] Consolidating javadoc and package structure.
add 809533e [hotfix][runtime] Moving interfaces closely related to mailbox default action into MailboxDefaultAction. Renaming DefaultActionContext to MailboxDefaultAction.Controller.
add ced28c9 [hotfix][metrics] Define the default time span for MeterView and add a constructor to use it
add 282f785 [hotfix][runtime] Remove the redundant handleGlobalFailure() definition from SchedulerBase
add 4f0d6c1 [FLINK-14164][runtime] Add a 'numberOfRestarts' metric to exhibit number of restarts
add ba7c279 [FLINK-14164][runtime] Add docs for 'numberOfRestarts' metric
add e933a5c [FLINK-14373][tests] Fix ZooKeeperHighAvailabilityITCase to pass with NG scheduler
add 525f3c9 [FLINK-12697][state backends] Support on-disk state storage for spill-able heap backend
add 9d45ad0 [FLINK-12697][state backends] (follow-up) Minor optimization that avoids extra memory segment wrapping.
add 534835b [FLINK-12216][runtime] Respect the number of bytes from input parameters in HybridMemorySegment
add 7ee05e5 [hotfix][core] Cleanups of compiler and inspection warnings for HybridMemorySegment and tests.
add c5b8949 [FLINK-14605][hive] Use Hive-1.1.0 as the profile to test against 1.1.x
add 25a3d91 [hotfix] Move TaskManagerSlot to o.a.f.runtime.resourcemanager.slotmanager
add 740ca1a [hotfix] Introduce TaskManagerSlotInformation
add 5a6aa93 [hotfix] Make SlotManagerImpl#findMatchingRequest and #findMatchingSlot private
add 743eae4 [hotfix] Extend OptionalConsumer to accept ThrowingRunnable
add b02fe5d [hotfix] Let SlotManagerImpl#findMatchingSlot return Optional<TaskManagerSlot>
add 216d073 [FLINK-12122] Introduce SlotMatchingStrategy for SlotManager
add 7973453 [FLINK-12122] Add LeastUtilizationSlotMatchingStrategy for spreading slot allocations out
add 0df281e [FLINK-12122] Introduce ClusterOptions#EVENLY_SPREAD_OUT_SLOTS_STRATEGY
add 728c02d [hotfix] Replace SlotInfoAndResource helper constructor with static factory method
add 362d767 [FLINK-12122] Calculate TaskExecutorUtilization when listing available slots
add 2ab8b61 [FLINK-12122] Add EvenlySpreadOutLocationPreferenceSlotSelectionStrategy
add 269e7f0 [FLINK-12122] Choose SlotSelectionStrategy based on ClusterOptions#EVENLY_SPREAD_OUT_SLOTS_STRATEGY
add fd1deff [hotfix] Fix checkstyle violations in SlotSharingManagerTest
add 7e82185 [FLINK-13969][Checkpointing] Do not allow trigger new checkpoitn after stop the coordinator
add 96df4fa [FLINK-14623][table-api] Add computed column information into TableSchema
add d938c19 [FLINK-14593][client] Port ClusterClient to asynchronous interface version
add fe77fdc [FLINK-14262][table] FunctionCatalog should return empty when can not get the catalog from catalog name
add 0a5ae34 [FLINK-14262][table-planner-blink] Add getCatalogManager to FlinkContext
add 1b4ebce [FLINK-14262][table-planner-blink] support referencing function with fully/partially qualified names in blink
add 8bd4b5c [FLINK-14262][table] FunctionIdentifier shouldn't normalize function name and use un-escaped identifier as toString
add b0a9afd [hotfix][table] Avoid passing CatalogManager to FunctionCatalogOperatorTable
add c2c0fb6 [hotfix][table] Fix the comments of Operation
add 47c277d [FLINK-14380][ScalaAPI] Passing inferred outputType directly to map and flatMap function
add 0b33726 [FLINK-14481][runtime] Change Flink's port check to 0 to 65535
add ab7b433 [hotfix] remove unused method in YarnConfigUtils
add bd7d745 [hotfix] Port the DYNAMIC_PROPERTIES config option to new options API
add 93c4d49 [FLINK-14630] Make the yarn APPLICATION_LOG_CONFIG_FILE an internal option
add 18f101a [FLINK-14630] Add test utility to create YarnClusterDescriptor with Logging
add 91d6e76 [FLINK-14630] Create separate util for setting the yarn log config option
add 63bf1df [hotfix] Make logging flags explicit
add 5acf09d [hotfix][table-planner-blink] Make sure TableSourceTable.catalogTable is not null
add 35836df [FLINK-14324][table-planner-blink] Convert SqlCreateTable with SqlWatermark to CatalogTable
add d98ad19 [FLINK-14326][table-planner-blink] Introduce WatermarkGenerator interface to generate watermark from current row
add bf27bdd [FLINK-14326][table-planner-blink] Support code generate a WatermarkGenerator from RexNode
add d0901dc [FLINK-14326][table-planner-blink] Support to generate and apply watermark assigner in translateToPlan
add 937356f [hotfix][table-planner-blink] Move SqlToOperationConverterTest from sqlexec package to operations package
add 3a09665 [FLINK-14646] Add non-null checks to KeyGroupRangeAssignment
add c1affda [hotfix] Fix checkstyle violations in KeyGroupRangeAssignment
add 2df3ccc [FLINK-14530][coordination] Replace PartitionTable with PartitionTracker
add d788c6f [FLINK-15430][coordination] Store IntermediateDatasetID
add 5927c54 [FLINK-14636][runtime] Enable scheduling for ScheduleMode.LAZY_FROM_SOURCES_WITH_BATCH_SLOT_REQUEST
add 2125ea2 [FLINK-14611][runtime] Move allVerticesInSameSlotSharingGroupByDefault setting from ExecutionConfig to StreamGraph
add 501f640 [FLINK-14579][sql cli] enable SQL CLI to configure modules via yaml config
add 1806a37 [FLINK-14673][hive] Shouldn't expect HMS client to throw NoSuchObjectException for non-existing function
add c1e9aef [FLINK-14465] Let StandaloneJobClusterEntryPoint use the user code class loader
add ef4055a [FLINK-14657] Generalize and move config utils from flink-yarn to flink-core
add 5aa00fb [FLINK-14395] Refactor ES 7 connectors to make them keep consistency with es 6 connectors
add 73193a8 [hotfix] Update Javadoc in FlinkKafkaProducer.java
add 6dbfd26 Fixed word typo : environment and refactored load savepoint exception message
add 11dc0da [hotfix] Rename TimeReaderFunction to TimerReaderFunction
add a815b7b [hotfix][JavaDocs] Correct docs in MemoryStateBackend
add 9e0b249 [FLINK-14665][table-planner-blink] Support computed column in blink-planner
add 43ef98e [FLINK-14554] Correct the comment of ExistingSavepoint#readKeyedState to generate java doc
add a43175c [FLINK-14601] [client] CLI documentation for list is missing '-a'
add 7a61c58 [hotfix] Fix wrong Java doc comment of BroadcastStateBootstrapFunction.Context
add 0f33630 [FLINK-14374][runtime] Expose scheduler type constants in SchedulerNGFactoryFactory
add 6aa0a67 [FLINK-14374][runtime,tests] Run RegionFailoverITCase also with DefaultScheduler enabled
add 7baf6875 [hotfix][docs] Fix broken table that describes 'numberOfRestarts' metric
add 51c2421 [hotfix][runtime] Rename metric 'numberOfRestarts' to 'numRestarts'
add 644d658 [FLINK-14164][runtime] Make metric 'fullRestarts' compatible with NG scheduler
add 658cea3 [FLINK-14660][sql cli] add 'SHOW MODULES' to SQL CLI
add 767bf99 [FLINK-14420][doc] Add documentation for pluggable module
add 55686bc [FLINK-14656][table-planner-blink] blink planner should also fetch catalog statistics for permanent table (#10119)
add 5d8081f [FLINK-14468][docs] Update Kubernetes docs
add 056e1fc [FLINK-14714][table-runtime-blink] BytesHashMap should not log the whole stack when start spilling (#10156)
add 7128fdc [FLINK-14693][python] Fix Python tox checks failure on travis
add b872f19 [hotfix] Introduce constants MemorySize#ZERO and MemorySize#MAX_VALUE.
add 95fe886 [hotfix] Move SimpleSlotContext to test scope.
add 740adc1 [hotfix] Fix misusage of UNKNOWN and ANY ResourceProfiles
add 4a5e8c0 [hotfix] Deduplicate setting operator resource / parallelism argument checks.
add 9d22410 [hotfix] UNKNOWN ResourceSpec should not be numerically compared.
add 1cbee5e [hotfix] Make MemorySize comparable.
add 2c81c3f [FLINK-14405][runtime] Update ResourceSpec to align with FLIP-49 resource types
add b6c2943 [FLINK-14405][runtime] Update ResourceProfile to align with FLIP-49 resource types
add 001733b [FLINK-14495][core] Limit ResourceSpec to always specify cpu cores and task heap memory size, unless it UNKNOWN.
add 099e965 [hotfix] Remove unused constructors and unnecessary javadocs for ResourceSpec.
add bfd6aa5 [hotfix] Remove unused constructors and unnecessary javadoces, and annotate constructors used only in testing codes as VisibleForTestting for ResourceProfile.
add 36d1b62 [hotfix] Preserve the singleton property for ResourceProfile#ANY.
add e2b6548 [FLINK-14344][checkpointing] PendingCheckpoint supports acknowledging master state
add 5522461 [hotfix] Correct code style of MasterTriggerRestoreHook
add d282c98 [FLINK-14344][checkpointing] Emphasize that MasterTriggerRestoreHook#triggerCheckpoint should be non-blocking in java doc
add 82c2057 [FLINK-14344][checkpointing] MasterHooks class supports asynchronous triggering
add b5da461 [hotfix] Correct the acknowledging method name of PendingCheckpoint
add 0cf9c28 [FLINK-14499][metric] MetricRegistry#getMetricQueryServiceGatewayRpcAddress is Nonnull
add 8d8c088 [hotfix][metric] MetricRegistryImpl#LOG is private
add 57160ba [FLINK-14704] Remove unused SynchronousSavepointLatch
add 563a4ad [FLINK-14486][table-api, docs] Update documentation regarding Temporary Objects
add 7c4fb30 [FLINK-14715][hive] HiveModuleTest fails with Hive-3.1.1
add 0022d4a [FLINK-14689][table] Add catalog related commands support in sql parser.
add a8e3a20 [FLINK-14612][runtime] Change Type of Field intermediateResults from ConcurrentHashMap to HashMap
add 512b4f7 [FLINK-14602][runtime] Change Type of Field tasks from ConcurrentHashMap to HashMap
add 4d97e2f [FLINK-14640][runtime] Change Type of Field currentExecutions from ConcurrentHashMap to HashMap
add 58f22cc [FLINK-14638][doc] move functions related docs to a new single, unified dir /dev/table/functions
add a20eb65 [FLINK-14301][doc] add documentation for functions categories and new function resolution orders
add 891ab858 [hotfix][doc] fix titles in Hive doc
add 276e850 [FLINK-14731][table-planner-blink] LogicalWatermarkAssigner should use specified trait set when doing copy (#10167)
add 965e4e5 [FLINK-14724][table-planner-blink] Join condition could be simplified in logical phase (#10163)
add 79e3b32 [FLINK-12039] Remove ASSIGNED_SLOT_UPDATER in Execution.tryAssignResource
add f93d350 [hotfix][docs] clarify RocksDB thread options applicability per operator/TM
add d36ce5f [hotfix][docs] clarify that a RocksDB dependency in pom.xml may not be needed
add 14adea4 [FLINK-14627][tests] Refactor ExecutionGraph creation in tests as TestingExecutionGraphBuilder
add 4ba7b4d [FLINK-14706] Remove legacy KvStateMessage
add 26faddd [FLINK-14723][table-planner-blink] Add tests for partial qualified UDF calls as computed columns
add 827477c [FLINK-14723][table-planner-blink] Remove result assertion in test CatalogTableITCase#testInsertSinkTableWithUnmatchedFields
add 095c4d4 [FLINK-14723][table-planner-blink] Java(Scala)DataStreamQueryOperation should remember the registered object path
add 8466134 [FLINK-14723][table-planner-blink] Use ObjectIdentifier in DataStreamQueryOperations
add ee44dc5 [hotfix][docs, config] Exlcude ReadableConfig and WritableConfig from configuration docs generator
add ac8d508 [FLINK-14494][docs] Add ConfigOption type to the documentation generator
add 381892f [FLINK-14494][docs] Regenerated config options documentation with type information
add f6ac09f [hotfix] Change the signature of the ConfigUtils.encodeCollectionToConfig()
add 86b00ad [hotfix] Move addJars() from ClientUtils to JobGraph
add c2dbf94 [hotfix] Refactors PackagedProgram.extractContainedLibraries()
add cffa2e8 [hotfix] CliFrontend.buildProgram() uses only ProgramOptions
add bd8570f [FLINK-14745] Add dependencies of job as list of URLs in config
add 8293c28 [FLINK-14745] Fix setting CoreOptions.DEFAULT_PARALLELISM in ExecutionConfigAccessor
add 03c125c [FLINK-14745] Wire the configuration to the ClientUtils.executeProgram
add 472772b [FLINK-14477][coordination] Move shuffle service access into TEPartitionTracker
add f892ccb [FLINK-14477][coordination] Implement promotion logic on TaskExecutor
add 313cf8b [hotfix][runtime] Remove unused import
add c196d0f [FLINK-13528][kafka] Disable sql tests failing on Java 11
new 7f04737 [FLINK-13729][docs] Update website generation dependencies
new 325a9c1 [FLINK-13725][docs] use sassc for faster doc generation
new b3cade4 [hotfix][docs] Temporarily disable liveserve
new 0b23069 [FLINK-13726][docs] Build docs with jekyll 4.0.0.pre.beta1
new d3004d5 [FLINK-13791][docs] Speed up sidenav by using group_by
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.travis.yml | 8 +
docs/.gitignore | 3 +-
docs/Gemfile | 19 +-
docs/Gemfile.lock | 86 +-
docs/README.md | 3 +-
docs/_includes/generated/akka_configuration.html | 26 +-
.../generated/algorithm_configuration.html | 6 +-
.../generated/blob_server_configuration.html | 13 +-
.../generated/checkpointing_configuration.html | 13 +-
.../_includes/generated/cluster_configuration.html | 14 +-
docs/_includes/generated/common_section.html | 14 +-
docs/_includes/generated/core_configuration.html | 8 +-
.../generated/deployment_configuration.html | 30 +
.../generated/environment_configuration.html | 12 +-
.../generated/execution_config_configuration.html | 22 +-
...ailure_rate_restart_strategy_configuration.html | 6 +-
.../generated/file_system_configuration.html | 6 +-
...fixed_delay_restart_strategy_configuration.html | 5 +-
.../generated/heartbeat_manager_configuration.html | 5 +-
.../generated/high_availability_configuration.html | 7 +-
.../high_availability_zookeeper_configuration.html | 17 +-
.../generated/history_server_configuration.html | 11 +-
.../generated/job_manager_configuration.html | 14 +-
.../generated/kerberos_configuration.html | 7 +-
docs/_includes/generated/mesos_configuration.html | 15 +-
.../mesos_task_manager_configuration.html | 18 +-
docs/_includes/generated/metric_configuration.html | 22 +-
.../netty_shuffle_environment_configuration.html | 10 +-
.../generated/network_netty_configuration.html | 10 +-
.../generated/optimizer_config_configuration.html | 11 +-
.../generated/optimizer_configuration.html | 6 +-
.../generated/pipeline_configuration.html | 24 +
...etheus_push_gateway_reporter_configuration.html | 10 +-
docs/_includes/generated/python_configuration.html | 5 +-
.../generated/queryable_state_configuration.html | 11 +-
.../generated/resource_manager_configuration.html | 10 +-
docs/_includes/generated/rest_configuration.html | 16 +-
docs/_includes/generated/rest_v1_dispatcher.html | 10 +
.../generated/restart_strategy_configuration.html | 4 +-
.../rocks_db_configurable_configuration.html | 18 +-
.../generated/rocks_db_configuration.html | 11 +-
.../rocks_db_native_metric_configuration.html | 25 +-
.../generated/savepoint_config_configuration.html | 24 +
.../generated/security_configuration.html | 29 +-
.../generated/shuffle_service_configuration.html | 4 +-
.../generated/task_manager_configuration.html | 19 +-
.../task_manager_memory_configuration.html | 20 +-
docs/_includes/generated/web_configuration.html | 18 +-
.../generated/yarn_config_configuration.html | 59 +-
.../generated/zoo_keeper_configuration.html | 6 +-
docs/_includes/sidenav.html | 7 +-
docs/build_docs.sh | 2 +-
docs/dev/connectors/kafka.zh.md | 690 +--
docs/dev/stream/operators/index.md | 2 +-
docs/dev/stream/operators/index.zh.md | 2 +-
docs/dev/stream/operators/process_function.md | 3 +-
docs/dev/stream/state/checkpointing.zh.md | 152 +-
docs/dev/stream/state/state.md | 1 +
docs/dev/stream/state/state.zh.md | 2 +-
docs/dev/table/catalogs.md | 8 +-
docs/dev/table/catalogs.zh.md | 8 +-
docs/dev/table/common.md | 412 +-
docs/dev/table/common.zh.md | 426 +-
docs/dev/table/connect.md | 10 +-
docs/dev/table/connect.zh.md | 14 +-
docs/dev/table/functions.md | 6408 -------------------
docs/dev/table/functions.zh.md | 6524 --------------------
docs/dev/table/functions/index.md | 94 +
docs/dev/table/functions/index.zh.md | 97 +
docs/dev/table/functions/systemFunctions.md | 6408 +++++++++++++++++++
docs/dev/table/functions/systemFunctions.zh.md | 6524 ++++++++++++++++++++
docs/dev/table/functions/udfs.md | 1566 +++++
docs/dev/table/functions/udfs.zh.md | 1566 +++++
docs/dev/table/hive/hive_functions.md | 36 +
docs/dev/table/hive/hive_functions.zh.md | 36 +
docs/dev/table/hive/index.md | 4 +-
docs/dev/table/hive/index.zh.md | 4 +-
docs/dev/table/modules.md | 126 +
docs/dev/table/modules.zh.md | 126 +
docs/dev/table/sourceSinks.md | 6 +-
docs/dev/table/sourceSinks.zh.md | 24 +-
docs/dev/table/sql.md | 62 +-
docs/dev/table/sql.zh.md | 72 +-
docs/dev/table/streaming/temporal_tables.md | 4 +-
docs/dev/table/streaming/time_attributes.md | 8 +-
docs/dev/table/streaming/time_attributes.zh.md | 8 +-
docs/dev/table/tableApi.md | 182 +-
docs/dev/table/tableApi.zh.md | 180 +-
docs/dev/table/udfs.md | 1566 -----
docs/dev/table/udfs.zh.md | 1566 -----
docs/fig/ssl_internal_external.svg | 541 +-
.../walkthroughs/datastream_api.zh.md | 233 +-
docs/monitoring/metrics.md | 9 +-
docs/monitoring/metrics.zh.md | 9 +-
docs/ops/config.md | 9 +
docs/ops/config.zh.md | 9 +
docs/ops/deployment/kubernetes.md | 16 +-
docs/ops/deployment/mesos.md | 4 +-
docs/ops/deployment/mesos.zh.md | 4 +-
docs/ops/scala_shell.md | 4 +-
docs/ops/scala_shell.zh.md | 4 +-
docs/ops/state/state_backends.md | 7 +-
docs/tutorials/python_table_api.md | 15 +-
docs/tutorials/python_table_api.zh.md | 4 +-
.../java/org/apache/flink/client/ClientUtils.java | 103 +-
.../org/apache/flink/client/LocalExecutor.java | 2 -
.../org/apache/flink/client/RemoteExecutor.java | 4 +-
.../client/cli/AbstractCustomCommandLine.java | 13 +-
.../org/apache/flink/client/cli/CliFrontend.java | 201 +-
.../apache/flink/client/cli/CliFrontendParser.java | 31 +-
.../apache/flink/client/cli/CustomCommandLine.java | 40 +-
.../org/apache/flink/client/cli/DefaultCLI.java | 30 +-
.../flink/client/cli/ExecutionConfigAccessor.java | 117 +
.../org/apache/flink/client/cli/InfoOptions.java | 31 -
.../apache/flink/client/cli/ProgramOptions.java | 7 +-
.../org/apache/flink/client/cli/RunOptions.java | 31 -
.../client/deployment/ClusterClientFactory.java | 63 +
.../deployment/ClusterClientServiceLoader.java | 36 +
.../DefaultClusterClientServiceLoader.java | 75 +
.../client/deployment/StandaloneClientFactory.java | 59 +
.../apache/flink/client/program/ClusterClient.java | 170 +-
.../flink/client/program/ContextEnvironment.java | 14 +-
.../flink/client/program/MiniClusterClient.java | 88 +-
.../flink/client/program/PackagedProgram.java | 375 +-
.../flink/client/program/PackagedProgramUtils.java | 11 +-
.../client/program/rest/RestClusterClient.java | 105 +-
...he.flink.client.deployment.ClusterClientFactory | 16 +
.../flink/client/cli/CliFrontendCancelTest.java | 60 +-
.../client/cli/CliFrontendPackageProgramTest.java | 86 +-
.../flink/client/cli/CliFrontendRunTest.java | 60 +-
.../cli/CliFrontendStopWithSavepointTest.java | 118 +-
.../flink/client/cli/CliFrontendTestBase.java | 6 +-
.../apache/flink/client/cli/DefaultCLITest.java | 38 +-
.../client/cli/util/DummyClusterClientFactory.java | 66 +
.../cli/util/DummyClusterClientServiceLoader.java | 44 +
.../client/cli/util/DummyClusterDescriptor.java | 3 +-
.../client/cli/util/DummyCustomCommandLine.java | 34 +-
.../flink/client/cli/util/MockedCliFrontend.java | 5 +-
.../deployment/ClusterClientServiceLoaderTest.java | 167 +
.../apache/flink/client/program/ClientTest.java | 57 +-
.../client/program/ExecutionPlanCreationTest.java | 5 +-
.../flink/client/program/PackagedProgramTest.java | 17 +-
.../flink/client/program/TestingClusterClient.java | 136 +
.../RestClusterClientSavepointTriggerTest.java | 2 +-
.../client/program/rest/RestClusterClientTest.java | 37 +-
...he.flink.client.deployment.ClusterClientFactory | 18 +
.../flink-connector-elasticsearch7/pom.xml | 14 +-
.../Elasticsearch7UpsertTableSink.java | 283 +
.../Elasticsearch7UpsertTableSinkFactory.java | 76 +
.../org.apache.flink.table.factories.TableFactory | 16 +
.../Elasticsearch7UpsertTableSinkFactoryTest.java | 216 +
flink-connectors/flink-connector-hive/pom.xml | 34 +-
.../connectors/hive/HiveTableOutputFormat.java | 51 +-
.../flink/connectors/hive/HiveTableSink.java | 3 +-
.../flink/connectors/hive/HiveTableSource.java | 5 -
.../flink/table/catalog/hive/HiveCatalog.java | 26 +-
.../hive/client/HiveMetastoreClientWrapper.java | 15 +-
.../flink/table/catalog/hive/client/HiveShim.java | 69 +-
.../table/catalog/hive/client/HiveShimLoader.java | 16 +
.../table/catalog/hive/client/HiveShimV100.java | 336 +
.../table/catalog/hive/client/HiveShimV101.java | 25 +
.../table/catalog/hive/client/HiveShimV110.java | 76 +
.../table/catalog/hive/client/HiveShimV111.java | 26 +
.../table/catalog/hive/client/HiveShimV120.java | 241 +-
.../table/catalog/hive/client/HiveShimV230.java | 7 -
.../factories/HiveFunctionDefinitionFactory.java | 32 +-
.../catalog/hive/util/HiveReflectionUtils.java | 53 +-
.../table/catalog/hive/util/HiveStatsUtil.java | 48 +-
.../table/catalog/hive/util/HiveTypeUtil.java | 9 +
.../table/functions/hive/HiveGenericUDAF.java | 15 +-
.../flink/table/functions/hive/HiveGenericUDF.java | 10 +-
.../table/functions/hive/HiveGenericUDTF.java | 2 +-
.../functions/hive/conversion/HiveInspectors.java | 183 +-
.../conversion/WritableHiveObjectConversion.java | 36 +
.../apache/flink/table/module/hive/HiveModule.java | 58 +
.../table/module/hive/HiveModuleDescriptor.java | 57 +
.../module/hive/HiveModuleDescriptorValidator.java | 37 +
.../flink/table/module/hive/HiveModuleFactory.java | 71 +
.../org.apache.flink.table.factories.TableFactory | 1 +
.../hive/FlinkStandaloneHiveServerContext.java | 3 +
.../connectors/hive/HiveRunnerShimLoader.java | 4 +
.../flink/connectors/hive/HiveTableSinkTest.java | 6 +-
.../flink/connectors/hive/HiveTableSourceTest.java | 58 +-
.../connectors/hive/TableEnvHiveConnectorTest.java | 61 +-
.../apache/flink/table/HiveVersionTestUtil.java | 29 +
.../catalog/hive/HiveCatalogHiveMetadataTest.java | 33 +-
.../table/catalog/hive/HiveCatalogTestBase.java | 11 +
.../catalog/hive/HiveCatalogUseBlinkITCase.java | 163 +-
.../flink/table/catalog/hive/HiveTestUtils.java | 139 +
.../table/functions/hive/HiveGenericUDAFTest.java | 2 +-
.../table/functions/hive/HiveGenericUDFTest.java | 17 +-
.../table/functions/hive/HiveGenericUDTFTest.java | 12 +-
.../module/hive/HiveModuleDescriptorTest.java | 54 +
.../flink/table/module/hive/HiveModuleTest.java | 91 +
.../src/test/resources/csv/test2.csv | 3 +
.../kafka/internal/FlinkKafkaProducer.java | 14 +-
.../connectors/kafka/FlinkKafkaProducerITCase.java | 56 +
.../connectors/kafka/KafkaConsumerTestBase.java | 104 +-
.../connectors/kafka/KafkaProducerTestBase.java | 11 +-
.../streaming/connectors/kafka/KafkaTestBase.java | 4 +
.../connectors/kafka/FlinkKafkaProducer.java | 2 +-
.../kafka/internal/FlinkKafkaInternalProducer.java | 14 +-
.../kafka/FlinkKafkaInternalProducerITCase.java | 56 +
.../streaming/connectors/rabbitmq/RMQSource.java | 19 +
.../flink/addons/hbase/HBaseConnectorITCase.java | 4 +-
.../api/java/io/jdbc/dialect/JDBCDialects.java | 2 +-
.../flink-sql-connector-elasticsearch7/pom.xml | 54 -
.../Elasticsearch7UpsertTableSink.java | 285 -
.../Elasticsearch7UpsertTableSinkFactory.java | 76 -
.../src/main/resources/META-INF/NOTICE | 1 +
.../org.apache.flink.table.factories.TableFactory | 16 -
.../Elasticsearch7UpsertTableSinkFactoryTest.java | 217 -
.../src/test/resources/log4j-test.properties | 24 -
flink-container/docker/Dockerfile | 3 +-
flink-container/docker/docker-entrypoint.sh | 2 +-
flink-container/pom.xml | 60 +
.../entrypoint/ClassPathJobGraphRetriever.java | 150 +-
.../entrypoint/StandaloneJobClusterEntryPoint.java | 10 +-
...test-assembly-test-user-classloader-job-jar.xml | 35 +
...-assembly-test-user-classloader-job-lib-jar.xml | 35 +
.../entrypoint/ClassPathJobGraphRetrieverTest.java | 181 +-
.../container/entrypoint/testjar/TestJobInfo.java | 33 +
.../entrypoint/testjar/TestUserClassLoaderJob.java | 41 +
.../testjar/TestUserClassLoaderJobLib.java | 32 +
.../flink/api/common/operators/ResourceSpec.java | 265 +-
.../operators/util/OperatorValidationUtils.java | 79 +
.../apache/flink/api/common/state/MapState.java | 9 +
.../org/apache/flink/api/dag/Transformation.java | 11 +-
.../apache/flink/configuration/ClusterOptions.java | 12 +
.../flink/configuration/ConfigConstants.java | 6 +
.../apache/flink/configuration/ConfigOption.java | 66 +-
.../apache/flink/configuration/ConfigOptions.java | 205 +-
.../apache/flink/configuration/ConfigUtils.java | 130 +
.../apache/flink/configuration/Configuration.java | 437 +-
.../configuration/DelegatingConfiguration.java | 21 +-
.../flink/configuration/DeploymentOptions.java | 49 +
.../flink/configuration/GlobalConfiguration.java | 25 -
.../org/apache/flink/configuration/MemorySize.java | 11 +-
.../flink/configuration/PipelineOptions.java | 53 +
.../apache/flink/configuration/ReadableConfig.java | 53 +
.../configuration/StructuredOptionsSplitter.java | 176 +
.../apache/flink/configuration/WritableConfig.java | 40 +
.../core/memory/ByteArrayInputStreamWithPos.java | 97 +-
.../flink/core/memory/HeapMemorySegment.java | 2 +-
.../flink/core/memory/HybridMemorySegment.java | 20 +-
.../apache/flink/core/memory/MemorySegment.java | 23 +-
.../memory/MemorySegmentInputStreamWithPos.java | 114 +
.../org/apache/flink/core/memory/MemoryUtils.java | 8 +-
.../org/apache/flink/core/plugin/PluginConfig.java | 19 +-
.../java/org/apache/flink/util/CollectionUtil.java | 10 +
.../main/java/org/apache/flink/util/FileUtils.java | 148 +
.../java/org/apache/flink/util/IterableUtils.java | 53 +
.../apache/flink/util/JavaGcCleanerWrapper.java | 255 +
.../org/apache/flink/util/OptionalConsumer.java | 4 +-
.../flink/util/WrappingRuntimeException.java | 13 +
.../api/common/operators/ResourceSpecTest.java | 74 +-
.../flink/configuration/ConfigUtilsTest.java | 121 +
.../ConfigurationConversionsTest.java | 378 ++
.../ConfigurationParsingInvalidFormatsTest.java | 87 +
.../flink/configuration/ConfigurationTest.java | 126 -
.../apache/flink/configuration/MemorySizeTest.java | 2 +-
.../ReadableWritableConfigurationTest.java | 265 +
.../StructuredOptionsSplitterTest.java | 158 +
.../UnmodifiableConfigurationTest.java | 3 +-
.../memory/ByteArrayInputStreamWithPosTest.java | 48 +-
.../flink/core/memory/HeapMemorySegmentTest.java | 10 +
.../memory/HybridOffHeapMemorySegmentTest.java | 10 +-
.../core/memory/HybridOnHeapMemorySegmentTest.java | 33 +
.../flink/core/memory/MemorySegmentTestBase.java | 23 +
.../apache/flink/core/plugin/PluginConfigTest.java | 80 +
.../java/org/apache/flink/util/FileUtilsTest.java | 101 +
.../org/apache/flink/util/IterableUtilsTest.java | 45 +
.../flink/util/JavaGcCleanerWrapperTest.java | 42 +
.../configuration/ConfigOptionsDocGenerator.java | 108 +-
.../ConfigOptionsDocGeneratorTest.java | 146 +-
.../ConfigOptionsDocsCompletenessITCase.java | 72 +-
.../streaming/examples/wordcount/WordCount.java | 1 -
.../formats/avro/AvroExternalJarProgramITCase.java | 5 +-
.../formats/json/JsonRowDeserializationSchema.java | 48 +-
.../json/JsonRowDeserializationSchemaTest.java | 20 +-
.../apache/flink/api/java/operators/DataSink.java | 13 +-
.../flink/api/java/operators/DeltaIteration.java | 13 +-
.../apache/flink/api/java/operators/Operator.java | 14 +-
.../flink/api/java/operator/OperatorTest.java | 4 +-
.../org/apache/flink/cep/operator/CepOperator.java | 9 +-
.../apache/flink/cep/utils/TestSharedBuffer.java | 9 +
.../apache/flink/state/api/ExistingSavepoint.java | 4 +-
.../java/org/apache/flink/state/api/Savepoint.java | 4 +-
.../functions/BroadcastStateBootstrapFunction.java | 2 +-
.../flink/state/api/output/BoundedStreamTask.java | 6 +-
.../flink/state/api/SavepointReaderITTestBase.java | 8 +-
.../state/api/SavepointReaderKeyedStateITCase.java | 7 +-
.../flink/state/api/SavepointWriterITCase.java | 5 +-
.../state/api/input/KeyedStateInputFormatTest.java | 6 +-
.../mesos/entrypoint/MesosEntrypointUtils.java | 181 -
.../entrypoint/MesosJobClusterEntrypoint.java | 28 +-
.../entrypoint/MesosSessionClusterEntrypoint.java | 28 +-
.../mesos/entrypoint/MesosTaskExecutorRunner.java | 3 +-
.../clusterframework/LaunchableMesosWorker.java | 8 +-
.../MesosResourceManagerFactory.java | 19 +-
.../org/apache/flink/mesos/util/MesosUtils.java | 177 +
.../LaunchableMesosWorkerTest.java | 37 +
.../java/org/apache/flink/metrics/MeterView.java | 7 +
.../org/apache/flink/metrics/MeterViewTest.java | 6 +-
flink-metrics/flink-metrics-influxdb/pom.xml | 2 +-
.../jobmanager/JMXJobManagerMetricTest.java | 4 +-
.../org/apache/flink/ml/common/linalg/BLAS.java | 121 +-
.../org/apache/flink/ml/common/mapper/Mapper.java | 83 +
.../flink/ml/common/mapper/MapperAdapter.java | 45 +
.../apache/flink/ml/common/mapper/ModelMapper.java | 72 +
.../flink/ml/common/mapper/ModelMapperAdapter.java | 62 +
.../common/model/BroadcastVariableModelSource.java | 50 +
.../apache/flink/ml/common/model/ModelSource.java | 39 +
.../flink/ml/common/model/RowsModelSource.java | 50 +
.../basicstatistic/MultivariateGaussian.java | 142 +
.../apache/flink/ml/common/linalg/BLASTest.java | 188 +
.../basicstatistic/MultivariateGaussianTest.java | 74 +
.../optimizer/plantranslate/JobGraphGenerator.java | 2 -
.../plantranslate/JobGraphGeneratorTest.java | 26 +-
flink-python/README.md | 42 +-
flink-python/dev/lint-python.sh | 16 +-
flink-python/lib/cloudpickle-1.2.2-src.zip | Bin 23425 -> 23105 bytes
flink-python/lib/py4j-0.10.8.1-src.zip | Bin 94484 -> 82546 bytes
flink-python/pom.xml | 5 +
flink-python/pyflink/fn_execution/coder_impl.py | 105 +-
flink-python/pyflink/fn_execution/coders.py | 163 +-
.../fn_execution/tests/coders_test_common.py | 86 +
flink-python/pyflink/table/descriptors.py | 29 +
flink-python/pyflink/table/table.py | 13 +-
flink-python/pyflink/table/table_environment.py | 164 +-
flink-python/pyflink/table/tests/test_aggregate.py | 3 +-
flink-python/pyflink/table/tests/test_calc.py | 14 +-
.../pyflink/table/tests/test_column_operation.py | 8 +-
flink-python/pyflink/table/tests/test_correlate.py | 2 +-
.../pyflink/table/tests/test_descriptor.py | 2 +
.../table/tests/test_environment_completeness.py | 18 +-
flink-python/pyflink/table/tests/test_join.py | 8 +-
flink-python/pyflink/table/tests/test_sort.py | 2 +-
.../table/tests/test_table_environment_api.py | 77 +
flink-python/pyflink/table/tests/test_udf.py | 187 +-
flink-python/pyflink/testing/test_case_utils.py | 7 +-
.../flink/python/AbstractPythonFunctionRunner.java | 40 +-
.../python/AbstractPythonScalarFunctionRunner.java | 4 +-
.../python/BaseRowPythonScalarFunctionRunner.java | 12 +-
.../runners/python/PythonScalarFunctionRunner.java | 12 +-
.../table/runtime/typeutils/BeamTypeUtils.java | 408 --
.../table/runtime/typeutils/PythonTypeUtils.java | 300 +
.../runtime/typeutils/coders/BaseRowCoder.java | 146 -
.../typeutils/coders/ReusableDataInputView.java | 41 -
.../typeutils/coders/ReusableDataOutputView.java | 41 -
.../table/runtime/typeutils/coders/RowCoder.java | 115 -
.../serializers/python/BaseRowSerializer.java | 232 +
.../serializers/python/DateSerializer.java | 131 +
.../serializers/python/StringSerializer.java | 122 +
.../BaseRowPythonScalarFunctionRunnerTest.java | 82 +-
.../table/functions/python/BeamTypeUtilsTest.java | 80 -
.../python/PythonScalarFunctionRunnerTest.java | 85 +-
.../functions/python/PythonTypeUtilsTest.java | 89 +
.../runtime/typeutils/coders/BaseRowCoderTest.java | 92 -
.../runtime/typeutils/coders/CoderTestBase.java | 105 -
.../runtime/typeutils/coders/RowCoderTest.java | 51 -
.../serializers/python/BaseRowSerializerTest.java | 103 +
.../serializers/python/DateSerializerTest.java | 50 +
.../serializers/python/StringSerializerTest.java | 48 +
flink-python/tox.ini | 2 +-
.../client/state/ImmutableMapState.java | 5 +
.../client/state/ImmutableMapStateTest.java | 6 +
.../itcases/AbstractQueryableStateTestBase.java | 44 +-
.../handlers/EntryClassQueryParameter.java | 4 +-
.../webmonitor/handlers/JarListHandler.java | 2 +-
.../runtime/webmonitor/handlers/JarRunHandler.java | 6 +-
.../handlers/ProgramArgQueryParameter.java | 4 +-
.../handlers/ProgramArgsQueryParameter.java | 4 +-
.../webmonitor/handlers/utils/JarHandlerUtils.java | 9 +-
.../runtime/webmonitor/WebFrontendITCase.java | 7 +-
.../src/test/resources/rest_api_v1.snapshot | 5 +-
.../src/app/interfaces/job-subtask.ts | 1 +
.../job-overview-drawer-subtasks.component.html | 20 +-
.../runtime/checkpoint/CheckpointCoordinator.java | 445 +-
.../checkpoint/MasterTriggerRestoreHook.java | 53 +-
.../runtime/checkpoint/PendingCheckpoint.java | 43 +-
.../checkpoint/StateAssignmentOperation.java | 14 +-
.../runtime/checkpoint/hooks/MasterHooks.java | 140 +-
.../clusterframework/ContainerSpecification.java | 74 +-
.../TaskExecutorResourceUtils.java | 4 +-
.../overlays/FlinkDistributionOverlay.java | 34 +-
.../overlays/HadoopConfOverlay.java | 2 +-
.../clusterframework/overlays/KeytabOverlay.java | 2 +-
.../clusterframework/overlays/SSLStoreOverlay.java | 4 +-
.../clusterframework/types/ResourceProfile.java | 368 +-
.../clusterframework/types/TaskManagerSlot.java | 166 -
.../flink/runtime/dispatcher/Dispatcher.java | 317 +-
.../runtime/dispatcher/DispatcherFactory.java | 10 +-
.../runtime/dispatcher/DispatcherServices.java | 47 +-
.../runtime/dispatcher/JobDispatcherFactory.java | 28 +-
.../dispatcher/JobManagerMetricGroupFactory.java | 32 +
.../flink/runtime/dispatcher/MiniDispatcher.java | 7 +-
.../dispatcher/PartialDispatcherServices.java | 18 +-
...PartialDispatcherServicesWithJobGraphStore.java | 85 +
.../dispatcher/SchedulerNGFactoryFactory.java | 13 +-
.../dispatcher/SessionDispatcherFactory.java | 11 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 9 +-
.../runner/AbstractDispatcherLeaderProcess.java | 254 +
.../runner/DefaultDispatcherGatewayService.java | 61 +
.../DefaultDispatcherGatewayServiceFactory.java | 73 +
.../dispatcher/runner/DefaultDispatcherRunner.java | 197 +
.../runner/DefaultDispatcherRunnerFactory.java | 73 +
.../dispatcher/runner/DispatcherLeaderProcess.java | 43 +
.../runner/DispatcherLeaderProcessFactory.java | 29 +
.../DispatcherLeaderProcessFactoryFactory.java | 39 +
.../dispatcher/runner/DispatcherRunner.java | 7 -
.../dispatcher/runner/DispatcherRunnerFactory.java | 8 +-
.../runner/DispatcherRunnerFactoryImpl.java | 46 -
.../dispatcher/runner/DispatcherRunnerImpl.java | 61 -
...atcherRunnerLeaderElectionLifecycleManager.java | 66 +
.../runner/JobDispatcherLeaderProcess.java | 57 +
.../runner/JobDispatcherLeaderProcessFactory.java | 49 +
.../JobDispatcherLeaderProcessFactoryFactory.java | 74 +
.../runner/SessionDispatcherLeaderProcess.java | 275 +
.../SessionDispatcherLeaderProcessFactory.java | 57 +
...ssionDispatcherLeaderProcessFactoryFactory.java | 62 +
.../runner/StoppedDispatcherLeaderProcess.java | 65 +
.../runtime/entrypoint/ClusterEntrypoint.java | 2 +-
.../AbstractUserClassPathJobGraphRetriever.java | 59 +
...tDispatcherResourceManagerComponentFactory.java | 25 +-
.../DispatcherResourceManagerComponent.java | 17 +-
.../flink/runtime/executiongraph/Execution.java | 79 +-
.../runtime/executiongraph/ExecutionGraph.java | 377 +-
.../executiongraph/ExecutionGraphBuilder.java | 11 +-
...ionGraphResultPartitionAvailabilityChecker.java | 6 +-
.../runtime/executiongraph/ExecutionJobVertex.java | 3 +-
.../runtime/executiongraph/ExecutionVertex.java | 12 +-
.../executiongraph/SlotProviderStrategy.java | 28 +-
.../AdaptedRestartPipelinedRegionStrategyNG.java | 4 +-
.../failover/adapter/DefaultFailoverEdge.java | 72 -
.../failover/adapter/DefaultFailoverTopology.java | 97 -
.../failover/adapter/DefaultFailoverVertex.java | 80 -
.../failover/flip1/ExecutionFailureHandler.java | 24 +-
.../failover/flip1/FailoverEdge.java | 57 -
.../failover/flip1/FailoverRegion.java | 8 +-
.../failover/flip1/FailoverResultPartition.java | 30 +
.../failover/flip1/FailoverStrategy.java | 5 +-
.../failover/flip1/FailoverTopology.java | 24 +-
.../failover/flip1/FailoverVertex.java | 36 +-
.../failover/flip1/PipelinedRegionComputeUtil.java | 54 +-
.../flip1/RestartPipelinedRegionStrategy.java | 53 +-
.../NotReleasingPartitionReleaseStrategy.java | 3 +-
.../partitionrelease/PartitionReleaseStrategy.java | 3 +-
.../RegionPartitionReleaseStrategy.java | 31 +-
.../metrics/NumberOfFullRestartsGauge.java | 47 -
.../flink/runtime/instance/SimpleSlotContext.java | 88 -
.../flink/runtime/io/AvailabilityProvider.java | 54 +
.../io/network/api/writer/RecordWriter.java | 9 +-
.../network/api/writer/ResultPartitionWriter.java | 9 +
.../runtime/io/network/buffer/BufferProvider.java | 4 +-
.../runtime/io/network/buffer/LocalBufferPool.java | 135 +-
.../io/network/buffer/NetworkBufferPool.java | 74 +-
.../io/network/metrics/InputChannelMetrics.java | 2 +-
.../runtime/io/network/netty/NettyConfig.java | 2 +-
.../partition/AbstractPartitionTracker.java | 117 +
.../partition/JobMasterPartitionTracker.java | 52 +
.../partition/JobMasterPartitionTrackerImpl.java | 191 +
.../io/network/partition/PartitionTracker.java | 39 +-
.../network/partition/PartitionTrackerEntry.java | 46 +
.../network/partition/PartitionTrackerFactory.java | 4 +-
.../io/network/partition/PartitionTrackerImpl.java | 190 -
.../io/network/partition/ResultPartition.java | 6 +
.../partition/TaskExecutorPartitionInfo.java | 57 +
.../partition/TaskExecutorPartitionTracker.java | 57 +
.../TaskExecutorPartitionTrackerImpl.java | 92 +
.../io/network/partition/consumer/InputGate.java | 11 +-
.../partition/consumer/SingleInputGate.java | 14 +-
.../network/partition/consumer/UnionInputGate.java | 16 +-
.../runtime/jobgraph/IntermediateDataSetID.java | 18 +-
.../jobgraph/IntermediateResultPartitionID.java | 7 +-
.../apache/flink/runtime/jobgraph/JobGraph.java | 28 +-
.../apache/flink/runtime/jobgraph/JobVertexID.java | 8 +-
.../runtime/jobgraph/SavepointConfigOptions.java | 51 +
.../runtime/jobgraph/SavepointRestoreSettings.java | 17 +
.../jobgraph/topology/DefaultLogicalResult.java | 74 +
.../jobgraph/topology/DefaultLogicalTopology.java | 114 +
.../jobgraph/topology/DefaultLogicalVertex.java | 71 +
.../jobgraph/topology/LogicalPipelinedRegion.java | 54 +
.../runtime/jobgraph/topology/LogicalResult.java | 30 +
.../runtime/jobgraph/topology/LogicalTopology.java | 30 +
.../runtime/jobgraph/topology/LogicalVertex.java | 30 +
.../jobmanager/HaServicesJobGraphStoreFactory.java | 48 +
.../runtime/jobmanager/ThrowingJobGraphWriter.java | 41 +
.../jobmanager/slots/TaskManagerGateway.java | 4 +-
.../apache/flink/runtime/jobmaster/JobMaster.java | 8 +-
.../runtime/jobmaster/RpcTaskManagerGateway.java | 7 +-
.../factories/DefaultJobMasterServiceFactory.java | 4 +-
...ultLocationPreferenceSlotSelectionStrategy.java | 46 +
.../slotpool/DefaultSchedulerFactory.java | 15 +-
...OutLocationPreferenceSlotSelectionStrategy.java | 46 +
.../LocationPreferenceSlotSelectionStrategy.java | 51 +-
.../PreviousAllocationSlotSelectionStrategy.java | 18 +-
.../runtime/jobmaster/slotpool/SchedulerImpl.java | 104 +-
.../slotpool/SlotInfoWithUtilization.java | 65 +
.../flink/runtime/jobmaster/slotpool/SlotPool.java | 7 +-
.../runtime/jobmaster/slotpool/SlotPoolImpl.java | 23 +-
.../runtime/jobmaster/slotpool/SlotProvider.java | 9 +-
.../jobmaster/slotpool/SlotSelectionStrategy.java | 18 +-
.../jobmaster/slotpool/SlotSharingManager.java | 76 +-
.../apache/flink/runtime/memory/MemoryManager.java | 5 +-
.../checkpoint/NotifyCheckpointComplete.java | 76 -
.../messages/checkpoint/TriggerCheckpoint.java | 94 -
.../apache/flink/runtime/metrics/MetricNames.java | 3 +
.../flink/runtime/metrics/MetricRegistryImpl.java | 2 +-
.../metrics/groups/OperatorIOMetricGroup.java | 4 +-
.../runtime/metrics/groups/TaskIOMetricGroup.java | 10 +-
.../flink/runtime/minicluster/MiniCluster.java | 59 +-
.../apache/flink/runtime/query/KvStateMessage.java | 302 -
.../runtime/resourcemanager/ResourceManager.java | 13 +-
.../resourcemanager/ResourceManagerGateway.java | 5 +-
.../ResourceManagerRuntimeServices.java | 32 +-
.../AnyMatchingSlotMatchingStrategy.java | 42 +
.../LeastUtilizationSlotMatchingStrategy.java | 65 +
.../slotmanager/SlotManagerConfiguration.java | 19 +-
.../slotmanager/SlotManagerImpl.java | 61 +-
.../slotmanager/SlotMatchingStrategy.java | 46 +
.../slotmanager/TaskManagerSlot.java | 172 +
.../slotmanager/TaskManagerSlotId.java | 1 -
.../slotmanager/TaskManagerSlotInformation.java | 49 +
.../rest/handler/job/JobExceptionsHandler.java | 19 +-
.../backpressure/BackPressureStatsTrackerImpl.java | 2 +-
.../rest/messages/JobExceptionsHeaders.java | 7 +-
.../runtime/rest/messages/JobExceptionsInfo.java | 21 +
.../job/JobExceptionsMessageParameters.java | 41 +
.../messages/job/UpperLimitExceptionParameter.java | 50 +
.../flink/runtime/scheduler/DefaultScheduler.java | 31 +-
.../runtime/scheduler/DefaultSchedulerFactory.java | 8 +-
.../flink/runtime/scheduler/DeploymentHandle.java | 14 -
.../flink/runtime/scheduler/LegacyScheduler.java | 9 +-
.../runtime/scheduler/LegacySchedulerFactory.java | 4 +-
.../flink/runtime/scheduler/SchedulerBase.java | 115 +-
.../runtime/scheduler/SchedulerNGFactory.java | 4 +-
.../adapter/DefaultExecutionTopology.java | 164 +
.../scheduler/adapter/DefaultExecutionVertex.java | 89 +
.../scheduler/adapter/DefaultResultPartition.java | 105 +
.../adapter/DefaultSchedulingExecutionVertex.java | 90 -
.../adapter/DefaultSchedulingResultPartition.java | 106 -
.../ExecutionGraphToSchedulingTopologyAdapter.java | 151 -
.../strategy/EagerSchedulingStrategy.java | 6 +-
.../scheduler/strategy/ExecutionVertexID.java | 3 +-
.../strategy/InputDependencyConstraintChecker.java | 41 +-
.../LazyFromSourcesSchedulingStrategy.java | 46 +-
.../strategy/SchedulingExecutionVertex.java | 28 +-
.../strategy/SchedulingResultPartition.java | 35 +-
.../strategy/SchedulingStrategyFactory.java | 2 +-
.../scheduler/strategy/SchedulingTopology.java | 20 +-
.../runtime/state/KeyGroupRangeAssignment.java | 8 +-
.../flink/runtime/state/UserFacingMapState.java | 5 +
.../state/heap/AbstractStateTableSnapshot.java | 7 -
.../runtime/state/heap/CopyOnWriteStateMap.java | 6 +
.../state/heap/CopyOnWriteStateMapSnapshot.java | 15 +-
.../state/heap/CopyOnWriteStateTableSnapshot.java | 9 +
.../flink/runtime/state/heap/HeapMapState.java | 6 +
.../runtime/state/heap/NestedMapsStateTable.java | 4 +
.../flink/runtime/state/heap/StateTable.java | 2 +-
.../runtime/state/memory/MemoryStateBackend.java | 2 +-
.../flink/runtime/state/ttl/TtlMapState.java | 6 +
.../flink/runtime/taskexecutor/TaskExecutor.java | 65 +-
.../runtime/taskexecutor/TaskExecutorGateway.java | 10 +-
.../taskexecutor/TaskExecutorHeartbeatPayload.java | 45 +
.../runtime/taskexecutor/TaskManagerRunner.java | 4 +-
.../runtime/taskexecutor/TaskManagerServices.java | 11 +-
.../runtime/taskexecutor/slot/TaskSlotTable.java | 7 +-
...bleNotifyingResultPartitionWriterDecorator.java | 6 +
.../flink/runtime/util/ClusterEntrypointUtils.java | 62 +
.../CheckpointCoordinatorFailureTest.java | 12 +-
.../CheckpointCoordinatorMasterHooksTest.java | 77 +-
.../CheckpointCoordinatorRestoringTest.java | 1016 +++
.../checkpoint/CheckpointCoordinatorTest.java | 2152 ++-----
.../CheckpointCoordinatorTestingUtils.java | 594 ++
.../CheckpointCoordinatorTriggeringTest.java | 313 +
.../CheckpointSettingsSerializableTest.java | 4 +-
.../checkpoint/CheckpointStateRestoreTest.java | 30 +-
.../ExecutionGraphCheckpointCoordinatorTest.java | 8 +-
.../FailoverStrategyCheckpointCoordinatorTest.java | 62 +-
.../runtime/checkpoint/PendingCheckpointTest.java | 138 +-
.../runtime/checkpoint/hooks/TestMasterHook.java | 91 +
.../TaskExecutorResourceUtilsTest.java | 8 +-
.../overlays/FlinkDistributionOverlayTest.java | 32 +-
.../overlays/HadoopConfOverlayTest.java | 2 +-
.../overlays/KeytabOverlayTest.java | 2 +-
.../overlays/SSLStoreOverlayTest.java | 4 +-
...ocationPreferenceSlotSelectionStrategyTest.java | 12 +-
...reviousAllocationSlotSelectionStrategyTest.java | 10 +-
.../types/ResourceProfileTest.java | 152 +-
.../types/SlotSelectionStrategyTestBase.java | 25 +-
.../ManuallyTriggeredScheduledExecutor.java | 123 +-
.../flink/runtime/dispatcher/DispatcherHATest.java | 489 --
.../dispatcher/DispatcherResourceCleanupTest.java | 87 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 394 +-
.../runtime/dispatcher/MiniDispatcherTest.java | 22 +-
.../runtime/dispatcher/NoOpJobGraphWriter.java | 45 +
.../runtime/dispatcher/TestingDispatcher.java | 50 +-
.../dispatcher/TestingJobManagerRunnerFactory.java | 2 +-
.../dispatcher/ZooKeeperHADispatcherTest.java | 348 --
.../runner/DefaultDispatcherRunnerITCase.java | 234 +
.../runner/DefaultDispatcherRunnerTest.java | 358 ++
.../runner/SessionDispatcherLeaderProcessTest.java | 507 ++
.../runner/TestingDispatcherGatewayService.java | 122 +
.../runner/TestingDispatcherLeaderProcess.java | 144 +
.../TestingDispatcherLeaderProcessFactory.java | 54 +
.../runner/TestingDispatcherServiceFactory.java | 61 +
.../ZooKeeperDefaultDispatcherRunnerTest.java | 249 +
...AbstractUserClassPathJobGraphRetrieverTest.java | 77 +
...egionStrategyNGAbortPendingCheckpointsTest.java | 4 +-
...inedRegionStrategyNGConcurrentFailoverTest.java | 10 +-
...startPipelinedRegionStrategyNGFailoverTest.java | 10 +-
.../executiongraph/ArchivedExecutionGraphTest.java | 29 +-
.../ExecutionGraphCoLocationRestartTest.java | 17 +-
.../ExecutionGraphConstructionTest.java | 172 +-
.../ExecutionGraphDeploymentTest.java | 104 +-
.../executiongraph/ExecutionGraphMetricsTest.java | 30 +-
.../ExecutionGraphNotEnoughResourceTest.java | 173 +
.../ExecutionGraphPartitionReleaseTest.java | 10 +-
.../ExecutionGraphRescalingTest.java | 10 +-
.../executiongraph/ExecutionGraphRestartTest.java | 359 +-
...raphResultPartitionAvailabilityCheckerTest.java | 4 +-
.../ExecutionGraphSchedulingTest.java | 11 +-
.../executiongraph/ExecutionGraphTestUtils.java | 183 +-
.../ExecutionPartitionLifecycleTest.java | 17 +-
.../executiongraph/ExecutionVertexCancelTest.java | 4 +-
.../ExecutionVertexInputConstraintTest.java | 32 +-
.../ExecutionVertexLocalityTest.java | 4 +-
.../ExecutionVertexSchedulingTest.java | 6 +-
.../executiongraph/ExecutionVertexTest.java | 9 +-
.../executiongraph/GlobalModVersionTest.java | 33 +-
.../executiongraph/LegacyJobVertexIdTest.java | 24 +-
.../executiongraph/PointwisePatternTest.java | 34 +-
.../executiongraph/ProgrammedSlotProvider.java | 1 -
.../TestingExecutionGraphBuilder.java | 179 +
.../executiongraph/TestingSlotProvider.java | 2 +-
.../TestingSlotProviderStrategy.java | 8 +-
.../executiongraph/VertexSlotSharingTest.java | 46 +-
.../adapter/DefaultFailoverTopologyTest.java | 199 -
.../flip1/ExecutionFailureHandlerTest.java | 11 +-
...RestartPipelinedRegionStrategyBuildingTest.java | 142 +-
.../flip1/RestartPipelinedRegionStrategyTest.java | 174 +-
.../failover/flip1/TestFailoverTopology.java | 106 +-
.../utils/SimpleAckingTaskManagerGateway.java | 40 +-
.../executiongraph/utils/SimpleSlotProvider.java | 8 +-
.../flink/runtime/instance/SimpleSlotContext.java | 88 +
.../AbstractCollectingResultPartitionWriter.java | 7 +
.../io/network/api/writer/RecordWriterTest.java | 61 +
.../network/buffer/LocalBufferPoolDestroyTest.java | 6 +-
.../io/network/buffer/LocalBufferPoolTest.java | 43 +
.../io/network/buffer/NetworkBufferPoolTest.java | 217 +-
.../runtime/io/network/buffer/NoOpBufferPool.java | 6 +
.../partition/AbstractPartitionTrackerTest.java | 101 +
.../JobMasterPartitionTrackerImplTest.java | 307 +
.../partition/NoOpJobMasterPartitionTracker.java | 69 +
.../io/network/partition/NoOpPartitionTracker.java | 62 -
.../partition/PartitionTrackerImplTest.java | 292 -
.../TestingJobMasterPartitionTracker.java | 116 +
.../network/partition/TestingPartitionTracker.java | 103 -
.../partition/consumer/LocalInputChannelTest.java | 1 +
.../io/network/util/TestPooledBufferProvider.java | 6 +
.../topology/DefaultLogicalResultTest.java | 129 +
.../topology/DefaultLogicalTopologyTest.java | 134 +
.../topology/DefaultLogicalVertexTest.java | 133 +
.../runtime/jobgraph/utils/JobGraphTestUtils.java | 36 +
.../SlotCountExceedingParallelismTest.java | 9 +-
.../scheduler/ScheduleWithCoLocationHintTest.java | 127 +-
.../scheduler/SchedulerIsolatedTasksTest.java | 125 +-
.../jobmanager/scheduler/SchedulerTestBase.java | 155 +-
.../jobmaster/JobMasterPartitionReleaseTest.java | 289 +
.../flink/runtime/jobmaster/JobMasterTest.java | 295 +-
.../runtime/jobmaster/TestingJobManagerRunner.java | 4 +
.../runtime/jobmaster/TestingLogicalSlot.java | 12 +-
.../jobmaster/slotpool/AllocatedSlotsTest.java | 2 +-
.../jobmaster/slotpool/SingleLogicalSlotTest.java | 2 +-
.../jobmaster/slotpool/SlotPoolCoLocationTest.java | 16 +-
.../jobmaster/slotpool/SlotPoolImplTest.java | 79 +-
.../slotpool/SlotPoolInteractionsTest.java | 15 +-
.../slotpool/SlotPoolRequestCompletionTest.java | 2 +-
.../slotpool/SlotPoolSlotSharingTest.java | 26 +-
.../slotpool/SlotPoolSlotSpreadOutTest.java | 176 +
.../jobmaster/slotpool/SlotSharingManagerTest.java | 105 +-
.../runtime/jobmaster/utils/JobMasterBuilder.java | 220 +
.../runtime/messages/CheckpointMessagesTest.java | 32 +-
.../SessionDispatcherWithUUIDFactory.java | 16 +-
.../runtime/minicluster/TestingMiniCluster.java | 10 +-
.../resourcemanager/ResourceManagerHATest.java | 3 +-
.../ResourceManagerTaskExecutorTest.java | 4 +-
.../AnyMatchingSlotMatchingStrategyTest.java | 91 +
.../LeastUtilizationSlotMatchingStrategyTest.java | 80 +
.../slotmanager/SlotManagerBuilder.java | 8 +
.../slotmanager/SlotManagerImplTest.java | 76 +-
.../slotmanager/TestingResourceActionsBuilder.java | 4 +-
.../TestingTaskManagerSlotInformation.java | 89 +
.../utils/TestingResourceManagerGateway.java | 5 +-
.../rest/handler/job/JobExceptionsHandlerTest.java | 144 +
.../DefaultExecutionSlotAllocatorTest.java | 4 +-
.../runtime/scheduler/DefaultSchedulerTest.java | 190 +-
.../LegacySchedulerBatchSchedulingTest.java | 11 +-
.../adapter/DefaultExecutionTopologyTest.java | 250 +
.../adapter/DefaultExecutionVertexTest.java | 120 +
.../adapter/DefaultResultPartitionTest.java | 104 +
.../DefaultSchedulingExecutionVertexTest.java | 115 -
.../DefaultSchedulingResultPartitionTest.java | 104 -
...cutionGraphToSchedulingTopologyAdapterTest.java | 210 -
.../strategy/EagerSchedulingStrategyTest.java | 2 +-
.../InputDependencyConstraintCheckerTest.java | 2 +-
.../LazyFromSourcesSchedulingStrategyTest.java | 2 +-
.../scheduler/strategy/TestSchedulingStrategy.java | 8 +-
.../strategy/TestingSchedulingExecutionVertex.java | 16 +-
.../strategy/TestingSchedulingResultPartition.java | 19 +-
.../strategy/TestingSchedulingTopology.java | 29 +-
.../flink/runtime/state/StateBackendTestBase.java | 30 +-
.../state/heap/CopyOnWriteStateMapTest.java | 119 +-
.../state/heap/CopyOnWriteStateTableTest.java | 88 +
.../runtime/state/heap/MockInternalKeyContext.java | 11 +-
.../state/ttl/mock/MockInternalMapState.java | 5 +
.../TaskExecutorPartitionLifecycleTest.java | 110 +-
.../taskexecutor/TaskExecutorSubmissionTest.java | 43 +
.../runtime/taskexecutor/TaskExecutorTest.java | 84 +-
.../TaskSubmissionTestEnvironment.java | 20 +-
.../runtime/taskexecutor/TestingTaskExecutor.java | 10 +-
.../taskexecutor/TestingTaskExecutorGateway.java | 13 +-
.../TestingTaskExecutorGatewayBuilder.java | 13 +-
.../taskexecutor/slot/TaskSlotTableTest.java | 30 +-
.../runtime/testutils/TestingJobGraphStore.java | 37 +-
.../runtime/util/TestingScheduledExecutor.java | 62 +
.../org/apache/flink/api/scala/FlinkShell.scala | 20 +-
.../flink-statebackend-heap-spillable/pom.xml | 19 +-
.../state/heap/CopyOnWriteSkipListStateMap.java | 1579 +++++
.../heap/CopyOnWriteSkipListStateMapSnapshot.java | 229 +
.../flink/runtime/state/heap/LevelIndexHeader.java | 55 +
.../flink/runtime/state/heap/NodeStatus.java | 48 +
.../runtime/state/heap/OnHeapLevelIndexHeader.java | 118 +
.../runtime/state/heap/SkipListKeyComparator.java | 80 +
.../runtime/state/heap/SkipListKeySerializer.java | 181 +
.../flink/runtime/state/heap/SkipListUtils.java | 784 +++
.../state/heap/SkipListValueSerializer.java | 75 +
.../flink/runtime/state/heap/space/Allocator.java | 51 +
.../flink/runtime/state/heap/space/Chunk.java | 64 +
.../flink/runtime/state/heap/space/Constants.java | 29 +
.../flink/runtime/state/heap/space/SpaceUtils.java | 36 +
.../CopyOnWriteSkipListStateMapBasicOpTest.java | 548 ++
.../CopyOnWriteSkipListStateMapComplexOpTest.java | 930 +++
.../heap/CopyOnWriteSkipListStateMapTestUtils.java | 259 +
.../state/heap/OnHeapLevelIndexHeaderTest.java | 169 +
.../state/heap/SkipListKeyComparatorTest.java | 299 +
.../runtime/state/heap/SkipListSerializerTest.java | 110 +
.../runtime/state/heap/SkipListUtilsTest.java | 170 +
.../flink/runtime/state/heap/TestAllocator.java | 166 +
.../state/RocksDBConfigurableOptions.java | 4 +-
.../contrib/streaming/state/RocksDBMapState.java | 12 +
.../contrib/streaming/state/RocksDBOptions.java | 2 +-
.../streaming/api/datastream/ConnectedStreams.java | 37 +-
.../flink/streaming/api/datastream/DataStream.java | 45 +-
.../streaming/api/datastream/DataStreamSink.java | 10 +-
.../streaming/api/datastream/DataStreamSource.java | 10 +-
.../api/datastream/SingleOutputStreamOperator.java | 23 +-
.../api/environment/StreamContextEnvironment.java | 11 +-
.../source/ContinuousFileReaderOperator.java | 8 +-
.../flink/streaming/api/graph/StreamConfig.java | 20 +
.../flink/streaming/api/graph/StreamGraph.java | 22 +
.../streaming/api/graph/StreamGraphGenerator.java | 11 -
.../api/graph/StreamingJobGraphGenerator.java | 76 +-
.../streaming/api/operators/MailboxExecutor.java | 247 +
.../api/operators/StreamOperatorFactoryUtil.java | 3 +-
.../streaming/api/operators/StreamSource.java | 4 +-
.../api/operators/YieldingOperatorFactory.java | 2 -
.../api/operators/async/AsyncWaitOperator.java | 10 +-
.../operators/async/AsyncWaitOperatorFactory.java | 2 +-
.../runtime/io/StreamOneInputProcessor.java | 2 +-
.../runtime/io/StreamTwoInputProcessor.java | 2 +-
.../streaming/runtime/tasks/OperatorChain.java | 64 +-
.../streaming/runtime/tasks/SourceStreamTask.java | 6 +-
.../runtime/tasks/StreamIterationHead.java | 6 +-
.../flink/streaming/runtime/tasks/StreamTask.java | 30 +-
.../runtime/tasks/SynchronousSavepointLatch.java | 121 -
.../streaming/runtime/tasks/mailbox/Mailbox.java | 69 -
.../tasks/mailbox/MailboxDefaultAction.java | 68 +
.../tasks/mailbox/MailboxExecutorFactory.java | 38 +
.../runtime/tasks/mailbox/MailboxExecutorImpl.java | 84 +
.../runtime/tasks/mailbox/MailboxProcessor.java | 295 +
.../tasks/mailbox/MailboxStateException.java | 41 -
.../runtime/tasks/mailbox/TaskMailbox.java | 168 +-
.../runtime/tasks/mailbox/TaskMailboxImpl.java | 231 +-
.../mailbox/execution/DefaultActionContext.java | 38 -
.../mailbox/execution/MailboxDefaultAction.java | 37 -
.../tasks/mailbox/execution/MailboxExecutor.java | 215 -
.../mailbox/execution/MailboxExecutorFactory.java | 34 -
.../mailbox/execution/MailboxExecutorImpl.java | 126 -
.../tasks/mailbox/execution/MailboxProcessor.java | 288 -
.../execution/SuspendedMailboxDefaultAction.java | 30 -
.../apache/flink/streaming/api/DataStreamTest.java | 28 +-
.../RemoteStreamExecutionEnvironmentTest.java | 33 +-
.../api/graph/StreamGraphGeneratorTest.java | 59 -
.../api/graph/StreamingJobGraphGeneratorTest.java | 162 +-
.../api/operators/async/AsyncWaitOperatorTest.java | 62 -
.../CheckpointBarrierAlignerMassiveRandomTest.java | 2 +-
.../flink/streaming/runtime/io/MockInputGate.java | 4 +-
.../runtime/operators/MailboxOperatorTest.java | 160 +
.../operators/StreamTaskOperatorTimerTest.java | 2 +-
.../partitioner/RescalePartitionerTest.java | 36 +-
.../runtime/tasks/OneInputStreamTaskTest.java | 81 +-
.../runtime/tasks/SourceStreamTaskTest.java | 38 +-
.../tasks/StreamTaskSelectiveReadingTest.java | 6 +-
.../runtime/tasks/StreamTaskTerminationTest.java | 6 +-
.../streaming/runtime/tasks/StreamTaskTest.java | 46 +-
.../runtime/tasks/SynchronousCheckpointITCase.java | 8 +-
.../runtime/tasks/SynchronousCheckpointTest.java | 6 +-
.../tasks/SynchronousSavepointSyncLatchTest.java | 182 -
.../tasks/TaskCheckpointingBehaviourTest.java | 6 +-
.../tasks/TestBoundedOneInputStreamOperator.java | 6 +
.../runtime/tasks/TwoInputStreamTaskTest.java | 6 +-
.../tasks/mailbox/MailboxExecutorImplTest.java | 177 +
.../runtime/tasks/mailbox/TaskMailboxImplTest.java | 144 +-
.../tasks/mailbox/TaskMailboxProcessorTest.java | 312 +
.../mailbox/execution/MailboxExecutorImplTest.java | 177 -
.../execution/TaskMailboxProcessorTest.java | 266 -
.../flink/streaming/util/MockStreamTask.java | 6 +-
.../util/OneInputStreamOperatorTestHarness.java | 9 -
.../util/TestBoundedTwoInputOperator.java | 8 +-
.../streaming/api/scala/ConnectedStreams.scala | 4 +-
.../flink/streaming/api/scala/DataStream.scala | 4 +-
.../flink-sql-client/conf/sql-client-defaults.yaml | 9 +
.../apache/flink/table/client/cli/CliClient.java | 20 +
.../flink/table/client/cli/SqlCommandParser.java | 4 +
.../flink/table/client/config/Environment.java | 34 +
.../table/client/config/entries/ModuleEntry.java | 68 +
.../flink/table/client/gateway/Executor.java | 5 +
.../client/gateway/local/ExecutionContext.java | 98 +-
.../table/client/gateway/local/LocalExecutor.java | 34 +-
.../client/gateway/local/ProgramDeployer.java | 10 +-
.../flink/table/client/cli/CliClientTest.java | 5 +
.../flink/table/client/cli/CliResultViewTest.java | 5 +
.../table/client/gateway/local/DependencyTest.java | 40 +-
.../client/gateway/local/EnvironmentTest.java | 21 +
.../client/gateway/local/ExecutionContextTest.java | 32 +-
.../client/gateway/local/LocalExecutorITCase.java | 20 +-
.../org.apache.flink.table.factories.TableFactory | 1 +
.../test/resources/test-sql-client-modules.yaml | 52 +
.../src/main/codegen/data/Parser.tdd | 24 +-
.../src/main/codegen/includes/parserImpls.ftl | 77 +-
.../flink/sql/parser/ddl/SqlCreateTable.java | 110 +-
.../apache/flink/sql/parser/ddl/SqlUseCatalog.java | 68 +
.../apache/flink/sql/parser/ddl/SqlWatermark.java | 78 +
.../flink/sql/parser/dql/SqlDescribeCatalog.java | 68 +
.../flink/sql/parser/dql/SqlShowCatalogs.java | 60 +
.../flink/sql/parser/utils/ParserResource.java | 44 +
.../ParserResource.properties | 22 +
.../flink/sql/parser/FlinkSqlParserImplTest.java | 296 +-
flink-table/flink-table-api-java-bridge/pom.xml | 8 +
.../table/api/java/BatchTableEnvironment.java | 80 +-
.../table/api/java/StreamTableEnvironment.java | 102 +-
.../java/internal/StreamTableEnvironmentImpl.java | 31 +-
.../operations/JavaDataStreamQueryOperation.java | 32 +-
.../internal/StreamTableEnvironmentImplTest.java | 37 +-
.../java/org/apache/flink/table/api/Table.java | 12 +-
.../apache/flink/table/api/TableEnvironment.java | 158 +-
.../flink/table/api/internal/Registration.java | 60 +
.../table/api/internal/TableEnvironmentImpl.java | 249 +-
.../apache/flink/table/api/internal/TableImpl.java | 4 +-
.../apache/flink/table/catalog/CatalogManager.java | 345 +-
.../flink/table/catalog/FunctionCatalog.java | 210 +-
.../apache/flink/table/catalog/FunctionLookup.java | 17 +-
.../table/catalog/GenericInMemoryCatalog.java | 39 +-
.../flink/table/catalog/UnresolvedIdentifier.java | 127 +
.../org/apache/flink/table/delegation/Parser.java | 57 +
.../org/apache/flink/table/delegation/Planner.java | 19 +-
.../table/descriptors/BatchTableDescriptor.java | 6 +-
.../table/descriptors/ConnectTableDescriptor.java | 76 +-
.../table/descriptors/StreamTableDescriptor.java | 6 +-
.../expressions/UnresolvedCallExpression.java | 34 +-
.../expressions/resolver/ExpressionResolver.java | 8 +-
.../expressions/resolver/LookupCallResolver.java | 5 +-
.../rules/QualifyBuiltInFunctionsRule.java | 4 +-
.../resolver/rules/ResolveCallByArgumentsRule.java | 6 +-
.../flink/table/factories/TableFactoryUtil.java | 2 +-
.../apache/flink/table/module/ModuleManager.java | 22 +-
.../table/operations/CatalogQueryOperation.java | 12 +-
.../operations/CatalogSinkModifyOperation.java | 19 +-
.../apache/flink/table/operations/Operation.java | 3 +-
.../table/operations/ddl/CreateTableOperation.java | 14 +-
.../table/operations/ddl/DropTableOperation.java | 13 +-
.../flink/table/api/TableEnvironmentTest.java | 13 +-
.../flink/table/catalog/FunctionCatalogTest.java | 200 +-
.../org/apache/flink/table/utils/ParserMock.java | 40 +
.../org/apache/flink/table/utils/PlannerMock.java | 5 +-
flink-table/flink-table-api-scala-bridge/pom.xml | 8 +
.../operations/ScalaDataStreamQueryOperation.java | 31 +-
.../table/api/scala/BatchTableEnvironment.scala | 70 +-
.../table/api/scala/StreamTableEnvironment.scala | 85 +-
.../internal/StreamTableEnvironmentImpl.scala | 33 +-
.../internal/StreamTableEnvironmentImplTest.scala | 26 +-
flink-table/flink-table-common/pom.xml | 14 +
.../org/apache/flink/table/api/TableColumn.java | 132 +
.../org/apache/flink/table/api/TableSchema.java | 342 +-
.../org/apache/flink/table/api/WatermarkSpec.java | 98 +
.../apache/flink/table/api/dataview/MapView.java | 11 +
.../org/apache/flink/table/catalog/Catalog.java | 7 +-
.../flink/table/catalog/ObjectIdentifier.java | 7 +
.../flink/table/dataview/ListViewTypeInfo.java | 2 +-
.../flink/table/dataview/MapViewTypeInfo.java | 2 +-
.../table/dataview/NullAwareMapSerializer.java | 2 +-
.../dataview/NullAwareMapSerializerSnapshot.java | 69 +
.../flink/table/dataview/NullSerializer.java | 17 +-
.../table/descriptors/CoreModuleDescriptor.java | 40 +
.../descriptors/CoreModuleDescriptorValidator.java | 32 +
.../table/descriptors/DescriptorProperties.java | 111 +-
.../flink/table/descriptors/ModuleDescriptor.java | 61 +
.../descriptors/ModuleDescriptorValidator.java | 38 +
.../flink/table/expressions/CallExpression.java | 23 +-
.../table/expressions/ValueLiteralExpression.java | 2 +-
.../flink/table/factories/ModuleFactory.java | 40 +
.../flink/table/functions/FunctionDefinition.java | 7 -
.../flink/table/functions/FunctionIdentifier.java | 150 +
.../flink/table/functions/FunctionLanguage.java | 32 -
.../org/apache/flink/table/module/CoreModule.java | 53 +
.../flink/table/module/CoreModuleFactory.java | 53 +
.../exceptions/ModuleAlreadyExistException.java | 28 -
.../module/exceptions/ModuleNotFoundException.java | 28 -
.../flink/table/sinks/PartitionableTableSink.java | 16 +-
.../flink/table/sources/LimitableTableSource.java | 46 +
.../table/sources/PartitionableTableSource.java | 14 +-
.../org.apache.flink.table.factories.TableFactory | 16 +
.../apache/flink/table/api/TableSchemaTest.java | 195 +
.../table/dataview/NullAwareMapSerializerTest.java | 95 +
.../descriptors/DescriptorPropertiesTest.java | 41 +
.../module/CoreModuleDescriptorTest.java | 57 +
.../flink/table/expressions/ExpressionTest.java | 22 +
.../factories/module/CoreModuleFactoryTest.java | 52 +
.../calcite/sql/validate/ParameterScope.java | 72 +
.../flink/table/planner/calcite/CalciteParser.java | 71 +
.../table/planner/calcite/FlinkToRelContext.java | 44 +
.../planner/calcite/SqlExprToRexConverter.java | 38 +
.../planner/calcite/SqlExprToRexConverterImpl.java | 166 +
.../planner/catalog/CatalogCalciteSchema.java | 14 +-
.../catalog/CatalogManagerCalciteSchema.java | 10 +-
.../planner/catalog/DatabaseCalciteSchema.java | 204 +-
.../catalog/FunctionCatalogOperatorTable.java | 50 +-
.../catalog/QueryOperationCatalogViewTable.java | 4 +-
.../table/planner/delegation/BatchExecutor.java | 1 +
.../flink/table/planner/delegation/ParserImpl.java | 77 +
.../table/planner/delegation/PlannerContext.java | 36 +-
.../planner/expressions/SqlAggFunctionVisitor.java | 9 +-
.../converter/ScalarFunctionConvertRule.java | 5 +-
.../functions/aggfunctions/CollectAggFunction.java | 22 +
.../aggfunctions/DenseRankAggFunction.java | 7 +-
.../FirstValueWithRetractAggFunction.java | 6 +-
.../LastValueWithRetractAggFunction.java | 4 +-
.../functions/utils/HiveAggSqlFunction.java | 8 +-
.../functions/utils/HiveScalarSqlFunction.java | 7 +-
.../functions/utils/HiveTableSqlFunction.java | 16 +-
.../operations/DataStreamQueryOperation.java | 33 +-
.../operations/RichTableSourceQueryOperation.java | 14 +-
.../operations/SqlToOperationConverter.java | 160 +-
.../planner/plan/QueryOperationConverter.java | 62 +-
.../plan/nodes/resource/NodeResourceUtil.java | 5 +-
.../flink/table/planner/calcite/FlinkContext.scala | 7 +-
.../table/planner/calcite/FlinkContextImpl.scala | 7 +-
.../table/planner/calcite/FlinkPlannerImpl.scala | 110 +-
.../table/planner/calcite/FlinkRelBuilder.scala | 4 +-
.../calcite/RelTimeIndicatorConverter.scala | 4 +-
.../flink/table/planner/codegen/CodeGenUtils.scala | 5 +-
.../table/planner/codegen/ExpressionReducer.scala | 12 +-
.../codegen/PythonFunctionCodeGenerator.scala | 7 +-
.../codegen/WatermarkGeneratorCodeGenerator.scala | 89 +
.../table/planner/delegation/PlannerBase.scala | 94 +-
.../planner/functions/utils/AggSqlFunction.scala | 23 +-
.../functions/utils/ScalarSqlFunction.scala | 19 +-
.../planner/functions/utils/TableSqlFunction.scala | 20 +-
.../functions/utils/UserDefinedFunctionUtils.scala | 18 +-
.../planner/plan/nodes/calcite/LogicalSink.scala | 15 +-
.../nodes/calcite/LogicalWatermarkAssigner.scala | 3 +-
.../plan/nodes/common/CommonLookupJoin.scala | 7 +
.../plan/nodes/common/CommonPhysicalJoin.scala | 8 +
.../plan/nodes/common/CommonPythonCalc.scala | 80 +-
.../plan/nodes/logical/FlinkLogicalSink.scala | 19 +-
.../logical/FlinkLogicalTableSourceScan.scala | 6 +-
.../nodes/physical/PhysicalTableSourceScan.scala | 14 +-
.../nodes/physical/stream/StreamExecMatch.scala | 6 +
.../stream/StreamExecTableSourceScan.scala | 111 +-
.../stream/StreamExecWatermarkAssigner.scala | 8 +-
.../physical/stream/StreamExecWindowJoin.scala | 7 +
.../BatchCommonSubGraphBasedOptimizer.scala | 4 +-
.../StreamCommonSubGraphBasedOptimizer.scala | 4 +-
.../planner/plan/rules/FlinkBatchRuleSets.scala | 10 +-
.../planner/plan/rules/FlinkStreamRuleSets.scala | 3 +
.../plan/rules/logical/LogicalUnnestRule.scala | 3 +-
.../PushFilterIntoTableSourceScanRule.scala | 10 +-
.../logical/PushLimitIntoTableSourceScanRule.scala | 121 +
.../PushPartitionIntoTableSourceScanRule.scala | 28 +-
.../PushProjectIntoTableSourceScanRule.scala | 3 +-
.../plan/rules/logical/PythonCalcSplitRule.scala | 28 +-
.../logical/SplitPythonConditionFromJoinRule.scala | 86 +
.../rules/physical/batch/BatchExecCalcRule.scala | 5 +-
.../physical/batch/BatchExecPythonCalcRule.scala | 5 +-
.../rules/physical/batch/BatchExecSinkRule.scala | 48 +-
.../rules/physical/stream/StreamExecCalcRule.scala | 5 +-
.../physical/stream/StreamExecPythonCalcRule.scala | 5 +-
.../rules/physical/stream/StreamExecSinkRule.scala | 46 +-
.../planner/plan/schema/FlinkRelOptTable.scala | 57 +-
.../planner/plan/schema/GenericRelDataType.scala | 2 +-
.../planner/plan/schema/TableSourceTable.scala | 67 +-
.../table/planner/plan/utils/AggregateUtil.scala | 16 +-
.../table/planner/plan/utils/PythonUtil.scala | 68 +-
.../planner/plan/utils/RexNodeExtractor.scala | 27 +-
.../planner/plan/utils/SetOpRewriteUtil.scala | 3 +-
.../flink/table/planner/sinks/TableSinkUtils.scala | 61 +-
.../table/planner/sources/TableSourceUtil.scala | 39 +-
.../planner/catalog/CatalogStatisticsTest.java | 104 +-
.../planner/codegen/SortCodeGeneratorTest.java | 16 +-
.../planner/delegation/BatchExecutorTest.java | 71 +
.../operations/SqlToOperationConverterTest.java | 510 ++
.../runtime/utils/BatchAbstractTestBase.java | 2 +-
.../utils/JavaUserDefinedScalarFunctions.java | 77 +-
.../table/sqlexec/SqlToOperationConverterTest.java | 392 --
.../org.apache.flink.table.factories.TableFactory | 2 +
.../testGetDigestWithDynamicFunctionView.out | 3 -
.../resources/explain/testGetStatsFromCatalog.out | 32 -
.../apache/flink/table/api/batch/ExplainTest.xml | 24 +-
.../apache/flink/table/api/stream/ExplainTest.xml | 210 +-
.../planner/plan/batch/sql/DagOptimizationTest.xml | 288 +-
.../table/planner/plan/batch/sql/LimitTest.xml | 105 +
.../plan/batch/sql/PartitionableSinkTest.xml | 100 +
.../planner/plan/batch/sql/SetOperatorsTest.xml | 28 +
.../table/planner/plan/batch/sql/SinkTest.xml | 30 +-
.../table/planner/plan/batch/sql/TableScanTest.xml | 24 +
.../table/planner/plan/batch/table/JoinTest.xml | 18 +
.../SplitPythonConditionFromJoinRuleTest.xml | 82 +
.../plan/schema/ComputedColumnToRelTest.xml | 67 +
.../plan/stream/sql/DagOptimizationTest.xml | 346 +-
.../plan/stream/sql/MiniBatchIntervalInferTest.xml | 152 +-
.../plan/stream/sql/PartitionableSinkTest.xml | 98 +
.../planner/plan/stream/sql/SetOperatorsTest.xml | 33 +-
.../table/planner/plan/stream/sql/SinkTest.xml | 48 +-
.../planner/plan/stream/sql/TableScanTest.xml | 37 +-
.../flink/table/api/TableEnvironmentTest.scala | 13 +-
.../validation/MatchRecognizeValidationTest.scala | 24 +
.../table/planner/catalog/CatalogTableITCase.scala | 374 +-
.../codegen/WatermarkGeneratorCodeGenTest.scala | 139 +
.../expressions/utils/ExpressionTestBase.scala | 3 +-
.../utils/TestCollectionTableFactory.scala | 14 +-
.../planner/match/PatternTranslatorTestBase.scala | 3 +-
.../table/planner/plan/batch/sql/LimitTest.scala | 38 +-
.../plan/batch/sql/PartitionableSinkTest.scala | 70 +
.../planner/plan/batch/sql/SetOperatorsTest.scala | 5 +
.../planner/plan/batch/sql/TableScanTest.scala | 20 +-
.../planner/plan/batch/sql/TableSourceTest.scala | 4 +-
.../plan/batch/sql/join/LookupJoinTest.scala | 17 +
.../table/planner/plan/batch/table/JoinTest.scala | 10 +
.../table/validation/JoinValidationTest.scala | 13 +-
.../metadata/AggCallSelectivityEstimatorTest.scala | 2 +-
.../plan/metadata/FlinkRelMdHandlerTestBase.scala | 17 +-
.../plan/metadata/SelectivityEstimatorTest.scala | 2 +-
.../logical/ExpressionReductionRulesTest.scala | 12 +-
.../PushPartitionIntoTableSourceScanRuleTest.scala | 4 +-
.../SplitPythonConditionFromJoinRuleTest.scala | 80 +
.../plan/schema/ComputedColumnToRelTest.scala | 191 +
.../plan/stream/sql/PartitionableSinkTest.scala | 70 +
.../planner/plan/stream/sql/SetOperatorsTest.scala | 5 +
.../planner/plan/stream/sql/TableScanTest.scala | 19 +-
.../planner/plan/stream/sql/TableSourceTest.scala | 4 +-
.../plan/stream/sql/join/WindowJoinTest.scala | 17 +
.../table/validation/TableSinkValidationTest.scala | 37 +-
.../planner/plan/utils/FlinkRelOptUtilTest.scala | 3 +-
.../planner/plan/utils/PartitionPrunerTest.scala | 8 +-
.../planner/plan/utils/RexNodeExtractorTest.scala | 14 +-
.../planner/runtime/batch/sql/LimitITCase.scala | 22 +-
.../runtime/batch/sql/OverWindowITCase.scala | 22 +
.../batch/sql/PartitionableSinkITCase.scala | 215 +-
.../runtime/batch/sql/TableSourceITCase.scala | 6 +-
.../batch/sql/agg/AggregateITCaseBase.scala | 8 +-
.../sql/agg/DistinctAggregateITCaseBase.scala | 2 +-
.../runtime/batch/sql/agg/GroupingSetsITCase.scala | 10 +-
.../runtime/batch/sql/join/InnerJoinITCase.scala | 8 +-
.../runtime/batch/sql/join/JoinITCase.scala | 5 +-
.../runtime/stream/sql/AggregateITCase.scala | 191 +-
.../planner/runtime/stream/sql/CalcITCase.scala | 2 +-
.../runtime/stream/sql/CorrelateITCase.scala | 14 +-
.../runtime/stream/sql/Limit0RemoveITCase.scala | 16 +-
.../planner/runtime/stream/sql/RankITCase.scala | 38 +-
.../runtime/stream/sql/SplitAggregateITCase.scala | 103 +-
.../runtime/stream/sql/TableSourceITCase.scala | 4 +-
.../runtime/stream/sql/TimeAttributeITCase.scala | 163 +
.../planner/runtime/stream/sql/UnnestITCase.scala | 2 +-
.../runtime/stream/sql/WindowAggregateITCase.scala | 2 +-
.../runtime/stream/table/AggregateITCase.scala | 2 +-
.../planner/runtime/stream/table/JoinITCase.scala | 12 +-
.../planner/runtime/utils/BatchTableEnvUtil.scala | 7 +-
.../table/planner/runtime/utils/TableUtil.scala | 8 +-
.../table/planner/runtime/utils/TestData.scala | 48 +-
.../table/planner/utils/DateTimeTestUtil.scala | 18 +-
.../flink/table/planner/utils/TableTestBase.scala | 82 +-
.../planner/utils/TestLimitableTableSource.scala | 78 +
.../table/planner/utils/testTableSources.scala | 83 +-
.../apache/flink/table/calcite/CalciteParser.java | 71 +
.../flink/table/catalog/CatalogCalciteSchema.java | 13 +-
.../table/catalog/CatalogManagerCalciteSchema.java | 10 +-
.../flink/table/catalog/DatabaseCalciteSchema.java | 88 +-
.../catalog/FunctionCatalogOperatorTable.java | 3 +-
.../flink/table/plan/QueryOperationConverter.java | 2 +-
.../org/apache/flink/table/planner/ParserImpl.java | 81 +
.../planner/PlanningConfigurationBuilder.java | 10 +
.../table/sqlexec/SqlToOperationConverter.java | 67 +-
.../table/api/internal/BatchTableEnvImpl.scala | 56 +-
.../flink/table/api/internal/TableEnvImpl.scala | 312 +-
.../java/internal/BatchTableEnvironmentImpl.scala | 13 +
.../scala/internal/BatchTableEnvironmentImpl.scala | 13 +
.../flink/table/calcite/FlinkPlannerImpl.scala | 51 +-
.../apache/flink/table/codegen/CodeGenerator.scala | 65 +-
.../table/codegen/CollectorCodeGenerator.scala | 22 +-
.../flink/table/codegen/ExpressionReducer.scala | 80 +-
.../table/codegen/FunctionCodeGenerator.scala | 26 +-
.../flink/table/codegen/MatchCodeGenerator.scala | 33 +-
.../codegen/PythonFunctionCodeGenerator.scala | 7 +-
.../apache/flink/table/dataview/StateMapView.scala | 2 +
.../org/apache/flink/table/plan/Optimizer.scala | 2 +-
.../apache/flink/table/plan/nodes/CommonJoin.scala | 10 +
.../flink/table/plan/nodes/CommonPythonCalc.scala | 76 +-
.../plan/nodes/datastream/DataStreamJoin.scala | 2 +
.../plan/nodes/datastream/DataStreamMatch.scala | 7 +
.../nodes/datastream/DataStreamPythonCalc.scala | 2 +-
.../nodes/datastream/DataStreamWindowJoin.scala | 2 +
.../flink/table/plan/rules/FlinkRuleSets.scala | 3 +
.../plan/rules/datastream/DataStreamCalcRule.scala | 5 +-
.../datastream/DataStreamPythonCalcRule.scala | 5 +-
.../plan/rules/logical/PythonCalcSplitRule.scala | 28 +-
.../logical/SplitPythonConditionFromJoinRule.scala | 86 +
.../apache/flink/table/plan/util/PythonUtil.scala | 67 +-
.../table/plan/util/RexProgramExtractor.scala | 5 +-
.../apache/flink/table/planner/StreamPlanner.scala | 87 +-
.../table/runtime/join/TemporalRowtimeJoin.scala | 2 +-
.../apache/flink/table/sinks/TableSinkUtils.scala | 28 +-
.../flink/table/catalog/CatalogManagerTest.java | 191 +-
.../table/catalog/CatalogStructureBuilder.java | 137 +-
.../table/catalog/DatabaseCalciteSchemaTest.java | 3 +-
.../flink/table/catalog/PathResolutionTest.java | 51 +-
.../utils/JavaUserDefinedScalarFunctions.java | 73 +
.../table/sqlexec/SqlToOperationConverterTest.java | 30 +-
.../flink/table/api/TableEnvironmentTest.scala | 33 +
.../apache/flink/table/api/TableSchemaTest.scala | 105 -
.../apache/flink/table/api/TableSourceTest.scala | 35 +-
.../flink/table/api/stream/sql/AggregateTest.scala | 6 +-
.../stream/sql/validation/JoinValidationTest.scala | 22 +
.../validation/MatchRecognizeValidationTest.scala | 25 +-
.../table/validation/JoinValidationTest.scala | 17 +
.../api/validation/TableSchemaValidationTest.scala | 12 +-
.../api/validation/TableSinksValidationTest.scala | 2 +-
.../flink/table/catalog/CatalogTableITCase.scala | 22 +-
.../expressions/utils/ExpressionTestBase.scala | 7 +-
.../table/match/PatternTranslatorTestBase.scala | 3 +-
.../table/plan/ExpressionReductionRulesTest.scala | 47 +-
.../flink/table/plan/PythonCalcSplitRuleTest.scala | 25 +-
.../SplitPythonConditionFromJoinRuleTest.scala | 109 +
.../batch/sql/PartitionableSinkITCase.scala | 139 +-
.../flink/table/runtime/stream/sql/SqlITCase.scala | 40 +
.../table/runtime/stream/table/CalcITCase.scala | 1 -
.../flink/table/utils/MockTableEnvironment.scala | 17 +
.../table/dataformat/AbstractBinaryWriter.java | 31 +-
.../apache/flink/table/dataformat/BinaryArray.java | 6 +-
.../flink/table/dataformat/BinaryFormat.java | 87 +-
.../flink/table/dataformat/BinaryGeneric.java | 49 +-
.../apache/flink/table/dataformat/BinaryMap.java | 12 +-
.../apache/flink/table/dataformat/BinaryRow.java | 8 +-
.../flink/table/dataformat/BinarySection.java | 74 +
.../flink/table/dataformat/BinaryString.java | 239 +-
.../flink/table/dataformat/BinaryStringUtil.java | 119 +-
.../flink/table/dataformat/BinaryWriter.java | 5 +-
.../table/dataformat/DataFormatConverters.java | 2 +-
.../flink/table/dataformat/LazyBinaryFormat.java | 73 +-
.../apache/flink/table/dataformat/NestedRow.java | 5 +-
.../flink/table/dataformat/SqlTimestamp.java | 187 +
.../flink/table/runtime/dataview/StateMapView.java | 10 +
.../generated/GeneratedWatermarkGenerator.java | 31 +
.../runtime/generated/WatermarkGenerator.java | 41 +
.../runtime/operators/aggregate/BytesHashMap.java | 46 +-
.../join/temporal/TemporalRowTimeJoinOperator.java | 2 +-
.../AbstractRowTimeUnboundedPrecedingOver.java | 3 +-
.../runtime/operators/window/WindowOperator.java | 2 +-
.../BoundedOutOfOrderWatermarkGenerator.java | 51 +
.../wmassigners/WatermarkAssignerOperator.java | 64 +-
.../WatermarkAssignerOperatorFactory.java | 77 +
.../runtime/typeutils/BinaryGenericSerializer.java | 76 +-
.../runtime/typeutils/SqlTimestampSerializer.java | 189 +
.../runtime/typeutils/SqlTimestampTypeInfo.java | 102 +
.../apache/flink/table/dataformat/BaseRowTest.java | 11 +-
.../flink/table/dataformat/BinaryArrayTest.java | 10 +-
.../flink/table/dataformat/BinaryRowTest.java | 63 +-
.../flink/table/dataformat/BinaryStringTest.java | 17 +-
.../flink/table/dataformat/NestedRowTest.java | 10 +-
.../flink/table/dataformat/SqlTimestampTest.java | 97 +
.../operators/window/MergingWindowSetTest.java | 10 +
.../wmassigners/WatermarkAssignerOperatorTest.java | 113 +-
.../WatermarkAssignerOperatorTestBase.java | 2 +-
.../runtime/typeutils/BaseArraySerializerTest.java | 2 +-
.../runtime/typeutils/BaseMapSerializerTest.java | 2 +-
.../typeutils/BinaryGenericSerializerTest.java | 21 +-
.../runtime/typeutils/InternalTypeInfoTest.java | 6 +-
.../typeutils/SqlTimestampSerializerTest.java | 73 +
.../flink/table/utils/BinaryGenericAsserter.java | 78 +
.../jobmaster/JobMasterStopWithSavepointIT.java | 16 +-
.../jobmaster/JobMasterTriggerSavepointITCase.java | 8 +-
.../test/accumulators/AccumulatorLiveITCase.java | 5 +-
.../flink/test/cancelling/CancelingTestBase.java | 7 +-
.../EventTimeWindowCheckpointingITCase.java | 3 +
.../KeyedStateCheckpointingITCase.java | 3 +
.../test/checkpointing/RegionFailoverITCase.java | 36 +-
.../flink/test/checkpointing/RescalingITCase.java | 33 +-
.../ResumeCheckpointManuallyITCase.java | 6 +-
.../flink/test/checkpointing/SavepointITCase.java | 33 +-
.../StreamFaultToleranceTestBase.java | 6 +-
.../checkpointing/WindowCheckpointingITCase.java | 3 +
.../ZooKeeperHighAvailabilityITCase.java | 20 +-
.../utils/SavepointMigrationTestBase.java | 27 +-
.../flink/test/classloading/ClassLoaderITCase.java | 86 +-
.../test/example/client/JobRetrievalITCase.java | 4 +-
.../example/failing/JobSubmissionFailsITCase.java | 11 +-
.../recovery/BatchFineGrainedRecoveryITCase.java | 3 +
.../recovery/ProcessFailureCancelingITCase.java | 2 +-
.../test/runtime/NetworkStackThroughputITCase.java | 5 +-
.../ZooKeeperLeaderElectionITCase.java | 126 +-
.../restore/AbstractOperatorRestoreTestBase.java | 17 +-
.../api/ContinuousFileReaderOperatorITCase.java | 98 -
.../runtime/BigUserProgramJobSubmitITCase.java | 4 +-
.../test/streaming/runtime/TimestampITCase.java | 2 +-
.../flink/yarn/CliFrontendRunWithYarnTest.java | 54 +-
.../java/org/apache/flink/yarn/YARNITCase.java | 12 +-
.../apache/flink/yarn/YarnConfigurationITCase.java | 14 +-
.../java/org/apache/flink/yarn/YarnTestBase.java | 12 +-
.../apache/flink/yarn/util/FakeClusterClient.java | 116 -
.../util/NonDeployingYarnClusterDescriptor.java | 3 +-
.../flink/yarn/YarnClusterClientFactory.java | 97 +
.../apache/flink/yarn/YarnClusterDescriptor.java | 156 +-
.../org/apache/flink/yarn/YarnResourceManager.java | 75 +-
.../apache/flink/yarn/cli/FlinkYarnSessionCli.java | 367 +-
.../yarn/configuration/YarnConfigOptions.java | 48 +
.../configuration/YarnConfigOptionsInternal.java | 43 +
...he.flink.client.deployment.ClusterClientFactory | 16 +
.../apache/flink/yarn/AbstractYarnClusterTest.java | 12 +-
.../apache/flink/yarn/FlinkYarnSessionCliTest.java | 88 +-
.../flink/yarn/YarnClusterClientFactoryTest.java | 47 +
.../flink/yarn/YarnClusterDescriptorTest.java | 24 +-
.../java/org/apache/flink/yarn/YarnTestUtils.java | 15 +
tools/travis/nightly.sh | 2 +-
tools/travis/splits/split_misc.sh | 8 +-
tools/travis/stage.sh | 14 +
1246 files changed, 69632 insertions(+), 39955 deletions(-)
create mode 100644 docs/_includes/generated/deployment_configuration.html
create mode 100644 docs/_includes/generated/pipeline_configuration.html
create mode 100644 docs/_includes/generated/savepoint_config_configuration.html
delete mode 100644 docs/dev/table/functions.md
delete mode 100644 docs/dev/table/functions.zh.md
create mode 100644 docs/dev/table/functions/index.md
create mode 100644 docs/dev/table/functions/index.zh.md
create mode 100644 docs/dev/table/functions/systemFunctions.md
create mode 100644 docs/dev/table/functions/systemFunctions.zh.md
create mode 100644 docs/dev/table/functions/udfs.md
create mode 100644 docs/dev/table/functions/udfs.zh.md
create mode 100644 docs/dev/table/modules.md
create mode 100644 docs/dev/table/modules.zh.md
delete mode 100644 docs/dev/table/udfs.md
delete mode 100644 docs/dev/table/udfs.zh.md
create mode 100644 flink-clients/src/main/java/org/apache/flink/client/cli/ExecutionConfigAccessor.java
delete mode 100644 flink-clients/src/main/java/org/apache/flink/client/cli/InfoOptions.java
delete mode 100644 flink-clients/src/main/java/org/apache/flink/client/cli/RunOptions.java
create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/ClusterClientFactory.java
create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/ClusterClientServiceLoader.java
create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/DefaultClusterClientServiceLoader.java
create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/StandaloneClientFactory.java
create mode 100644 flink-clients/src/main/resources/META-INF/services/org.apache.flink.client.deployment.ClusterClientFactory
create mode 100644 flink-clients/src/test/java/org/apache/flink/client/cli/util/DummyClusterClientFactory.java
create mode 100644 flink-clients/src/test/java/org/apache/flink/client/cli/util/DummyClusterClientServiceLoader.java
create mode 100644 flink-clients/src/test/java/org/apache/flink/client/deployment/ClusterClientServiceLoaderTest.java
create mode 100644 flink-clients/src/test/java/org/apache/flink/client/program/TestingClusterClient.java
create mode 100644 flink-clients/src/test/resources/META-INF/services/org.apache.flink.client.deployment.ClusterClientFactory
create mode 100644 flink-connectors/flink-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/connectors/elasticsearch7/Elasticsearch7UpsertTableSink.java
create mode 100644 flink-connectors/flink-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/connectors/elasticsearch7/Elasticsearch7UpsertTableSinkFactory.java
create mode 100644 flink-connectors/flink-connector-elasticsearch7/src/main/resources/META-INF/services/org.apache.flink.table.factories.TableFactory
create mode 100644 flink-connectors/flink-connector-elasticsearch7/src/test/java/org/apache/flink/streaming/connectors/elasticsearch7/Elasticsearch7UpsertTableSinkFactoryTest.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/catalog/hive/client/HiveShimV100.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/catalog/hive/client/HiveShimV101.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/catalog/hive/client/HiveShimV110.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/catalog/hive/client/HiveShimV111.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/functions/hive/conversion/WritableHiveObjectConversion.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/module/hive/HiveModule.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/module/hive/HiveModuleDescriptor.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/module/hive/HiveModuleDescriptorValidator.java
create mode 100644 flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/module/hive/HiveModuleFactory.java
create mode 100644 flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/table/HiveVersionTestUtil.java
create mode 100644 flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/table/module/hive/HiveModuleDescriptorTest.java
create mode 100644 flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/table/module/hive/HiveModuleTest.java
create mode 100644 flink-connectors/flink-connector-hive/src/test/resources/csv/test2.csv
delete mode 100644 flink-connectors/flink-sql-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/sql/connectors/elasticsearch7/Elasticsearch7UpsertTableSink.java
delete mode 100644 flink-connectors/flink-sql-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/sql/connectors/elasticsearch7/Elasticsearch7UpsertTableSinkFactory.java
delete mode 100644 flink-connectors/flink-sql-connector-elasticsearch7/src/main/resources/META-INF/services/org.apache.flink.table.factories.TableFactory
delete mode 100644 flink-connectors/flink-sql-connector-elasticsearch7/src/test/java/org/apache/flink/streaming/sql/connectors/elasticsearch7/Elasticsearch7UpsertTableSinkFactoryTest.java
delete mode 100644 flink-connectors/flink-sql-connector-elasticsearch7/src/test/resources/log4j-test.properties
create mode 100644 flink-container/src/test/assembly/test-assembly-test-user-classloader-job-jar.xml
create mode 100644 flink-container/src/test/assembly/test-assembly-test-user-classloader-job-lib-jar.xml
create mode 100644 flink-container/src/test/java/org/apache/flink/container/entrypoint/testjar/TestJobInfo.java
create mode 100644 flink-container/src/test/java/org/apache/flink/container/entrypoint/testjar/TestUserClassLoaderJob.java
create mode 100644 flink-container/src/test/java/org/apache/flink/container/entrypoint/testjar/TestUserClassLoaderJobLib.java
create mode 100644 flink-core/src/main/java/org/apache/flink/api/common/operators/util/OperatorValidationUtils.java
create mode 100644 flink-core/src/main/java/org/apache/flink/configuration/ConfigUtils.java
create mode 100644 flink-core/src/main/java/org/apache/flink/configuration/DeploymentOptions.java
create mode 100644 flink-core/src/main/java/org/apache/flink/configuration/PipelineOptions.java
create mode 100644 flink-core/src/main/java/org/apache/flink/configuration/ReadableConfig.java
create mode 100644 flink-core/src/main/java/org/apache/flink/configuration/StructuredOptionsSplitter.java
create mode 100644 flink-core/src/main/java/org/apache/flink/configuration/WritableConfig.java
create mode 100644 flink-core/src/main/java/org/apache/flink/core/memory/MemorySegmentInputStreamWithPos.java
create mode 100644 flink-core/src/main/java/org/apache/flink/util/IterableUtils.java
create mode 100644 flink-core/src/main/java/org/apache/flink/util/JavaGcCleanerWrapper.java
create mode 100644 flink-core/src/test/java/org/apache/flink/configuration/ConfigUtilsTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/configuration/ConfigurationConversionsTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/configuration/ConfigurationParsingInvalidFormatsTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/configuration/ReadableWritableConfigurationTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/configuration/StructuredOptionsSplitterTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/core/plugin/PluginConfigTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/util/IterableUtilsTest.java
create mode 100644 flink-core/src/test/java/org/apache/flink/util/JavaGcCleanerWrapperTest.java
delete mode 100755 flink-mesos/src/main/java/org/apache/flink/mesos/entrypoint/MesosEntrypointUtils.java
create mode 100755 flink-mesos/src/main/java/org/apache/flink/mesos/util/MesosUtils.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/mapper/Mapper.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/mapper/MapperAdapter.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/mapper/ModelMapper.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/mapper/ModelMapperAdapter.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/model/BroadcastVariableModelSource.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/model/ModelSource.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/model/RowsModelSource.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/main/java/org/apache/flink/ml/common/statistics/basicstatistic/MultivariateGaussian.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/test/java/org/apache/flink/ml/common/linalg/BLASTest.java
create mode 100644 flink-ml-parent/flink-ml-lib/src/test/java/org/apache/flink/ml/common/statistics/basicstatistic/MultivariateGaussianTest.java
create mode 100644 flink-python/pyflink/fn_execution/tests/coders_test_common.py
delete mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/BeamTypeUtils.java
create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/PythonTypeUtils.java
delete mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/coders/BaseRowCoder.java
delete mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/coders/ReusableDataInputView.java
delete mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/coders/ReusableDataOutputView.java
delete mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/coders/RowCoder.java
create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/serializers/python/BaseRowSerializer.java
create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/serializers/python/DateSerializer.java
create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/typeutils/serializers/python/StringSerializer.java
delete mode 100644 flink-python/src/test/java/org/apache/flink/table/functions/python/BeamTypeUtilsTest.java
create mode 100644 flink-python/src/test/java/org/apache/flink/table/functions/python/PythonTypeUtilsTest.java
delete mode 100644 flink-python/src/test/java/org/apache/flink/table/runtime/typeutils/coders/BaseRowCoderTest.java
delete mode 100644 flink-python/src/test/java/org/apache/flink/table/runtime/typeutils/coders/CoderTestBase.java
delete mode 100644 flink-python/src/test/java/org/apache/flink/table/runtime/typeutils/coders/RowCoderTest.java
create mode 100644 flink-python/src/test/java/org/apache/flink/table/runtime/typeutils/serializers/python/BaseRowSerializerTest.java
create mode 100644 flink-python/src/test/java/org/apache/flink/table/runtime/typeutils/serializers/python/DateSerializerTest.java
create mode 100644 flink-python/src/test/java/org/apache/flink/table/runtime/typeutils/serializers/python/StringSerializerTest.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/TaskManagerSlot.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/JobManagerMetricGroupFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/PartialDispatcherServicesWithJobGraphStore.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/AbstractDispatcherLeaderProcess.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DefaultDispatcherGatewayService.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DefaultDispatcherGatewayServiceFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DefaultDispatcherRunner.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DefaultDispatcherRunnerFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DispatcherLeaderProcess.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DispatcherLeaderProcessFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DispatcherLeaderProcessFactoryFactory.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DispatcherRunnerFactoryImpl.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DispatcherRunnerImpl.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/DispatcherRunnerLeaderElectionLifecycleManager.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/JobDispatcherLeaderProcess.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/JobDispatcherLeaderProcessFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/JobDispatcherLeaderProcessFactoryFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/SessionDispatcherLeaderProcess.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/SessionDispatcherLeaderProcessFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/SessionDispatcherLeaderProcessFactoryFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/runner/StoppedDispatcherLeaderProcess.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/entrypoint/component/AbstractUserClassPathJobGraphRetriever.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/adapter/DefaultFailoverEdge.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/adapter/DefaultFailoverTopology.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/adapter/DefaultFailoverVertex.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/flip1/FailoverEdge.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/failover/flip1/FailoverResultPartition.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/metrics/NumberOfFullRestartsGauge.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/instance/SimpleSlotContext.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/AbstractPartitionTracker.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/JobMasterPartitionTracker.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/JobMasterPartitionTrackerImpl.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PartitionTrackerEntry.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PartitionTrackerImpl.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/TaskExecutorPartitionInfo.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/TaskExecutorPartitionTracker.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/TaskExecutorPartitionTrackerImpl.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/SavepointConfigOptions.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/DefaultLogicalResult.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/DefaultLogicalTopology.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/DefaultLogicalVertex.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/LogicalPipelinedRegion.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/LogicalResult.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/LogicalTopology.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/topology/LogicalVertex.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/HaServicesJobGraphStoreFactory.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/ThrowingJobGraphWriter.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/DefaultLocationPreferenceSlotSelectionStrategy.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/EvenlySpreadOutLocationPreferenceSlotSelectionStrategy.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotInfoWithUtilization.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/messages/checkpoint/NotifyCheckpointComplete.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/messages/checkpoint/TriggerCheckpoint.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/query/KvStateMessage.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/AnyMatchingSlotMatchingStrategy.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/LeastUtilizationSlotMatchingStrategy.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/SlotMatchingStrategy.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/TaskManagerSlot.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/TaskManagerSlotInformation.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/JobExceptionsMessageParameters.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/UpperLimitExceptionParameter.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adapter/DefaultExecutionTopology.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adapter/DefaultExecutionVertex.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adapter/DefaultResultPartition.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adapter/DefaultSchedulingExecutionVertex.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adapter/DefaultSchedulingResultPartition.java
delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adapter/ExecutionGraphToSchedulingTopologyAdapter.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutorHeartbeatPayload.java
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/util/ClusterEntrypointUtils.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinatorRestoringTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinatorTestingUtils.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinatorTriggeringTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/hooks/TestMasterHook.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/DispatcherHATest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/NoOpJobGraphWriter.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/ZooKeeperHADispatcherTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/DefaultDispatcherRunnerITCase.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/DefaultDispatcherRunnerTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/SessionDispatcherLeaderProcessTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/TestingDispatcherGatewayService.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/TestingDispatcherLeaderProcess.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/TestingDispatcherLeaderProcessFactory.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/TestingDispatcherServiceFactory.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/dispatcher/runner/ZooKeeperDefaultDispatcherRunnerTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/entrypoint/component/AbstractUserClassPathJobGraphRetrieverTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/ExecutionGraphNotEnoughResourceTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/TestingExecutionGraphBuilder.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/failover/adapter/DefaultFailoverTopologyTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/instance/SimpleSlotContext.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/AbstractPartitionTrackerTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/JobMasterPartitionTrackerImplTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/NoOpJobMasterPartitionTracker.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/NoOpPartitionTracker.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PartitionTrackerImplTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/TestingJobMasterPartitionTracker.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/TestingPartitionTracker.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobgraph/topology/DefaultLogicalResultTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobgraph/topology/DefaultLogicalTopologyTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobgraph/topology/DefaultLogicalVertexTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobgraph/utils/JobGraphTestUtils.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/JobMasterPartitionReleaseTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPoolSlotSpreadOutTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/utils/JobMasterBuilder.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/slotmanager/AnyMatchingSlotMatchingStrategyTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/slotmanager/LeastUtilizationSlotMatchingStrategyTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/slotmanager/TestingTaskManagerSlotInformation.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/rest/handler/job/JobExceptionsHandlerTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adapter/DefaultExecutionTopologyTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adapter/DefaultExecutionVertexTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adapter/DefaultResultPartitionTest.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adapter/DefaultSchedulingExecutionVertexTest.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adapter/DefaultSchedulingResultPartitionTest.java
delete mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adapter/ExecutionGraphToSchedulingTopologyAdapterTest.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/util/TestingScheduledExecutor.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/CopyOnWriteSkipListStateMap.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/CopyOnWriteSkipListStateMapSnapshot.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/LevelIndexHeader.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/NodeStatus.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/OnHeapLevelIndexHeader.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/SkipListKeyComparator.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/SkipListKeySerializer.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/SkipListUtils.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/SkipListValueSerializer.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/space/Allocator.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/space/Chunk.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/space/Constants.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/main/java/org/apache/flink/runtime/state/heap/space/SpaceUtils.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/CopyOnWriteSkipListStateMapBasicOpTest.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/CopyOnWriteSkipListStateMapComplexOpTest.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/CopyOnWriteSkipListStateMapTestUtils.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/OnHeapLevelIndexHeaderTest.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/SkipListKeyComparatorTest.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/SkipListSerializerTest.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/SkipListUtilsTest.java
create mode 100644 flink-state-backends/flink-statebackend-heap-spillable/src/test/java/org/apache/flink/runtime/state/heap/TestAllocator.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/MailboxExecutor.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/SynchronousSavepointLatch.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/Mailbox.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxDefaultAction.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxExecutorFactory.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxExecutorImpl.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxProcessor.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxStateException.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/DefaultActionContext.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/MailboxDefaultAction.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/MailboxExecutor.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/MailboxExecutorFactory.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/MailboxExecutorImpl.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/MailboxProcessor.java
delete mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/SuspendedMailboxDefaultAction.java
create mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/MailboxOperatorTest.java
delete mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/SynchronousSavepointSyncLatchTest.java
create mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/mailbox/MailboxExecutorImplTest.java
create mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/mailbox/TaskMailboxProcessorTest.java
delete mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/MailboxExecutorImplTest.java
delete mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/mailbox/execution/TaskMailboxProcessorTest.java
create mode 100644 flink-table/flink-sql-client/src/main/java/org/apache/flink/table/client/config/entries/ModuleEntry.java
create mode 100644 flink-table/flink-sql-client/src/test/resources/test-sql-client-modules.yaml
create mode 100644 flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/ddl/SqlUseCatalog.java
create mode 100644 flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/ddl/SqlWatermark.java
create mode 100644 flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/dql/SqlDescribeCatalog.java
create mode 100644 flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/dql/SqlShowCatalogs.java
create mode 100644 flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/utils/ParserResource.java
create mode 100644 flink-table/flink-sql-parser/src/main/resources/org.apache.flink.sql.parser.utils/ParserResource.properties
create mode 100644 flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/Registration.java
create mode 100644 flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/UnresolvedIdentifier.java
create mode 100644 flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/delegation/Parser.java
create mode 100644 flink-table/flink-table-api-java/src/test/java/org/apache/flink/table/utils/ParserMock.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/api/TableColumn.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/api/WatermarkSpec.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/dataview/NullAwareMapSerializerSnapshot.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/descriptors/CoreModuleDescriptor.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/descriptors/CoreModuleDescriptorValidator.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/descriptors/ModuleDescriptor.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/descriptors/ModuleDescriptorValidator.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/factories/ModuleFactory.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions/FunctionIdentifier.java
delete mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions/FunctionLanguage.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/module/CoreModule.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/module/CoreModuleFactory.java
delete mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/module/exceptions/ModuleAlreadyExistException.java
delete mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/module/exceptions/ModuleNotFoundException.java
create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/sources/LimitableTableSource.java
create mode 100644 flink-table/flink-table-common/src/main/resources/META-INF/services/org.apache.flink.table.factories.TableFactory
create mode 100644 flink-table/flink-table-common/src/test/java/org/apache/flink/table/api/TableSchemaTest.java
create mode 100644 flink-table/flink-table-common/src/test/java/org/apache/flink/table/dataview/NullAwareMapSerializerTest.java
create mode 100644 flink-table/flink-table-common/src/test/java/org/apache/flink/table/descriptors/module/CoreModuleDescriptorTest.java
create mode 100644 flink-table/flink-table-common/src/test/java/org/apache/flink/table/factories/module/CoreModuleFactoryTest.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/calcite/sql/validate/ParameterScope.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/calcite/CalciteParser.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/calcite/FlinkToRelContext.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/calcite/SqlExprToRexConverter.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/calcite/SqlExprToRexConverterImpl.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/delegation/ParserImpl.java
create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/codegen/WatermarkGeneratorCodeGenerator.scala
create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/rules/logical/PushLimitIntoTableSourceScanRule.scala
create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/rules/logical/SplitPythonConditionFromJoinRule.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/java/org/apache/flink/table/planner/delegation/BatchExecutorTest.java
create mode 100644 flink-table/flink-table-planner-blink/src/test/java/org/apache/flink/table/planner/operations/SqlToOperationConverterTest.java
delete mode 100644 flink-table/flink-table-planner-blink/src/test/java/org/apache/flink/table/sqlexec/SqlToOperationConverterTest.java
delete mode 100644 flink-table/flink-table-planner-blink/src/test/resources/explain/testGetStatsFromCatalog.out
create mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/batch/sql/PartitionableSinkTest.xml
create mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/rules/logical/SplitPythonConditionFromJoinRuleTest.xml
create mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/schema/ComputedColumnToRelTest.xml
create mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/stream/sql/PartitionableSinkTest.xml
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/codegen/WatermarkGeneratorCodeGenTest.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/batch/sql/PartitionableSinkTest.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/rules/logical/SplitPythonConditionFromJoinRuleTest.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/schema/ComputedColumnToRelTest.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/stream/sql/PartitionableSinkTest.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/runtime/stream/sql/TimeAttributeITCase.scala
create mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/utils/TestLimitableTableSource.scala
create mode 100644 flink-table/flink-table-planner/src/main/java/org/apache/flink/table/calcite/CalciteParser.java
create mode 100644 flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/ParserImpl.java
create mode 100644 flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/plan/rules/logical/SplitPythonConditionFromJoinRule.scala
delete mode 100644 flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/api/TableSchemaTest.scala
create mode 100644 flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/plan/SplitPythonConditionFromJoinRuleTest.scala
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/dataformat/BinarySection.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/dataformat/SqlTimestamp.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/generated/GeneratedWatermarkGenerator.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/generated/WatermarkGenerator.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/operators/wmassigners/BoundedOutOfOrderWatermarkGenerator.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/operators/wmassigners/WatermarkAssignerOperatorFactory.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/typeutils/SqlTimestampSerializer.java
create mode 100644 flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/typeutils/SqlTimestampTypeInfo.java
create mode 100644 flink-table/flink-table-runtime-blink/src/test/java/org/apache/flink/table/dataformat/SqlTimestampTest.java
create mode 100644 flink-table/flink-table-runtime-blink/src/test/java/org/apache/flink/table/runtime/typeutils/SqlTimestampSerializerTest.java
create mode 100644 flink-table/flink-table-runtime-blink/src/test/java/org/apache/flink/table/utils/BinaryGenericAsserter.java
delete mode 100644 flink-tests/src/test/java/org/apache/flink/test/streaming/api/ContinuousFileReaderOperatorITCase.java
delete mode 100644 flink-yarn-tests/src/test/java/org/apache/flink/yarn/util/FakeClusterClient.java
create mode 100644 flink-yarn/src/main/java/org/apache/flink/yarn/YarnClusterClientFactory.java
create mode 100644 flink-yarn/src/main/java/org/apache/flink/yarn/configuration/YarnConfigOptionsInternal.java
create mode 100644 flink-yarn/src/main/resources/META-INF/services/org.apache.flink.client.deployment.ClusterClientFactory
create mode 100644 flink-yarn/src/test/java/org/apache/flink/yarn/YarnClusterClientFactoryTest.java
[flink] 02/05: [FLINK-13725][docs] use sassc for faster doc
generation
Posted by nk...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a commit to branch docs_experimental__docs
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 325a9c1a45840bdfc147b19c529a6fa9a5328d54
Author: Nico Kruber <ni...@ververica.com>
AuthorDate: Wed Aug 14 17:29:43 2019 +0200
[FLINK-13725][docs] use sassc for faster doc generation
Jekyll requires sass but can optionally also use a C-based implementation
provided by sassc. Although we do not use sass directly, there may be some
indirect use inside jekyll. It doesn't seem to hurt to upgrade here.
This closes #9443
---
docs/Gemfile | 1 +
docs/Gemfile.lock | 5 +++++
2 files changed, 6 insertions(+)
diff --git a/docs/Gemfile b/docs/Gemfile
index eb307fd..70bd4df 100644
--- a/docs/Gemfile
+++ b/docs/Gemfile
@@ -28,6 +28,7 @@ gem 'json', '2.2.0'
gem 'jekyll-multiple-languages', '2.0.3'
gem 'jekyll-paginate', '1.1.0'
gem 'liquid-c', '4.0.0' # speed-up site generation
+gem 'sassc', '2.0.1' # speed-up site generation
group :jekyll_plugins do
gem 'hawkins'
diff --git a/docs/Gemfile.lock b/docs/Gemfile.lock
index 68e66d3..d8bd82e 100644
--- a/docs/Gemfile.lock
+++ b/docs/Gemfile.lock
@@ -55,6 +55,7 @@ GEM
pathutil (0.16.2)
forwardable-extended (~> 2.6)
public_suffix (3.1.1)
+ rake (12.3.3)
rb-fsevent (0.10.3)
rb-inotify (0.10.0)
ffi (~> 1.0)
@@ -67,6 +68,9 @@ GEM
sass-listen (4.0.0)
rb-fsevent (~> 0.9, >= 0.9.4)
rb-inotify (~> 0.9, >= 0.9.7)
+ sassc (2.0.1)
+ ffi (~> 1.9)
+ rake
sawyer (0.8.2)
addressable (>= 2.3.5)
faraday (> 0.8, < 2.0)
@@ -86,6 +90,7 @@ DEPENDENCIES
json (= 2.2.0)
liquid-c (= 4.0.0)
octokit (= 4.14.0)
+ sassc (= 2.0.1)
therubyracer (= 0.12.3)
RUBY VERSION
[flink] 03/05: [hotfix][docs] Temporarily disable liveserve
Posted by nk...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a commit to branch docs_experimental__docs
in repository https://gitbox.apache.org/repos/asf/flink.git
commit b3cade47bc62912c049ba1fdac42cd01648cf734
Author: Nico Kruber <ni...@ververica.com>
AuthorDate: Wed Aug 14 23:00:09 2019 +0200
[hotfix][docs] Temporarily disable liveserve
./build_docs.sh -i previously did not only enable incremental documentation
building while serving the docs, it also enabled a 'liveserve' mode that
automatically reloaded pages in the browser when they changed. This is based
on the 'hawkins' module which is not (yet) compatible with jekyll 4.0 which we
need to (significantly) improve build times.
This disables the liveserve mode and remove the hawkins module until a new
version is available.
---
docs/Gemfile | 6 +++---
docs/Gemfile.lock | 4 ----
docs/build_docs.sh | 2 +-
3 files changed, 4 insertions(+), 8 deletions(-)
diff --git a/docs/Gemfile b/docs/Gemfile
index 70bd4df..ef5086e 100644
--- a/docs/Gemfile
+++ b/docs/Gemfile
@@ -30,6 +30,6 @@ gem 'jekyll-paginate', '1.1.0'
gem 'liquid-c', '4.0.0' # speed-up site generation
gem 'sassc', '2.0.1' # speed-up site generation
-group :jekyll_plugins do
- gem 'hawkins'
-end
+# group :jekyll_plugins do
+# gem 'hawkins'
+# end
diff --git a/docs/Gemfile.lock b/docs/Gemfile.lock
index d8bd82e..f6aedee 100644
--- a/docs/Gemfile.lock
+++ b/docs/Gemfile.lock
@@ -13,9 +13,6 @@ GEM
multipart-post (>= 1.2, < 3)
ffi (1.11.1)
forwardable-extended (2.6.0)
- hawkins (2.0.5)
- em-websocket (~> 0.5)
- jekyll (~> 3.1)
http_parser.rb (0.6.0)
i18n (0.9.5)
concurrent-ruby (~> 1.0)
@@ -83,7 +80,6 @@ PLATFORMS
DEPENDENCIES
addressable (= 2.6.0)
- hawkins
jekyll (= 3.7.2)
jekyll-multiple-languages (= 2.0.3)
jekyll-paginate (= 1.1.0)
diff --git a/docs/build_docs.sh b/docs/build_docs.sh
index 1ab46f1..aecac83 100755
--- a/docs/build_docs.sh
+++ b/docs/build_docs.sh
@@ -64,7 +64,7 @@ while getopts "piez" opt; do
;;
i)
[[ `${RUBY} -v` =~ 'ruby 1' ]] && echo "Error: building the docs with the incremental option requires at least ruby 2.0" && exit 1
- JEKYLL_CMD="liveserve --baseurl= --watch --incremental"
+ JEKYLL_CMD="serve --baseurl= --watch --incremental"
;;
e)
JEKYLL_CONFIG="--config _config.yml,_config_dev_en.yml"
[flink] 05/05: [FLINK-13791][docs] Speed up sidenav by using
group_by
Posted by nk...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a commit to branch docs_experimental__docs
in repository https://gitbox.apache.org/repos/asf/flink.git
commit d3004d5477682ce0e1edc59b6b9e7398f4e2980f
Author: Nico Kruber <ni...@ververica.com>
AuthorDate: Mon Aug 19 23:48:57 2019 +0200
[FLINK-13791][docs] Speed up sidenav by using group_by
_includes/sidenav.html parses through pages_by_language over and over again
trying to find children when building the (recursive) side navigation. By doing
this once with a group_by, we can gain considerable savings in building the
docs via `./build_docs.sh` without any change to the generated HTML pages:
This closes #9487
---
docs/_includes/sidenav.html | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/docs/_includes/sidenav.html b/docs/_includes/sidenav.html
index 1073d99..70a24a7 100644
--- a/docs/_includes/sidenav.html
+++ b/docs/_includes/sidenav.html
@@ -69,7 +69,9 @@ level is determined by 'nav-pos'.
{%- assign posStack = site.array -%}
{%- assign elements = site.array -%}
-{%- assign children = (site.pages_by_language[page.language] | where: "nav-parent_id" , "root" | sort: "nav-pos") -%}
+{%- assign all_pages_by_nav_parent = (site.pages_by_language[page.language] | where_exp: "item", "item.nav-parent_id != nil" | group_by: "nav-parent_id") -%}
+{%- assign children = (all_pages_by_nav_parent | where: "name" , "root") -%}
+{%- assign children = (children[0].items | sort: "nav-pos") -%}
{%- if children.size > 0 -%}
{%- assign elements = elements | push: children -%}
{%- endif -%}
@@ -111,8 +113,9 @@ level is determined by 'nav-pos'.
{%- assign pos = pos | plus: 1 -%}
{%- if this.nav-id -%}
- {%- assign children = (site.pages_by_language[page.language] | where: "nav-parent_id" , this.nav-id | sort: "nav-pos") -%}
+ {%- assign children = (all_pages_by_nav_parent | where: "name" , this.nav-id) -%}
{%- if children.size > 0 -%}
+ {%- assign children = (children[0].items | sort: "nav-pos") -%}
{%- capture collapse_target -%}"#collapse-{{ i }}" data-toggle="collapse"{%- if active -%} class="active"{%- endif -%}{%- endcapture -%}
{%- capture expand -%}{%- unless active -%} <i class="fa fa-caret-down pull-right" aria-hidden="true" style="padding-top: 4px"></i>{%- endunless -%}{%- endcapture %}
<li><a href={{ collapse_target }}>{{ title }}{{ expand }}</a><div class="collapse{% if active %} in{% endif %}" id="collapse-{{ i }}"><ul>
[flink] 01/05: [FLINK-13729][docs] Update website generation
dependencies
Posted by nk...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a commit to branch docs_experimental__docs
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 7f0473779b1ed99223f536be14bf72102b2a27e2
Author: Nico Kruber <ni...@ververica.com>
AuthorDate: Wed Aug 14 16:57:14 2019 +0200
[FLINK-13729][docs] Update website generation dependencies
This seems to come with a much nicer code highlighting.
This closes #9442
---
docs/Gemfile | 8 +++----
docs/Gemfile.lock | 62 ++++++++++++++++++++++++++++---------------------------
2 files changed, 36 insertions(+), 34 deletions(-)
diff --git a/docs/Gemfile b/docs/Gemfile
index b519eb9..eb307fd 100644
--- a/docs/Gemfile
+++ b/docs/Gemfile
@@ -21,10 +21,10 @@ source 'https://rubygems.org'
ruby '>= 2.1.0'
gem 'jekyll', '3.7.2'
-gem 'addressable', '2.4.0'
-gem 'octokit', '~> 4.3.0'
-gem 'therubyracer', '0.12.2'
-gem 'json', '2.0.4'
+gem 'addressable', '2.6.0'
+gem 'octokit', '4.14.0'
+gem 'therubyracer', '0.12.3'
+gem 'json', '2.2.0'
gem 'jekyll-multiple-languages', '2.0.3'
gem 'jekyll-paginate', '1.1.0'
gem 'liquid-c', '4.0.0' # speed-up site generation
diff --git a/docs/Gemfile.lock b/docs/Gemfile.lock
index 09b02e8..68e66d3 100644
--- a/docs/Gemfile.lock
+++ b/docs/Gemfile.lock
@@ -1,22 +1,23 @@
GEM
remote: https://rubygems.org/
specs:
- addressable (2.4.0)
+ addressable (2.6.0)
+ public_suffix (>= 2.0.2, < 4.0)
colorator (1.1.0)
- concurrent-ruby (1.0.5)
+ concurrent-ruby (1.1.5)
em-websocket (0.5.1)
eventmachine (>= 0.12.9)
http_parser.rb (~> 0.6.0)
- eventmachine (1.2.5)
- faraday (0.9.2)
+ eventmachine (1.2.7)
+ faraday (0.15.4)
multipart-post (>= 1.2, < 3)
- ffi (1.9.18)
+ ffi (1.11.1)
forwardable-extended (2.6.0)
hawkins (2.0.5)
em-websocket (~> 0.5)
jekyll (~> 3.1)
http_parser.rb (0.6.0)
- i18n (0.9.3)
+ i18n (0.9.5)
concurrent-ruby (~> 1.0)
jekyll (3.7.2)
addressable (~> 2.4)
@@ -33,14 +34,14 @@ GEM
safe_yaml (~> 1.0)
jekyll-multiple-languages (2.0.3)
jekyll-paginate (1.1.0)
- jekyll-sass-converter (1.5.1)
+ jekyll-sass-converter (1.5.2)
sass (~> 3.4)
- jekyll-watch (2.0.0)
+ jekyll-watch (2.2.1)
listen (~> 3.0)
- json (2.0.4)
- kramdown (1.16.2)
+ json (2.2.0)
+ kramdown (1.17.0)
libv8 (3.16.14.19)
- liquid (4.0.0)
+ liquid (4.0.3)
liquid-c (4.0.0)
liquid (>= 3.0.0)
listen (3.1.5)
@@ -48,43 +49,44 @@ GEM
rb-inotify (~> 0.9, >= 0.9.7)
ruby_dep (~> 1.2)
mercenary (0.3.6)
- multipart-post (2.0.0)
- octokit (4.3.0)
- sawyer (~> 0.7.0, >= 0.5.3)
- pathutil (0.16.1)
+ multipart-post (2.1.1)
+ octokit (4.14.0)
+ sawyer (~> 0.8.0, >= 0.5.3)
+ pathutil (0.16.2)
forwardable-extended (~> 2.6)
- rb-fsevent (0.10.2)
- rb-inotify (0.9.10)
- ffi (>= 0.5.0, < 2)
+ public_suffix (3.1.1)
+ rb-fsevent (0.10.3)
+ rb-inotify (0.10.0)
+ ffi (~> 1.0)
ref (2.0.0)
- rouge (3.1.1)
+ rouge (3.8.0)
ruby_dep (1.5.0)
- safe_yaml (1.0.4)
- sass (3.5.5)
+ safe_yaml (1.0.5)
+ sass (3.7.4)
sass-listen (~> 4.0.0)
sass-listen (4.0.0)
rb-fsevent (~> 0.9, >= 0.9.4)
rb-inotify (~> 0.9, >= 0.9.7)
- sawyer (0.7.0)
- addressable (>= 2.3.5, < 2.5)
- faraday (~> 0.8, < 0.10)
- therubyracer (0.12.2)
- libv8 (~> 3.16.14.0)
+ sawyer (0.8.2)
+ addressable (>= 2.3.5)
+ faraday (> 0.8, < 2.0)
+ therubyracer (0.12.3)
+ libv8 (~> 3.16.14.15)
ref
PLATFORMS
ruby
DEPENDENCIES
- addressable (= 2.4.0)
+ addressable (= 2.6.0)
hawkins
jekyll (= 3.7.2)
jekyll-multiple-languages (= 2.0.3)
jekyll-paginate (= 1.1.0)
- json (= 2.0.4)
+ json (= 2.2.0)
liquid-c (= 4.0.0)
- octokit (~> 4.3.0)
- therubyracer (= 0.12.2)
+ octokit (= 4.14.0)
+ therubyracer (= 0.12.3)
RUBY VERSION
ruby 2.3.1p112
[flink] 04/05: [FLINK-13726][docs] Build docs with jekyll
4.0.0.pre.beta1
Posted by nk...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
nkruber pushed a commit to branch docs_experimental__docs
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 0b230694b3011af274b75334f11b476d960fc3b2
Author: Nico Kruber <ni...@ververica.com>
AuthorDate: Wed Aug 14 23:05:00 2019 +0200
[FLINK-13726][docs] Build docs with jekyll 4.0.0.pre.beta1
This significantly reduces the build times, on my machine from 140s to 47s!
This closes #9444
---
docs/.gitignore | 3 ++-
docs/Gemfile | 4 ++--
docs/Gemfile.lock | 19 +++++++++++--------
docs/README.md | 3 +--
4 files changed, 16 insertions(+), 13 deletions(-)
diff --git a/docs/.gitignore b/docs/.gitignore
index 98b6f6b..6b3ce42 100644
--- a/docs/.gitignore
+++ b/docs/.gitignore
@@ -1,6 +1,7 @@
.bundle/
.jekyll-metadata
+.jekyll-cache/
.rubydeps/
content/
ruby2/.bundle/
-ruby2/.rubydeps/
\ No newline at end of file
+ruby2/.rubydeps/
diff --git a/docs/Gemfile b/docs/Gemfile
index ef5086e..f7ff66a 100644
--- a/docs/Gemfile
+++ b/docs/Gemfile
@@ -18,9 +18,9 @@
source 'https://rubygems.org'
-ruby '>= 2.1.0'
+ruby '>= 2.4.0'
-gem 'jekyll', '3.7.2'
+gem 'jekyll', '4.0.0.pre.beta1'
gem 'addressable', '2.6.0'
gem 'octokit', '4.14.0'
gem 'therubyracer', '0.12.3'
diff --git a/docs/Gemfile.lock b/docs/Gemfile.lock
index f6aedee..185af92 100644
--- a/docs/Gemfile.lock
+++ b/docs/Gemfile.lock
@@ -14,20 +14,21 @@ GEM
ffi (1.11.1)
forwardable-extended (2.6.0)
http_parser.rb (0.6.0)
- i18n (0.9.5)
+ i18n (1.6.0)
concurrent-ruby (~> 1.0)
- jekyll (3.7.2)
+ jekyll (4.0.0.pre.beta1)
addressable (~> 2.4)
colorator (~> 1.0)
em-websocket (~> 0.5)
- i18n (~> 0.7)
+ i18n (>= 0.9.5, < 2)
jekyll-sass-converter (~> 1.0)
jekyll-watch (~> 2.0)
- kramdown (~> 1.14)
+ kramdown (~> 2.1)
+ kramdown-parser-gfm (~> 1.0)
liquid (~> 4.0)
mercenary (~> 0.3.3)
pathutil (~> 0.9)
- rouge (>= 1.7, < 4)
+ rouge (~> 3.0)
safe_yaml (~> 1.0)
jekyll-multiple-languages (2.0.3)
jekyll-paginate (1.1.0)
@@ -36,7 +37,9 @@ GEM
jekyll-watch (2.2.1)
listen (~> 3.0)
json (2.2.0)
- kramdown (1.17.0)
+ kramdown (2.1.0)
+ kramdown-parser-gfm (1.1.0)
+ kramdown (~> 2.0)
libv8 (3.16.14.19)
liquid (4.0.3)
liquid-c (4.0.0)
@@ -80,7 +83,7 @@ PLATFORMS
DEPENDENCIES
addressable (= 2.6.0)
- jekyll (= 3.7.2)
+ jekyll (= 4.0.0.pre.beta1)
jekyll-multiple-languages (= 2.0.3)
jekyll-paginate (= 1.1.0)
json (= 2.2.0)
@@ -90,7 +93,7 @@ DEPENDENCIES
therubyracer (= 0.12.3)
RUBY VERSION
- ruby 2.3.1p112
+ ruby 2.6.3p62
BUNDLED WITH
1.17.2
diff --git a/docs/README.md b/docs/README.md
index 924fcba..c3d5f63 100644
--- a/docs/README.md
+++ b/docs/README.md
@@ -42,8 +42,7 @@ If you call the script with the preview flag `build_docs.sh -p`, Jekyll will
start a web server at `localhost:4000` and watch the docs directory for
updates. Use this mode to preview changes locally.
-If you have ruby 2.0 or greater,
-you can call the script with the incremental flag `build_docs.sh -i`.
+You can call the script with the incremental flag `build_docs.sh -i`.
Jekyll will then serve a live preview at `localhost:4000`,
and it will be much faster because it will only rebuild the pages corresponding
to files that are modified. Note that if you are making changes that affect