You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hop.apache.org by ha...@apache.org on 2022/02/08 16:48:41 UTC
[hop] branch 2.0.0 updated (92178d8 -> 980d026)
This is an automated email from the ASF dual-hosted git repository.
hansva pushed a change to branch 2.0.0
in repository https://gitbox.apache.org/repos/asf/hop.git.
from 92178d8 Merge pull request #1328 from pscigala/HOP-3606
new 6bfe4e8 update version for rebase
new 112e776 HOP-3504 KafkaConsumerInput: manage exceptions the soft way
new 095ac26 HOP-3504 Managed called pipeline re-initialization whenever an exception is raised
new dcffa9c HOP-3504 Added fields in output to the error path of KafkaConsumer as soon as getFields method is called. Updated KafkaConsumer documentation.
new 7352dae HOP-3504 Added Kafka container to actual set of container used for integration tests. Added kafka integration tests.
new 62c9af3 HOP-3570 Fixed a typo in test's name.
new 25203da Merge pull request #1244 from sramazzina/HOP-3504.2
new 2fc2d57 HOP-3562 removed 'incubating' and 'incubator' references from a variety of files, removed DISCLAIMER
new 93aa996 Merge pull request #1254 from bamaer/HOP-3562
new 932ad31 HOP-3599 : Improve documentation of the Apache Flink pipeline configuration
new 85dd867 HOP-3600 : Beam Flink Run causes Hadoop classpath error
new 9de0eab HOP-3601 : The Flink pipeline run configuration always runs embedded
new e4c58e8 HOP-3600 : Beam Flink Run causes Hadoop classpath error HOP-3603 : Update the Beam flink runner to 1.13
new 882abc0 HOP-3599 : Improve documentation of the Apache Flink pipeline configuration HOP-3600 : Beam Flink Run causes Hadoop classpath error HOP-3601 : The Flink pipeline run configuration always runs embedded HOP-3603 : Update the Beam flink runner to 1.13
new 3d8f399 HOP-3599 : Improve documentation of the Apache Flink pipeline configuration HOP-3600 : Beam Flink Run causes Hadoop classpath error HOP-3601 : The Flink pipeline run configuration always runs embedded HOP-3603 : Update the Beam flink runner to 1.13
new d478475 HOP-3600 : Beam Flink Run causes Hadoop classpath error
new 0f645ec Merge pull request #1262 from mattcasters/master
new 5e3a70e HOP-3424 RepeatDialog: fix hardcoded strings. Minor improvements to italian translations
new 1341f29 [FIX] Cleaned up unneeded file. Same file with more entries under the resource folder (right place).
new e88af28 Merge pull request #1253 from sramazzina/HOP-3424
new 6e25a09 Update H2 to 2.0.206
new 30ba33a Merge pull request #1263 from Chromico/master
new 7410ba9 [NEW YEAR] Update year in NOTICE
new 4a21782 Merge pull request #1267 from hansva/master
new 336e447 HOP-3661 : Docker: make project and environment name settings optional
new 38ad38e HOP-3661 : Docker: make project and environment name settings optional
new 84b92f2 HOP-3669 : Database Lookup performance degraded
new 62c35fd HOP-3671 : Beam: failing integration test
new 6dbb1af Merge pull request #1265 from mattcasters/master
new 92f4399 HOP-3585 No result file in Process files with Move operation. HOP-3670 Process filenames action returns wrong status. Minor refactoring on costant name
new 4756921 Merge pull request #1266 from sramazzina/HOP-3525
new 16e93b0 HOP-3586 Unable to remove "Insert data from transform" from TableInput - Fix update of TransformIOMeta - Remove unused method: checkCancel and variable: changedInDialog
new d1bb46c Merge pull request #1264 from nadment/HOP-3586
new 8dca98b HOP-3605 Get Filenames: exception raised on opening the dialog
new 900361a HOP-3579 Get Filenames: cannot set a "limit" value in "Get file names" transform
new 6dade23 HOP-3580 Enhancement to Get Filenames transform documentation to explain better how things works when choosing to raise exceptions
new 070c1b7 HOP-3579 Fixed limit statement
new f5063f7 Merge pull request #1255 from sramazzina/GETFILENAMES
new 8e9e81a HOP-3579: fix integration test
new b112a07 Merge pull request #1271 from hansva/master
new 16e8874 HOP-3675 : Add service account option to the Beam Dataflow pipeline options
new 4a4bda9 HOP-3676 : Beam Dataflow add tooltips for the various options HOP-3677 : Beam Dataflow: add service options
new fc08c2a Merge pull request #1272 from mattcasters/master
new fca3774 Update h2.adoc
new 471b13b Merge pull request #1273 from nadment/patch-2
new 6630ac3 HOP-3591 ActionWorkflow: input filenames result collection is empty
new dc4d678 Merge pull request #1270 from sramazzina/HOP-3591
new 5e54238 HOP-3673 Connections not closed if a pipeline is run with transactional flag set
new 7db4d7d HOP-3673 Minor improvements
new 2044245 HOP-3673 Code refactoring
new 993a960 Merge pull request #1268 from sramazzina/COMMIT-MISSING
new 423ba3d HOP-3584 Table Input: unable to use variable for connection field. HOP-3674 Insert/Update: unable to use a variable as connection name
new 8425279 Merge pull request #1269 from sramazzina/HOP-3584
new 0e1a87a HOP-3682 MailAction: attachments not sent on an email
new cb0899d HOP-3682 Added integration tests
new 8859a8d Merge pull request #1277 from sramazzina/action-email
new a01fd13 [RELEASE] Update LICENSE FILE
new 9ee4516 Merge pull request #1278 from hansva/master
new f4068b2 [RELEASE] Update versions
new b9467b3 Merge pull request #1279 from hansva/master
new 9f960bd [DOCS] fix latest reference
new d76ffe7 Merge pull request #1280 from hansva/master
new aa3ca91 Support Timestamp type in HopRowCoder
new c7b4529 Support byte[] and InetAddress in HopRowCoder
new dee4c02 Merge pull request #1276 from shlxue/master
new ddd5516 HOP-3680 : Run SSH commands transform does not accept any input from other transforms
new 3a86414 HOP-3685 : Metadata annotation defaultBoolean is not used
new 05dfec1 HOP-3684 : Clean up the Neo4j connection dialog
new ec865b8 HOP-3688 : Update Avro libraries to version 1.11.0
new 35acae1 Merge pull request #1274 from mattcasters/master
new 9777320 HOP-3667 initial adoc version of Stefan Klaffke's tutorial
new cdd00dc Merge pull request #1281 from bamaer/HOP-3667
new 4b7da46 HOP-3667 replace & by & to avoid website build errors
new 4e1a940 Merge pull request #1282 from bamaer/HOP-3667
new ee336c8 HOP-3667 escape entire url to avoid parsing issues
new 141f6fe Merge pull request #1283 from bamaer/HOP-3667
new 6345106 HOP-3667 escape entire url to avoid parsing issues
new 73108b2 Merge pull request #1284 from bamaer/HOP-3667
new 7e8ef62 Sonar cleanup
new 5f46fe9 Merge pull request #1288 from gvdutra/master
new 1e461be HOP-3696 PipelineExecutor: NullPointerException when no rows are coming in
new 4534101 Merge pull request #1286 from sramazzina/HOP-3696
new e47a8b3 upgrade to poi 5.2.0
new b95136f fix compile issues
new 079cd26 Update StaxPoiWorkbook.java
new ad49e4b Update BaseExcelParsingTest.java
new a575a97 Merge remote-tracking branch 'upstream/master' into HOP-3681-upgrade-poi
new 4bd594a use poi transitive dependencies
new e375082 extend assembles
new 8a424b4 Merge pull request #1275 from pjfanning/HOP-3681-upgrade-poi
new 2d40414 Doc Oracle TIP
new e399995 Merge pull request #1290 from nadment/master
new 35343f1 HOP-3703 Improve the setup-dev-environment doc
new b86cd4b Merge pull request #1292 from gvdutra/HOP-3703
new ae1c4c8 [HOP-3704] remove poi dependency from jsoninput
new 691b267 Merge pull request #1293 from pjfanning/HOP-3704-remove-poi-from-jsoninput
new 3284985 Doc typo case
new 178af5a update nav.adoc
new 1c5c4c4 Merge pull request #1294 from nadment/Typo
new 502d875 [HOP3705] remove poi dependency from xml plugin
new 8564bf2 add back dependency removed in error
new bf79201 Merge pull request #1295 from pjfanning/HOP-3705-remove-poi-from-xml
new 294df2f HOP-3706: use correct name of poi-ooxml-schemas jar (jar name changed for poi 5 - but tika uses poi 4)
new ef1045b poi 4.1.2 licenses
new cbaaa4b Merge pull request #1297 from pjfanning/HOP-3706-tika-poi
new a9e0191 HOP-1877 - update file translate from pt_BR report
new 23a5cf4 Merge pull request #1296 from ambientelivre/master
new c6ebd4b HOP-3040 Add Brazilian translations
new 527b6fc Merge pull request #1302 from gvdutra/HOP-3040
new a8d8976 HOP-3202 Code cleanup and Sonar issues
new 981fe07 Merge pull request #1301 from gvdutra/HOP-3202
new bd270ad Update README.md
new f221f65 Merge pull request #1311 from nadment/patch-3
new 62ebd1a HOP-2906 Review of french translation files
new b4eab46 HOP-2906: switch file to LF to align with rest
new 969012d Merge pull request #1310 from nadment/HOP-2906
new fd3bcfa HOP-3700 HopLogStore: value read for maxLogTimeoutMinutes is wrong
new e88b030 Merge pull request #1308 from sramazzina/MEMORYLEAK
new 4e84dfa HOP-3714 - Automatically display the shortcut in the GuiToolbarItem and Perspective toolitem tooltip - Add F5 shortcut to refresh meta perspective - Replace CCombo with Combo in PluginPerspective
new 7d85aa2 Merge pull request #1306 from nadment/HOP-3714
new 8f1eb65 HOP-3242 RuntimeException copying & pasting a step
new 8f0adff Merge pull request #1299 from gvdutra/HOP-3242
new 1b26677 HOP-3202 Code cleanup and Sonar issues
new d6e5e8a Merge pull request #1312 from gvdutra/HOP-3202
new 6ea3860 HOP-1857 Data set: Show error if filename or path is wrong
new 88c58b7 Merge pull request #1300 from gvdutra/HOP-1857
new e9a86fd HOP-3708: add arm support to hop image
new df840b3 Merge pull request #1313 from hansva/master
new 8087785 HOP-3708: try to fix arm build
new 6a97ce1 Merge pull request #1314 from hansva/master
new 1c8fbc2 HOP-3708
new cfbd583 Merge pull request #1316 from hansva/master
new 43fb4fa HOP-3708: reactivate regular build
new 4feb4b8 Merge pull request #1317 from hansva/master
new 2f078cf HOP-2906 French translation + Tika i18n
new a9ea5e2 Merge pull request #1315 from nadment/HOP-2906
new c1c6350 HOP-3719 Fix Multiway Merge Join transforms fail select keys
new d6ce40e Merge pull request #1318 from nadment/HOP-3719
new 58dcae0 HOP-3708: add arm swt for linux
new 4af90f4 Merge pull request #1320 from hansva/master
new 09ae74f Fix i18n category
new 21e7b2f Merge pull request #1321 from nadment/XXX
new da85827 batik 1.14
new bc2e4ad Merge pull request #1323 from pjfanning/batik
new b115353 upgrade xerces to 2.12.2
new 1e13543 Update LICENSE
new 8e5a9c6 Merge pull request #1322 from pjfanning/upgrade
new d5e451a HOP-3040 Add Brazilian translations
new adee074 Merge pull request #1324 from gvdutra/HOP-3040
new 0a5bbc7 [DOC] update sniffTransform docs
new 5b679b7 Merge pull request #1325 from hansva/master
new b8d8115 [DOC] version change
new 74421fe Merge pull request #1326 from hansva/master
new 6ea6799 Revert "[DOC] version change"
new 2767e04 Merge pull request #1327 from hansva/master
new 40d18e7 HOP-1981 Fix encoding issue on br translation
new c966d04 Merge pull request #1329 from gvdutra/HOP-1981
new 0411eef Create CONTRIBUTING.md
new 6193b36 (Doc) added apache license header
new 080b15e Merge pull request #1330 from gvdutra/patch-1
new 6d25b86 HOP-3724 DatabaseConnectionMap takes to memory leaks conditions in long running processes
new d03d247 Merge pull request #1331 from sramazzina/MEMORYLEAK
new 043e961 [DOC] change version number
new 1d851a2 Merge pull request #1333 from hansva/master
new 1c6a717 [HOP-3733] update httpclient due to cve
new 50d701c Merge pull request #1336 from pjfanning/patch-1
new 5237a37 [HOP-3734] upgrade postgres driver due to security issue
new e16df55 Merge pull request #1337 from pjfanning/HOP-3734-postgres
new 0fea586 [DOC] add Register Pipeline example
new 4148f76 Merge pull request #1338 from hansva/master
new 9a94e0b [DOC] change pre-release version
new 31a2c9b Merge pull request #1339 from hansva/master
new 93191ad HOP-3737: fix documentation url for snapshot
new 27608f3 Merge pull request #1340 from hansva/master
new 804ae96 Hop-3730 Clear the JarCache in HopGui, HopRun and HopServer to free up memory
new 98e2764 Merge pull request #1335 from nadment/HOP-3730
new fd54d11 [HOP-3733] another reference to old httpclient
new cd6f277 Update pom.xml
new e93cfa4 Update pom.xml
new 24a6395 Merge pull request #1341 from pjfanning/patch-1
new 988c2a1 [HOP-3732] standardise on xerces 2.12.2
new fe690db Merge pull request #1342 from pjfanning/HOP-3732-upgrade-xerces
new b06f805 Merge remote-tracking branch 'origin/master' into 2.0.0
new 28d31ee set version back to 2.0.0-SNAPSHOT
new 980d026 Merge pull request #1344 from hansva/2.0.0
The 3577 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CONTRIBUTING.md | 64 +
DISCLAIMER | 6 -
Jenkinsfile | 7 +-
LICENSE | 4 +-
NOTICE | 4 +-
README.md | 4 +-
assemblies/client/pom.xml | 13 +
assemblies/client/src/assembly/assembly.xml | 9 +
assemblies/core/lib/pom.xml | 4 +-
assemblies/plugins/databases/h2-assemblies/pom.xml | 4 +-
.../databases/postgresql-assemblies/pom.xml | 2 +-
assemblies/plugins/engines/beam/pom.xml | 74 +-
.../plugins/engines/beam/src/assembly/assembly.xml | 32 +-
assemblies/plugins/tech/avro/pom.xml | 2 +-
assemblies/plugins/tech/aws/pom.xml | 4 +-
.../tech/cassandra/src/assembly/assembly.xml | 1 -
.../plugins/tech/google/src/assembly/assembly.xml | 1 -
assemblies/plugins/tech/parquet/pom.xml | 2 +-
assemblies/plugins/transforms/excelinput/pom.xml | 39 +-
.../excelinput/src/assembly/assembly.xml | 51 +-
assemblies/plugins/transforms/excelwriter/pom.xml | 28 +-
.../excelwriter/src/assembly/assembly.xml | 51 +-
assemblies/plugins/transforms/json/pom.xml | 13 +-
.../transforms/json/src/assembly/assembly.xml | 1 -
assemblies/plugins/transforms/ssh/pom.xml | 6 +-
.../transforms/ssh/src/assembly/assembly.xml | 2 +-
assemblies/plugins/transforms/xml/pom.xml | 7 -
.../transforms/xml/src/assembly/assembly.xml | 7 -
assemblies/static/src/main/resources/LICENSE | 678 +++++---
assemblies/static/src/main/resources/hop-conf.sh | 8 +-
assemblies/static/src/main/resources/hop-gui.sh | 8 +-
assemblies/static/src/main/resources/hop-import.sh | 8 +-
assemblies/static/src/main/resources/hop-run.sh | 8 +-
assemblies/static/src/main/resources/hop-search.sh | 8 +-
assemblies/static/src/main/resources/hop-server.sh | 8 +-
.../static/src/main/resources/hop-translator.sh | 8 +-
.../src/main/resources/licenses/LICENSE-BOUNCY | 8 +
.../src/main/resources/licenses/LICENSE-UNRAR | 42 +
core/pom.xml | 13 +-
core/src/main/java/org/apache/hop/core/Const.java | 33 +-
.../org/apache/hop/core/database/Database.java | 7 +-
.../core/database/map/DatabaseConnectionMap.java | 2 +-
.../hop/core/extension/HopExtensionPoint.java | 8 +-
.../hop/core/gui/plugin/key/KeyboardShortcut.java | 4 +-
.../apache/hop/core/plugins/PluginRegistry.java | 12 +-
.../org/apache/hop/core/svg/HopSvgGraphics2D.java | 53 +-
.../java/org/apache/hop/core/util/StringUtil.java | 130 +-
.../serializer/json/JsonMetadataParser.java | 11 +
.../apache/hop/server/ServerConnectionManager.java | 39 +-
.../hop/core/messages/messages_pt_PT.properties | 22 +-
.../core/vfs}/messages/messages_pt_BR.properties | 6 +-
.../hop/i18n/messages/messages_pt_BR.properties | 93 +-
.../test/java/org/apache/hop/core/ConstTest.java | 42 +-
docker/Dockerfile | 25 +-
.../integration-tests/integration-tests-kafka.yaml | 48 +
docker/resources/load-and-execute.sh | 233 ++-
docker/resources/run.sh | 30 +-
docs/hop-dev-manual/antora.yml | 3 +-
docs/hop-dev-manual/modules/.asciidoctor/pom.xml | 4 +-
.../pages/apache-release/checking-a-release.adoc | 24 +-
.../pages/apache-release/creating-a-release.adoc | 50 +-
.../pages/apache-release/promoting-a-release.adoc | 24 +-
.../modules/ROOT/pages/integration-testing.adoc | 4 +-
.../modules/ROOT/pages/metadata-plugins.adoc | 4 +-
.../modules/ROOT/pages/plugin-development.adoc | 2 +-
.../modules/ROOT/pages/setup-dev-environment.adoc | 20 +-
docs/hop-dev-manual/pom.xml | 4 +-
docs/hop-doc-resources/pom.xml | 2 +-
docs/hop-tech-manual/antora.yml | 3 +-
docs/hop-tech-manual/modules/.asciidoctor/pom.xml | 4 +-
.../modules/ROOT/pages/docker-container.adoc | 12 +-
docs/hop-tech-manual/pom.xml | 4 +-
docs/hop-user-manual/antora.yml | 5 +-
docs/hop-user-manual/modules/.asciidoctor/pom.xml | 4 +-
.../web-services-in-docker/json-output.png | Bin 0 -> 175410 bytes
.../web-services-in-docker/metadata.png | Bin 0 -> 128946 bytes
.../web-services-in-docker/pipeline.png | Bin 0 -> 26079 bytes
.../web-services-in-docker/result.png | Bin 0 -> 19962 bytes
.../simplified-architecture.png | Bin 0 -> 244385 bytes
docs/hop-user-manual/modules/ROOT/nav.adoc | 10 +-
.../ROOT/pages/database/databases/firebird.adoc | 2 +-
.../modules/ROOT/pages/database/databases/h2.adoc | 2 +-
.../ROOT/pages/database/databases/informix.adoc | 2 +-
.../ROOT/pages/database/databases/ingres.adoc | 2 +-
.../ROOT/pages/database/databases/monetdb.adoc | 2 +-
.../ROOT/pages/database/databases/oracle.adoc | 3 +
.../modules/ROOT/pages/hop-gui/hop-web.adoc | 6 +-
.../modules/ROOT/pages/hop-server/index.adoc | 2 +-
.../modules/ROOT/pages/hop-server/rest-api.adoc | 194 ++-
.../apache-hop-web-services-docker.adoc | 176 ++
.../databases/h2.adoc => how-to-guides/index.adoc} | 21 +-
.../metadata-types/neo4j/neo4j-connection.adoc | 50 +-
.../pipeline/beam/getting-started-with-beam.adoc | 19 +-
.../beam-dataflow-pipeline-engine.adoc | 14 +-
.../beam-flink-pipeline-engine.adoc | 72 +-
.../beam-spark-pipeline-engine.adoc | 18 +-
.../pages/pipeline/transforms/getfilenames.adoc | 12 +-
.../pages/pipeline/transforms/kafkaconsumer.adoc | 20 +-
.../ROOT/pages/pipeline/transforms/runssh.adoc | 4 +-
docs/hop-user-manual/pom.xml | 4 +-
docs/pom.xml | 2 +-
docs/site.yml | 2 +-
engine/pom.xml | 2 +-
.../java/org/apache/hop/pipeline/PipelineMeta.java | 6 +
.../pipeline/SingleThreadedPipelineExecutor.java | 159 +-
.../engines/local/LocalPipelineEngine.java | 69 +-
.../src/main/java/org/apache/hop/run/HopRun.java | 11 +
.../java/org/apache/hop/workflow/Workflow.java | 10 +-
.../engines/local/LocalWorkflowEngine.java | 81 +-
.../main/java/org/apache/hop/www/HopServer.java | 17 +-
.../core/auth}/messages/messages_pt_BR.properties | 6 +-
.../pipeline/messages/messages_pt_PT.properties | 374 ++--
.../workflow/messages/messages_pt_BR.properties | 31 +-
.../core/compress/CompressionInputStreamTest.java | 2 +-
.../core/compress/CompressionOutputStreamTest.java | 2 +-
.../compress/CompressionProviderFactoryTest.java | 2 +-
.../core/compress/NoneCompressionProviderTest.java | 2 +-
.../gzip/GzipCompressionInputStreamTest.java | 2 +-
.../gzip/GzipCompressionOutputStreamTest.java | 2 +-
.../compress/gzip/GzipCompressionProviderTest.java | 2 +-
.../snappy/SnappyCompressionInputStreamTest.java | 2 +-
.../snappy/SnappyCompressionOutputStreamTest.java | 2 +-
.../snappy/SnappyCompressionProviderTest.java | 2 +-
.../zip/ZipCompressionInputStreamTest.java | 2 +-
.../zip/ZipCompressionOutputStreamTest.java | 2 +-
.../compress/zip/ZipCompressionProviderTest.java | 2 +-
.../java/org/apache/hop/www/HopServerTest.java | 1 -
helm/hop-server/values.yaml | 2 +-
.../0004-addfilename-to-resultfilenames.hpl | 102 ++
.../actions/0004-use-result-filenames.hwf | 91 +
.../0004-verify-resultsfilenames-were-used.hpl} | 111 +-
...-actionworkflow-check-resultfilenames-used.hwf} | 146 +-
integration-tests/hopweb/pom.xml | 4 +-
.../0001-kafka-consumer-called-subpipeline.hpl | 112 ++
.../0001-kafka-consumer-read-record-basic.hpl | 145 ++
...504-kafka-consumer-called-subpipeline-error.hpl | 122 ++
.../HOP3504-kafka-consumer-read-record-error.hpl} | 175 +-
integration-tests/kafka/dev-env-config.json | 19 +
integration-tests/{xml => kafka}/hop-config.json | 0
.../main-0001-kafka-test-basic.hwf} | 150 +-
.../main-HOP3504-kafka-test-error-path.hwf} | 150 +-
.../metadata/pipeline-run-configuration/local.json | 0
.../metadata/workflow-run-configuration/local.json | 0
.../kafka/prepare-kafka-test-basic.hpl | 114 ++
.../{http => kafka}/project-config.json | 0
integration-tests/scripts/run-tests.sh | 6 +
.../transforms/0038-getfilenames-fromfield.hpl | 173 +-
...ames-regexp.hpl => 0038-getfilenames-limit.hpl} | 94 +-
.../transforms/0038-getfilenames-regexp.hpl | 89 +-
.../files/{sample-file2.txt => sample-file3.txt} | 0
.../transforms/main-0038-getfilename.hwf | 39 +-
.../messages/messages_en_US.properties | 4 +-
.../messages/messages_pt_BR.properties | 46 +
.../messages/messages_pt_BR.properties | 35 +
.../ActionCopyMoveResultFilenames.java | 7 +-
.../ActionCopyMoveResultFilenamesDialog.java | 4 +-
.../messages/messages_en_US.properties | 2 +-
.../messages/messages_en_US.properties | 4 +-
.../msgboxinfo/messages/messages_pt_BR.properties | 6 +-
.../hop/workflow/actions/repeat/EndRepeat.java | 4 +-
.../workflow/actions/repeat/EndRepeatDialog.java | 6 +-
.../apache/hop/workflow/actions/repeat/Repeat.java | 4 +-
.../hop/workflow/actions/repeat/RepeatDialog.java | 42 +-
.../repeat/messages/messages_en_US.properties | 34 +-
.../repeat/messages/messages_it_IT.properties | 48 +
.../repeat}/messages/messages_pt_BR.properties | 8 +-
.../messages/messages_pt_BR.properties | 7 +-
.../messages/messages_pt_BR.properties | 6 +-
.../shell}/messages/messages_pt_BR.properties | 8 +-
.../simpleeval/messages/messages_pt_BR.properties | 72 +-
.../messages/messages_pt_BR.properties | 8 +-
.../workflow/actions/workflow/ActionWorkflow.java | 1 +
.../messages/messages_pt_BR.properties | 6 +-
.../messages/messages_pt_BR.properties | 6 +-
plugins/databases/postgresql/pom.xml | 2 +-
plugins/engines/beam/pom.xml | 39 +-
.../apache/hop/beam/core/coder/HopRowCoder.java | 79 +-
.../beam/core/transform/TransformTransform.java | 6 +
.../BeamDataFlowPipelineRunConfiguration.java | 118 +-
.../flink/BeamFlinkPipelineRunConfiguration.java | 10 +-
.../spark/BeamSparkPipelineRunConfiguration.java | 2 +
.../HopPipelineMetaToBeamPipelineConverter.java | 88 +-
.../java/org/apache/hop/beam/run/MainBeam.java | 27 +-
.../bq}/messages/messages_pt_BR.properties | 6 +-
.../kafka}/messages/messages_pt_BR.properties | 6 +-
.../hop/beam/core/coder/HopRowCoderTest.java | 3 +-
.../engines/spark/BeamSparkPipelineEngineTest.java | 3 +-
plugins/misc/git/pom.xml | 2 +-
.../org/apache/hop/testing/DataSetCsvUtil.java | 4 +-
...PipelineMetaPriorToExecutionExtensionPoint.java | 6 +
plugins/tech/avro/pom.xml | 2 +-
plugins/tech/aws/pom.xml | 2 +-
plugins/tech/neo4j/pom.xml | 2 +-
.../hop/neo4j/perspective/HopNeo4jPerspective.java | 3 +-
.../apache/hop/neo4j/shared/DriverSingleton.java | 3 +-
.../org/apache/hop/neo4j/shared/NeoConnection.java | 114 +-
.../hop/neo4j/shared/NeoConnectionEditor.java | 587 ++++---
.../apache/hop/neo4j/transforms/cypher/Cypher.java | 7 +-
.../shared/messages/messages_en_US.properties | 6 +-
plugins/tech/parquet/pom.xml | 2 +-
.../output/messages/messages_pt_PT.properties | 33 +
.../addsequence/messages/messages_pt_BR.properties | 93 +-
.../transforms/constant/ConstantMetaTest.java | 2 +-
.../transforms/cubeinput/BaseParsingTest.java | 2 +-
.../messages/messages_it_IT.properties | 2 +-
.../databasejoin/DatabaseJoinMetaTest.java | 2 +-
.../transforms/databaselookup/DatabaseLookup.java | 39 +-
.../databaselookup/DatabaseLookupData.java | 3 +
.../pipeline/transforms/dbproc/DBProcMetaTest.java | 2 +-
.../transform/messages/messages_pt_PT.properties} | 6 +-
.../delete/messages/messages_it_IT.properties | 2 +-
.../pipeline/transforms/delete/DeleteMetaTest.java | 2 +-
.../dynamicsqlrow/DynamicSqlRowMetaTest.java | 2 +-
plugins/transforms/excelinput/pom.xml | 40 +-
.../transforms/excelinput/poi/PoiCell.java | 4 +-
.../transforms/excelinput/poi/PoiWorkbook.java | 13 +-
.../excelinput/staxpoi/StaxPoiSheet.java | 8 +-
.../excelinput/staxpoi/StaxPoiWorkbook.java | 1 +
.../excelinput/BaseExcelParsingTest.java | 9 +
.../transforms/excelinput/BaseParsingTest.java | 2 +-
.../excelinput/staxpoi/StaxPoiSheetTest.java | 7 +-
plugins/transforms/excelwriter/pom.xml | 39 +-
.../excelwriter/ExcelWriterTransform.java | 2 +-
.../transforms/execsqlrow/ExecSqlRowMetaTest.java | 2 +-
.../transforms/filterrows/FilterRowsMetaTest.java | 2 +-
.../transforms/getfilenames/GetFileNames.java | 4 +-
.../getfilenames/GetFileNamesDialog.java | 13 +-
.../messages/messages_it_IT.properties | 2 +-
.../getfilenames/GetFileNamesMetaTest.java | 2 +-
.../getvariable/GetVariableMetaTest.java | 2 +-
.../transforms/http/HttpMetaLoadSaveTest.java | 2 +-
.../transforms/httppost/HttpPostMetaTest.java | 2 +-
.../insertupdate/InsertUpdateDialog.java | 3 +-
.../pipeline/transforms/janino/JaninoMetaTest.java | 2 +-
.../transforms/javafilter/JavaFilterMetaTest.java | 2 +-
.../javascript/ScriptValuesMetaTest.java | 2 +-
.../transforms/joinrows/JoinRowsMetaTest.java | 2 +-
plugins/transforms/json/pom.xml | 18 +-
.../pipeline/transforms/jsoninput/JsonInput.java | 6 +-
.../kafka/consumer/KafkaConsumerInput.java | 130 +-
.../kafka/consumer/KafkaConsumerInputData.java | 4 +
.../kafka/consumer/KafkaConsumerInputMeta.java | 38 +
.../producer/messages/messages_it_IT.properties | 8 +-
.../transforms/ldapinput/LdapConnection.java | 6 +-
.../transforms/ldapinput/LdapInputMetaTest.java | 2 +-
.../hop/pipeline/transforms/mail/MailMetaTest.java | 2 +-
.../transforms/mailinput/MailInputMetaTest.java | 2 +-
.../input/MappingInputMetaCloningTest.java | 2 +-
.../transforms/mapping/SimpleMappingMetaTest.java | 2 +-
.../memgroupby/MemoryGroupByMetaTest.java | 2 +-
.../transforms/mergerows/MergeRowsMetaTest.java | 2 +-
.../multimerge/MultiMergeJoinDialog.java | 65 +-
.../multimerge/MultiMergeJoinMetaTest.java | 2 +-
.../transforms/normaliser/NormaliserMetaTest.java | 2 +-
plugins/transforms/pgbulkloader/pom.xml | 2 +-
.../pgbulkloader/PGBulkLoaderMetaTest.java | 4 +-
.../pgpdecryptstream/PGPDecryptStreamMetaTest.java | 2 +-
.../pgpencryptstream/PGPEncryptStreamMetaTest.java | 2 +-
.../pipelineexecutor/PipelineExecutor.java | 3 +-
.../messages/messages_it_IT.properties | 2 +-
.../transforms/processfiles/ProcessFiles.java | 2 +-
.../messages/messages_it_IT.properties | 28 +-
.../transforms/propertyinput/BaseParsingTest.java | 2 +-
.../propertyinput/PropertyInputMetaTest.java | 2 +-
.../transforms/regexeval/RegexEvalMetaTest.java | 2 +-
.../rowgenerator/RowGeneratorMetaTest.java | 2 +-
.../rowsfromresult/RowsFromResultMetaTest.java | 2 +-
.../salesforceinput/SalesforceInputDialog.java | 8 +-
.../transforms/salesforce/SalesforceMetaTest.java | 2 +-
.../salesforcedelete/SalesforceDeleteMetaTest.java | 2 +-
.../salesforceinput/SalesforceInputMetaTest.java | 2 +-
.../salesforceinsert/SalesforceInsertMetaTest.java | 2 +-
.../salesforceupdate/SalesforceUpdateMetaTest.java | 2 +-
.../salesforceupsert/SalesforceUpsertMetaTest.java | 2 +-
.../transforms/samplerows/SampleRowsMetaTest.java | 2 +-
.../transforms/sasinput/SasInputMetaTest.java | 2 +-
.../serverstatus/GetServerStatusMeta.java | 2 +-
.../setvalueconstant/SetValueConstantMetaTest.java | 2 +-
.../setvaluefield/SetValueFieldMetaTest.java | 2 +-
.../sql/messages/messages_it_IT.properties | 2 +-
.../pipeline/transforms/sql/ExecSqlMetaTest.java | 2 +-
.../sqlfileoutput/SQLFileOutputMetaTest.java | 2 +-
plugins/transforms/ssh/pom.xml | 6 +-
.../hop/pipeline/transforms/ssh/SSHMeta.java | 481 ------
.../hop/pipeline/transforms/ssh/SessionResult.java | 18 +-
.../pipeline/transforms/ssh/{SSH.java => Ssh.java} | 56 +-
.../transforms/ssh/{SSHData.java => SshData.java} | 97 +-
.../ssh/{SSHDialog.java => SshDialog.java} | 224 +--
.../hop/pipeline/transforms/ssh/SshMeta.java | 354 ++++
.../ssh/messages/messages_en_US.properties | 20 +-
.../ssh/messages/messages_fr_FR.properties | 4 +-
.../ssh/messages/messages_it_IT.properties | 4 +-
.../ssh/messages/messages_ja_JP.properties | 4 +-
.../hop/pipeline/transforms/ssh/SSHDataTest.java | 185 --
.../ssh/{SSHMetaTest.java => SshMetaTest.java} | 60 +-
.../streamlookup/StreamLookupMetaTest.java | 2 +-
.../transforms/stringcut/StringCutMetaTest.java | 2 +-
.../stringoperations/StringOperations.java | 4 +-
.../stringoperations/StringOperationsMetaTest.java | 2 +-
.../SynchronizeAfterMergeMetaTest.java | 2 +-
.../transforms/systemdata/SystemDataMetaTest.java | 2 +-
.../tablecompare/TableCompareMetaTest.java | 2 +-
.../transforms/tableinput/TableInputDialog.java | 64 +-
.../transforms/tableinput/TableInputMeta.java | 27 +-
.../tableinput/messages/messages_it_IT.properties | 2 +-
.../tableoutput/messages/messages_it_IT.properties | 2 +-
.../tableoutput/TableOutputMetaTest.java | 2 +-
.../transforms/csvinput/BaseParsingTest.java | 2 +-
.../transforms/csvinput/CsvInputMetaTest.java | 2 +-
.../transforms/fileinput/text/BaseParsingTest.java | 2 +-
.../textfileoutput/TextFileOutputTest.java | 2 +-
.../hop/pipeline/transforms/tika/TikaMeta.java | 8 +-
.../tika/messages/messages_en_US.properties | 3 +
.../tika/messages/messages_fr_FR.properties} | 4 +-
.../pipeline/transforms/update/UpdateMetaTest.java | 2 +-
.../valuemapper/ValueMapperMetaTest.java | 2 +-
.../webservices/WebServiceMetaLoadSaveTest.java | 2 +-
.../transforms/writetolog/WriteToLogMetaTest.java | 2 +-
plugins/transforms/xml/pom.xml | 7 -
.../xml/xmlinputstream/BaseParsingTest.java | 2 +-
.../xml/xsdvalidator/XsdValidatorIntTest.java | 22 +-
.../transforms/yamlinput/YamlInputMetaTest.java | 2 +-
.../zipfile/ZipFileMetaLoadSaveTest.java | 2 +-
pom.xml | 69 +-
.../org/apache/hop/ui/core/dialog/BaseDialog.java | 2 +-
.../apache/hop/ui/core/gui/GuiToolbarWidgets.java | 19 +-
.../main/java/org/apache/hop/ui/hopgui/HopGui.java | 18 +-
.../apache/hop/ui/hopgui/dialog/NotePadDialog.java | 2 +-
.../delegates/HopGuiPipelineClipboardDelegate.java | 7 +-
.../hopgui/file/workflow/HopGuiWorkflowGraph.java | 6 +-
.../perspective/dataorch/HopGuiAbstractGraph.java | 10 +-
.../perspective/explorer/ExplorerPerspective.java | 3 +-
.../perspective/metadata/MetadataPerspective.java | 2 +
.../HopPluginExplorePerspective.java | 4 +-
.../pipeline/messages/messages_it_IT.properties | 32 -
.../pipeline/messages/messages_fr_FR.properties | 10 +-
.../workflow/messages/messages_en_US.properties | 2 +-
.../workflow/messages/messages_fr_FR.properties | 1810 ++++++++++----------
.../workflow/messages/messages_it_IT.properties | 2 +-
.../ui/hopgui/messages/messages_en_US.properties | 2 +-
.../ui/hopgui/messages/messages_pt_BR.properties | 787 ++++-----
.../dataorch/messages/messages_en_US.properties | 2 +-
.../dataorch/messages/messages_it_IT.properties | 2 +-
.../explorer/messages/messages_en_US.properties | 6 +-
.../explorer/messages/messages_fr_FR.properties | 2 +-
.../explorer/messages/messages_it_IT.properties | 2 +-
.../metadata/messages/messages_en_US.properties | 2 +-
.../metadata/messages/messages_it_IT.properties | 2 +-
.../messages/messages_pt_PT.properties | 6 +-
.../search/messages/messages_pt_PT.properties | 7 +-
350 files changed, 6960 insertions(+), 5274 deletions(-)
create mode 100644 CONTRIBUTING.md
delete mode 100644 DISCLAIMER
create mode 100644 assemblies/static/src/main/resources/licenses/LICENSE-BOUNCY
create mode 100644 assemblies/static/src/main/resources/licenses/LICENSE-UNRAR
copy plugins/actions/repeat/src/main/resources/org/apache/hop/workflow/actions/repeat/messages/messages_en_US.properties => core/src/main/resources/org/apache/hop/core/messages/messages_pt_PT.properties (60%)
copy {plugins/actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => core/src/main/resources/org/apache/hop/core/vfs}/messages/messages_pt_BR.properties (78%)
create mode 100644 docker/integration-tests/integration-tests-kafka.yaml
create mode 100644 docs/hop-user-manual/modules/ROOT/assets/images/how-to-guides/web-services-in-docker/json-output.png
create mode 100644 docs/hop-user-manual/modules/ROOT/assets/images/how-to-guides/web-services-in-docker/metadata.png
create mode 100644 docs/hop-user-manual/modules/ROOT/assets/images/how-to-guides/web-services-in-docker/pipeline.png
create mode 100644 docs/hop-user-manual/modules/ROOT/assets/images/how-to-guides/web-services-in-docker/result.png
create mode 100644 docs/hop-user-manual/modules/ROOT/assets/images/how-to-guides/web-services-in-docker/simplified-architecture.png
create mode 100644 docs/hop-user-manual/modules/ROOT/pages/how-to-guides/apache-hop-web-services-docker.adoc
copy docs/hop-user-manual/modules/ROOT/pages/{database/databases/h2.adoc => how-to-guides/index.adoc} (65%)
copy {plugins/actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => engine/src/main/resources/org/apache/hop/core/auth}/messages/messages_pt_BR.properties (76%)
create mode 100644 integration-tests/actions/0004-addfilename-to-resultfilenames.hpl
create mode 100644 integration-tests/actions/0004-use-result-filenames.hwf
copy integration-tests/{transforms/0038-getfilenames-regexp.hpl => actions/0004-verify-resultsfilenames-were-used.hpl} (60%)
copy integration-tests/{transforms/main-0038-getfilename.hwf => actions/main-0004-actionworkflow-check-resultfilenames-used.hwf} (62%)
create mode 100644 integration-tests/kafka/0001-kafka-consumer-called-subpipeline.hpl
create mode 100644 integration-tests/kafka/0001-kafka-consumer-read-record-basic.hpl
create mode 100644 integration-tests/kafka/HOP3504-kafka-consumer-called-subpipeline-error.hpl
copy integration-tests/{transforms/0038-getfilenames-regexp.hpl => kafka/HOP3504-kafka-consumer-read-record-error.hpl} (51%)
create mode 100644 integration-tests/kafka/dev-env-config.json
copy integration-tests/{xml => kafka}/hop-config.json (100%)
copy integration-tests/{transforms/main-0038-getfilename.hwf => kafka/main-0001-kafka-test-basic.hwf} (51%)
copy integration-tests/{transforms/main-0038-getfilename.hwf => kafka/main-HOP3504-kafka-test-error-path.hwf} (51%)
copy integration-tests/{http => kafka}/metadata/pipeline-run-configuration/local.json (100%)
copy integration-tests/{http => kafka}/metadata/workflow-run-configuration/local.json (100%)
create mode 100644 integration-tests/kafka/prepare-kafka-test-basic.hpl
copy integration-tests/{http => kafka}/project-config.json (100%)
copy integration-tests/transforms/{0038-getfilenames-regexp.hpl => 0038-getfilenames-limit.hpl} (98%)
copy integration-tests/transforms/files/{sample-file2.txt => sample-file3.txt} (100%)
create mode 100644 plugins/actions/addresultfilenames/src/main/resources/org/apache/hop/workflow/actions/addresultfilenames/messages/messages_pt_BR.properties
create mode 100644 plugins/actions/checkdbconnection/src/main/resources/org/apache/hop/workflow/actions/checkdbconnection/messages/messages_pt_BR.properties
create mode 100644 plugins/actions/repeat/src/main/resources/org/apache/hop/workflow/actions/repeat/messages/messages_it_IT.properties
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => repeat/src/main/resources/org/apache/hop/workflow/actions/repeat}/messages/messages_pt_BR.properties (75%)
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => sendnagiospassivecheck/src/main/resources/org/apache/hop/workflow/actions/sendnagiospassivecheck}/messages/messages_pt_BR.properties (74%)
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => setvariables/src/main/resources/org/apache/hop/workflow/actions/setvariables}/messages/messages_pt_BR.properties (81%)
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => shell/src/main/resources/org/apache/hop/workflow/actions/shell}/messages/messages_pt_BR.properties (76%)
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => truncatetables/src/main/resources/org/apache/hop/workflow/actions/truncatetables}/messages/messages_pt_BR.properties (72%)
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => xml/src/main/resources/org/apache/hop/workflow/actions/xml/dtdvalidator}/messages/messages_pt_BR.properties (81%)
copy plugins/actions/{msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => xml/src/main/resources/org/apache/hop/workflow/actions/xml/xmlwellformed}/messages/messages_pt_BR.properties (81%)
copy plugins/{actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => engines/beam/src/main/resources/org/apache/hop/beam/transforms/bq}/messages/messages_pt_BR.properties (81%)
copy plugins/{actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo => engines/beam/src/main/resources/org/apache/hop/beam/transforms/kafka}/messages/messages_pt_BR.properties (82%)
create mode 100644 plugins/tech/parquet/src/main/resources/org/apache/hop/parquet/transforms/output/messages/messages_pt_PT.properties
copy plugins/{actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo/messages/messages_pt_BR.properties => transforms/delay/src/main/resources/org/apache/hop/pipeline/transform/messages/messages_pt_PT.properties} (82%)
delete mode 100644 plugins/transforms/ssh/src/main/java/org/apache/hop/pipeline/transforms/ssh/SSHMeta.java
rename plugins/transforms/ssh/src/main/java/org/apache/hop/pipeline/transforms/ssh/{SSH.java => Ssh.java} (79%)
rename plugins/transforms/ssh/src/main/java/org/apache/hop/pipeline/transforms/ssh/{SSHData.java => SshData.java} (55%)
rename plugins/transforms/ssh/src/main/java/org/apache/hop/pipeline/transforms/ssh/{SSHDialog.java => SshDialog.java} (85%)
create mode 100644 plugins/transforms/ssh/src/main/java/org/apache/hop/pipeline/transforms/ssh/SshMeta.java
delete mode 100644 plugins/transforms/ssh/src/test/java/org/apache/hop/pipeline/transforms/ssh/SSHDataTest.java
rename plugins/transforms/ssh/src/test/java/org/apache/hop/pipeline/transforms/ssh/{SSHMetaTest.java => SshMetaTest.java} (60%)
copy plugins/{actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo/messages/messages_pt_BR.properties => transforms/tika/src/main/resources/org/apache/hop/pipeline/transforms/tika/messages/messages_fr_FR.properties} (85%)
delete mode 100644 ui/src/main/org/apache/hop/ui/hopgui/file/pipeline/messages/messages_it_IT.properties
copy plugins/actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo/messages/messages_pt_BR.properties => ui/src/main/resources/org/apache/hop/ui/hopgui/perspective/pluginexplorer/messages/messages_pt_PT.properties (80%)
copy plugins/actions/msgboxinfo/src/main/resources/org/apache/hop/workflow/actions/msgboxinfo/messages/messages_pt_BR.properties => ui/src/main/resources/org/apache/hop/ui/hopgui/perspective/search/messages/messages_pt_PT.properties (76%)