You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hop.apache.org by ha...@apache.org on 2021/12/21 15:44:48 UTC

[incubator-hop] branch master updated (05f98a0 -> 27be9ef)

This is an automated email from the ASF dual-hosted git repository.

hansva pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hop.git.


    from 05f98a0  Merge pull request #1236 from hansva/master
     new 4f52d5f  HOP-3571 : Files with a UTF-8-BOM encoding are read incorrectly
     new 58ece28  HOP-3288 : Null Pointer exception in Parquet Output
     new 501baeb  HOP-3288 : Null Pointer exception in Parquet Output (rat exclusion)
     new 27be9ef  Merge pull request #1237 from mattcasters/master

The 3288 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 ...names-basic.hpl => 0038-getfilenames-basic.hpl} |   0
 ...omfield.hpl => 0038-getfilenames-fromfield.hpl} |   0
 ...hpl => 0038-getfilenames-nofiles-exception.hpl} |   0
 ...mes-regexp.hpl => 0038-getfilenames-regexp.hpl} |   0
 .../transforms/0039-csv-input-utf-bom.hpl          |  65 ++++------
 ...dation.hpl => 0040-text-file-input-utf-bom.hpl} | 138 ++++++++-------------
 .../datasets/golden-csv-input-utf-bom.csv          |   6 +
 .../transforms/files/data-with-utf-8-bom.csv       |   5 +
 ...e-tests-group.hwf => main-0038-getfilename.hwf} |  38 +++---
 ...ow-denormaliser.hwf => main-0039-csv-input.hwf} |  36 ++++--
 ...ache-tika.hwf => main-0040-text-file-input.hwf} |  53 +++-----
 ...s-output.json => golden-csv-input-utf-bom.json} |  20 +--
 ... UNIT.json => 0039-csv-input-utf-bom UNIT.json} |  21 ++--
 ...json => 0040-text-file-input-utf-bom UNIT.json} |  19 ++-
 .../transforms/output/ParquetWriteSupport.java     |   2 +-
 pom.xml                                            |   1 +
 .../common/GetFieldsSampleDataDialog.java          |  20 +--
 .../common/ICsvInputAwareTransformDialog.java      |  17 ++-
 .../transform/common/TextFileLineUtil.java         |  10 +-
 19 files changed, 211 insertions(+), 240 deletions(-)
 rename integration-tests/transforms/{0037-getfilenames-basic.hpl => 0038-getfilenames-basic.hpl} (100%)
 rename integration-tests/transforms/{0037-getfilenames-fromfield.hpl => 0038-getfilenames-fromfield.hpl} (100%)
 rename integration-tests/transforms/{0037-getfilenames-nofiles-exception.hpl => 0038-getfilenames-nofiles-exception.hpl} (100%)
 rename integration-tests/transforms/{0037-getfilenames-regexp.hpl => 0038-getfilenames-regexp.hpl} (100%)
 copy plugins/transforms/textfile/src/main/samples/transforms/csvinput-basic.hpl => integration-tests/transforms/0039-csv-input-utf-bom.hpl (69%)
 copy integration-tests/transforms/{0021-row-denormaliser-beam-validation.hpl => 0040-text-file-input-utf-bom.hpl} (74%)
 create mode 100644 integration-tests/transforms/datasets/golden-csv-input-utf-bom.csv
 create mode 100644 integration-tests/transforms/files/data-with-utf-8-bom.csv
 rename integration-tests/transforms/{main-0037-getfilename-tests-group.hwf => main-0038-getfilename.hwf} (85%)
 copy integration-tests/transforms/{main-0021-row-denormaliser.hwf => main-0039-csv-input.hwf} (67%)
 copy integration-tests/transforms/{main-0037-apache-tika.hwf => main-0040-text-file-input.hwf} (68%)
 copy integration-tests/transforms/metadata/dataset/{golden-get-variables-output.json => golden-csv-input-utf-bom.json} (63%)
 copy integration-tests/transforms/metadata/unit-test/{0030-data-grid UNIT.json => 0039-csv-input-utf-bom UNIT.json} (64%)
 copy integration-tests/transforms/metadata/unit-test/{0030-data-grid UNIT.json => 0040-text-file-input-utf-bom UNIT.json} (68%)