You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/01/13 07:25:18 UTC
[GitHub] [pinot] chimucong opened a new pull request #8012: pinot-druid-benchmark: set the multiValueDelimiterEnabled to false
chimucong opened a new pull request #8012:
URL: https://github.com/apache/pinot/pull/8012
I ran into trouble when running the benchmark.
When importing the TPC-H data, the exception occurs:
```bash
java.lang.RuntimeException: Caught exception while transforming data type for column: l_comment
...
Caused by: java.lang.IllegalArgumentException: Cannot read single-value from Object[]: [y express dolphins use blithely, s] for column: l_comment
...
```
The corresponding row in TPC-H data that causes this exception is
```text
21339361|1373339|73391|4|29|40955.83|0.04|0.04|A|F|1992-01-02|1992-03-14|1992-01-19|DELIVER IN PERSON|MAIL|y express dolphins use blithely; s|
```
which has a semicolon in the `l_comment` column.
For `org.apache.pinot.plugin.inputformat.csv.CSVRecordReaderConfig`, `multiValueDelimiterEnabled` is set to `true` by default, and the `DEFAULT_MULTI_VALUE_DELIMITER` is `;`.
To avoid the `l_comment` being parsed as multiple values, the `multiValueDelimiterEnabled` has to be set to `true` explicitly in the job-spec.yml file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang merged pull request #8012: pinot-druid-benchmark: set the multiValueDelimiterEnabled to false
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang merged pull request #8012:
URL: https://github.com/apache/pinot/pull/8012
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org