You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pinot.apache.org by Pinot Slack Email Digest <ap...@gmail.com> on 2022/05/04 02:00:41 UTC
Apache Pinot Daily Email Digest (2022-05-03)
### _#general_
**@giacomo.barone:** @giacomo.barone has joined the channel
**@pekka.vuorio:** @pekka.vuorio has joined the channel
**@ryan.ariasruane:** @ryan.ariasruane has joined the channel
**@chris:** @chris has joined the channel
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#random_
**@giacomo.barone:** @giacomo.barone has joined the channel
**@pekka.vuorio:** @pekka.vuorio has joined the channel
**@ryan.ariasruane:** @ryan.ariasruane has joined the channel
**@chris:** @chris has joined the channel
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#feat-compound-types_
**@slacksync:** @slacksync has joined the channel
### _#feat-text-search_
**@slacksync:** @slacksync has joined the channel
### _#feat-rt-seg-complete_
**@slacksync:** @slacksync has joined the channel
### _#feat-presto-connector_
**@slacksync:** @slacksync has joined the channel
### _#feat-upsert_
**@slacksync:** @slacksync has joined the channel
### _#pinot-helix_
**@slacksync:** @slacksync has joined the channel
### _#group-by-refactor_
**@slacksync:** @slacksync has joined the channel
### _#qps-metric_
**@slacksync:** @slacksync has joined the channel
### _#order-by_
**@slacksync:** @slacksync has joined the channel
### _#feat-better-schema-evolution_
**@slacksync:** @slacksync has joined the channel
### _#fraud_
**@slacksync:** @slacksync has joined the channel
### _#pinotadls_
**@slacksync:** @slacksync has joined the channel
### _#inconsistent-segment_
**@slacksync:** @slacksync has joined the channel
### _#pinot-power-bi_
**@slacksync:** @slacksync has joined the channel
### _#twitter_
**@slacksync:** @slacksync has joined the channel
### _#apa-16824_
**@slacksync:** @slacksync has joined the channel
### _#pinot-website_
**@slacksync:** @slacksync has joined the channel
### _#minion-star-tree_
**@slacksync:** @slacksync has joined the channel
### _#troubleshooting_
**@giacomo.barone:** @giacomo.barone has joined the channel
**@pekka.vuorio:** @pekka.vuorio has joined the channel
**@ryan.ariasruane:** @ryan.ariasruane has joined the channel
**@ryan.ariasruane:** Hi everyone. New here and I was just wanting to ask
some questions on ingesting arrays, that is `INT_ARRAY`, `FLOAT_ARRAY`,
`TIMESTAMP_ARRAY`, etc. I have found that I can ingest using JSON all types as
multi-valued dimension columns with the exception of `BOOLEAN`, `TIMESTAMP`,
and `BYTES`. I believe that `JSON_ARRAY` isn't a valid type, but I wasn't sure
about `BYTES_ARRAY`. If anyone is about and can shed some light, I would be
very appreciative. More info present in-thread
**@ryan.ariasruane:** For BYTES_ARRAY I get:
```java.lang.UnsupportedOperationException: Unsupported data type : BYTES```
For BOOLEAN_ARRAY I get: ```java.lang.ClassCastException: class [Z cannot be
cast to class java.lang.Integer ([Z and java.lang.Integer are in module
java.base of loader 'bootstrap')``` For TIMESTAMP_ARRAY I get:
```java.lang.ClassCastException: class java.sql.Timestamp cannot be cast to
class java.lang.Long (java.sql.Timestamp is in module java.sql of loader
'platform'; java.lang.Long is in module java.base of loader 'bootstrap')``` So
far I have in my docker contained pinot DB a table with all other types in
singular and multi-valued form. The schema for the failing types are: ```
"dimensionFieldSpecs": [ { "name": "gamesWon", "dataType": "BOOLEAN",
"singleValueField": false }, { "name": "datesPlayed", "dataType": "TIMESTAMP",
"singleValueField": false }, { "name": "rawArray", "dataType": "BYTES",
"singleValueField": false }``` and the ingestion lines for these columns are:
row 1 ``` "datesPlayed": ["2020-01-01 10:45:28", "2020-02-01 10:45:28",
"2020-03-01 10:45:28"], "gamesWon": [true, false, true], "rawArray": ["cd",
"ef"]``` row 2 ``` "datesPlayed":[] , "gamesWon": [], "rawArray": []```
**@ryan.ariasruane:** I have also tried ingestion of `TIMESTAMP_ARRAY` as
long-typed epoch values, but it makes no difference.
**@ryan.ariasruane:** Oh, and I'm using the
`org.apache.pinot.plugin.inputformat.json.JSONRecordReader`
**@mayanks:** @ryan.ariasruane do you mind creating an issue for this?
**@chris:** @chris has joined the channel
**@taohu:** Hi everyone. I updated to 0.10.0 and tried a group by query with
filter clause in aggregations but got the following error: ```GROUP BY with
FILTER clauses is not supported``` Do we have any plans to support FILTER
clause with group by? And for now is there any workaround if I want to filter
my aggregations in a group by query? Thanks
**@mayanks:** @atri.sharma ^^
**@atri.sharma:** Yep, I am on it.
**@atri.sharma:** Expect a patch next week. Of course I will send you my crowd
funding account number :wink:
**@taohu:** Awesome, thank you!
**@atri.sharma:** I was just kidding about the crowd funding account :P let me
get a patch out asap
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#pinot-s3_
**@slacksync:** @slacksync has joined the channel
### _#pinot-k8s-operator_
**@slacksync:** @slacksync has joined the channel
### _#onboarding_
**@slacksync:** @slacksync has joined the channel
### _#feat-geo-spatial-index_
**@slacksync:** @slacksync has joined the channel
### _#transform-functions_
**@slacksync:** @slacksync has joined the channel
### _#custom-aggregators_
**@slacksync:** @slacksync has joined the channel
### _#inconsistent-perf_
**@slacksync:** @slacksync has joined the channel
### _#docs_
**@slacksync:** @slacksync has joined the channel
### _#aggregators_
**@slacksync:** @slacksync has joined the channel
### _#query-latency_
**@slacksync:** @slacksync has joined the channel
### _#dhill-date-seg_
**@slacksync:** @slacksync has joined the channel
### _#enable-generic-offsets_
**@slacksync:** @slacksync has joined the channel
### _#pinot-dev_
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#community_
**@slacksync:** @slacksync has joined the channel
### _#feat-pravega-connector_
**@slacksync:** @slacksync has joined the channel
### _#announcements_
**@slacksync:** @slacksync has joined the channel
### _#s3-multiple-buckets_
**@slacksync:** @slacksync has joined the channel
### _#release-certifier_
**@slacksync:** @slacksync has joined the channel
### _#multiple_streams_
**@slacksync:** @slacksync has joined the channel
### _#lp-pinot-poc_
**@slacksync:** @slacksync has joined the channel
### _#roadmap_
**@slacksync:** @slacksync has joined the channel
### _#presto-pinot-connector_
**@slacksync:** @slacksync has joined the channel
### _#multi-region-setup_
**@slacksync:** @slacksync has joined the channel
### _#metadata-push-api_
**@slacksync:** @slacksync has joined the channel
### _#pql-sql-regression_
**@slacksync:** @slacksync has joined the channel
### _#latency-during-segment-commit_
**@slacksync:** @slacksync has joined the channel
### _#pinot-realtime-table-rebalance_
**@slacksync:** @slacksync has joined the channel
### _#release060_
**@slacksync:** @slacksync has joined the channel
### _#time-based-segment-pruner_
**@slacksync:** @slacksync has joined the channel
### _#discuss-validation_
**@slacksync:** @slacksync has joined the channel
### _#segment-cold-storage_
**@slacksync:** @slacksync has joined the channel
### _#new-office-space_
**@slacksync:** @slacksync has joined the channel
### _#config-tuner_
**@slacksync:** @slacksync has joined the channel
### _#test-channel_
**@slacksync:** @slacksync has joined the channel
### _#pinot-perf-tuning_
**@slacksync:** @slacksync has joined the channel
### _#thirdeye-pinot_
**@slacksync:** @slacksync has joined the channel
### _#getting-started_
**@giacomo.barone:** @giacomo.barone has joined the channel
**@pekka.vuorio:** @pekka.vuorio has joined the channel
**@ryan.ariasruane:** @ryan.ariasruane has joined the channel
**@chris:** @chris has joined the channel
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#feat-partial-upsert_
**@slacksync:** @slacksync has joined the channel
### _#pinot_website_improvement_suggestions_
**@slacksync:** @slacksync has joined the channel
### _#segment-write-api_
**@slacksync:** @slacksync has joined the channel
### _#releases_
**@slacksync:** @slacksync has joined the channel
### _#metrics-plugin-impl_
**@slacksync:** @slacksync has joined the channel
### _#debug_upsert_
**@slacksync:** @slacksync has joined the channel
### _#flink-pinot-connector_
**@slacksync:** @slacksync has joined the channel
### _#pinot-rack-awareness_
**@slacksync:** @slacksync has joined the channel
### _#minion-improvements_
**@slacksync:** @slacksync has joined the channel
### _#fix-numerical-predicate_
**@slacksync:** @slacksync has joined the channel
### _#complex-type-support_
**@slacksync:** @slacksync has joined the channel
### _#fix_llc_segment_upload_
**@slacksync:** @slacksync has joined the channel
### _#product-launch_
**@slacksync:** @slacksync has joined the channel
### _#pinot-docsrus_
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#pinot-trino_
**@slacksync:** @slacksync has joined the channel
### _#kinesis_help_
**@slacksync:** @slacksync has joined the channel
### _#udf-type-matching_
**@slacksync:** @slacksync has joined the channel
### _#jobs_
**@slacksync:** @slacksync has joined the channel
### _#introductions_
**@giacomo.barone:** @giacomo.barone has joined the channel
**@pekka.vuorio:** @pekka.vuorio has joined the channel
**@ryan.ariasruane:** @ryan.ariasruane has joined the channel
**@chris:** @chris has joined the channel
**@slacksync:** @slacksync has joined the channel
**@anli:** @anli has joined the channel
### _#linen_dev_
**@xiangfu0:** @xiangfu0 has joined the channel
**@xiangfu0:** added an integration to this channel:
**@xiangfu0:** added an integration to this channel:
**@slacksync:** @slacksync has joined the channel
\--------------------------------------------------------------------- To
unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org For additional commands,
e-mail: dev-help@pinot.apache.org