You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "lgbo-ustc (via GitHub)" <gi...@apache.org> on 2024/10/16 09:38:10 UTC
[I] [CH] Invalid result from `get_json_object` [incubator-gluten]
lgbo-ustc opened a new issue, #7563:
URL: https://github.com/apache/incubator-gluten/issues/7563
### Backend
CH (ClickHouse)
### Bug description
[Expected behavior] and [actual behavior].
For json text
```
{"check_status":["0"],"ranker":["likee_rank_wce_ids_view_lr_ru"],"score":["0.437435"],"strategy":["2140"],"rough_ranker":["","","","","","","","","",""],"rough_score":["0.419119","0.408650","0.131906","0.084743","0.179108","0.147447","0.198390","0.047044","0.518033","0.553486"],"intervene":[""],"rec_type":["0"],"ad_abflag":[""],"rerank_score":["0.000000"],"multi_rank_score":["0.437435","0.018430","0.043816","0.003434","0.002499","0.705915","0.328035","0.002205","0.017328","0.001465","0.555912","0.009627","0.002222","0.906478","0.474217","0.043995","0.043995","2.400376"],"post_type":["0"],"final_score":["50127"],"pos":["11"],"hts":["6737,7244,"],"q":["0.0"],"mq":["0.418629"],"rrec":["0"],"rlev":["0"],"mts":[""],"ext":[0.0,0.0,0.0,0.0,0.0,1.0,0.0,2.696539702293474e308,0.0,0.0],"c":[32,2,0,0,0],"b":[1,600,50,14,3,20,722],"sim":[64],"v":[9.5],"vid":["7424585662627846403"],"lts1":[""],"lts2":["0,"],"boostq":[11.610852241516114],"mergeq":[0.0],"finalq":[50127.078125],"fts":[""],"pq":[0.
0],"fmts":[":"],"mrr_score":"1577.521484","replace":["0:0"],"relation":"0","face":[""],"rerank_queue":["boost"],"mq_rank":["916"],"lrvt":[0],"mq_origin":["0.000000"],"es_rough_score":["0.533300","0.519814","0.842657","0.824342","0.967532","0.979021","0.521479","0.981352","0.512654","0.516983","0.620047"],"co":"1176","ct":1,"gc":50,"ut":1,"cn":"RU","du":10054}
```
`get_json_object(a, '$.rerank_queue[0]')` returns `NULL`.
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CH] Invalid result from `get_json_object` [incubator-gluten]
Posted by "lgbo-ustc (via GitHub)" <gi...@apache.org>.
lgbo-ustc commented on issue #7563:
URL: https://github.com/apache/incubator-gluten/issues/7563#issuecomment-2416319382
There is overflow float in simdjson
```sql
0: jdbc:hive2://localhost:10000> select get_json_object('{"check_status":["0"],"ext":[0.0,0.0,0.0,0.0,0.0,1.0,0.0,2.696539702293474e3,0.0,0.0] }', '$.check_status');
+----------------------------------------------------+
| get_json_object({"check_status":["0"],"ext":[0.0,0.0,0.0,0.0,0.0,1.0,0.0,2.696539702293474e3,0.0,0.0] }, $.check_status) |
+----------------------------------------------------+
| ["0"] |
+----------------------------------------------------+
1 row selected (0.049 seconds)
0: jdbc:hive2://localhost:10000> select get_json_object('{"check_status":["0"],"ext":[0.0,0.0,0.0,0.0,0.0,1.0,0.0,2.696539702293474e308,0.0,0.0] }', '$.check_status');
+----------------------------------------------------+
| get_json_object({"check_status":["0"],"ext":[0.0,0.0,0.0,0.0,0.0,1.0,0.0,2.696539702293474e308,0.0,0.0] }, $.check_status) |
+----------------------------------------------------+
| NULL |
+----------------------------------------------------+
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CH] Invalid result from `get_json_object` [incubator-gluten]
Posted by "lgbo-ustc (via GitHub)" <gi...@apache.org>.
lgbo-ustc closed issue #7563: [CH] Invalid result from `get_json_object`
URL: https://github.com/apache/incubator-gluten/issues/7563
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org