You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jackwener (via GitHub)" <gi...@apache.org> on 2023/04/13 02:53:33 UTC

[GitHub] [arrow-datafusion] jackwener commented on issue #5934: `is distinct from` fail to type coercion in UTF/LargeUTF8

jackwener commented on issue #5934:
URL: https://github.com/apache/arrow-datafusion/issues/5934#issuecomment-1506256884

   ```
   explain verbose select 's' is distinct from arrow_cast('s', 'LargeUtf8');
   +------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
   | plan_type                                                  | plan                                                                                                                               |
   +------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
   | initial_logical_plan                                       | Projection: Utf8("s") IS DISTINCT FROM CAST(Utf8("s") AS LargeUtf8)                                                                |
   |                                                            |   EmptyRelation                                                                                                                    |
   | logical_plan after unwrap_cast_in_comparison               | Projection: CAST(Utf8("s") AS LargeUtf8) IS DISTINCT FROM CAST(Utf8("s") AS LargeUtf8)                                             |
   |                                                            |   EmptyRelation                                                                                                                    |
   | logical_plan after replace_distinct_aggregate              | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after decorrelate_where_exists                | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after decorrelate_where_in                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after scalar_subquery_to_join                 | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after extract_equijoin_predicate              | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after merge_projection                        | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after rewrite_disjunctive_predicate           | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_duplicated_expr               | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_filter                        | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_cross_join                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after common_sub_expression_eliminate         | Projection: CAST(Utf8("s") AS LargeUtf8)Utf8("s") AS Utf8("s") IS DISTINCT FROM CAST(Utf8("s") AS LargeUtf8)Utf8("s") AS Utf8("s") |
   |                                                            |   Projection: CAST(Utf8("s") AS LargeUtf8) AS CAST(Utf8("s") AS LargeUtf8)Utf8("s")                                                |
   |                                                            |     EmptyRelation                                                                                                                  |
   | logical_plan after eliminate_limit                         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after propagate_empty_relation                | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after filter_null_join_keys                   | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_outer_join                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_limit                         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_filter                        | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after single_distinct_aggregation_to_group_by | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after simplify_expressions                    | Projection: CAST(Utf8("s") AS LargeUtf8)Utf8("s") AS Utf8("s") IS DISTINCT FROM CAST(Utf8("s") AS LargeUtf8)Utf8("s") AS Utf8("s") |
   |                                                            |   Projection: LargeUtf8("s") AS CAST(Utf8("s") AS LargeUtf8)Utf8("s")                                                              |
   |                                                            |     EmptyRelation                                                                                                                  |
   | logical_plan after unwrap_cast_in_comparison               | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after common_sub_expression_eliminate         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_projection                    | Projection: LargeUtf8("s") AS Utf8("s") IS DISTINCT FROM LargeUtf8("s") AS Utf8("s")                                               |
   |                                                            |   EmptyRelation                                                                                                                    |
   | logical_plan after eliminate_projection                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_limit                         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after simplify_expressions                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after unwrap_cast_in_comparison               | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after replace_distinct_aggregate              | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after decorrelate_where_exists                | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after decorrelate_where_in                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after scalar_subquery_to_join                 | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after extract_equijoin_predicate              | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after simplify_expressions                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after merge_projection                        | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after rewrite_disjunctive_predicate           | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_duplicated_expr               | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_filter                        | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_cross_join                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after common_sub_expression_eliminate         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_limit                         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after propagate_empty_relation                | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after filter_null_join_keys                   | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_outer_join                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_limit                         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_filter                        | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after single_distinct_aggregation_to_group_by | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after simplify_expressions                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after unwrap_cast_in_comparison               | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after common_sub_expression_eliminate         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_projection                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after eliminate_projection                    | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan after push_down_limit                         | SAME TEXT AS ABOVE                                                                                                                 |
   | logical_plan                                               | Projection: LargeUtf8("s") AS Utf8("s") IS DISTINCT FROM LargeUtf8("s") AS Utf8("s")                                               |
   |                                                            |   EmptyRelation                                                                                                                    |
   | initial_physical_plan                                      | ProjectionExec: expr=[s IS DISTINCT FROM s as Utf8("s") IS DISTINCT FROM Utf8("s")]                                                |
   |                                                            |   EmptyExec: produce_one_row=true                                                                                                  |
   |                                                            |                                                                                                                                    |
   | physical_plan after aggregate_statistics                   | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after join_selection                         | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after PipelineFixer                          | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after repartition                            | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after global_sort_selection                  | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after EnforceDistribution                    | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after EnforceSorting                         | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after CombinePartialFinalAggregate           | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after coalesce_batches                       | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan after PipelineChecker                        | SAME TEXT AS ABOVE                                                                                                                 |
   | physical_plan                                              | ProjectionExec: expr=[s IS DISTINCT FROM s as Utf8("s") IS DISTINCT FROM Utf8("s")]                                                |
   |                                                            |   EmptyExec: produce_one_row=true                                                                                                  |
   |                                                            |                                                                                                                                    |
   +------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
   66 rows in set. Query took 0.006 seconds.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org