You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "suremarc (via GitHub)" <gi...@apache.org> on 2023/09/08 18:40:51 UTC
[GitHub] [arrow-datafusion] suremarc commented on issue #7500: Implement `except` syntax to select all columns except certain ones
suremarc commented on issue #7500:
URL: https://github.com/apache/arrow-datafusion/issues/7500#issuecomment-1712082684
I thought `exclude/except` syntax landed in [this PR](https://github.com/apache/arrow-datafusion/issues/6439). I am actually currently using it in my DataFusion-based project and it seems to work fine.
In the OP it looks like `span_id` is missing from the columns, which is the expected behavior. Is this just a misunderstanding? I attempted to reproduce the issue, but I was even able to exclude other columns as well:
```sql
❯ SELECT * EXCLUDE(span_id, attributes, trace_id) FROM './traces_sample.parquet' LIMIT 10;
```
```
+---------------+---------------------+--------------+-----------+------------------+----------------------------+------------------+----------------+
| duration_nano | end_time_unix_nano | service.name | span.kind | span.name | time | otel.status_code | parent_span_id |
+---------------+---------------------+--------------+-----------+------------------+----------------------------+------------------+----------------+
| 16000 | 1688748446779372000 | frontend | Server | HTTP GET /config | 2023-07-07T16:47:26.779356 | | |
| 10000 | 1688748430404380000 | frontend | Server | HTTP GET /config | 2023-07-07T16:47:10.404370 | | |
| 6000 | 1688748422265841000 | frontend | Server | HTTP GET /config | 2023-07-07T16:47:02.265835 | | |
| 39000 | 1688748463776702000 | frontend | Server | HTTP GET /config | 2023-07-07T16:47:43.776663 | | |
| 12000 | 1688748403699926000 | frontend | Server | HTTP GET /config | 2023-07-07T16:46:43.699914 | | |
| 7000 | 1688748392960688000 | frontend | Server | HTTP GET /config | 2023-07-07T16:46:32.960681 | | |
| 8000 | 1688748465953262000 | frontend | Server | HTTP GET /config | 2023-07-07T16:47:45.953254 | | |
| 10000 | 1688748413717028000 | frontend | Server | HTTP GET /config | 2023-07-07T16:46:53.717018 | | |
| 15000 | 1688748412730887000 | frontend | Server | HTTP GET /config | 2023-07-07T16:46:52.730872 | | |
| 10000 | 1688748407923796000 | frontend | Server | HTTP GET /config | 2023-07-07T16:46:47.923786 | | |
+---------------+---------------------+--------------+-----------+------------------+----------------------------+------------------+----------------+
10 rows in set. Query took 0.002 seconds.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org