[I] Regression: "Internal error: Only intervals with the same data type are comparable, lhs:Float32, rhs:UInt64." [datafusion]

["alamb (via GitHub)" <gi...@apache.org>]

alamb opened a new issue, #13186:
URL: https://github.com/apache/datafusion/issues/13186

   ### Describe the bug
   
   There is a bug in calculating filter statistics that results in an internal error
   
   
   
   ### To Reproduce
   
   
   Reproducer
   
   ```sql
   create table cpu (time timestamp, usage_idle float, usage_user float, cpu int);
   insert into cpu values ('1970-01-01 00:00:00', 1.0, 2.0, 3);
   copy (select * from cpu) to '/tmp/foo.parquet';
   
   select time, rn
   from (
     select time, row_number() OVER (ORDER BY usage_idle, time) as rn
     from '/tmp/foo.parquet'
     where cpu = 3
   ) where rn > 0;
   ```
   
   Results in
   ```
   ProjectionPushdown
   caused by
   Internal error: Only intervals with the same data type are comparable, lhs:Float32, rhs:UInt64.
   This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker
   ```
   
   
   ### Expected behavior
   
   
   I expect it to produce a row:
   
   ```
   +---------------------+----+
   | time                | rn |
   +---------------------+----+
   | 1970-01-01T00:00:00 | 1  |
   +---------------------+----+
   1 row(s) fetched.
   ```
   
   
   ### Additional context
   
   We found a bug with some of our internal tests in InfluxDB 3.0
   
   I believe this is a regression introduced by 4659096f9c0d30bbea59256af8f8e9b73b921cb7 / https://github.com/apache/datafusion/pull/12281 which added a projection to `FilterExec`
   
   However, as the projection is not applied to the statistics, the reported output schema and statistics are inconsistent which causes issues upstream.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] Regression: "Internal error: Only intervals with the same data type are comparable, lhs:Float32, rhs:UInt64." [datafusion]

["alamb (via GitHub)" <gi...@apache.org>]

alamb closed issue #13186: Regression: "Internal error: Only intervals with the same data type are comparable, lhs:Float32, rhs:UInt64."
URL: https://github.com/apache/datafusion/issues/13186


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org