You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@auron.apache.org by "weimingdiit (via GitHub)" <gi...@apache.org> on 2026/06/16 12:31:25 UTC

[I] Support array input for native reverse expression [auron]

weimingdiit opened a new issue, #2337:
URL: https://github.com/apache/auron/issues/2337

   **Is your feature request related to a problem? Please describe.**
   
   Auron currently supports native `reverse` for string inputs, but array inputs are not handled by the native expression path. The Spark compatibility tests for `reverse(array<T>)` are excluded because array inputs fail with an unsupported List type.
   
   This leaves a semantic gap for Spark's built-in `reverse` function, which supports both strings and arrays.
   
   **Describe the solution you'd like**
   
   Add native support for `reverse(array<T>)`.
   
   The implementation should:
   - keep the existing native string reverse behavior unchanged;
   - route `Reverse` with `ArrayType` input to a Spark-compatible native array reverse function;
   - preserve null array rows;
   - preserve null elements inside arrays;
   - support primitive array elements and non-primitive array elements where Auron already supports the element type;
   - re-enable the existing Spark reverse array tests.
   
   **Describe alternatives you've considered**
   
   One alternative is to keep array reverse on Spark fallback, but this weakens native coverage for a common Spark built-in function.
   
   Another alternative is to add only primitive array support first, but Spark's test coverage already includes non-primitive arrays, and the implementation can handle values generically through `ScalarValue`.
   
   **Additional context**
   
   Current exclude locations include Spark 3.1, 3.2, 3.4, and 3.5 `AuronSparkTestSettings`, where the reverse array tests are disabled with comments saying native reverse only supports string inputs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Support array input for native reverse expression [auron]

Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 closed issue #2337: Support array input for native reverse expression
URL: https://github.com/apache/auron/issues/2337


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org