You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "ankitsultana (via GitHub)" <gi...@apache.org> on 2024/12/12 20:23:50 UTC

[I] [feature-request] Support Lambda Expressions [pinot]

ankitsultana opened a new issue, #14650:
URL: https://github.com/apache/pinot/issues/14650

   It would be great if Pinot supported Lambda expressions. For a reference point, PrestoSQL has [really rich lambda expression](https://prestodb.io/docs/current/functions/lambda.html) support, where you can even pass in custom functions for sorting an array. Example expressions supported in Presto:
   
   ```
   SELECT
     ARRAY_SORT(
       filter(someArrayExpression),
       state -> json_extract_scalar(state, '$.source') = 'something'
     ),
     (st1, st2) -> IF(
         JSON_EXTRACT_SCALAR(st1, '$.timestamp') < JSON_EXTRACT_SCALAR(st2, '$.timestamp'),
              -1,
              IF(
                 JSON_EXTRACT_SCALAR(st1, '$.timestamp') = JSON_EXTRACT_SCALAR(st2, '$.timestamp'),
                 0,
                 1
              )
         )
     )
   ```
   
   Calcite has support for Lambda expressions but I haven't taken a deeper look into this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "gortiz (via GitHub)" <gi...@apache.org>.
gortiz commented on issue #14650:
URL: https://github.com/apache/pinot/issues/14650#issuecomment-2560789042

   As @ankitsultana said, this is a complex task that would need a design document. How to evaluate these lambdas in the query engine is not a trivial task that would probably involve several core changes in the engine (including at least extending the function registry).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "cutiepie-10 (via GitHub)" <gi...@apache.org>.
cutiepie-10 commented on issue #14650:
URL: https://github.com/apache/pinot/issues/14650#issuecomment-2556469021

   Hello @ankitsultana ,
   Can you assign this issue to me ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #14650: [feature-request] Support Lambda Expressions
URL: https://github.com/apache/pinot/issues/14650


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "ankitsultana (via GitHub)" <gi...@apache.org>.
ankitsultana commented on issue #14650:
URL: https://github.com/apache/pinot/issues/14650#issuecomment-2560409953

   @cutiepie-10 : supporting lambda expressions is going to be quite a large effort. Do you have a design doc or a PoC we can take a look at?
   
   If you are new to Pinot I'd recommend picking up smaller starter tasks first.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14650:
URL: https://github.com/apache/pinot/issues/14650#issuecomment-4636654795

   This issue has been closed because it has been inactive for 180 days. If you believe this issue is still relevant, please feel free to reopen it or create a new issue. Thank you!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "cutiepie-10 (via GitHub)" <gi...@apache.org>.
cutiepie-10 commented on issue #14650:
URL: https://github.com/apache/pinot/issues/14650#issuecomment-2546176642

   Hi @ankitsultana,
   I would like to contribute on this issue. Could you please help me get more insights on the execution part?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Re: [I] [feature-request] Support Lambda Expressions [pinot]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14650:
URL: https://github.com/apache/pinot/issues/14650#issuecomment-4393216300

   This issue has been automatically marked as stale because it has not had any activity in the last 150 days. It will be closed in 30 days if no further activity occurs. If this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org