You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/02/24 18:16:12 UTC

[GitHub] [pinot] fritzb opened a new issue #8245: Transform function with Groovy return wrong value in REALTIME table

fritzb opened a new issue #8245:
URL: https://github.com/apache/pinot/issues/8245


   I have a transformFunction which rename a column from `name` to `name_match`. Apparently, the Groovy transform function generates wrong value from other rows, occasionally ( 6000 out of 52000 have wrong value ).
   This happened on REALTIME table and not OFFLINE.
   
   `  "fieldConfigList": [
       {
         "name": "name_match",
         "encodingType": "RAW",
         "indexType": "TEXT"
       }
     ],
     "ingestionConfig": {
       "transformConfigs": [{
         "columnName": "name_match",
         "transformFunction": "Groovy({name}, name)"
       }]
     },
   `
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [pinot] fritzb commented on issue #8245: Transform function with Groovy return wrong value in REALTIME table

Posted by GitBox <gi...@apache.org>.
fritzb commented on issue #8245:
URL: https://github.com/apache/pinot/issues/8245#issuecomment-1052194014


   I am not able to reproduce this issue at the moment. The incorrect columns value were the value of the prior rows. 
   
   Thanks for the tip. I will keep an eye on this issue and will reopen if I can reproduce it reliably.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [pinot] fritzb closed issue #8245: Transform function with Groovy return wrong value in REALTIME table

Posted by GitBox <gi...@apache.org>.
fritzb closed issue #8245:
URL: https://github.com/apache/pinot/issues/8245


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [pinot] Jackie-Jiang commented on issue #8245: Transform function with Groovy return wrong value in REALTIME table

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #8245:
URL: https://github.com/apache/pinot/issues/8245#issuecomment-1050421645


   Can you give some example of the wrong values generated (both the input and output)?
   
   FYI, this renaming does not need groovy, `"transformConfigs": [{ "columnName": "name_match", "transformFunction":  "name" }]` should work


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org