You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/05/07 23:04:08 UTC
[GitHub] [incubator-pinot] npawar opened a new issue #5351: Transformations using columns which themselves are a result of transformation
npawar opened a new issue #5351:
URL: https://github.com/apache/incubator-pinot/issues/5351
In https://github.com/apache/incubator-pinot/pull/5238 we added transform functions feature.
This issue has the design doc: https://github.com/apache/incubator-pinot/issues/5135.
This is one of the follow ups.
In the transform functions support so far, we have 1 limitation.
If `destColumn = f(sourceColumn)`, then, destColumn cannot be used as an input to another transform function in the same schema.
Example:
source columns: `foodExpenses`=[100, 500, 200], `totalExpense`=4000
destination columns: `totalFoodExpense = sumOfAll(foodExpenses)`
So `totalFoodExpense` cannot be used as input to another transformFunction.
This is the behavior that we want to change.
Now we want to add support for using `totalFoodExpense` as input to another transform function
source columns: `foodExpenses`=[100, 500, 200], `totalExpense`=4000
destination columns: `totalFoodExpense = sumOfAll(foodExpenses)`, `percentFoodExpense = totalFoodExpense/totalExpense * 100`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] hotienvu commented on issue #5351: Transformations using columns which themselves are a result of transformation
Posted by GitBox <gi...@apache.org>.
hotienvu commented on issue #5351:
URL: https://github.com/apache/incubator-pinot/issues/5351#issuecomment-720982607
hi @npawar I'd like to work on this. I think we need to sort the columns in topological order before applying the transform function
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org