You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2023/01/16 02:11:45 UTC
[GitHub] [incubator-seatunnel] hailin0 opened a new issue, #3956: [Feature][Transform] Support for filter data rows based on conditions
hailin0 opened a new issue, #3956:
URL: https://github.com/apache/incubator-seatunnel/issues/3956
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Currently only supports filter data rows based on kind, and needs to be extended to support filter based on field values or kind
expected：
```hocon
source {
}
transform {
FilterRow {
source_table_name = "fake"
result_table_name = "fake1"
// and conditions
must = {
field-x = {
eq = 1
not_eq = 1
in = [1,2,3]
not_id = [1,2,3]
lt = 1
lte = 1
gl = 1
gte = 1
is_null = true
not_null = true
}
}
// not conditions
must_not = {
field-x = [xxx]
}
// or conditions
should = {
}
}
}
sink {
}
```
Improve FilterRowKindTransform to FilterRowTransform:
https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/FilterRowKindTransform.java
https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/FilterRowKindTransformFactory.java
update e2e:
https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-e2e/seatunnel-transforms-v2-e2e/src/test/java/org/apache/seatunnel/e2e/transform/TestFilterRowKindIT.java
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #3956: [Feature][Transform] Support for filter data rows based on conditions
Posted by "MonsterChenzhuo (via GitHub)" <gi...@apache.org>.
MonsterChenzhuo commented on issue #3956:
URL: https://github.com/apache/incubator-seatunnel/issues/3956#issuecomment-1434054081
<img width="778" alt="图片" src="https://user-images.githubusercontent.com/60029759/219543847-1138f7f2-3f57-496f-875f-29772262dfc3.png">
condation = {
and = [ ----> Logical operators
"{id:{eq:1}}", --->User-written conditional expression string
"{name:{ne:2}}"
],
or = []
}
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3956: [Feature][Transform] Support for filter data rows based on conditions
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3956:
URL: https://github.com/apache/incubator-seatunnel/issues/3956#issuecomment-1432280353
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3956: [Feature][Transform] Support for filter data rows based on conditions
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3956:
URL: https://github.com/apache/incubator-seatunnel/issues/3956#issuecomment-1475454113
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3956: [Feature][Transform] Support for filter data rows based on conditions
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3956:
URL: https://github.com/apache/incubator-seatunnel/issues/3956#issuecomment-1486036840
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #3956: [Feature][Transform] Support for filter data rows based on conditions
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #3956: [Feature][Transform] Support for filter data rows based on conditions
URL: https://github.com/apache/incubator-seatunnel/issues/3956
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #3956: [Feature][Transform] Support for filter data rows based on conditions
Posted by GitBox <gi...@apache.org>.
MonsterChenzhuo commented on issue #3956:
URL: https://github.com/apache/incubator-seatunnel/issues/3956#issuecomment-1383583072
please assign to me; thx。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org