You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "wuchong (via GitHub)" <gi...@apache.org> on 2025/11/14 11:08:35 UTC
[I] Lake Tiering Service is not compatible with Flink 2.1 [fluss]
wuchong opened a new issue, #1983:
URL: https://github.com/apache/fluss/issues/1983
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.
### Fluss version
main (development)
### Please describe the bug 🐞
Using lake tiering service of fluss 0.8 with Flink 2.1, throws the following exception:
<img width="887" height="443" alt="Image" src="https://github.com/user-attachments/assets/745b81b6-3eba-4515-8101-c734b01e2cd9" />
### Solution
_No response_
### Are you willing to submit a PR?
- [ ] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3602530697
@buvb sorry for the late response. However, I saw @sd4324530 has submitted a PR for this. Thus I assigned this issue to him.
I copied my comment from the PR to here to continue discussion if needed.
https://github.com/apache/fluss/pull/2063#issuecomment-3602523204
> @sd4324530 we already have dedicated flink version modules `fluss-flink-1.18`, `fluss-flink-1.19`, `fluss-flink-1.20`, `fluss-flink-2.1` to handle compatibility, so we don't need to introduce `flink1` and `flink2` modules. There are already some adapter classes in them. You can follow it.
>
> One more thing is that we should add tests to reproduce the problem. So that we don't encounter it again in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong closed issue #1983: Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool)
URL: https://github.com/apache/fluss/issues/1983
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "sd4324530 (via GitHub)" <gi...@apache.org>.
sd4324530 commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3689247298
> [@sd4324530](https://github.com/sd4324530) would you like to take it?
@loserwang1024 Sure, I'll fix it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 [fluss]
Posted by "luoyuxia (via GitHub)" <gi...@apache.org>.
luoyuxia commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3580846616
Flink2.x has rename `org.apache.flink.api.java.utils.MultipleParameterTool` to `org.apache.flink.util.MultipleParameterTool`. Seems we can follow how paimon solve this problem. @buvb Are you interested in this issue? I can assign to you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "loserwang1024 (via GitHub)" <gi...@apache.org>.
loserwang1024 commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3685571561
Hi, @sd4324530 , would you like to test lake tiering service in real session, I have found that getRuntimeContext().getAttemptNumber() is also not founded in flink 2.1
<img width="1209" height="526" alt="Image" src="https://github.com/user-attachments/assets/5364a98b-cc03-4a6a-ba31-6cabb6f238e5" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "loserwang1024 (via GitHub)" <gi...@apache.org>.
loserwang1024 commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3689287112
@sd4324530 just do it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "buvb (via GitHub)" <gi...@apache.org>.
buvb commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3604679905
@wuchong OK, I have seen that @sd4324530 has taken the lead in advancing this project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "sd4324530 (via GitHub)" <gi...@apache.org>.
sd4324530 commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3584344479
I found that Paimon's solution provides the flink1-common module and the flink2-common module, which implement the adapter respectively. Fluss only has a unified common module. Should it also be split into flink1 and flink2?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "buvb (via GitHub)" <gi...@apache.org>.
buvb commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3601242616
@luoyuxia I found that this problem is caused by flink version incompatibility, actually bidirectional incompatibility, I think the best way is to use Adapter to isolate API differences between different flink versions, we can refer to Apache Paimon's approach, you can assign this issue to me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 [fluss]
Posted by "buvb (via GitHub)" <gi...@apache.org>.
buvb commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3540881172
@wuchong I can attempt to fix this bug.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3580988774
Yes, we can wrap a adapter for this class.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "loserwang1024 (via GitHub)" <gi...@apache.org>.
loserwang1024 commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3689073449
@sd4324530 would you like to take it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Lake Tiering Service is not compatible with Flink 2.1 (ClassNotFoundException MultipleParameterTool) [fluss]
Posted by "sd4324530 (via GitHub)" <gi...@apache.org>.
sd4324530 commented on issue #1983:
URL: https://github.com/apache/fluss/issues/1983#issuecomment-3685712469
> Hi, [@sd4324530](https://github.com/sd4324530) , would you like to test lake tiering service in real session, I have found that getRuntimeContext().getAttemptNumber() is also not founded in flink 2.1您好，您是否想在实际会话中测试 Lake Tiering 服务？我发现 Flink 2.1 中也找不到 `getRuntimeContext().getAttemptNumber()` 方法。
>
> <img alt="Image" width="822" height="357.625" src="https://private-user-images.githubusercontent.com/125648852/529549153-5364a98b-cc03-4a6a-ba31-6cabb6f238e5.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NjY0Nzg0MDEsIm5iZiI6MTc2NjQ3ODEwMSwicGF0aCI6Ii8xMjU2NDg4NTIvNTI5NTQ5MTUzLTUzNjRhOThiLWNjMDMtNGE2YS1iYTMxLTZjYWJiNmYyMzhlNS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUxMjIzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MTIyM1QwODIxNDFaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT04OTEyYjVjYTZhYjgzMjExNzhkNTU3MDkxNGIzNGE5NzczZDAwODI4NTlmNDAxZGUwODFmZTU2MmM1MWU2Y2Y5JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.mJacNFzxAc3nCnadrvSQP6K3uR68IxGfrQomGYbBPrc">
@loserwang1024 Thank you very much, but I haven't officially used Fluss in my data warehouse yet, so I don't have a real environment to test it.
However, I see that Flink's official documentation addresses the issue you've raised.
The current code is compatible with Flink version 1.18. Newer versions can replace it with: `getRuntimeContext().getTaskInfo().getAttemptNumber()`.
We should need to adapt it for Flink 1.19 and above.
<img width="639" height="285" alt="Image" src="https://github.com/user-attachments/assets/0676edc5-1630-4ba4-8567-0d78833f137f" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org