You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/07 10:53:43 UTC
[GitHub] [hudi] LinMingQiang opened a new issue, #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
LinMingQiang opened a new issue, #5782:
URL: https://github.com/apache/hudi/issues/5782
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
- If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
**Describe the problem you faced**
When we instantiate the hoodiemergehandle, sometimes a certain fielID under a partition does not exist,but the 'loc.getinstanttime()' is 'U' causes an exception NoSuchElementException to be thrown,but the exception information does not tell which fileID file does not exist, which makes it difficult to locate.
A clear and concise description of the problem.
**To Reproduce**
Steps to reproduce the behavior:
1.
2.
3.
4.
**Expected behavior**
A clear and concise description of what you expected to happen.
**Environment Description**
* Hudi version :
* Spark version :
* Hive version :
* Hadoop version :
* Storage (HDFS/S3/GCS..) :
* Running on Docker? (yes/no) :
**Additional context**
Add any other context about the problem here.
**Stacktrace**
```Add the stacktrace of the error.```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] LinMingQiang commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
LinMingQiang commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1149639777
When enable `write.insert.cluster`, an error `NoSuchElementexception: no value present in option` will be reported after the data is written for a period of time。This problem is not easy to locate because of the lack of information, and this problem will not occur during local debugging
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] LinMingQiang commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
LinMingQiang commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1149392962
Yes, but someone encountered an `nosuchelementexception: no value present in option` error again, so I hope to bring more detailed information when reporting this exception, such as the `fileID` under which partition.Facilitate troubleshooting; There's only one small change here,You can check my PR : https://github.com/apache/hudi/pull/5788
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1149131765
@wangxianghu @danny0405 @leesf : can you loop in someone to assist here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1149381917
Did you use the bucket index instead ? There are some fixes for it:
https://github.com/apache/hudi/pull/5590
https://github.com/apache/hudi/pull/5763
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] LinMingQiang closed issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
LinMingQiang closed issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
URL: https://github.com/apache/hudi/issues/5782
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1149611283
The error throws because an INSERT records was recognized as an UPDATE and appended to a UPDATE bucket, we may need to figure out why an INSERT has been seen as an UPDATE yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hbgstc123 commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
hbgstc123 commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1352840942
@danny0405 @LinMingQiang
do you know the cause of this problem or have fixes now? We meet this problem too today. Use hudi 0.12.1 version
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] LinMingQiang commented on issue #5782: [SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required
Posted by GitBox <gi...@apache.org>.
LinMingQiang commented on issue #5782:
URL: https://github.com/apache/hudi/issues/5782#issuecomment-1352867552
> @danny0405 @LinMingQiang do you know the cause of this problem or have fixes now? We meet this problem too today. Use hudi 0.12.1 version
This problem has been solved in 0.12.1. You can open a new issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org