You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "yuanoOo (via GitHub)" <gi...@apache.org> on 2023/03/30 09:35:15 UTC
[GitHub] [incubator-paimon] yuanoOo opened a new issue, #773: [Bug] When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date.
yuanoOo opened a new issue, #773:
URL: https://github.com/apache/incubator-paimon/issues/773
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
### Paimon version
paimon-flink-1.15-0.4-20230330.002117-12.jar
### Compute Engine
flink1.15.3
### Minimal reproduce step
When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date.
### What doesn't meet your expectations?
When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date.
### Anything else?
_No response_
### Are you willing to submit a PR?
- [X] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date. [incubator-paimon]
Posted by "dailai (via GitHub)" <gi...@apache.org>.
dailai commented on issue #773:
URL: https://github.com/apache/incubator-paimon/issues/773#issuecomment-2006340216
I think this issue need to fix. For example, we develop a paimon connector of seatunnel which use java api of paimon also has the same problem.The types in date,time,timestamp all have the same problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date. [paimon]
Posted by "dailai (via GitHub)" <gi...@apache.org>.
dailai commented on issue #773:
URL: https://github.com/apache/paimon/issues/773#issuecomment-2109635155
@JingsongLi Hi, how about this problem?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-paimon] JingsongLi commented on issue #773: [Bug] When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date.
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on issue #773:
URL: https://github.com/apache/incubator-paimon/issues/773#issuecomment-1490167608
Direct fixes may have compatibility issues, we should be careful.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-paimon] yuanoOo commented on issue #773: [Bug] When writing a partitioned table for Paimon using Flink SQL and storing the table on HDFS, the partition directory name on HDFS is displayed abnormally. For example, it shows as SCAN_DATE=19415 instead of the correct format of SCAN_DATE=2023-03-01, where SCAN_DATE is of type date.
Posted by "yuanoOo (via GitHub)" <gi...@apache.org>.
yuanoOo commented on issue #773:
URL: https://github.com/apache/incubator-paimon/issues/773#issuecomment-1501039559
> Direct fixes may have compatibility issues, we should be careful.
I’m trying to fix this bug, can you assign it to me?
My idea is to format the DATE type in the org.apache.paimon.utils.RowDataPartitionComputer#generatePartValues method. For example, converting the int value 19996 of the DATE type into the correct date string 2024-09-30.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org