You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/08/12 13:04:04 UTC
[GitHub] [hudi] tooptoop4 opened a new issue #1956: [SUPPORT] DMS for table without PK
tooptoop4 opened a new issue #1956:
URL: https://github.com/apache/hudi/issues/1956
Some table i want to use deltastreamer DMS on have no PK, if i specify all columns as the PK it then complains if there are nulls inside any. How to handle this?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] tooptoop4 commented on issue #1956: [SUPPORT] DMS for table without PK
Posted by GitBox <gi...@apache.org>.
tooptoop4 commented on issue #1956:
URL: https://github.com/apache/hudi/issues/1956#issuecomment-673284248
so on single column table it was https://github.com/apache/hudi/blob/release-0.5.3/hudi-spark/src/main/java/org/apache/hudi/keygen/SimpleKeyGenerator.java#L58
can I use complexkey class even for single column table ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar closed issue #1956: [SUPPORT] DMS for table without PK
Posted by GitBox <gi...@apache.org>.
bvaradar closed issue #1956:
URL: https://github.com/apache/hudi/issues/1956
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bhasudha commented on issue #1956: [SUPPORT] DMS for table without PK
Posted by GitBox <gi...@apache.org>.
bhasudha commented on issue #1956:
URL: https://github.com/apache/hudi/issues/1956#issuecomment-673341610
> so on single column table it was https://github.com/apache/hudi/blob/release-0.5.3/hudi-spark/src/main/java/org/apache/hudi/keygen/SimpleKeyGenerator.java#L58
>
> can I use complexkey class even for single column table ?
It should be possible. It would split record keys separated by comma (in case of multiple columns) into a list.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on issue #1956: [SUPPORT] DMS for table without PK
Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #1956:
URL: https://github.com/apache/hudi/issues/1956#issuecomment-673138395
@tooptoop4 : Can you add the exceptions you are getting. With 0.5.3, We handle null columns in record-key https://github.com/apache/hudi/blob/release-0.5.3/hudi-spark/src/main/java/org/apache/hudi/keygen/ComplexKeyGenerator.java#L71
Curious, what the exception is ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org