You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/09/20 08:44:50 UTC
[GitHub] [beam] gabrywu opened a new issue, #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
gabrywu opened a new issue, #23299:
URL: https://github.com/apache/beam/issues/23299
### What would you like to happen?
Hi, folks,
I'm using a SQLTransform to read & write a Date field to a parquet file. However, AvroUtils.toAvroSchema can't convert org.apache.beam.sdk.schemas.logicaltypes.Date to a avro date type. Because its identifier is `beam:logical_type:date:v1`, which can't be handled in method org.apache.beam.sdk.schemas.utils.AvroUtils.genericFromBeamField
### Issue Priority
Priority: 1
### Issue Component
Component: sdk-java-core
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #23299:
URL: https://github.com/apache/beam/issues/23299#issuecomment-1297321620
`beam:logical_type:date:v1` is a portable logical type (with URN). The support of portable logical types is currently underway. For now as a workaround, could create a PTransform that convert Row with `beam:logical_type:date:v1` type to `Date` type in its schema.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #23299:
URL: https://github.com/apache/beam/issues/23299#issuecomment-1297318680
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #23299:
URL: https://github.com/apache/beam/issues/23299#issuecomment-1335274517
Reopen because it is rolled back #24489
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn closed issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
Abacn closed issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
URL: https://github.com/apache/beam/issues/23299
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn closed issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
Abacn closed issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
URL: https://github.com/apache/beam/issues/23299
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] gabrywu commented on issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
gabrywu commented on issue #23299:
URL: https://github.com/apache/beam/issues/23299#issuecomment-1297978678
> `beam:logical_type:date:v1` is a portable logical type (with URN). The support of portable logical types is currently underway. For now as a workaround, could create a PTransform that convert Row with `beam:logical_type:date:v1` type to `Date` type in its schema.
I'm creating a table using a Beam SQL, can't apply a PTransform before it's created.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] gabrywu commented on issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
gabrywu commented on issue #23299:
URL: https://github.com/apache/beam/issues/23299#issuecomment-1254485305
`Schema beamSchema = new Schema.Builder()
.addLogicalTypeField("date1", SqlTypes.DATE)
.build();
Assert.assertThrows(RuntimeException.class, () -> AvroUtils.toAvroSchema(beamSchema));`
AvroUtils.toAvroSchema can't process SqlTypes.DATE.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] gabrywu commented on issue #23299: [Feature Request]: AvroUtils.toAvroSchema supports a logicaltypes.Date type
Posted by GitBox <gi...@apache.org>.
gabrywu commented on issue #23299:
URL: https://github.com/apache/beam/issues/23299#issuecomment-1254523921
@reuvenlax @kanterov @piter75
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org