You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@parquet.apache.org by "preetham02 (via GitHub)" <gi...@apache.org> on 2025/02/06 06:10:23 UTC
[I] `MessageTypeParser.parseMessageType()` Fails to Parse Valid Parquet Schemas with Special Characters in Field Names [parquet-java]
preetham02 opened a new issue, #3145:
URL: https://github.com/apache/parquet-java/issues/3145
### Describe the bug, including details regarding any error messages, version, and platform.
The MessageTypeParser.parseMessageType(String) method fails when parsing Parquet schemas containing field names with special characters such as "name=id" or "first name". These field names are valid in Parquet schema definitions and Parquet files successfully support them. However, parseMessageType throws an error or fails to deserialize such schemas back into a valid MessageType object.
Steps to Reproduce:
Create a valid Parquet schema with a field name like name=id or first name.
Convert it to a string using .toString().
Attempt to parse it back using MessageTypeParser.parseMessageType(parquetSchema.toString()).
Suggested Fix:
Enhance MessageTypeParser to properly handle and deserialize field names containing special characters, ensuring compliance with the Parquet specification.
### Component(s)
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] `MessageTypeParser.parseMessageType()` Fails to Parse Valid Parquet Schemas with Special Characters in Field Names [parquet-java]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #3145:
URL: https://github.com/apache/parquet-java/issues/3145#issuecomment-2643324252
I'd suggest to send an email with title `[DISCUSS] XXX` to `dev@parquet.apache.org` to have a boarder audience. You can see a couple of past examples here: https://lists.apache.org/list.html?dev@parquet.apache.org
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] `MessageTypeParser.parseMessageType()` Fails to Parse Valid Parquet Schemas with Special Characters in Field Names [parquet-java]
Posted by "preetham0202 (via GitHub)" <gi...@apache.org>.
preetham0202 commented on issue #3145:
URL: https://github.com/apache/parquet-java/issues/3145#issuecomment-2643314439
I agree that there's no explicit mention of Parquet supporting column names with = or spaces, but there's also no clear restriction against them. Given this, is this truly a Parquet format issue, and should I be reporting the bug [there](https://github.com/apache/parquet-format)? I'm also curious if Parquet doesn't actively support such names due to potential conflicts in resolving field names.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] `MessageTypeParser.parseMessageType()` Fails to Parse Valid Parquet Schemas with Special Characters in Field Names [parquet-java]
Posted by "preetham02 (via GitHub)" <gi...@apache.org>.
preetham02 commented on issue #3145:
URL: https://github.com/apache/parquet-java/issues/3145#issuecomment-2643318451
I agree that there's no explicit mention of Parquet supporting column names with = or spaces, but there's also no clear restriction against them. Given this, is this truly a Parquet format issue, and should I be reporting the bug [there](https://github.com/apache/parquet-format)? I'm also curious if Parquet doesn't actively support such names due to potential conflicts in resolving field names.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] `MessageTypeParser.parseMessageType()` Fails to Parse Valid Parquet Schemas with Special Characters in Field Names [parquet-java]
Posted by "wgtmac (via GitHub)" <gi...@apache.org>.
wgtmac commented on issue #3145:
URL: https://github.com/apache/parquet-java/issues/3145#issuecomment-2642264661
> The MessageTypeParser.parseMessageType(String) method fails when parsing Parquet schemas containing field names with special characters such as "name=id" or "first name". These field names are valid in Parquet schema definitions and Parquet files successfully support them.
CMIW, the spec does not explicitly say this so I don't think this is true. These is a related JIRA: https://issues.apache.org/jira/browse/PARQUET-677
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org