You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2020/01/28 16:03:00 UTC
[jira] [Created] (ARROW-7703) [C++][Dataset] Give more informative
error message for mismatching schemas for FileSystemSources
Joris Van den Bossche created ARROW-7703:
--------------------------------------------
Summary: [C++][Dataset] Give more informative error message for mismatching schemas for FileSystemSources
Key: ARROW-7703
URL: https://issues.apache.org/jira/browse/ARROW-7703
Project: Apache Arrow
Issue Type: Bug
Reporter: Joris Van den Bossche
Currently, if you try to create a dataset from files with different schemes, you get this error:
{code}
ArrowInvalid: Unable to merge: Field a has incompatible types: int64 vs int32
{code}
If you are reading a directory of files, it would be very helpful if the error message can indicate which files are involved here (eg if you have a lot of files and only one has an error).
You can already inspect the schema's if you first make a SourceFactory manually, but that also only gives a list of schema's, not mapped to the original file (this last item probably relates to ARROW-7608
--
This message was sent by Atlassian Jira
(v8.3.4#803005)