You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2020/01/28 16:03:00 UTC

[jira] [Created] (ARROW-7703) [C++][Dataset] Give more informative error message for mismatching schemas for FileSystemSources

Joris Van den Bossche created ARROW-7703:
--------------------------------------------

             Summary: [C++][Dataset] Give more informative error message for mismatching schemas for FileSystemSources
                 Key: ARROW-7703
                 URL: https://issues.apache.org/jira/browse/ARROW-7703
             Project: Apache Arrow
          Issue Type: Bug
            Reporter: Joris Van den Bossche


Currently, if you try to create a dataset from files with different schemes, you get this error:

{code}
ArrowInvalid: Unable to merge: Field a has incompatible types: int64 vs int32
{code}

If you are reading a directory of files, it would be very helpful if the error message can indicate which files are involved here (eg if you have a lot of files and only one has an error).

You can already inspect the schema's if you first make a SourceFactory manually, but that also only gives a list of schema's, not mapped to the original file (this last item probably relates to ARROW-7608 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)