You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by "enjoyy2 (via GitHub)" <gi...@apache.org> on 2025/04/30 13:35:35 UTC
[D] Does CSV file input care about the schema and makes validations? (hop)
GitHub user enjoyy2 created a discussion: Does CSV file input care about the schema and makes validations?
I am using a CSV file input with some required fields layout. When righting nonsense in the file, i expected that the parse CSV to fail, but instead it is parsing everything, and generating invalid data.
i was expecting that the CSV file transform to fail. what am i doing wrong?
GitHub link: https://github.com/apache/hop/discussions/5233
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Does CSV file input care about the schema and makes validations? (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Does CSV file input care about the schema and makes validations?
Not sure what behavior you expected, but the CSV File Input and Text File Input transforms read data based on a field's position in the file. The field/header names are just an indication. The transforms will try to read the data in the position and for the data type you specify.
GitHub link: https://github.com/apache/hop/discussions/5233#discussioncomment-12994106
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Does CSV file input care about the schema and makes validations? (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
GitHub user hansva edited a comment on the discussion: Does CSV file input care about the schema and makes validations?
Field enclosures are used to ignore delimiters and new lines that are inside the enclosure. The delimiter is what splits the fields
GitHub link: https://github.com/apache/hop/discussions/5233#discussioncomment-12994928
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Does CSV file input care about the schema and makes validations? (hop)
Posted by "enjoyy2 (via GitHub)" <gi...@apache.org>.
GitHub user enjoyy2 added a comment to the discussion: Does CSV file input care about the schema and makes validations?
i m expecting for example when reading a column in the csv, that is enclosed in "" not to give me the value: Protocol Number = zxcx"aaa"
GitHub link: https://github.com/apache/hop/discussions/5233#discussioncomment-12994122
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Does CSV file input care about the schema and makes validations? (hop)
Posted by "enjoyy2 (via GitHub)" <gi...@apache.org>.
GitHub user enjoyy2 edited a discussion: Does CSV file input care about the schema and makes validations?
I am using a CSV file input with some required fields layout. When righting nonsense in the file, i expected that the parse CSV to fail, but instead it is parsing everything, and generating invalid data.
the header seems to be ignored, not checked, then fields value is invalid
i was expecting that the CSV file transform to fail. what am i doing wrong?
GitHub link: https://github.com/apache/hop/discussions/5233
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Does CSV file input care about the schema and makes validations? (hop)
Posted by "enjoyy2 (via GitHub)" <gi...@apache.org>.
GitHub user enjoyy2 edited a comment on the discussion: Does CSV file input care about the schema and makes validations?
i m expecting for example when reading a column in the csv, that is enclosed in "" not to give me the value: Protocol Number = zxcx"aaa"
it's like it s useless that i specify the fields are enclosed in "" it will search for delimiter , and send me whatever he managed to read which is invalid
GitHub link: https://github.com/apache/hop/discussions/5233#discussioncomment-12994122
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Does CSV file input care about the schema and makes validations? (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
GitHub user hansva added a comment to the discussion: Does CSV file input care about the schema and makes validations?
Field enclosures are used to ignore delimiters that are inside the enclosure. The delimiter is what splits the fields
GitHub link: https://github.com/apache/hop/discussions/5233#discussioncomment-12994928
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org