[D] [Bug] Table Compare not populating fields meant for error handling (hop)

["ossDataEngineer (via GitHub)" <gi...@apache.org>]

GitHub user ossDataEngineer created a discussion: [Bug] Table Compare not populating fields meant for error handling

Hello Team,

I have two tables in database table. I want to check if the rows in both table match exactly. I am using Table Compare shape to achieve this. 

My tables have few rows with mismatched data for one column. I want the table compare shape to indicate this rows to me. I supplied fields where Table Compare can put information for error handling. But these fields have null values despite nrErrors value is non-zero.

Table compare detects correctly with mismatching column data, but fails to populate the discovery in error handling fields.

Can someone help test this and confirm if its a bug?

Thanks,
ossDataEngineer

GitHub link: https://github.com/apache/hop/discussions/5505

----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org

Re: [D] [Bug] Table Compare not populating fields meant for error handling (hop)

["bamaer (via GitHub)" <gi...@apache.org>]

GitHub user bamaer added a comment to the discussion: [Bug] Table Compare not populating fields meant for error handling

I just had a quick look at the code. It looks like we only populate the error fields if the key fields match. They remain empty if the keys don't match. 

GitHub link: https://github.com/apache/hop/discussions/5505#discussioncomment-13731843

----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org

Re: [D] [Bug] Table Compare not populating fields meant for error handling (hop)

["RuppMartin001 (via GitHub)" <gi...@apache.org>]

GitHub user RuppMartin001 added a comment to the discussion: [Bug] Table Compare not populating fields meant for error handling

I use table compare. One important thing is that the table compare uses the main output stream and the error output stream.
You can find information about the details of the differences in the error output stream.

But unfortunately there are only the information about: 
 - Values of the primary key columns with "and" between them to identify the row. This string can be used as "'Where" condition in SQL statements.
 - If there is a row with the same primary key values in the reference and compare table and if column values are different:
    - Value of a column in the reference table.
    - Value of a column in the compare table.
 
But there is no information if the record is missing in the reference or compare table.
And if the row is found in both tables and there is a difference: The name of the column with different values.

These information would be so helpful and I don't understand why these information is not in the output stream.

    
    

GitHub link: https://github.com/apache/hop/discussions/5505#discussioncomment-14848541

----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org