You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "AlefRP (via GitHub)" <gi...@apache.org> on 2024/05/06 17:20:46 UTC

[I] [Bug]: Consistent Date Handling Issues with SQLite Plugin in Apache Hop (hop)

AlefRP opened a new issue, #3910:
URL: https://github.com/apache/hop/issues/3910

   ### Apache Hop version?
   
   2.8.0
   
   ### Java version?
   
   OpenJDK 21.0.3 LTS
   
   ### Operating system
   
   Windows
   
   ### What happened?
   
   ## Environment
   - **Apache Hop Version**: 2.8.0 and 2.7.0
   - **SQLite Version**: 3.43.0 2023-08-24 (32-bit)
   - **Java Version**: OpenJDK 21.0.3 LTS, Temurin-21.0.3+9, built 2024-04-16
   - **Operating System**: Windows 11 Pro, Version 23H2, OS Build 22631.3527, Installed on 13/07/2023, Windows Feature Experience Pack 1000.22700.1003.0
   
   ## Issue Description
   Apache Hop consistently struggles with handling date data from SQLite databases. This includes failures and incorrect results when using various date conversion functions (`STRFTIME`, `DATE`, `FORMAT`) as well as issues with direct imports of date columns that contain null values. In other database clients like DBeaver, these dates are displayed and processed correctly, but Apache Hop converts date values to integers or fails to properly recognize and import them when no conversion function is applied.
   
   ## Steps to Reproduce
   1. **Direct Import of Date Columns**:
      - Import a date column directly from a SQLite database into Apache Hop without any conversion functions.
      - Observe how Apache Hop handles the raw date data, especially focusing on the handling of null values.
   
   2. **Using Date Conversion Functions**:
      - Apply various date conversion functions (`STRFTIME`, `DATE`, `FORMAT`) to a date column in separate transformations.
      - Check the output in each case and note any discrepancies or failures, particularly when the input data contains null or empty values.
   
   ## Expected Result
   - Directly imported date columns should be recognized and displayed correctly as date data types.
   - Date conversion functions should return properly formatted date strings, and handle null values gracefully without causing failures.
   
   ## Actual Result
   - Directly imported dates, especially those with null values, are not recognized or handled properly.
   - Date conversion functions return integers (primarily the year component) instead of formatted date strings and struggle with null date values.
   
   ## Additional Information
   - Screenshots and logs that show the discrepancies in date handling in Apache Hop compared to expected outputs observed in other environments can be attached here.
   <img width="341" alt="example_hop" src="https://github.com/apache/hop/assets/93484657/80e7cc0e-f3f2-4499-8706-608b71ae1461">
   <img width="233" alt="example_dbeaver" src="https://github.com/apache/hop/assets/93484657/4419f2ac-e117-43e9-9836-3ed62fafd513">
   
   ### Issue Priority
   
   Priority: 1
   
   ### Issue Component
   
   Component: Database


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Consistent Date Handling Issues with SQLite Plugin in Apache Hop (hop)

Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters commented on issue #3910:
URL: https://github.com/apache/hop/issues/3910#issuecomment-2615907031

   You wouldn't happen to have a SQLite test database you can share to fix this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Consistent Date Handling Issues with SQLite Plugin in Apache Hop (hop)

Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #3910:
URL: https://github.com/apache/hop/issues/3910#issuecomment-5367879261

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug]: Consistent Date Handling Issues with SQLite Plugin in Apache Hop (hop)

Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva closed issue #3910: [Bug]: Consistent Date Handling Issues with SQLite Plugin in Apache Hop
URL: https://github.com/apache/hop/issues/3910


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org