You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "valentina kroshilina (JIRA)" <ji...@apache.org> on 2009/11/23 16:42:39 UTC

[jira] Created: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
--------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1235
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: contrib/sqoop
    Affects Versions: 0.20.1
         Environment: hadoop 0.20.1
sqoop
ubuntu karmic
mysql 4
            Reporter: valentina kroshilina
            Priority: Minor


*Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
*Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
*Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification#reply_1604384

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball reassigned MAPREDUCE-1235:
----------------------------------------

    Assignee: Aaron Kimball

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "valentina kroshilina (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

valentina kroshilina updated MAPREDUCE-1235:
--------------------------------------------

    Description: 
*Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
*Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
*Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

  was:
*Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
*Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
*Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification#reply_1604384


> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Priority: Minor
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792490#action_12792490 ] 

Hadoop QA commented on MAPREDUCE-1235:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12428350/MAPREDUCE-1235.patch
  against trunk revision 892178.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/217/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/217/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/217/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/217/console

This message is automatically generated.

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-1235:
-------------------------------------

    Attachment: MAPREDUCE-1235.patch

Attaching patch to fix this issue. MySQL supports TIMESTAMP values of '0000-00-00 00:00:00' which is out-of-range for java.sql.Timestamp. MySQL allows various behaviors for handling this; the default used to be to convert this value to null; since MySQL 5 it now throws IOException when such a timestamp is retrieved.

Sqoop now sets the default behavior to be convert these values to 'null', since this is a reasonable data conversion given the imprecision available. Users can override this default by passing the {{zeroDateTimeBehavior=exception}} parameter in the connect string.

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated MAPREDUCE-1235:
-------------------------------------

    Status: Patch Available  (was: Open)

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792176#action_12792176 ] 

Todd Lipcon commented on MAPREDUCE-1235:
----------------------------------------

patch looks good to me

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas updated MAPREDUCE-1235:
-------------------------------------

       Resolution: Fixed
    Fix Version/s: 0.22.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I committed this. Thanks, Aaron!

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>             Fix For: 0.22.0
>
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796739#action_12796739 ] 

Hudson commented on MAPREDUCE-1235:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #196 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/196/])
    

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>             Fix For: 0.22.0
>
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-1235) java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP.

Posted by "Aaron Kimball (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792549#action_12792549 ] 

Aaron Kimball commented on MAPREDUCE-1235:
------------------------------------------

These test failures are unrelated

> java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> --------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1235
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1235
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/sqoop
>    Affects Versions: 0.20.1
>         Environment: hadoop 0.20.1
> sqoop
> ubuntu karmic
> mysql 4
>            Reporter: valentina kroshilina
>            Assignee: Aaron Kimball
>            Priority: Minor
>         Attachments: MAPREDUCE-1235.patch
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> *Description*: java.io.IOException is thrown when trying to import a table to HDFS using Sqoop. Table has "0" value in a field of type datetime. 
> *Full Exception*: java.io.IOException: Cannot convert value '0000-00-00 00:00:00' from column 6 to TIMESTAMP. 
> *Original question*: http://getsatisfaction.com/cloudera/topics/cant_import_table?utm_content=reply_link&utm_medium=email&utm_source=reply_notification

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.