You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Louis Mau (JIRA)" <ji...@apache.org> on 2013/12/05 19:32:35 UTC

[jira] [Created] (SQOOP-1251) Sqoop job performing Incremental import hangs after the successful import

Louis Mau created SQOOP-1251:
--------------------------------

             Summary: Sqoop job performing Incremental import hangs after the successful import
                 Key: SQOOP-1251
                 URL: https://issues.apache.org/jira/browse/SQOOP-1251
             Project: Sqoop
          Issue Type: Bug
          Components: metastore
    Affects Versions: 1.4.3
            Reporter: Louis Mau


To reproduce the problem, create an incremental import job.
$SQOOP_HOME/bin/sqoop job --create mergetest -- import --options-file sqoop-params.txt --table mergetest --incremental lastmodified --check-column lastmod -m 1
In subsequent "exec", the import completed successfully but the process  hung.

It appears that hsqldb v1.8 used in the metastore only allows "a single session at a time performs an SQL statement completely, before the next session is allowed access."    In this scenario, the JobTool created a session to retrieve the previously saved Job info and the ImportTool created a separate connection for saving incremental info.    Adding a connection.rollback() call in the read(String jobName) method of  HsqldbJobStorage.java eliminated the hang.   Upgrading hsqldb to v2.0 might also resolve the problem.



--
This message was sent by Atlassian JIRA
(v6.1#6144)