You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Bennie Schut (JIRA)" <ji...@apache.org> on 2011/03/15 13:49:29 UTC

[jira] Created: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
---------------------------------------------------------------------------------------------------------

                 Key: HIVE-2054
                 URL: https://issues.apache.org/jira/browse/HIVE-2054
             Project: Hive
          Issue Type: Bug
          Components: JDBC
            Reporter: Bennie Schut
            Priority: Minor


It seems something recently changed on the jdbc driver which causes this IOException on windows.

java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007803#comment-13007803 ] 

Ning Zhang commented on HIVE-2054:
----------------------------------

I think the problem is that the tmpDir by default is /tmp/<user.name>/, specified by hive.querylog.location. Bennie, I think if you set hive.querylog.location to be something like 'c:\' on Windows, it should work. Can you try that?

The JdbcSessionState was introduced in the very first version of the JDBC driver (HIVE-48). It is not used but I guess the reason for it to be able to set session level states for the JDBC connection. I'm OK removing it, but not sure about others' opinion.

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007848#comment-13007848 ] 

Bennie Schut commented on HIVE-2054:
------------------------------------

Yes setting hive.querylog.location makes it work.

At the very least we should remove the "extends SessionState" since it introduces a link to the hive server code which makes no sense at this point in time. However I have a preference for removing it all together since it currently adds no value.  On the jdbc side I would expect the HiveConnection to hold the state which it is actually doing right now.



> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007240#comment-13007240 ] 

Ning Zhang commented on HIVE-2054:
----------------------------------

Bennie, do you know what changes in SessionState causes JDBC failed on Windows? 

We recently committed HIVE-818 which changes HiveServer and some behavior on how to pass End-of-file from the server side to the client side. Previously server just send an empty string and now server throws an HiveServerException with ErrorCode = 0. I think that may be the reason. Can you try your test case with and without HIVE-818 to verify?

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2054:
---------------------------------

       Resolution: Fixed
    Fix Version/s: 0.7.1
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

Committed to trunk and 0.7.1. Thanks Bennie!

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.7.1, 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt, HIVE-2054.2.patch.txt, HIVE-2054.3.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015513#comment-13015513 ] 

Carl Steinbach commented on HIVE-2054:
--------------------------------------

+1. Will commit if tests pass.

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt, HIVE-2054.2.patch.txt, HIVE-2054.3.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015295#comment-13015295 ] 

Bennie Schut commented on HIVE-2054:
------------------------------------

Any chance in getting this committed :) This is rather annoying for windows users.

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt, HIVE-2054.2.patch.txt, HIVE-2054.3.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007366#comment-13007366 ] 

Bennie Schut commented on HIVE-2054:
------------------------------------

Yes it was this code block:

      try {
        File tmpFile = File.createTempFile(sessionID, ".pipeout", tmpDir);
        tmpFile.deleteOnExit();
        startSs.setTmpOutputFile(tmpFile);
      } catch (IOException e) {
        throw new RuntimeException(e);
      }

So you are correct it's related to changes from HIVE-818.

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bennie Schut updated HIVE-2054:
-------------------------------

    Attachment: HIVE-2054.1.patch.txt

Removing SessionState so the jdbc works correctly on windows.

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>            Reporter: Bennie Schut
>            Priority: Minor
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006899#comment-13006899 ] 

Bennie Schut commented on HIVE-2054:
------------------------------------

This seems to happen because we use the same SessionState class the cli is using which is now including some temporary output files and history file references.
It's rather trivial to remove the SessionState from the jdbc driver to make it work again (just tried this a few minutes ago). We currently have a JdbcSessionState which extends the SessonState but I don't see a need for the JdbcSessionState either. It seems to be there as a placeholder but is not actually used. 

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>            Reporter: Bennie Schut
>            Priority: Minor
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bennie Schut updated HIVE-2054:
-------------------------------

        Fix Version/s: 0.8.0
             Assignee: Bennie Schut
    Affects Version/s: 0.8.0
         Release Note: Fix for IOException on the jdbc driver on windows.
               Status: Patch Available  (was: Open)

https://reviews.apache.org/r/513/

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008333#comment-13008333 ] 

Ning Zhang commented on HIVE-2054:
----------------------------------

Sounds reasonable to me. 

Raghu, what do you think?

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bennie Schut updated HIVE-2054:
-------------------------------

    Attachment: HIVE-2054.3.patch.txt

New patch because of changes from HIVE-2062

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt, HIVE-2054.2.patch.txt, HIVE-2054.3.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (HIVE-2054) Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"

Posted by "Bennie Schut (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bennie Schut updated HIVE-2054:
-------------------------------

    Attachment: HIVE-2054.2.patch.txt

New patch because of merge from HIVE-1815.

> Exception on windows when using the jdbc driver. "IOException: The system cannot find the path specified"
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-2054
>                 URL: https://issues.apache.org/jira/browse/HIVE-2054
>             Project: Hive
>          Issue Type: Bug
>          Components: JDBC
>    Affects Versions: 0.8.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2054.1.patch.txt, HIVE-2054.2.patch.txt
>
>
> It seems something recently changed on the jdbc driver which causes this IOException on windows.
> java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
> 	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:237)
> 	at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:73)
> 	at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira