You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@livy.apache.org by "Gyorgy Gal (Jira)" <ji...@apache.org> on 2025/11/10 17:14:00 UTC

[jira] [Updated] (LIVY-789) Spark data files are not available in interactive session

     [ https://issues.apache.org/jira/browse/LIVY-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gyorgy Gal updated LIVY-789:
----------------------------
    Fix Version/s: 0.10.0
                       (was: 0.9.0)

This issue has been moved to the 0.10.0 release as part of a bulk update. If you feel this is moved out inappropriately, feel free to provide justification and reset the Fix Version to 0.9.0.

> Spark data files are not available in interactive session
> ---------------------------------------------------------
>
>                 Key: LIVY-789
>                 URL: https://issues.apache.org/jira/browse/LIVY-789
>             Project: Livy
>          Issue Type: Bug
>          Components: Interpreter
>    Affects Versions: 0.7.0
>            Reporter: Dylan Patterson
>            Priority: Blocker
>             Fix For: 0.10.0
>
>
> Files passed via the `files` parameter are not available from the main program in interactive mode. This is because livy runs the `fake_shell.py` interpreter in the root directory while yarn stages in a temp dir.  I have not checked whether batch programs suffer the same short coming.
> *Potential Solutions*
> # Set CWD of `fake_shell.py` to yarn staging directory
> # Create temporary working directory and copy necessary files from the `files` parameter



--
This message was sent by Atlassian Jira
(v8.20.10#820010)