You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@livy.apache.org by "Gyorgy Gal (Jira)" <ji...@apache.org> on 2026/03/02 16:52:00 UTC

[jira] [Assigned] (LIVY-789) Spark data files are not available in interactive session

     [ https://issues.apache.org/jira/browse/LIVY-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gyorgy Gal reassigned LIVY-789:
-------------------------------

    Assignee: Arnav Balyan

> Spark data files are not available in interactive session
> ---------------------------------------------------------
>
>                 Key: LIVY-789
>                 URL: https://issues.apache.org/jira/browse/LIVY-789
>             Project: Livy
>          Issue Type: Bug
>          Components: Interpreter
>    Affects Versions: 0.7.0
>            Reporter: Dylan Patterson
>            Assignee: Arnav Balyan
>            Priority: Blocker
>             Fix For: 0.10.0
>
>          Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Files passed via the `files` parameter are not available from the main program in interactive mode. This is because livy runs the `fake_shell.py` interpreter in the root directory while yarn stages in a temp dir.  I have not checked whether batch programs suffer the same short coming.
> *Potential Solutions*
> # Set CWD of `fake_shell.py` to yarn staging directory
> # Create temporary working directory and copy necessary files from the `files` parameter



--
This message was sent by Atlassian Jira
(v8.20.10#820010)