You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "Vlad Rozov (JIRA)" <ji...@apache.org> on 2017/03/30 03:23:42 UTC
[jira] [Updated] (APEXCORE-683) Apex client should support
application packages on HDFS
[ https://issues.apache.org/jira/browse/APEXCORE-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vlad Rozov updated APEXCORE-683:
--------------------------------
Description:
apex client supports only local file system, it is natural for native yarn application to support hdfs and other dfs file systems:
{noformat}
hdfs dfs -ls hdfs:///user/vrozov
Found 4 items
drwx------ - vrozov supergroup 0 2016-12-24 16:00 hdfs:///user/vrozov/.Trash
drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20 hdfs:///user/vrozov/.flink
-rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20 hdfs:///user/vrozov/appPackage.apa
drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49 hdfs:///user/vrozov/datatorrent
[vrozov@node0 apex]$ apex
Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:118)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
at com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
at com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
{noformat}
was:
apex client supports only local file system:
{noformat}
hdfs dfs -ls hdfs:///user/vrozov
Found 4 items
drwx------ - vrozov supergroup 0 2016-12-24 16:00 hdfs:///user/vrozov/.Trash
drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20 hdfs:///user/vrozov/.flink
-rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20 hdfs:///user/vrozov/appPackage.apa
drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49 hdfs:///user/vrozov/datatorrent
[vrozov@node0 apex]$ apex
Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:118)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
at com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
at com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
{noformat}
> Apex client should support application packages on HDFS
> -------------------------------------------------------
>
> Key: APEXCORE-683
> URL: https://issues.apache.org/jira/browse/APEXCORE-683
> Project: Apache Apex Core
> Issue Type: Improvement
> Reporter: Vlad Rozov
> Assignee: Vlad Rozov
>
> apex client supports only local file system, it is natural for native yarn application to support hdfs and other dfs file systems:
> {noformat}
> hdfs dfs -ls hdfs:///user/vrozov
> Found 4 items
> drwx------ - vrozov supergroup 0 2016-12-24 16:00 hdfs:///user/vrozov/.Trash
> drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20 hdfs:///user/vrozov/.flink
> -rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20 hdfs:///user/vrozov/appPackage.apa
> drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49 hdfs:///user/vrozov/datatorrent
> [vrozov@node0 apex]$ apex
> Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
> apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
> java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:215)
> at java.util.zip.ZipFile.<init>(ZipFile.java:145)
> at java.util.jar.JarFile.<init>(JarFile.java:154)
> at java.util.jar.JarFile.<init>(JarFile.java:118)
> at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
> at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
> at com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
> at com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
> at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)