You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "Tushar Gosavi (JIRA)" <ji...@apache.org> on 2017/05/05 10:47:08 UTC
[jira] [Closed] (APEXCORE-683) Apex client should support
application packages on HDFS
[ https://issues.apache.org/jira/browse/APEXCORE-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tushar Gosavi closed APEXCORE-683.
----------------------------------
Closing after 3.6.0 release
> Apex client should support application packages on HDFS
> -------------------------------------------------------
>
> Key: APEXCORE-683
> URL: https://issues.apache.org/jira/browse/APEXCORE-683
> Project: Apache Apex Core
> Issue Type: Improvement
> Reporter: Vlad Rozov
> Assignee: Vlad Rozov
> Fix For: 3.6.0
>
>
> apex client supports only local file system, it is natural for native yarn application to support hdfs and other dfs file systems:
> {noformat}
> hdfs dfs -ls hdfs:///user/vrozov
> Found 4 items
> drwx------ - vrozov supergroup 0 2016-12-24 16:00 hdfs:///user/vrozov/.Trash
> drwxrwxrwx - vrozov supergroup 0 2017-02-28 19:20 hdfs:///user/vrozov/.flink
> -rw-r--r-- 3 vrozov supergroup 18862977 2017-03-25 09:20 hdfs:///user/vrozov/appPackage.apa
> drwxrwxrwx - vrozov supergroup 0 2016-10-25 21:49 hdfs:///user/vrozov/datatorrent
> [vrozov@node0 apex]$ apex
> Apex CLI 3.6.0-SNAPSHOT 25.03.2017 @ 09:17:45 PDT rev: b4a4e05 branch: master
> apex> get-app-package-info hdfs:///user/vrozov/appPackage.apa
> java.io.FileNotFoundException: hdfs:/user/vrozov/appPackage.apa (No such file or directory)
> at java.util.zip.ZipFile.open(Native Method)
> at java.util.zip.ZipFile.<init>(ZipFile.java:215)
> at java.util.zip.ZipFile.<init>(ZipFile.java:145)
> at java.util.jar.JarFile.<init>(JarFile.java:154)
> at java.util.jar.JarFile.<init>(JarFile.java:118)
> at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:185)
> at com.datatorrent.stram.client.AppPackage.<init>(AppPackage.java:258)
> at com.datatorrent.stram.cli.ApexCli.newAppPackageInstance(ApexCli.java:467)
> at com.datatorrent.stram.cli.ApexCli$GetAppPackageInfoCommand.execute(ApexCli.java:3502)
> at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1520)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)