You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@twill.apache.org by "Terence Yim (JIRA)" <ji...@apache.org> on 2014/03/15 08:54:42 UTC

[jira] [Commented] (TWILL-55) Verify that LocalFile filenames are valid

    [ https://issues.apache.org/jira/browse/TWILL-55?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13936075#comment-13936075 ] 

Terence Yim commented on TWILL-55:
----------------------------------

So the file name does get verified and triggered an exception. What extra verification is needed?

> Verify that LocalFile filenames are valid
> -----------------------------------------
>
>                 Key: TWILL-55
>                 URL: https://issues.apache.org/jira/browse/TWILL-55
>             Project: Apache Twill
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 0.2.0-incubating
>            Reporter: Alvin Wang
>            Priority: Minor
>
> With the following local files configuration:
> .withLocalFiles().add("test html", uri, false).apply()
> I got the following error:
> 2014-03-11 01:16:18,382 INFO  [ STARTING] - [org.apache.twill.yarn.YarnTwillController]- Checking yarn application status
> 2014-03-11 01:16:18,383 INFO  [ STARTING] - [org.apache.twill.yarn.YarnTwillController]- Yarn application is in state RUNNING
> Exception in thread " STARTING" java.lang.IllegalArgumentException
> 	at java.net.URI.create(URI.java:841)
> 	at org.apache.twill.filesystem.HDFSLocation.append(HDFSLocation.java:107)
> 	at org.apache.twill.yarn.YarnTwillPreparer.createTempLocation(YarnTwillPreparer.java:579)
> 	at org.apache.twill.yarn.YarnTwillPreparer.generateRunnableLocalFile(YarnTwillPreparer.java:407)
> 	at org.apache.twill.yarn.YarnTwillPreparer.populateRunnableLocalFiles(YarnTwillPreparer.java:388)
> 	at org.apache.twill.yarn.YarnTwillPreparer.access$600(YarnTwillPreparer.java:106)
> 	at org.apache.twill.yarn.YarnTwillPreparer$1.call(YarnTwillPreparer.java:243)
> 	at org.apache.twill.yarn.YarnTwillPreparer$1.call(YarnTwillPreparer.java:229)
> 	at org.apache.twill.yarn.YarnTwillController.doStartUp(YarnTwillController.java:87)
> 	at org.apache.twill.internal.AbstractZKServiceController.startUp(AbstractZKServiceController.java:98)
> 	at org.apache.twill.internal.AbstractExecutionServiceController$ServiceDelegate.startUp(AbstractExecutionServiceController.java:109)
> 	at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: java.net.URISyntaxException: Illegal character in path at index 84: hdfs://hs405-1001.local/twill/JarRunnerApp/4e21fc12-eaa7-4be7-875d-93be7702b02f/test html
> 	at java.net.URI$Parser.fail(URI.java:2810)
> 	at java.net.URI$Parser.checkChars(URI.java:2983)
> 	at java.net.URI$Parser.parseHierarchical(URI.java:3067)
> 	at java.net.URI$Parser.parse(URI.java:3015)
> 	at java.net.URI.<init>(URI.java:577)
> 	at java.net.URI.create(URI.java:839)
> 	... 12 more
> java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException
> 	at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294)
> 	at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281)
> 	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> 	at org.apache.twill.yarn.JarRunnerExample.main(JarRunnerExample.java:123)
> Caused by: java.lang.IllegalArgumentException
> 	at java.net.URI.create(URI.java:841)
> 	at org.apache.twill.filesystem.HDFSLocation.append(HDFSLocation.java:107)
> 	at org.apache.twill.yarn.YarnTwillPreparer.createTempLocation(YarnTwillPreparer.java:579)
> 	at org.apache.twill.yarn.YarnTwillPreparer.generateRunnableLocalFile(YarnTwillPreparer.java:407)
> 	at org.apache.twill.yarn.YarnTwillPreparer.populateRunnableLocalFiles(YarnTwillPreparer.java:388)
> 	at org.apache.twill.yarn.YarnTwillPreparer.access$600(YarnTwillPreparer.java:106)
> 	at org.apache.twill.yarn.YarnTwillPreparer$1.call(YarnTwillPreparer.java:243)
> 	at org.apache.twill.yarn.YarnTwillPreparer$1.call(YarnTwillPreparer.java:229)
> 	at org.apache.twill.yarn.YarnTwillController.doStartUp(YarnTwillController.java:87)
> 	at org.apache.twill.internal.AbstractZKServiceController.startUp(AbstractZKServiceController.java:98)
> 	at org.apache.twill.internal.AbstractExecutionServiceController$ServiceDelegate.startUp(AbstractExecutionServiceController.java:109)
> 	at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: java.net.URISyntaxException: Illegal character in path at index 84: hdfs://hs405-1001.local/twill/JarRunnerApp/4e21fc12-eaa7-4be7-875d-93be7702b02f/test html
> 	at java.net.URI$Parser.fail(URI.java:2810)
> 	at java.net.URI$Parser.checkChars(URI.java:2983)
> 	at java.net.URI$Parser.parseHierarchical(URI.java:3067)
> 	at java.net.URI$Parser.parse(URI.java:3015)
> 	at java.net.URI.<init>(URI.java:577)
> 	at java.net.URI.create(URI.java:839)
> 	... 12 more



--
This message was sent by Atlassian JIRA
(v6.2#6252)