[jira] [Updated] (BIGTOP-2133) Running BPSGenerator using fat-jar fails on Mac OS X

["Kengo Seki (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BIGTOP-2133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kengo Seki updated BIGTOP-2133:
-------------------------------
    Attachment: BIGTOP-2133.patch

Attaching a patch, but I think Bigtop doesn't support OS X officially. Please close this JIRA as "won't fix" if it's not a problem. Thanks!

> Running BPSGenerator using fat-jar fails on Mac OS X
> ----------------------------------------------------
>
>                 Key: BIGTOP-2133
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-2133
>             Project: Bigtop
>          Issue Type: Bug
>          Components: blueprints
>            Reporter: Kengo Seki
>            Priority: Minor
>         Attachments: BIGTOP-2133.patch
>
>
> I tried bigpetstore-mapreduce following the "Running on a hadoop cluster" section in bigtop-bigpetstore/bigpetstore-mapreduce/README.md on OS X.
> First, I created fat-jar using the following command:
> {code}
> gradle clean shadowJar -Pfor-cluster
> {code}
> Then, I ran BPSGenerator, but encountered the following error:
> {code}
> [sekikn@mobile bigpetstore-mapreduce]$ hadoop jar build/libs/BigPetStore-1.1.0-SNAPSHOT-all.jar org.apache.bigtop.bigpetstore.generator.BPSGenerator 1000000 bigpetstore/gen
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /var/folders/n2/1bnspz7j4q7100jmh610zd200000gn/T/hadoop-unjar4851530034973666155/META-INF/license
> 	at org.apache.hadoop.util.RunJar.ensureDirectory(RunJar.java:128)
> 	at org.apache.hadoop.util.RunJar.unJar(RunJar.java:104)
> 	at org.apache.hadoop.util.RunJar.unJar(RunJar.java:81)
> 	at org.apache.hadoop.util.RunJar.run(RunJar.java:209)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
> {code}
> This is because both META-INF/LICENSE (file) and META-INF/license (directory) exist in the fat-jar and the default filesystem of OS X doesn't differentiate them.
> {code}
> [sekikn@mobile bigpetstore-mapreduce]$ jar tf build/libs/BigPetStore-1.1.0-SNAPSHOT-all.jar | grep -i -E META-INF/license/?$
> META-INF/LICENSE
> META-INF/license/
> {code}
> If either of them is removed, generated jar works well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)