[jira] [Created] (BIGTOP-2133) Running BPSGenerator using fat-jar fails on Mac OS X

["Kengo Seki (JIRA)" <ji...@apache.org>]

Kengo Seki created BIGTOP-2133:
----------------------------------

             Summary: Running BPSGenerator using fat-jar fails on Mac OS X
                 Key: BIGTOP-2133
                 URL: https://issues.apache.org/jira/browse/BIGTOP-2133
             Project: Bigtop
          Issue Type: Bug
          Components: blueprints
            Reporter: Kengo Seki
            Priority: Minor


I tried bigpetstore-mapreduce following the "Running on a hadoop cluster" section in bigtop-bigpetstore/bigpetstore-mapreduce/README.md on OS X.
First, I created fat-jar using the following command:

{code}
gradle clean shadowJar -Pfor-cluster
{code}

Then, I ran BPSGenerator, but encountered the following error:

{code}
[sekikn@mobile bigpetstore-mapreduce]$ hadoop jar build/libs/BigPetStore-1.1.0-SNAPSHOT-all.jar org.apache.bigtop.bigpetstore.generator.BPSGenerator 1000000 bigpetstore/gen
Exception in thread "main" java.io.IOException: Mkdirs failed to create /var/folders/n2/1bnspz7j4q7100jmh610zd200000gn/T/hadoop-unjar4851530034973666155/META-INF/license
	at org.apache.hadoop.util.RunJar.ensureDirectory(RunJar.java:128)
	at org.apache.hadoop.util.RunJar.unJar(RunJar.java:104)
	at org.apache.hadoop.util.RunJar.unJar(RunJar.java:81)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:209)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
{code}

This is because both META-INF/LICENSE (file) and META-INF/license (directory) exist in the fat-jar and the default filesystem of OS X doesn't differentiate them.

{code}
[sekikn@mobile bigpetstore-mapreduce]$ jar tf build/libs/BigPetStore-1.1.0-SNAPSHOT-all.jar | grep -i -E META-INF/license/?$
META-INF/LICENSE
META-INF/license/
{code}

If either of them is removed, generated jar works well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)