You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@bahir.apache.org by ckadner <gi...@git.apache.org> on 2016/11/16 22:44:42 UTC

[GitHub] bahir issue #27: [BAHIR-75][WIP] Initital code delivery for WebHDFS data sou...

Github user ckadner commented on the issue:

    https://github.com/apache/bahir/pull/27
  
    @sourav-mazumder  I pushed a fixes to your fork:
    
    * `README.md` correcting typos, add syntax highlighting
    *  `pom.xml` fix `RAT` excludes, include `META-INF/services` as resources in generated `jar` file so Spark can pick up your `webhdfs` data source
    
    I am in the process of fixing the 798 Scalastyle violations. The failed Scalastyle checks block the `mvn install` build which is supposed to install the new `datasource-webhdfs` module into the local Maven repository &mdash; a prerequisite to running `spark-submit` or `spark-shell` with the  `--packages datasource-webhdfs` option:
    ```Shell
    $ mvn install -DskipTests -pl datasource-webhdfs
    ```
    Output:
    ```                                                                    
    [INFO] ------------------------------------------------------------------------
    [INFO] Building Apache Bahir - Spark DataSource WebHDFS 2.1.0-SNAPSHOT
    [INFO] ------------------------------------------------------------------------
    ...
    [INFO] --- scalastyle-maven-plugin:0.8.0:check (default) @ datasource-webhdfs_2.11 ---
    ...
    Processed 10 file(s)
    Found 798 errors
    Found 0 warnings
    Found 0 infos
    Finished in 1912 ms
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal org.scalastyle:scalastyle-maven-plugin:0.8.0:check (default) on project datasource-webhdfs_2.11: Failed during scalastyle execution: You have 798 Scalastyle violation(s). -> [Help 1]
    ...
    ```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---