You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2014/05/29 21:55:02 UTC

[jira] [Commented] (STORM-211) Add module for HDFS integration

    [ https://issues.apache.org/jira/browse/STORM-211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012791#comment-14012791 ] 

ASF GitHub Bot commented on STORM-211:
--------------------------------------

GitHub user ptgoetz opened a pull request:

    https://github.com/apache/incubator-storm/pull/128

    STORM-211: Add module for HDFS integration

    More information on usage, etc. is available in the README.md.
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/ptgoetz/incubator-storm storm-hdfs

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-storm/pull/128.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #128
    
----
commit 18f5e6b216f1386a7e1c4e642944343193e9a022
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T15:22:26Z

    Initial commit

commit 54d15543df9121e8fe6682047cf69d6fd4b11198
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T15:26:47Z

    initial check-in

commit 34311bceac43b026d8d4a91644de1d7d733b5013
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T15:28:37Z

    Merge branch 'master' of github.com:ptgoetz/storm-hdfs

commit 736cd54a6041761eee3428bf6e8e498272b53aad
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T15:30:29Z

    update .gitignore

commit 8fb04abcd22d757fd7c07106bf99de45b19ef92f
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T15:47:23Z

    add basic usage example

commit 8c62c8f1aa9489c23d86be29172c65d0c0f1e98d
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T16:50:47Z

    update readme with basic usage information

commit 07733db07c2a2e549c6114ebc761e772dbbcdeae
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-27T16:53:39Z

    fix typo and re-order

commit 42d43f095c285d48effdef82599478df9fa69f60
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-28T19:48:26Z

    preliminary support for HDFS sequence files

commit 4ad401ad5bb466a4b6e22e3f1b956149e11d800d
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-01-28T19:50:10Z

    set version

commit fbda8b7000a88b606400c9ed93f9ba68b7b931a8
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-03T20:00:42Z

    use storm incubating version

commit 08bd4140c47b02d33d0f3741561f6a44c620a414
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-03T20:05:49Z

    refactor HdfsBolt/SequenceFileBolt

commit 7444918651d6a2c7595b03951d11f22671eca3b2
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-03T20:08:11Z

    add trident state implementation

commit ebc630286037ddc7c6764cbcc3609ab9c3307b93
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-03T20:25:56Z

    add trident sample to README

commit c5ba15fee214bd9ca0dbe9a1661aec7855fb2db1
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-05T01:35:45Z

    updated readme per issue #1

commit e7adf3f5706602ce481263478b73ba0160fdbd5f
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-05T06:15:04Z

    add rotation actions for bolts

commit 7085e2b19925bc95e7fe921e3979bb16a8c55d1a
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-07T19:31:09Z

    add RotationActions to State implementation.

commit e7a0bb86a76a73eadd047f24c4b60e488a4b1886
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-07T21:05:23Z

    refactor trident state implementation and add support for sequence files.

commit b19b7869cc7363658dd084b5d08e390cac625542
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-07T21:08:56Z

    rollback pom to storm 0.9.0.1

commit 2a0cce2e54eedb4f6f813c4f88b53e852909e1d1
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-08T07:02:55Z

    cleanup and documentation

commit 32826f0c3b908e2852b836f46c303a82b62d73bd
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-08T07:09:06Z

    documentation fix

commit b214f7231d03ff3c964afd88616e11de16b91a18
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-10T15:46:15Z

    cleanup and javadoc

commit a826fa33d18d41d6a3c9869c30c4e54f5a848e0a
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-10T15:46:45Z

    add samples to test directory

commit 98a70814025bff0a65c01d17c1a2550f17b7b38f
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-11T21:10:17Z

    move path configuration to FileNameFormat to allow dynamic paths

commit bd3d7805be7d8c57d39626b61e1e50240fa98824
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-11T21:12:55Z

    bump version for API change

commit 891f2f8efe22cad232f10fa6f7a1e327623159dc
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-02-11T21:17:26Z

    update README for API change

commit 0c754dc6d47c6b5b76bb06cace190b164350e53c
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-03-11T13:33:45Z

    update examples to get hdfs url from CLI arguments

commit 7a75c959eea518211af766ee0f1146dbc051ae0e
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-03-11T21:11:17Z

    add ability to specify hdfs url from command line in samples

commit f550621ea814af02014886a78b45584569b468fe
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-03-21T19:36:33Z

    fix issue #7

commit c8a511bd0d753bbb48a80a815998e8f7000c77a4
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-04-09T20:03:52Z

    fix issue with DelimitedRecordFormat

commit 15346a8533442dbd82806824556eb5fd2735e38e
Author: P. Taylor Goetz <pt...@gmail.com>
Date:   2014-04-14T17:51:20Z

    add ability to specify hadoop configuration parameters (override hdfs-site.xml)

----


> Add module for HDFS integration
> -------------------------------
>
>                 Key: STORM-211
>                 URL: https://issues.apache.org/jira/browse/STORM-211
>             Project: Apache Storm (Incubating)
>          Issue Type: Sub-task
>            Reporter: P. Taylor Goetz
>
> Add a module with generic components (storm, trident) for interacting with HDFS:
> - Write to regular and sequence files
> - Core bolts, and Trident state implementation.
> - Integrate with secure (kerberos-enabled) HDFS



--
This message was sent by Atlassian JIRA
(v6.2#6252)