You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by chamikaramj <gi...@git.apache.org> on 2016/10/31 14:45:47 UTC

[GitHub] incubator-beam pull request #1235: [BEAM-700] Improvements related to size e...

GitHub user chamikaramj opened a pull request:

    https://github.com/apache/incubator-beam/pull/1235

    [BEAM-700] Improvements related to size estimation.

    Updates FileBasedSource so that size estimation of glob patterns that expand into a large number of files is done using sampling.
    
    Updates Dataflow runner to set estimated sizes of sources when submitting jobs.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/chamikaramj/incubator-beam estimate_size_of_sources

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/1235.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1235
    
----
commit 42b1d9f541a54ea49ec717934632e8e82c21e911
Author: chamikara@google.com <ch...@google.com>
Date:   2016-10-31T14:39:13Z

    Improvements related to size estimation.
    
    Updates FileBasedSource so that size estimation of glob patterns that expand into a large number of files is done using sampling.
    
    Updates Dataflow runner to set estimated sizes of sources when submitting jobs.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #1235: [BEAM-700] Improvements related to size e...

Posted by chamikaramj <gi...@git.apache.org>.
Github user chamikaramj closed the pull request at:

    https://github.com/apache/incubator-beam/pull/1235


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---