You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Narayan Periwal (JIRA)" <ji...@apache.org> on 2015/09/14 10:43:46 UTC

[jira] [Commented] (FALCON-503) The expected result of examples/data/generate.sh <>?

    [ https://issues.apache.org/jira/browse/FALCON-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14743165#comment-14743165 ] 

Narayan Periwal commented on FALCON-503:
----------------------------------------

The examples/data/generate.sh script is used to generate the input data for the falcon processes(that are there inside examples/entity/filesystem/) to consume.

The script will generate the /data directory in the hdfs which will contain the input data, as depicted below:-

[oozie@/opt/gridops/falcon$]hadoop fs -ls /data/in/2013/11/15/00
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

15/09/14 14:11:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 60 items
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/00
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/01
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/02
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/03
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/04
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/05
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/06
drwxr-xr-x   - oozie hdfs          0 2015-09-02 18:12 /data/in/2013/11/15/00/07
 .......

> The expected result of examples/data/generate.sh <<hdfs endpoint>>?
> -------------------------------------------------------------------
>
>                 Key: FALCON-503
>                 URL: https://issues.apache.org/jira/browse/FALCON-503
>             Project: Falcon
>          Issue Type: Improvement
>          Components: docs
>    Affects Versions: 0.6
>            Reporter: Peng
>
> In the current version setup, there is a command examples/data/generate.sh <<hdfs endpoint>>. What is the expected result of this command.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)