You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by ketan dikshit <kd...@yahoo.com.INVALID> on 2017/09/22 10:58:08 UTC
check-env.sh not able to pick property
Hi Team,
I am working with Kylin 2.1.0;
When I try to start Kylin, I get this error:
bin]# ./kylin.sh start
Retrieving hadoop conf dir...
KYLIN_HOME is set to /mnt/md0/kylin/apache-kylin-2.1.0-SNAPSHOT-bin
Please set kylin.env.hdfs-working-dir in kylin.properties
Same with check-env.sh
bin]# ./check-env.sh
Retrieving hadoop conf dir...
KYLIN_HOME is set to /mnt/md0/kylin/apache-kylin-2.1.0-SNAPSHOT-bin
Please set kylin.env.hdfs-working-dir in kylin.properties
When I check this specific property with ./get-properties.sh kylin.env.hdfs-working-dir, I don’t get the value,
But when I check any other property, none are picked,
I have kylin.proprties
kylin.web.timezone=US/Pacific
kylin.metadata.url=kylin_2.1_metadata_production@hbase
kylin.storage.url=hbase
kylin.env.hdfs-working-dir=/tmp/kylin-2.1-prod
kylin.engine.mr.reduce-input-mb=300
kylin.server.mode=all
kylin.job.use-remote-cli=false
kylin.job.remote-cli-working-dir=/tmp/kylin-2.1
kylin.job.max-concurrent-jobs=10
kylin.engine.mr.yarn-check-interval-seconds=10
kylin.source.hive.database-for-flat-table=kylin
kylin.storage.hbase.compression-codec=lz4
kylin.storage.hbase.region-cut-gb=3
kylin.storage.hbase.min-region-count=1
kylin.hbase.region.count.max=500
kylin.storage.partition.max-scan-bytes=16106127360
kylin.security.profile=testing
Why are these not getting picked any idea ??
Thanks,
Ketan
.
Re: check-env.sh not able to pick property
Posted by Li Yang <li...@apache.org>.
Maybe Kylin should check java before checking "kylin.env.hdfs-working-dir".
Something to improve.
Thanks Ketan!
On Fri, Sep 22, 2017 at 8:47 PM, ketan dikshit <kdcool6932@yahoo.com.invalid
> wrote:
> Hi Team,
> Bad on my part, Corrected, the issue was with java access permissions to
> ‘kylin’ user ,
> In get-properties.sh,
> ….
> ...
> ….
> tool_jar=$(ls $KYLIN_HOME/tool/kylin-tool-*.jar)
> result=`java -cp $tool_jar -Dlog4j.configuration=file:${
> KYLIN_HOME}/conf/kylin-tools-log4j.properties org.apache.kylin.tool.KylinConfigCLI
> $1 2>/dev/null`
> echo "$result"
>
> I just got mislead by the error: "Please set kylin.env.hdfs-working-dir in
> kylin.properties”;
>
> Thanks,
> Ketan
>
> > On 22-Sep-2017, at 4:28 PM, ketan dikshit <kd...@yahoo.com.INVALID>
> wrote:
> >
> > Hi Team,
> > I am working with Kylin 2.1.0;
> >
> > When I try to start Kylin, I get this error:
> > bin]# ./kylin.sh start
> > Retrieving hadoop conf dir...
> > KYLIN_HOME is set to /mnt/md0/kylin/apache-kylin-2.1.0-SNAPSHOT-bin
> > Please set kylin.env.hdfs-working-dir in kylin.properties
> >
> > Same with check-env.sh
> > bin]# ./check-env.sh
> > Retrieving hadoop conf dir...
> > KYLIN_HOME is set to /mnt/md0/kylin/apache-kylin-2.1.0-SNAPSHOT-bin
> > Please set kylin.env.hdfs-working-dir in kylin.properties
> >
> > When I check this specific property with ./get-properties.sh
> kylin.env.hdfs-working-dir, I don’t get the value,
> > But when I check any other property, none are picked,
> >
> > I have kylin.proprties
> > kylin.web.timezone=US/Pacific
> > kylin.metadata.url=kylin_2.1_metadata_production@hbase
> > kylin.storage.url=hbase
> > kylin.env.hdfs-working-dir=/tmp/kylin-2.1-prod
> > kylin.engine.mr.reduce-input-mb=300
> > kylin.server.mode=all
> > kylin.job.use-remote-cli=false
> > kylin.job.remote-cli-working-dir=/tmp/kylin-2.1
> > kylin.job.max-concurrent-jobs=10
> > kylin.engine.mr.yarn-check-interval-seconds=10
> > kylin.source.hive.database-for-flat-table=kylin
> > kylin.storage.hbase.compression-codec=lz4
> > kylin.storage.hbase.region-cut-gb=3
> > kylin.storage.hbase.min-region-count=1
> > kylin.hbase.region.count.max=500
> > kylin.storage.partition.max-scan-bytes=16106127360
> > kylin.security.profile=testing
> >
> > Why are these not getting picked any idea ??
> >
> > Thanks,
> > Ketan
> >
> >
> >
> > .
>
>
> .
>
Re: check-env.sh not able to pick property
Posted by ketan dikshit <kd...@yahoo.com.INVALID>.
Hi Team,
Bad on my part, Corrected, the issue was with java access permissions to ‘kylin’ user ,
In get-properties.sh,
….
...
….
tool_jar=$(ls $KYLIN_HOME/tool/kylin-tool-*.jar)
result=`java -cp $tool_jar -Dlog4j.configuration=file:${KYLIN_HOME}/conf/kylin-tools-log4j.properties org.apache.kylin.tool.KylinConfigCLI $1 2>/dev/null`
echo "$result"
I just got mislead by the error: "Please set kylin.env.hdfs-working-dir in kylin.properties”;
Thanks,
Ketan
> On 22-Sep-2017, at 4:28 PM, ketan dikshit <kd...@yahoo.com.INVALID> wrote:
>
> Hi Team,
> I am working with Kylin 2.1.0;
>
> When I try to start Kylin, I get this error:
> bin]# ./kylin.sh start
> Retrieving hadoop conf dir...
> KYLIN_HOME is set to /mnt/md0/kylin/apache-kylin-2.1.0-SNAPSHOT-bin
> Please set kylin.env.hdfs-working-dir in kylin.properties
>
> Same with check-env.sh
> bin]# ./check-env.sh
> Retrieving hadoop conf dir...
> KYLIN_HOME is set to /mnt/md0/kylin/apache-kylin-2.1.0-SNAPSHOT-bin
> Please set kylin.env.hdfs-working-dir in kylin.properties
>
> When I check this specific property with ./get-properties.sh kylin.env.hdfs-working-dir, I don’t get the value,
> But when I check any other property, none are picked,
>
> I have kylin.proprties
> kylin.web.timezone=US/Pacific
> kylin.metadata.url=kylin_2.1_metadata_production@hbase
> kylin.storage.url=hbase
> kylin.env.hdfs-working-dir=/tmp/kylin-2.1-prod
> kylin.engine.mr.reduce-input-mb=300
> kylin.server.mode=all
> kylin.job.use-remote-cli=false
> kylin.job.remote-cli-working-dir=/tmp/kylin-2.1
> kylin.job.max-concurrent-jobs=10
> kylin.engine.mr.yarn-check-interval-seconds=10
> kylin.source.hive.database-for-flat-table=kylin
> kylin.storage.hbase.compression-codec=lz4
> kylin.storage.hbase.region-cut-gb=3
> kylin.storage.hbase.min-region-count=1
> kylin.hbase.region.count.max=500
> kylin.storage.partition.max-scan-bytes=16106127360
> kylin.security.profile=testing
>
> Why are these not getting picked any idea ??
>
> Thanks,
> Ketan
>
>
>
> .
.