You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by mnagy <ma...@quantium.com.au> on 2016/08/25 04:16:02 UTC

version compability

Here we are using hadoop 2.7.0, hbase 1.1.1, hive 1.2.
I tried to use kylin 1.5.2.1 and 1.5.3 without success.
Can you point me the right kylin version to use?

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by Sarnath K <st...@gmail.com>.
This is an excellent use-case for running docker image. I assume Kylin
already supports docker. I guess you should give that a try if Ubuntu is
the reason.
On Aug 26, 2016 2:16 PM, "ShaoFeng Shi" <sh...@apache.org> wrote:

> I remember someone mentioned the same issue with Ubuntu. The dev team are
> using Redhat/CentOS, so not aware its problem in other Linux. Could you
> please open a JIRA (in http://issues.apache.org/jira/secure/Dashboard.jspa
> )
> for tracking this problem? Thanks!
>
> 2016-08-26 15:32 GMT+08:00 mnagy <ma...@quantium.com.au>:
>
> > DISTRIB_ID=Ubuntu
> > DISTRIB_RELEASE=14.04
> > DISTRIB_CODENAME=trusty
> > DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> > NAME="Ubuntu"
> > VERSION="14.04.4 LTS, Trusty Tahr"
> > ID=ubuntu
> > ID_LIKE=debian
> > PRETTY_NAME="Ubuntu 14.04.4 LTS"
> > VERSION_ID="14.04"
> > HOME_URL="http://www.ubuntu.com/"
> > SUPPORT_URL="http://help.ubuntu.com/"
> > BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/version-compability-tp5636p5657.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>

Re: version compability

Posted by ShaoFeng Shi <sh...@apache.org>.
New JIRA opened: https://issues.apache.org/jira/browse/KYLIN-1978


2016-08-26 17:55 GMT+08:00 mnagy <ma...@quantium.com.au>:

> I am not been able to reset my password.
> So I am not able to log at jira can you check it for me ?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p5661.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Best regards,

Shaofeng Shi

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
I am not been able to reset my password.
So I am not able to log at jira can you check it for me ?

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5661.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by ShaoFeng Shi <sh...@apache.org>.
I remember someone mentioned the same issue with Ubuntu. The dev team are
using Redhat/CentOS, so not aware its problem in other Linux. Could you
please open a JIRA (in http://issues.apache.org/jira/secure/Dashboard.jspa )
for tracking this problem? Thanks!

2016-08-26 15:32 GMT+08:00 mnagy <ma...@quantium.com.au>:

> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/"
> SUPPORT_URL="http://help.ubuntu.com/"
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p5657.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Best regards,

Shaofeng Shi

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
Kylin is throwing these message when I try do build a cube following the the
tutorial. http://kylin.apache.org/docs15/tutorial/create_cube.html 


Error Message

CubeDesc is null.
Cube Schema

{
  "name": "TUTORIAL_CUBE",
  "model_name": "Tutorial_Model",
  "description": "desc tutorial
hjhkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk",
  "dimensions": [
    {
      "name": "DATE",
      "table": "DEFAULT.KYLIN_SALES",
      "derived": null,
      "column": "PART_DT"
    },
    {
      "name": "DERIVED_DATES",
      "table": "DEFAULT.KYLIN_CAL_DT",
      "derived": [
        "YEAR_BEG_DT",
        "QTR_BEG_DT",
        "MONTH_BEG_DT",
        "WEEK_BEG_DT"
      ],
      "column": null
    },
    {
      "name": "DEFAULT.KYLIN_SALES.LSTG_FORMAT_NAME",
      "table": "DEFAULT.KYLIN_SALES",
      "derived": null,
      "column": "LSTG_FORMAT_NAME"
    },
    {
      "name": "DEFAULT.KYLIN_SALES.LEAF_CATEG_ID",
      "table": "DEFAULT.KYLIN_SALES",
      "derived": null,
      "column": "LEAF_CATEG_ID"
    },
    {
      "name": "DEFAULT.KYLIN_SALES.LSTG_SITE_ID",
      "table": "DEFAULT.KYLIN_SALES",
      "derived": null,
      "column": "LSTG_SITE_ID"
    }
  ],
  "measures": [
    {
      "name": "transactions",
      "function": {
        "expression": "COUNT",
        "returntype": "bigint",
        "parameter": {
          "type": "constant",
          "value": 1,
          "next_parameter": null
        }
      }
    },
    {
      "name": "total_price",
      "function": {
        "expression": "SUM",
        "returntype": "decimal(19,4)",
        "parameter": {
          "type": "column",
          "value": "PRICE",
          "next_parameter": null
        }
      }
    },
    {
      "name": "min_price",
      "function": {
        "expression": "MIN",
        "returntype": "decimal(19,4)",
        "parameter": {
          "type": "column",
          "value": "PRICE",
          "next_parameter": null
        }
      }
    },
    {
      "name": "max_price",
      "function": {
        "expression": "MAX",
        "returntype": "decimal(19,4)",
        "parameter": {
          "type": "column",
          "value": "PRICE",
          "next_parameter": null
        }
      }
    },
    {
      "name": "distinct_sellers",
      "function": {
        "expression": "COUNT_DISTINCT",
        "returntype": "hllc12",
        "parameter": {
          "type": "column",
          "value": "SELLER_ID",
          "next_parameter": null
        }
      }
    },
    {
      "name": "top_seller",
      "function": {
        "expression": "TOP_N",
        "returntype": "topn(100)",
        "parameter": {
          "type": "column",
          "value": "PRICE",
          "next_parameter": {
            "type": "column",
            "value": "SELLER_ID",
            "next_parameter": null
          }
        }
      }
    }
  ],
  "rowkey": {
    "rowkey_columns": [
      {
        "column": "PART_DT",
        "encoding": "dict",
        "isShardBy": "false"
      },
      {
        "column": "LSTG_FORMAT_NAME",
        "encoding": "dict",
        "isShardBy": "false"
      },
      {
        "column": "LEAF_CATEG_ID",
        "encoding": "dict",
        "isShardBy": "false"
      },
      {
        "column": "LSTG_SITE_ID",
        "encoding": "dict",
        "isShardBy": "false"
      }
    ]
  },
  "aggregation_groups": [
    {
      "includes": [
        "PART_DT",
        "LSTG_FORMAT_NAME",
        "LEAF_CATEG_ID",
        "LSTG_SITE_ID"
      ],
      "select_rule": {
        "hierarchy_dims": [],
        "mandatory_dims": [],
        "joint_dims": []
      }
    }
  ],
  "partition_date_start": "2011-12-31",
  "notify_list": [],
  "hbase_mapping": {
    "column_family": [
      {
        "name": "f1",
        "columns": [
          {
            "qualifier": "m",
            "measure_refs": [
              "transactions",
              "total_price",
              "min_price",
              "max_price",
              "top_seller"
            ]
          }
        ]
      },
      {
        "name": "f2",
        "columns": [
          {
            "qualifier": "m",
            "measure_refs": [
              "distinct_sellers"
            ]
          }
        ]
      }
    ]
  },
  "retention_range": 15552000000,
  "status_need_notify": [
    "ERROR",
    "DISCARDED",
    "SUCCEED"
  ],
  "auto_merge_time_ranges": [
    2419200000
  ],
  "engine_type": 2,
  "storage_type": 2,
  "project": "tutorial"
}



--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5658.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=14.04
DISTRIB_CODENAME=trusty
DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
NAME="Ubuntu"
VERSION="14.04.4 LTS, Trusty Tahr"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 14.04.4 LTS"
VERSION_ID="14.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5657.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Marcelo,  It looks like a shell compatible issue; what's your linux
distribution name and version?

2016-08-26 9:37 GMT+08:00 Yiming Liu <li...@gmail.com>:

> Here‘s tutorial from MapR. https://community.mapr.com/docs/DOC-1558
>
> Hope that works.
>
> 2016-08-26 7:27 GMT+08:00 mnagy <ma...@quantium.com.au>:
>
> > Yes I am using MAPR.
> > If I find a solution I will post it here.
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/version-compability-tp5636p5649.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>



-- 
Best regards,

Shaofeng Shi

Re: version compability

Posted by Yiming Liu <li...@gmail.com>.
Here‘s tutorial from MapR. https://community.mapr.com/docs/DOC-1558

Hope that works.

2016-08-26 7:27 GMT+08:00 mnagy <ma...@quantium.com.au>:

> Yes I am using MAPR.
> If I find a solution I will post it here.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p5649.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: version compability

Posted by ShaoFeng Shi <sh...@apache.org>.
Thanks for the feedback.

2016-10-28 8:50 GMT+08:00 Billy(Yiming) Liu <li...@gmail.com>:

> Glad to hear that.
>
> 2016-10-28 6:43 GMT+08:00 mnagy <ma...@quantium.com.au>:
>
> > Problem fixed at version 1.6.
> > I have just checked it ;)
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/version-compability-tp5636p6106.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>



-- 
Best regards,

Shaofeng Shi 史少锋

Re: version compability

Posted by "Billy(Yiming) Liu" <li...@gmail.com>.
Glad to hear that.

2016-10-28 6:43 GMT+08:00 mnagy <ma...@quantium.com.au>:

> Problem fixed at version 1.6.
> I have just checked it ;)
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p6106.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
Problem fixed at version 1.6.
I have just checked it ;)

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p6106.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by ShaoFeng Shi <sh...@apache.org>.
Thanks Marcelo for the update; We will try to fix it in the 1.5.4 release;

2016-08-29 15:36 GMT+08:00 mnagy <ma...@quantium.com.au>:

> I fixed the script problem.
> If you get the get-properties.sh from version 1.5.2 and substitute it at
> 1.5.3 kylin.sh start --- works !!!
> The cat line that I mentioned before is different on those scripts.
> I have just executed the sample.sh built the cube and executed the query
> all
> good   .
>
> Version 1.5.2 do not return any result from any query at kylin but I the
> data is there and I can ru the same query in hive and get the results.
>
> So if you want to update your jira ticket that is the solution.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p5693.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
Best regards,

Shaofeng Shi

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
I fixed the script problem.
If you get the get-properties.sh from version 1.5.2 and substitute it at
1.5.3 kylin.sh start --- works !!! 
The cat line that I mentioned before is different on those scripts.
I have just executed the sample.sh built the cube and executed the query all
good   .

Version 1.5.2 do not return any result from any query at kylin but I the
data is there and I can ru the same query in hive and get the results.

So if you want to update your jira ticket that is the solution.  

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5693.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by Yiming Liu <li...@gmail.com>.
You could find more clues from the kylin.log.

2016-08-29 11:57 GMT+08:00 mnagy <ma...@quantium.com.au>:

> I discovered with what kylin was trying to connect at these point and I
> fixed
> it.
> These error was about yarn rosource manager.
> Now my cube is build but when I ran the query I don not have any result.
> If I run the query inside hive I have the results.
>
> This is the query i got it form your tutorial
> select part_dt, sum(price) as total_selled, count(distinct seller_id) as
> sellers from kylin_sales group by part_dt order by part_dt;
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p5690.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
I discovered with what kylin was trying to connect at these point and I fixed
it.
These error was about yarn rosource manager.
Now my cube is build but when I ran the query I don not have any result.
If I run the query inside hive I have the results.

This is the query i got it form your tutorial
select part_dt, sum(price) as total_selled, count(distinct seller_id) as
sellers from kylin_sales group by part_dt order by part_dt; 

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5690.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
Ok now i am using apache-kylin-1.5.2.1.
Kylin is up and running  but after I run the sample.sh when I tried to build
it I have got stuck at step 2.
This is the error at kylin.log.

2016-08-26 15:06:13,762 DEBUG [pool-2-thread-2]
persistence.ResourceStore:209 : Directly saving resource
/table/DEFAULT.KYLIN_SALES.json (Store
/home/mapr/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/kylin_job_meta2427113614378612316/meta)
2016-08-26 15:06:13,763 INFO  [pool-2-thread-2] common.AbstractHadoopJob:472
: HDFS meta dir is:
file:///home/mapr/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/kylin_job_meta2427113614378612316/meta
2016-08-26 15:06:13,763 INFO  [pool-2-thread-2] common.AbstractHadoopJob:350
: Job 'tmpfiles' updated --
file:///home/mapr/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/kylin_job_meta2427113614378612316/meta
2016-08-26 15:06:16,289 INFO  [pool-2-thread-2] common.AbstractHadoopJob:479
: tempMetaFileString is :
file:///home/mapr/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/kylin_job_meta2427113614378612316/meta
2016-08-26 15:06:16,314 INFO  [pool-2-thread-2]
httpclient.HttpMethodDirector:439 : I/O exception
(java.net.ConnectException) caught when processing request: Connection
refused
2016-08-26 15:06:16,315 INFO  [pool-2-thread-2]
httpclient.HttpMethodDirector:445 : Retrying request
2016-08-26 15:06:16,316 INFO  [pool-2-thread-2]
httpclient.HttpMethodDirector:439 : I/O exception
(java.net.ConnectException) caught when processing request: Connection
refused
2016-08-26 15:06:16,316 INFO  [pool-2-thread-2]
httpclient.HttpMethodDirector:445 : Retrying request
2016-08-26 15:06:16,318 INFO  [pool-2-thread-2]
httpclient.HttpMethodDirector:439 : I/O exception
(java.net.ConnectException) caught when processing request: Connection
refused
2016-08-26 15:06:16,318 INFO  [pool-2-thread-2]
httpclient.HttpMethodDirector:445 : Retrying request
2016-08-26 15:06:16,321 ERROR [pool-2-thread-2]
common.HadoopStatusChecker:93 : error check status
java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at java.net.Socket.connect(Socket.java:528)
	at java.net.Socket.<init>(Socket.java:425)
	at java.net.Socket.<init>(Socket.java:280)
	at
org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80)
	at
org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122)
	at
org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
	at
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
	at
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
	at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
	at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
	at
org.apache.kylin.engine.mr.common.HadoopStatusGetter.getHttpResponse(HadoopStatusGetter.java:179)
	at
org.apache.kylin.engine.mr.common.HadoopStatusGetter.get(HadoopStatusGetter.java:71)
	at
org.apache.kylin.engine.mr.common.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:58)
	at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:150)
	at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
	at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
	at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
	at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
	at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
  
and this is kylin_job.log


2016-08-26 15:06:05,874 INFO  [pool-2-thread-1]
manager.ExecutableManager:274 : job
id:a1b0db46-6ad1-4b04-a49f-84aa30c82ae2-00 from RUNNING to SUCCEED
2016-08-26 15:06:05,981 INFO  [pool-2-thread-1]
manager.ExecutableManager:274 : job id:a1b0db46-6ad1-4b04-a49f-84aa30c82ae2
from RUNNING to READY
2016-08-26 15:06:06,017 INFO  [pool-1-thread-1]
threadpool.DefaultScheduler:96 :
CubingJob{id=a1b0db46-6ad1-4b04-a49f-84aa30c82ae2, name=kylin_sales_cube -
20120101000000_20160826103000 - BUILD - PDT 2016-08-25 22:04:48,
state=READY} prepare to schedule
2016-08-26 15:06:06,019 INFO  [pool-1-thread-1]
threadpool.DefaultScheduler:100 :
CubingJob{id=a1b0db46-6ad1-4b04-a49f-84aa30c82ae2, name=kylin_sales_cube -
20120101000000_20160826103000 - BUILD - PDT 2016-08-25 22:04:48,
state=READY} scheduled
2016-08-26 15:06:06,020 INFO  [pool-1-thread-1]
threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 1 actual running,
1 ready, 0 others
2016-08-26 15:06:06,019 INFO  [pool-2-thread-2]
execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>>  
kylin_sales_cube - 20120101000000_20160826103000 - BUILD - PDT 2016-08-25
22:04:48   <<<<<<<<<<<<<
2016-08-26 15:06:06,037 INFO  [pool-2-thread-2]
manager.ExecutableManager:274 : job id:a1b0db46-6ad1-4b04-a49f-84aa30c82ae2
from READY to RUNNING
2016-08-26 15:06:06,046 INFO  [pool-2-thread-2]
execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>>   Extract Fact
Table Distinct Columns   <<<<<<<<<<<<<
2016-08-26 15:06:06,060 INFO  [pool-2-thread-2]
manager.ExecutableManager:274 : job
id:a1b0db46-6ad1-4b04-a49f-84aa30c82ae2-01 from READY to RUNNING
2016-08-26 15:06:06,193 INFO  [pool-2-thread-2]
execution.AbstractExecutable:113 : parameters of the MapReduceExecutable:
2016-08-26 15:06:06,193 INFO  [pool-2-thread-2]
execution.AbstractExecutable:114 :  -conf
/home/mapr/kylin/apache-kylin-1.5.2.1-bin/bin/./../conf/kylin_job_conf.xml
-cubename kylin_sales_cube -output
/user/mapr/kylin/kylin_metadata/kylin-a1b0db46-6ad1-4b04-a49f-84aa30c82ae2/kylin_sales_cube/fact_distinct_columns
-segmentname 20120101000000_20160826103000 -statisticsenabled true
-statisticsoutput
/user/mapr/kylin/kylin_metadata/kylin-a1b0db46-6ad1-4b04-a49f-84aa30c82ae2/kylin_sales_cube/statistics
-statisticssamplingpercent 100 -jobname
Kylin_Fact_Distinct_Columns_kylin_sales_cube_Step
2016-08-26 15:06:16,501 INFO  [pool-2-thread-2]
manager.ExecutableManager:274 : job
id:a1b0db46-6ad1-4b04-a49f-84aa30c82ae2-01 from RUNNING to ERROR
2016-08-26 15:06:16,551 INFO  [pool-2-thread-2]
manager.ExecutableManager:274 : job id:a1b0db46-6ad1-4b04-a49f-84aa30c82ae2
from RUNNING to ERROR
2016-08-26 15:06:16,551 WARN  [pool-2-thread-2]
execution.AbstractExecutable:224 : no need to send email, user list is empty

any ideas ?

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5653.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
Yes I am using MAPR.
If I find a solution I will post it here.

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5649.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by Yiming Liu <li...@gmail.com>.
Are you using MapR distribution?

There maybe some file path issues in the kylin.sh script. Maybe you could
try to fix the script and contribute back to the community.

2016-08-25 16:42 GMT+08:00 mnagy <ma...@quantium.com.au>:

> These part of the script is breaking the path for the KYLIN_HOME
>
> cat ${KYLIN_HOME}/conf/kylin.properties
>
> My KYLIN_HOME is set and when it iterates at the for I am having the path
> cut to  /home/mapr/kylin/apache-kylin-1.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p5644.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
These part of the script is breaking the path for the KYLIN_HOME

cat ${KYLIN_HOME}/conf/kylin.properties

My KYLIN_HOME is set and when it iterates at the for I am having the path
cut to  /home/mapr/kylin/apache-kylin-1.

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5644.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by mnagy <ma...@quantium.com.au>.
mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
start
*KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
cat: invalid option -- '1'
Try 'cat --help' for more information.
-mkdir: Not enough arguments: expected 1 but got 0
Usage: hadoop fs [generic options] -mkdir [-p] <path> ...
failed to create , Please make sure the user has right to access 


That is what is happening when I try to start kylin.
I traced the error and the first one come from get-properties.sh at these
line 
for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
'^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`

and as you can see kylin home is set. 


--
View this message in context: http://apache-kylin.74782.x6.nabble.com/version-compability-tp5636p5640.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: version compability

Posted by Yiming Liu <li...@gmail.com>.
Both 1.5.2.1 and 1.5.3 could run on your hadoop. Please use HBase 1.1
branch package.

2016-08-25 12:16 GMT+08:00 mnagy <ma...@quantium.com.au>:

> Here we are using hadoop 2.7.0, hbase 1.1.1, hive 1.2.
> I tried to use kylin 1.5.2.1 and 1.5.3 without success.
> Can you point me the right kylin version to use?
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)