You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Alberto Ramón <a....@gmail.com> on 2016/12/22 23:44:34 UTC
ArrayIndexOutOfBoundsException: -1
Error on, Extract Fact Table Distinct Columns
* Insane record: [1, 0600-160077, FVP DAFUTURO - ESTABLE, COP, 11,
11, Tipo de producto 11, 16.94579786]
java.lang.ArrayIndexOutOfBoundsException: -1
at org.apache.kylin.engine.mr.steps.FactDistinctHiveColumnsMapper.map(FactDistinctHiveColumnsMapper.java:140)*
I see an extra column, ???? My DIM have 7 columns:
*Original CSV: 7 columns*
[image: Imágenes integradas 3]
*On hive: 7 columns*
[image: Imágenes integradas 1]
*On DM: 7 columns*[image: Imágenes integradas 2]
*On Cube: 7 columns*
"dimensions": [
{
"name": "ID_PRODUCTO",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "ID_PRODUCTO",
"derived": null
},
{
"name": "COD_PRODUCTO",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "COD_PRODUCTO",
"derived": null
},
{
"name": "PRODUCTO_DESC",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "PRODUCTO_DESC",
"derived": null
},
{
"name": "CURRECY",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "CURRENCY",
"derived": null
},
{
"name": "ISIN",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "ISIN",
"derived": null
},
{
"name": "ID_TIPO_PRODUCTO",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "ID_TIPO_PRODUCTO",
"derived": null
},
{
"name": "TIPO_PRODUCTO_DESC",
"table": "HERR_POSITIONS.DIM_PRODUCTOS",
"column": "TIPO_PRODUCTO_DESC",
"derived": null
}
],
Re: ArrayIndexOutOfBoundsException: -1
Posted by ShaoFeng Shi <sh...@apache.org>.
Alberto, please open a JIRA with your finding; Kylin v1.5/v1.6 will exist
for some time, other users may face the same error; putting on JIRA with
the error trace and root cause will benefit them. Thank you!
2016-12-26 21:12 GMT+08:00 Billy Liu <bi...@apache.org>:
> This is the known restrict for Kylin currently. But the good news is Kylin
> master has supported the same name column in both fact table and lookup
> table. The restriction will go away from the next release. Here is a
> workaround, rename the column by Hive view.
>
> 2016-12-26 18:28 GMT+08:00 Alberto Ramón <a....@gmail.com>:
>
>> (merry Christmas)
>>
>> I found the error:
>> * You can't have the same name column (cod_producto) in Dim Table and
>> Fact Table* ==> ERROR: java.lang.ArrayIndexOutOfBoundsException: -1
>> (If you don't use this Dim in Cube, don't have any problem)
>> Open JIRA ??
>>
>>
>> I also discovered:
>> In Data model, you can define the same column from Fact Table as Dim
>> and as Measure
>> Is this the desired behavior ??
>> Open JIRA ??
>>
>>
>>
>> 2016-12-23 0:44 GMT+01:00 Alberto Ramón <a....@gmail.com>:
>>
>>>
>>> Error on, Extract Fact Table Distinct Columns
>>>
>>>
>>>
>>>
>>> * Insane record: [1, 0600-160077, FVP DAFUTURO - ESTABLE, COP, 11, 11, Tipo de producto 11, 16.94579786] java.lang.ArrayIndexOutOfBoundsException: -1
>>> at org.apache.kylin.engine.mr <http://org.apache.kylin.engine.mr>.steps.FactDistinctHiveColumnsMapper.map(FactDistinctHiveColumnsMapper.java:140)*
>>>
>>>
>>>
>>> I see an extra column, ???? My DIM have 7 columns:
>>>
>>> *Original CSV: 7 columns*
>>> [image: Imágenes integradas 3]
>>>
>>>
>>> *On hive: 7 columns*
>>> [image: Imágenes integradas 1]
>>>
>>>
>>>
>>> *On DM: 7 columns*[image: Imágenes integradas 2]
>>>
>>>
>>>
>>> *On Cube: 7 columns*
>>>
>>> "dimensions": [
>>> {
>>> "name": "ID_PRODUCTO",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "ID_PRODUCTO",
>>> "derived": null
>>> },
>>> {
>>> "name": "COD_PRODUCTO",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "COD_PRODUCTO",
>>> "derived": null
>>> },
>>> {
>>> "name": "PRODUCTO_DESC",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "PRODUCTO_DESC",
>>> "derived": null
>>> },
>>> {
>>> "name": "CURRECY",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "CURRENCY",
>>> "derived": null
>>> },
>>> {
>>> "name": "ISIN",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "ISIN",
>>> "derived": null
>>> },
>>> {
>>> "name": "ID_TIPO_PRODUCTO",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "ID_TIPO_PRODUCTO",
>>> "derived": null
>>> },
>>> {
>>> "name": "TIPO_PRODUCTO_DESC",
>>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>>> "column": "TIPO_PRODUCTO_DESC",
>>> "derived": null
>>> }
>>> ],
>>>
>>>
>>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: ArrayIndexOutOfBoundsException: -1
Posted by Billy Liu <bi...@apache.org>.
This is the known restrict for Kylin currently. But the good news is Kylin
master has supported the same name column in both fact table and lookup
table. The restriction will go away from the next release. Here is a
workaround, rename the column by Hive view.
2016-12-26 18:28 GMT+08:00 Alberto Ramón <a....@gmail.com>:
> (merry Christmas)
>
> I found the error:
> * You can't have the same name column (cod_producto) in Dim Table and
> Fact Table* ==> ERROR: java.lang.ArrayIndexOutOfBoundsException: -1
> (If you don't use this Dim in Cube, don't have any problem)
> Open JIRA ??
>
>
> I also discovered:
> In Data model, you can define the same column from Fact Table as Dim and
> as Measure
> Is this the desired behavior ??
> Open JIRA ??
>
>
>
> 2016-12-23 0:44 GMT+01:00 Alberto Ramón <a....@gmail.com>:
>
>>
>> Error on, Extract Fact Table Distinct Columns
>>
>>
>>
>>
>> * Insane record: [1, 0600-160077, FVP DAFUTURO - ESTABLE, COP, 11, 11, Tipo de producto 11, 16.94579786] java.lang.ArrayIndexOutOfBoundsException: -1
>> at org.apache.kylin.engine.mr <http://org.apache.kylin.engine.mr>.steps.FactDistinctHiveColumnsMapper.map(FactDistinctHiveColumnsMapper.java:140)*
>>
>>
>>
>> I see an extra column, ???? My DIM have 7 columns:
>>
>> *Original CSV: 7 columns*
>> [image: Imágenes integradas 3]
>>
>>
>> *On hive: 7 columns*
>> [image: Imágenes integradas 1]
>>
>>
>>
>> *On DM: 7 columns*[image: Imágenes integradas 2]
>>
>>
>>
>> *On Cube: 7 columns*
>>
>> "dimensions": [
>> {
>> "name": "ID_PRODUCTO",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "ID_PRODUCTO",
>> "derived": null
>> },
>> {
>> "name": "COD_PRODUCTO",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "COD_PRODUCTO",
>> "derived": null
>> },
>> {
>> "name": "PRODUCTO_DESC",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "PRODUCTO_DESC",
>> "derived": null
>> },
>> {
>> "name": "CURRECY",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "CURRENCY",
>> "derived": null
>> },
>> {
>> "name": "ISIN",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "ISIN",
>> "derived": null
>> },
>> {
>> "name": "ID_TIPO_PRODUCTO",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "ID_TIPO_PRODUCTO",
>> "derived": null
>> },
>> {
>> "name": "TIPO_PRODUCTO_DESC",
>> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
>> "column": "TIPO_PRODUCTO_DESC",
>> "derived": null
>> }
>> ],
>>
>>
>
Re: ArrayIndexOutOfBoundsException: -1
Posted by Alberto Ramón <a....@gmail.com>.
(merry Christmas)
I found the error:
* You can't have the same name column (cod_producto) in Dim Table and Fact
Table* ==> ERROR: java.lang.ArrayIndexOutOfBoundsException: -1
(If you don't use this Dim in Cube, don't have any problem)
Open JIRA ??
I also discovered:
In Data model, you can define the same column from Fact Table as Dim and
as Measure
Is this the desired behavior ??
Open JIRA ??
2016-12-23 0:44 GMT+01:00 Alberto Ramón <a....@gmail.com>:
>
> Error on, Extract Fact Table Distinct Columns
>
>
>
>
> * Insane record: [1, 0600-160077, FVP DAFUTURO - ESTABLE, COP, 11, 11, Tipo de producto 11, 16.94579786] java.lang.ArrayIndexOutOfBoundsException: -1
> at org.apache.kylin.engine.mr <http://org.apache.kylin.engine.mr>.steps.FactDistinctHiveColumnsMapper.map(FactDistinctHiveColumnsMapper.java:140)*
>
>
>
> I see an extra column, ???? My DIM have 7 columns:
>
> *Original CSV: 7 columns*
> [image: Imágenes integradas 3]
>
>
> *On hive: 7 columns*
> [image: Imágenes integradas 1]
>
>
>
> *On DM: 7 columns*[image: Imágenes integradas 2]
>
>
>
> *On Cube: 7 columns*
>
> "dimensions": [
> {
> "name": "ID_PRODUCTO",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "ID_PRODUCTO",
> "derived": null
> },
> {
> "name": "COD_PRODUCTO",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "COD_PRODUCTO",
> "derived": null
> },
> {
> "name": "PRODUCTO_DESC",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "PRODUCTO_DESC",
> "derived": null
> },
> {
> "name": "CURRECY",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "CURRENCY",
> "derived": null
> },
> {
> "name": "ISIN",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "ISIN",
> "derived": null
> },
> {
> "name": "ID_TIPO_PRODUCTO",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "ID_TIPO_PRODUCTO",
> "derived": null
> },
> {
> "name": "TIPO_PRODUCTO_DESC",
> "table": "HERR_POSITIONS.DIM_PRODUCTOS",
> "column": "TIPO_PRODUCTO_DESC",
> "derived": null
> }
> ],
>
>