You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Arshad, Mohammad" <mo...@visa.com.INVALID> on 2022/07/22 20:35:37 UTC

Phoenix upgrade from 4.7.0(base 1.1.2) to 5.1.2(base 2.3.0) is failing with ColumnNotFoundException

Hello All,



Upgraded HBase from 1.1.2 to 2.3.0. After applying HBASE-25902, hbase upgrade was successful.



But phoenix upgrade from version 4.7.0(hbase version 1.1.2) to 5.1.2(hbase version 2.3,0) is failing with following error.



22/07/18 10:53:26 WARN query.ConnectionQueryServicesImpl: Failed upgrading System tables. Snapshots for system tables created so far: {SYSTEM.CATALOG=SNAPSHOT_SYSTEM.CATALOG_4.7.x_TO_5.1.0_20220718105325}

Error: ERROR 504 (42703): Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER (state=42703,code=504)

org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703): Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER

at org.apache.phoenix.schema.PTableImpl.getColumnForColumnName(PTableImpl.java:1175)

at org.apache.phoenix.compile.FromCompiler$SingleTableColumnResolver.resolveColumn(FromCompiler.java:528)



When phoenix clients connect above error is logged.



is anyone faced this issue earlier, is there known solution for this issue?



Thanks & Regards

Arshad

Re: Phoenix upgrade from 4.7.0(base 1.1.2) to 5.1.2(base 2.3.0) is failing with ColumnNotFoundException

Posted by "Arshad, Mohammad" <mo...@visa.com.INVALID>.
Thanks a lot Istvan Toth for sharing this usefull information.
I took this PHOENIX-6534 changes applied on  release-5.1.2, built and used phoenix-core-5.1.2.jar. It worked. Phoenix clients connected succesfully.

Thanks once again.

On 25/07/22, 12:54 PM, "Istvan Toth" <st...@cloudera.com.INVALID> wrote:

    Yes, this is PHOENIX-6534.
    There is no released Apache version with the fix, you need to manually
    apply the fix to 5.1.2, or use the 5.1 branch head.

    regards
    István

    On Fri, Jul 22, 2022 at 10:35 PM Arshad, Mohammad <mo...@visa.com>
    wrote:

    > Hello All,
    >
    >
    >
    > Upgraded HBase from 1.1.2 to 2.3.0. After applying HBASE-25902, hbase
    > upgrade was successful.
    >
    >
    >
    > But phoenix upgrade from version 4.7.0(hbase version 1.1.2) to 5.1.2(hbase
    > version 2.3,0) is failing with following error.
    >
    >
    >
    > 22/07/18 10:53:26 WARN query.ConnectionQueryServicesImpl: Failed upgrading
    > System tables. Snapshots for system tables created so far:
    > {SYSTEM.CATALOG=SNAPSHOT_SYSTEM.CATALOG_4.7.x_TO_5.1.0_20220718105325}
    >
    > Error: ERROR 504 (42703): Undefined column.
    > columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER (state=42703,code=504)
    >
    > org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703):
    > Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER
    >
    > at
    > org.apache.phoenix.schema.PTableImpl.getColumnForColumnName(PTableImpl.java:1175)
    >
    > at
    > org.apache.phoenix.compile.FromCompiler$SingleTableColumnResolver.resolveColumn(FromCompiler.java:528)
    >
    >
    >
    > When phoenix clients connect above error is logged.
    >
    >
    >
    > is anyone faced this issue earlier, is there known solution for this issue?
    >
    >
    >
    > Thanks & Regards
    >
    > Arshad
    >


    -- 
    *István Tóth* | Staff Software Engineer
    stoty@cloudera.com <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    [image: Cloudera] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    [image: Cloudera on Twitter] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=ZlBmGqavSSpBO84a6CT8ApOcbjlgkWirbFkfkJtlGj4%3D&amp;reserved=0> [image:
    Cloudera on Facebook] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Yg602GfFf5FAdBzDjAylfovowrnLgutsCJ%2FJpekYVa8%3D&amp;reserved=0> [image: Cloudera
    on LinkedIn] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=qrl4ja%2BTsKm5Ns3RfQBrkbpSSF88aniND9Y5HZyJq5U%3D&amp;reserved=0>
    <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    ------------------------------


Re: Phoenix upgrade from 4.7.0(base 1.1.2) to 5.1.2(base 2.3.0) is failing with ColumnNotFoundException

Posted by "Arshad, Mohammad" <mo...@visa.com>.
Thanks a lot Istvan Toth for sharing this usefull information.
I took this PHOENIX-6534 changes applied on  release-5.1.2, built and used phoenix-core-5.1.2.jar. It worked. Phoenix clients connected succesfully.

Thanks once again.

On 25/07/22, 12:54 PM, "Istvan Toth" <st...@cloudera.com.INVALID> wrote:

    Yes, this is PHOENIX-6534.
    There is no released Apache version with the fix, you need to manually
    apply the fix to 5.1.2, or use the 5.1 branch head.

    regards
    István

    On Fri, Jul 22, 2022 at 10:35 PM Arshad, Mohammad <mo...@visa.com>
    wrote:

    > Hello All,
    >
    >
    >
    > Upgraded HBase from 1.1.2 to 2.3.0. After applying HBASE-25902, hbase
    > upgrade was successful.
    >
    >
    >
    > But phoenix upgrade from version 4.7.0(hbase version 1.1.2) to 5.1.2(hbase
    > version 2.3,0) is failing with following error.
    >
    >
    >
    > 22/07/18 10:53:26 WARN query.ConnectionQueryServicesImpl: Failed upgrading
    > System tables. Snapshots for system tables created so far:
    > {SYSTEM.CATALOG=SNAPSHOT_SYSTEM.CATALOG_4.7.x_TO_5.1.0_20220718105325}
    >
    > Error: ERROR 504 (42703): Undefined column.
    > columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER (state=42703,code=504)
    >
    > org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703):
    > Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER
    >
    > at
    > org.apache.phoenix.schema.PTableImpl.getColumnForColumnName(PTableImpl.java:1175)
    >
    > at
    > org.apache.phoenix.compile.FromCompiler$SingleTableColumnResolver.resolveColumn(FromCompiler.java:528)
    >
    >
    >
    > When phoenix clients connect above error is logged.
    >
    >
    >
    > is anyone faced this issue earlier, is there known solution for this issue?
    >
    >
    >
    > Thanks & Regards
    >
    > Arshad
    >


    -- 
    *István Tóth* | Staff Software Engineer
    stoty@cloudera.com <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    [image: Cloudera] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    [image: Cloudera on Twitter] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=ZlBmGqavSSpBO84a6CT8ApOcbjlgkWirbFkfkJtlGj4%3D&amp;reserved=0> [image:
    Cloudera on Facebook] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Yg602GfFf5FAdBzDjAylfovowrnLgutsCJ%2FJpekYVa8%3D&amp;reserved=0> [image: Cloudera
    on LinkedIn] <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fcloudera&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=qrl4ja%2BTsKm5Ns3RfQBrkbpSSF88aniND9Y5HZyJq5U%3D&amp;reserved=0>
    <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cloudera.com%2F&amp;data=05%7C01%7Cmohammad.arshad%40visa.com%7Cab849b86c46647d0273c08da6e0ec145%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637943306894915791%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=Kg1oRmXrJpv%2FlXKjLCtmRjXnpwemdcoiIOwDM0kYgD8%3D&amp;reserved=0>
    ------------------------------


Re: Phoenix upgrade from 4.7.0(base 1.1.2) to 5.1.2(base 2.3.0) is failing with ColumnNotFoundException

Posted by Istvan Toth <st...@cloudera.com.INVALID>.
Yes, this is PHOENIX-6534.
There is no released Apache version with the fix, you need to manually
apply the fix to 5.1.2, or use the 5.1 branch head.

regards
István

On Fri, Jul 22, 2022 at 10:35 PM Arshad, Mohammad <mo...@visa.com>
wrote:

> Hello All,
>
>
>
> Upgraded HBase from 1.1.2 to 2.3.0. After applying HBASE-25902, hbase
> upgrade was successful.
>
>
>
> But phoenix upgrade from version 4.7.0(hbase version 1.1.2) to 5.1.2(hbase
> version 2.3,0) is failing with following error.
>
>
>
> 22/07/18 10:53:26 WARN query.ConnectionQueryServicesImpl: Failed upgrading
> System tables. Snapshots for system tables created so far:
> {SYSTEM.CATALOG=SNAPSHOT_SYSTEM.CATALOG_4.7.x_TO_5.1.0_20220718105325}
>
> Error: ERROR 504 (42703): Undefined column.
> columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER (state=42703,code=504)
>
> org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703):
> Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER
>
> at
> org.apache.phoenix.schema.PTableImpl.getColumnForColumnName(PTableImpl.java:1175)
>
> at
> org.apache.phoenix.compile.FromCompiler$SingleTableColumnResolver.resolveColumn(FromCompiler.java:528)
>
>
>
> When phoenix clients connect above error is logged.
>
>
>
> is anyone faced this issue earlier, is there known solution for this issue?
>
>
>
> Thanks & Regards
>
> Arshad
>


-- 
*István Tóth* | Staff Software Engineer
stoty@cloudera.com <https://www.cloudera.com>
[image: Cloudera] <https://www.cloudera.com/>
[image: Cloudera on Twitter] <https://twitter.com/cloudera> [image:
Cloudera on Facebook] <https://www.facebook.com/cloudera> [image: Cloudera
on LinkedIn] <https://www.linkedin.com/company/cloudera>
<https://www.cloudera.com/>
------------------------------

Re: Phoenix upgrade from 4.7.0(base 1.1.2) to 5.1.2(base 2.3.0) is failing with ColumnNotFoundException

Posted by Istvan Toth <st...@cloudera.com>.
Yes, this is PHOENIX-6534.
There is no released Apache version with the fix, you need to manually
apply the fix to 5.1.2, or use the 5.1 branch head.

regards
István

On Fri, Jul 22, 2022 at 10:35 PM Arshad, Mohammad <mo...@visa.com>
wrote:

> Hello All,
>
>
>
> Upgraded HBase from 1.1.2 to 2.3.0. After applying HBASE-25902, hbase
> upgrade was successful.
>
>
>
> But phoenix upgrade from version 4.7.0(hbase version 1.1.2) to 5.1.2(hbase
> version 2.3,0) is failing with following error.
>
>
>
> 22/07/18 10:53:26 WARN query.ConnectionQueryServicesImpl: Failed upgrading
> System tables. Snapshots for system tables created so far:
> {SYSTEM.CATALOG=SNAPSHOT_SYSTEM.CATALOG_4.7.x_TO_5.1.0_20220718105325}
>
> Error: ERROR 504 (42703): Undefined column.
> columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER (state=42703,code=504)
>
> org.apache.phoenix.schema.ColumnNotFoundException: ERROR 504 (42703):
> Undefined column. columnName=SYSTEM.CATALOG.COLUMN_QUALIFIER
>
> at
> org.apache.phoenix.schema.PTableImpl.getColumnForColumnName(PTableImpl.java:1175)
>
> at
> org.apache.phoenix.compile.FromCompiler$SingleTableColumnResolver.resolveColumn(FromCompiler.java:528)
>
>
>
> When phoenix clients connect above error is logged.
>
>
>
> is anyone faced this issue earlier, is there known solution for this issue?
>
>
>
> Thanks & Regards
>
> Arshad
>


-- 
*István Tóth* | Staff Software Engineer
stoty@cloudera.com <https://www.cloudera.com>
[image: Cloudera] <https://www.cloudera.com/>
[image: Cloudera on Twitter] <https://twitter.com/cloudera> [image:
Cloudera on Facebook] <https://www.facebook.com/cloudera> [image: Cloudera
on LinkedIn] <https://www.linkedin.com/company/cloudera>
<https://www.cloudera.com/>
------------------------------