You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@kudu.apache.org by Nitin Agarwal <2n...@gmail.com> on 2017/10/13 19:10:08 UTC

Unable to access Kudu table created using Spark via Impala

Hi, I used Spark and KuduContext to create a table in Kudu. I can see the
table in Kudu UI and can access it through Spark. However I am unable to
access that table via Impala. I have issued invalidate metadata in Impala
but I am still unable to list the table.

So what do I need to do to access this table via Impala?

I am using Kudu version kudu 1.4.0-cdh5.12.1 with Spark 1.6.x

This is what I see in Kudu UI for my table

CREATE EXTERNAL TABLE `nums.telephone_number` STORED AS KUDU
TBLPROPERTIES(
  'kudu.table_name' = 'nums.telephone_number',
  'kudu.master_addresses' =
'ff58-29.idc1.level3.com:7051,ff58-30.idc1.level3.com:7051,ff58-34.idc1.level3.com:7051');

Nitin

Re: Unable to access Kudu table created using Spark via Impala

Posted by Nitin Agarwal <2n...@gmail.com>.

Thanks Alexey, that did the trick.

Nitin

On Fri, Oct 13, 2017 at 1:15 PM, Alexey Serbin <as...@cloudera.com> wrote:

> Hi Nitin,
>
> Impala needs to know about Kudu tables which were created 'externally'
> (i.e. not via Impala).  Have you run that 'CREATE EXTERNAL TABLE ...' via
> Impala shell already?  If not, you need to do so.  More information on the
> topic can be found at:
> http://kudu.apache.org/docs/kudu_impala_integration.html#_qu
> erying_an_existing_kudu_table_in_impala
>
>
> Best regards,
>
> Alexey
>
>
> On 10/13/17 12:10 PM, Nitin Agarwal wrote:
>
>> Hi, I used Spark and KuduContext to create a table in Kudu. I can see the
>> table in Kudu UI and can access it through Spark. However I am unable to
>> access that table via Impala. I have issued invalidate metadata in Impala
>> but I am still unable to list the table.
>>
>> So what do I need to do to access this table via Impala?
>>
>> I am using Kudu version kudu 1.4.0-cdh5.12.1 with Spark 1.6.x
>>
>> This is what I see in Kudu UI for my table
>>
>> |CREATE EXTERNAL TABLE `nums.telephone_number` STORED AS KUDU
>> TBLPROPERTIES( 'kudu.table_name' = 'nums.telephone_number',
>> 'kudu.master_addresses' = 'ff58-29.idc1.level3.com:7051 <
>> http://ff58-29.idc1.level3.com:7051>,ff58-30.idc1.level3.com:7051 <
>> http://ff58-30.idc1.level3.com:7051>,ff58-34.idc1.level3.com:7051');|
>> |Nitin|
>>
>
>

Re: Unable to access Kudu table created using Spark via Impala

Posted by Alexey Serbin <as...@cloudera.com>.

Hi Nitin,

Impala needs to know about Kudu tables which were created 'externally' 
(i.e. not via Impala).  Have you run that 'CREATE EXTERNAL TABLE ...' 
via Impala shell already?  If not, you need to do so.  More information 
on the topic can be found at:
http://kudu.apache.org/docs/kudu_impala_integration.html#_querying_an_existing_kudu_table_in_impala

Best regards,

Alexey

On 10/13/17 12:10 PM, Nitin Agarwal wrote:
> Hi, I used Spark and KuduContext to create a table in Kudu. I can see 
> the table in Kudu UI and can access it through Spark. However I am 
> unable to access that table via Impala. I have issued invalidate 
> metadata in Impala but I am still unable to list the table.
>
> So what do I need to do to access this table via Impala?
>
> I am using Kudu version kudu 1.4.0-cdh5.12.1 with Spark 1.6.x
>
> This is what I see in Kudu UI for my table
>
> |CREATE EXTERNAL TABLE `nums.telephone_number` STORED AS KUDU 
> TBLPROPERTIES( 'kudu.table_name' = 'nums.telephone_number', 
> 'kudu.master_addresses' = 'ff58-29.idc1.level3.com:7051 
> <http://ff58-29.idc1.level3.com:7051>,ff58-30.idc1.level3.com:7051 
> <http://ff58-30.idc1.level3.com:7051>,ff58-34.idc1.level3.com:7051');|
> |Nitin|