You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by 诺铁 <no...@gmail.com> on 2014/11/27 04:10:44 UTC
can't get smallint field from hive on spark
hi,
don't know whether this question should be asked here, if not, please point
me out, thanks.
we are currently using hive on spark, when reading a small int field, it
reports error:
Cannot get field 'i16Val' because union is currently set to i32Val
I googled and find only source code of
TColumnValue.java
<https://svn.apache.org/repos/asf/hive/trunk/service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumnValue.java>
where the exception is thrown
don't know where to go, please help
Re: can't get smallint field from hive on spark
Posted by 诺铁 <no...@gmail.com>.
I mean the later... thanks
On Thu, Nov 27, 2014 at 1:42 PM, Yin Huai <hu...@gmail.com> wrote:
> For "hive on spark", did you mean the thrift server of Spark SQL or
> https://issues.apache.org/jira/browse/HIVE-7292? If you meant the latter
> one, I think Hive's mailing list will be a good place to ask (see
> https://hive.apache.org/mailing_lists.html).
>
> Thanks,
>
> Yin
>
> On Wed, Nov 26, 2014 at 10:49 PM, 诺铁 <no...@gmail.com> wrote:
>
>> thank you very much.
>>
>> On Thu, Nov 27, 2014 at 11:30 AM, Michael Armbrust <
>> michael@databricks.com> wrote:
>>
>>> This has been fixed in Spark 1.1.1 and Spark 1.2
>>>
>>> https://issues.apache.org/jira/browse/SPARK-3704
>>>
>>> On Wed, Nov 26, 2014 at 7:10 PM, 诺铁 <no...@gmail.com> wrote:
>>>
>>>> hi,
>>>>
>>>> don't know whether this question should be asked here, if not, please
>>>> point me out, thanks.
>>>>
>>>> we are currently using hive on spark, when reading a small int field,
>>>> it reports error:
>>>> Cannot get field 'i16Val' because union is currently set to i32Val
>>>>
>>>> I googled and find only source code of
>>>> TColumnValue.java
>>>> <https://svn.apache.org/repos/asf/hive/trunk/service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumnValue.java>
>>>> where the exception is thrown
>>>>
>>>> don't know where to go, please help
>>>>
>>>
>>>
>>
>
Re: can't get smallint field from hive on spark
Posted by Yin Huai <hu...@gmail.com>.
For "hive on spark", did you mean the thrift server of Spark SQL or
https://issues.apache.org/jira/browse/HIVE-7292? If you meant the latter
one, I think Hive's mailing list will be a good place to ask (see
https://hive.apache.org/mailing_lists.html).
Thanks,
Yin
On Wed, Nov 26, 2014 at 10:49 PM, 诺铁 <no...@gmail.com> wrote:
> thank you very much.
>
> On Thu, Nov 27, 2014 at 11:30 AM, Michael Armbrust <michael@databricks.com
> > wrote:
>
>> This has been fixed in Spark 1.1.1 and Spark 1.2
>>
>> https://issues.apache.org/jira/browse/SPARK-3704
>>
>> On Wed, Nov 26, 2014 at 7:10 PM, 诺铁 <no...@gmail.com> wrote:
>>
>>> hi,
>>>
>>> don't know whether this question should be asked here, if not, please
>>> point me out, thanks.
>>>
>>> we are currently using hive on spark, when reading a small int field, it
>>> reports error:
>>> Cannot get field 'i16Val' because union is currently set to i32Val
>>>
>>> I googled and find only source code of
>>> TColumnValue.java
>>> <https://svn.apache.org/repos/asf/hive/trunk/service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumnValue.java>
>>> where the exception is thrown
>>>
>>> don't know where to go, please help
>>>
>>
>>
>
Re: can't get smallint field from hive on spark
Posted by 诺铁 <no...@gmail.com>.
thank you very much.
On Thu, Nov 27, 2014 at 11:30 AM, Michael Armbrust <mi...@databricks.com>
wrote:
> This has been fixed in Spark 1.1.1 and Spark 1.2
>
> https://issues.apache.org/jira/browse/SPARK-3704
>
> On Wed, Nov 26, 2014 at 7:10 PM, 诺铁 <no...@gmail.com> wrote:
>
>> hi,
>>
>> don't know whether this question should be asked here, if not, please
>> point me out, thanks.
>>
>> we are currently using hive on spark, when reading a small int field, it
>> reports error:
>> Cannot get field 'i16Val' because union is currently set to i32Val
>>
>> I googled and find only source code of
>> TColumnValue.java
>> <https://svn.apache.org/repos/asf/hive/trunk/service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumnValue.java>
>> where the exception is thrown
>>
>> don't know where to go, please help
>>
>
>
Re: can't get smallint field from hive on spark
Posted by Michael Armbrust <mi...@databricks.com>.
This has been fixed in Spark 1.1.1 and Spark 1.2
https://issues.apache.org/jira/browse/SPARK-3704
On Wed, Nov 26, 2014 at 7:10 PM, 诺铁 <no...@gmail.com> wrote:
> hi,
>
> don't know whether this question should be asked here, if not, please
> point me out, thanks.
>
> we are currently using hive on spark, when reading a small int field, it
> reports error:
> Cannot get field 'i16Val' because union is currently set to i32Val
>
> I googled and find only source code of
> TColumnValue.java
> <https://svn.apache.org/repos/asf/hive/trunk/service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumnValue.java>
> where the exception is thrown
>
> don't know where to go, please help
>