[jira] [Created] (IMPALA-10541) impyla fails to fetchall() in python3

["Balazs Jeszenszky (Jira)" <ji...@apache.org>]

Balazs Jeszenszky created IMPALA-10541:
------------------------------------------

             Summary: impyla fails to fetchall() in python3
                 Key: IMPALA-10541
                 URL: https://issues.apache.org/jira/browse/IMPALA-10541
             Project: IMPALA
          Issue Type: Bug
          Components: Clients
            Reporter: Balazs Jeszenszky


{{select *}} queries fail instantly, with:
{code}
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/balazsj/.local/lib/python3.6/site-packages/impala/hiveserver2.py", line 536, in fetchall
    return list(self)
  File "/home/balazsj/.local/lib/python3.6/site-packages/impala/hiveserver2.py", line 582, in __next__
    self._buffer = self._last_operation.fetch(self.description,
  File "/home/balazsj/.local/lib/python3.6/site-packages/impala/hiveserver2.py", line 187, in description
    schema = self._last_operation.get_result_schema()
  File "/home/balazsj/.local/lib/python3.6/site-packages/impala/hiveserver2.py", line 1295, in get_result_schema
    entry = column.typeDesc.types[0].primitiveEntry
AttributeError: 'NoneType' object has no attribute 'types'
{code}

Selecting specific columns hangs indefinitely. The stack trace is always:
{code}
 File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/impala/hiveserver2.py", line 535, in fetchall
    return list(self)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/impala/hiveserver2.py", line 583, in __next__
    convert_types=self.convert_types)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/impala/hiveserver2.py", line 1242, in fetch
    resp = self._rpc('FetchResults', req)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/impala/hiveserver2.py", line 992, in _rpc
    response = self._execute(func_name, request)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/impala/hiveserver2.py", line 1009, in _execute
    return func(request)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/thrift.py", line 219, in _req
    return self._recv(_api)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/thrift.py", line 238, in _recv
    result.read(self._iprot)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/thrift.py", line 160, in read
    iprot.read_struct(self)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 387, in read_struct
    return read_struct(self.trans, obj, self.decode_response)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 316, in read_struct
    read_val(inbuf, f_type, f_container_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 289, in read_val
    read_struct(inbuf, obj, decode_response)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 316, in read_struct
    read_val(inbuf, f_type, f_container_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 289, in read_val
    read_struct(inbuf, obj, decode_response)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 316, in read_struct
    read_val(inbuf, f_type, f_container_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 256, in read_val
    result.append(read_val(inbuf, v_type, v_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 289, in read_val
    read_struct(inbuf, obj, decode_response)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 316, in read_struct
    read_val(inbuf, f_type, f_container_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 289, in read_val
    read_struct(inbuf, obj, decode_response)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 316, in read_struct
    read_val(inbuf, f_type, f_container_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 256, in read_val
    result.append(read_val(inbuf, v_type, v_spec, decode_response))
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/protocol/binary.py", line 230, in read_val
    byte_payload = inbuf.read(sz)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thrift_sasl/__init__.py", line 173, in read
    self._read_frame()
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thrift_sasl/__init__.py", line 177, in _read_frame
    header = self._trans_read_all(4)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thrift_sasl/__init__.py", line 198, in _trans_read_all
    return read_all(sz)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/site-packages/thriftpy2/transport/socket.py", line 110, in read
    buff = self.sock.recv(sz)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/ssl.py", line 1037, in recv
    return self.read(buflen)
  File "/Users/balazsjeszenszky/.pyenv/versions/3.7.3/lib/python3.7/ssl.py", line 913, in read
    return self._sslobj.read(len)
{code}

{{count(*)}} queries work. 
I've tried on various hosts and with multiple impala versions (the most recent one being:
{{impalad version 3.4.0-SNAPSHOT RELEASE (build 134517e42b7b6085e758195465f956f431e0e575)}}
A minimal pip freeze:
{code}
bitarray==1.6.3
impyla==0.16.3
ply==3.11
sasl==0.2.1
six==1.15.0
thrift==0.13.0
thrift-sasl==0.4.2
thriftpy2==0.4.14
{code}
, after doing:
{code}
yum install python3 python3-pip python3-devel
pip3 install impyla thrift-sasl --user
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)