You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by jinossy <gi...@git.apache.org> on 2015/10/14 11:55:59 UTC

[GitHub] tajo pull request: TAJO-1928: Can't read parquet on hive meta

GitHub user jinossy opened a pull request:

    https://github.com/apache/tajo/pull/826

    TAJO-1928: Can't read parquet on hive meta

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jinossy/tajo TAJO-1928

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/tajo/pull/826.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #826
    
----
commit 95a9bac46be404b140ad5b976d2fc322be1ff622
Author: Jinho Kim <jh...@apache.org>
Date:   2015-10-14T09:54:53Z

    TAJO-1928: Can't read parquet on hive meta

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] tajo pull request: TAJO-1928: Can't read parquet on hive meta

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/tajo/pull/826


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] tajo pull request: TAJO-1928: Can't read parquet on hive meta

Posted by jinossy <gi...@git.apache.org>.
Github user jinossy commented on the pull request:

    https://github.com/apache/tajo/pull/826#issuecomment-148589156
  
    @jihoonson 
    Thanks for your review! 
    I've update the patch. Could you review again?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] tajo pull request: TAJO-1928: Can't read parquet on hive meta

Posted by jihoonson <gi...@git.apache.org>.
Github user jihoonson commented on the pull request:

    https://github.com/apache/tajo/pull/826#issuecomment-148629026
  
    +1 ship it!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] tajo pull request: TAJO-1928: Can't read parquet on hive meta

Posted by jihoonson <gi...@git.apache.org>.
Github user jihoonson commented on the pull request:

    https://github.com/apache/tajo/pull/826#issuecomment-148258023
  
    Hi @jinossy, thanks for your work.
    I found a problem of this patch when creating a table of text format.
    Here is the log.
    ```
    default> create external table nation (
    >     N_NATIONKEY bigint,
    >     N_NAME text,
    >     N_REGIONKEY bigint,
    >     N_COMMENT text)
    > using text with ('text.delimiter'='|') location 'hdfs://localhost:7020/tpch1/nation';
    ERROR: internal error: TEXTFILE_INPUT
    
    2015-10-15 11:18:06,362 ERROR org.apache.tajo.catalog.CatalogServer:
    Stack Trace:
    org.apache.tajo.exception.TajoInternalError: internal error: TEXTFILE_INPUT
            at org.apache.tajo.catalog.store.HiveCatalogStore.createTable(HiveCatalogStore.java:602)
            at org.apache.tajo.catalog.CatalogServer$CatalogProtocolHandler.createTable(CatalogServer.java:691)
            at org.apache.tajo.catalog.AbstractCatalogClient.createTable(AbstractCatalogClient.java:584)
            at org.apache.tajo.master.exec.CreateTableExecutor.create(CreateTableExecutor.java:111)
            at org.apache.tajo.master.exec.CreateTableExecutor.create(CreateTableExecutor.java:67)
            at org.apache.tajo.master.exec.DDLExecutor.execute(DDLExecutor.java:107)
            at org.apache.tajo.master.exec.QueryExecutor.execute(QueryExecutor.java:117)
            at org.apache.tajo.master.GlobalEngine.executeQuery(GlobalEngine.java:191)
            at org.apache.tajo.master.TajoMasterClientService$TajoMasterClientProtocolServiceHandler.submitQuery(TajoMasterClientService.java:303)
            at org.apache.tajo.ipc.TajoMasterClientProtocol$TajoMasterClientProtocolService$2.callBlockingMethod(TajoMasterClientProtocol.java:675)
            at org.apache.tajo.rpc.BlockingRpcServer$ServerHandler.channelRead0(BlockingRpcServer.java:100)
            at org.apache.tajo.rpc.BlockingRpcServer$ServerHandler.channelRead0(BlockingRpcServer.java:61)
            at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
            at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
            at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
            at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
            at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
            at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
            at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:244)
            at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
            at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
            at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
            at org.apache.tajo.rpc.MonitorServerHandler.channelRead(MonitorServerHandler.java:70)
            at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
            at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
            at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:846)
            at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
            at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
            at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
            at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
            at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
            at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
            at java.lang.Thread.run(Thread.java:745)
    ```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] tajo pull request: TAJO-1928: Can't read parquet on hive meta

Posted by jinossy <gi...@git.apache.org>.
Github user jinossy commented on the pull request:

    https://github.com/apache/tajo/pull/826#issuecomment-148004532
  
    Additionally, I’ve remove unnecessarily exception in alterTablespace of HiveCatalogStore
    ```
    Stack Trace:
    org.apache.tajo.exception.TajoRuntimeException: org.apache.tajo.exception.UnsupportedException: unsupported feature: Tablespace in HiveMeta
            at org.apache.tajo.catalog.store.HiveCatalogStore.alterTablespace(HiveCatalogStore.java:344)
            at org.apache.tajo.catalog.CatalogServer$CatalogProtocolHandler.alterTablespace(CatalogServer.java:397)
            at org.apache.tajo.catalog.AbstractCatalogClient.alterTablespace(AbstractCatalogClient.java:170)
            at org.apache.tajo.master.TajoMaster.checkBaseTBSpaceAndDatabase(TajoMaster.java:407)
            at org.apache.tajo.master.TajoMaster.serviceStart(TajoMaster.java:325)
            at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
            at org.apache.tajo.master.TajoMaster.main(TajoMaster.java:607)
    Caused by: org.apache.tajo.exception.UnsupportedException: unsupported feature: Tablespace in HiveMeta
            ... 7 more
    ```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---