You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "marin-ma (via GitHub)" <gi...@apache.org> on 2024/11/07 12:58:35 UTC

[PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

marin-ma opened a new pull request, #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852

   1. Fix udf implicit type conversion not working, refine the UT.
   2. Update the hive udf example in UDF document
   3. Moved some general utility functions from `WholeStageTransformerSuite` into `GlutenQueryTest`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2462178540

   Run Gluten Clickhouse CI on x86


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2462178023

   https://github.com/apache/incubator-gluten/issues/7760


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "marin-ma (via GitHub)" <gi...@apache.org>.
marin-ma commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2463861441

   @loneylee The CH UT failure seems very odd, and also cannot get passed after the re-run. I couldn't figure out the reason. Could you help to check it?
   
   Here's the failed UT and its log
   
   ```
   [2024-11-08T05:23:02.405Z] - GLUTEN-7542: Fix cache refresh *** FAILED ***
   [2024-11-08T05:23:02.413Z]   org.apache.hadoop.ipc.RemoteException: No lease on /tpch-data/issue_7542/00000_0 (inode 17131): File does not exist. Holder DFSClient_NONMAPREDUCE_-1409055608_1 does not have any open files.
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:3428)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFileInternal(FSNamesystem.java:3518)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:3485)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:786)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:536)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
   [2024-11-08T05:23:02.413Z] 	at java.security.AccessController.doPrivileged(Native Method)
   [2024-11-08T05:23:02.413Z] 	at javax.security.auth.Subject.doAs(Subject.java:421)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
   [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
   [2024-11-08T05:23:02.413Z]   at org.apache.hadoop.ipc.Client.call(Client.java:1476)
   [2024-11-08T05:23:02.413Z]   at org.apache.hadoop.ipc.Client.call(Client.java:1413)
   [2024-11-08T05:23:02.413Z]   at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
   [2024-11-08T05:23:02.413Z]   at com.sun.proxy.$Proxy42.complete(Unknown Source)
   [2024-11-08T05:23:02.414Z]   at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.complete(ClientNamenodeProtocolTranslatorPB.java:462)
   [2024-11-08T05:23:02.414Z]   at sun.reflect.GeneratedMethodAccessor336.invoke(Unknown Source)
   [2024-11-08T05:23:02.414Z]   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [2024-11-08T05:23:02.414Z]   at java.lang.reflect.Method.invoke(Method.java:498)
   [2024-11-08T05:23:02.414Z]   at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:191)
   [2024-11-08T05:23:02.414Z]   at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
   [2024-11-08T05:23:02.414Z]   ...
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "marin-ma (via GitHub)" <gi...@apache.org>.
marin-ma merged PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2463748341

   Run Gluten Clickhouse CI on x86


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2463584700

   Run Gluten Clickhouse CI on x86


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "loneylee (via GitHub)" <gi...@apache.org>.
loneylee commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2463880914

   Run Gluten Clickhouse CI on x86


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org


Re: [PR] [GLUTEN-7760] Fix udf implicit cast & update doc [incubator-gluten]

Posted by "loneylee (via GitHub)" <gi...@apache.org>.
loneylee commented on PR #7852:
URL: https://github.com/apache/incubator-gluten/pull/7852#issuecomment-2464162899

   > @loneylee The CH UT failure seems very odd, and also cannot get passed after the re-run. I couldn't figure out the reason. Could you help to check it?
   > 
   > Here's the failed UT and its log
   > 
   > ```
   > [2024-11-08T05:23:02.405Z] - GLUTEN-7542: Fix cache refresh *** FAILED ***
   > [2024-11-08T05:23:02.413Z]   org.apache.hadoop.ipc.RemoteException: No lease on /tpch-data/issue_7542/00000_0 (inode 17131): File does not exist. Holder DFSClient_NONMAPREDUCE_-1409055608_1 does not have any open files.
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:3428)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFileInternal(FSNamesystem.java:3518)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:3485)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:786)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:536)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
   > [2024-11-08T05:23:02.413Z] 	at java.security.AccessController.doPrivileged(Native Method)
   > [2024-11-08T05:23:02.413Z] 	at javax.security.auth.Subject.doAs(Subject.java:421)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
   > [2024-11-08T05:23:02.413Z] 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
   > [2024-11-08T05:23:02.413Z]   at org.apache.hadoop.ipc.Client.call(Client.java:1476)
   > [2024-11-08T05:23:02.413Z]   at org.apache.hadoop.ipc.Client.call(Client.java:1413)
   > [2024-11-08T05:23:02.413Z]   at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
   > [2024-11-08T05:23:02.413Z]   at com.sun.proxy.$Proxy42.complete(Unknown Source)
   > [2024-11-08T05:23:02.414Z]   at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.complete(ClientNamenodeProtocolTranslatorPB.java:462)
   > [2024-11-08T05:23:02.414Z]   at sun.reflect.GeneratedMethodAccessor336.invoke(Unknown Source)
   > [2024-11-08T05:23:02.414Z]   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   > [2024-11-08T05:23:02.414Z]   at java.lang.reflect.Method.invoke(Method.java:498)
   > [2024-11-08T05:23:02.414Z]   at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:191)
   > [2024-11-08T05:23:02.414Z]   at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
   > [2024-11-08T05:23:02.414Z]   ...
   > ```
   
   Retry and passed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org