You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jinwenjie123 (via GitHub)" <gi...@apache.org> on 2024/02/20 21:35:37 UTC
[I] Supported Input Data Type [arrow-datafusion-comet]
jinwenjie123 opened a new issue, #64:
URL: https://github.com/apache/arrow-datafusion-comet/issues/64
### What is the problem the feature request solves?
Hi Team,
I am wondering will we have a documentation about what kinda of data types are supported by Comet/Datafusion. (Like, Decimal(16, 6), interger .... )
Or where I can lookup to find related information. Since this is very important while we are trying to evaluate whether to use Comet or not.
Thank you so much !
### Describe the potential solution
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] What's the Supported Input Data Type [arrow-datafusion-comet]
Posted by "jinwenjie123 (via GitHub)" <gi...@apache.org>.
jinwenjie123 commented on issue #64:
URL: https://github.com/apache/arrow-datafusion-comet/issues/64#issuecomment-1955233067
Thank you !
One more quick question. Is Decimal(26, 6) currently supported ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] What's the Supported Input Data Type [arrow-datafusion-comet]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #64:
URL: https://github.com/apache/arrow-datafusion-comet/issues/64#issuecomment-1955229082
We will add the document, maybe as part of user document in #57.
For a quick answer, primitive types should be supported now: ByteType, ShortType, IntegerType, LongType, FloatType, DoubleType, StringType, BinaryType, TimestampType, DecimalType, DateType, BooleanType, NullType. The support I mean is, Comet query planner will accept query plan using these types. But for certain expression or operator, the supported types might be various, for example, if the corresponding DataFusion expression or operator may not support some data types.
I think one important goal of Comet is to fulfill the gap and we are working on it. So welcome to report any missing datatypes when you test or evaluate Comet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] What's the Supported Input Data Type [datafusion-comet]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #64:
URL: https://github.com/apache/datafusion-comet/issues/64#issuecomment-2096768027
Close it now. Please let me know if you still have other questions. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] What's the Supported Input Data Type [arrow-datafusion-comet]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #64:
URL: https://github.com/apache/arrow-datafusion-comet/issues/64#issuecomment-1955235351
DecimalType is supported.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] What's the Supported Input Data Type [datafusion-comet]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya closed issue #64: What's the Supported Input Data Type
URL: https://github.com/apache/datafusion-comet/issues/64
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] What's the Supported Input Data Type [arrow-datafusion-comet]
Posted by "sunchao (via GitHub)" <gi...@apache.org>.
sunchao commented on issue #64:
URL: https://github.com/apache/arrow-datafusion-comet/issues/64#issuecomment-1957194222
We should support all primitive data types as of now (if not, we should definitely fill the gap).
Complex types (e.g., list, map, struct) are not supported in the Parquet scan. We do have plan to support it soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] What's the Supported Input Data Type [datafusion-comet]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #64:
URL: https://github.com/apache/datafusion-comet/issues/64#issuecomment-2096767337
We have better documentation for the issue: https://datafusion.apache.org/comet/user-guide/datatypes.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org