You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by Ravindra Pesala <ra...@gmail.com> on 2018/08/22 02:54:00 UTC
[DISCUSSION] Support Standard Spark's FileFormat interface in Carbondata
Hi,
Current Carbondata has deep integration with Spark to provide optimizations
in performance and also supports features like compaction, IUD, data maps
and metadata management etc. This type of integration forces user to use
CarbonSession instance to use carbon even for read and write operations.
So I am proposing standard spark's FileFormat implementation in carbon for
simple integration with Spark. Please check the jira for the design
document.
https://issues.apache.org/jira/browse/CARBONDATA-2872
--
Thanks & Regards,
Ravindra
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in
Carbondata
Posted by xm_zzc <44...@qq.com>.
+1, Good feature.
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in
Carbondata
Posted by David CaiQiang <da...@gmail.com>.
+1
-----
Best Regards
David Cai
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in
Carbondata
Posted by kanaka <ka...@gmail.com>.
+ 1 for Carbon FileFormat.
Thanks for the design details.
Regards,
Kanaka
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in
Carbondata
Posted by aaron <94...@qq.com>.
Does this means that we could call carbon in pyspark?
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in
Carbondata
Posted by manishgupta88 <to...@gmail.com>.
+1
Regards
Manish Gupta
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in Carbondata
Posted by Kumar Vishal <ku...@gmail.com>.
+1
-Regards
Kumar Vishal
On Thu, Aug 23, 2018 at 9:43 PM Liang Chen <ch...@gmail.com> wrote:
> HI
>
> +1, agree to support standard spark file format interface in carbondata, it
> will be significantly helpful for broadening apache carbondata's ecosystem.
>
> Regards
> Liang
>
>
> ravipesala wrote
> > Hi,
> >
> > Current Carbondata has deep integration with Spark to provide
> > optimizations
> > in performance and also supports features like compaction, IUD, data maps
> > and metadata management etc. This type of integration forces user to use
> > CarbonSession instance to use carbon even for read and write operations.
> >
> > So I am proposing standard spark's FileFormat implementation in carbon
> for
> > simple integration with Spark. Please check the jira for the design
> > document.
> > https://issues.apache.org/jira/browse/CARBONDATA-2872
> >
> > --
> > Thanks & Regards,
> > Ravindra
>
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
Re: [DISCUSSION] Support Standard Spark's FileFormat interface in
Carbondata
Posted by Liang Chen <ch...@gmail.com>.
HI
+1, agree to support standard spark file format interface in carbondata, it
will be significantly helpful for broadening apache carbondata's ecosystem.
Regards
Liang
ravipesala wrote
> Hi,
>
> Current Carbondata has deep integration with Spark to provide
> optimizations
> in performance and also supports features like compaction, IUD, data maps
> and metadata management etc. This type of integration forces user to use
> CarbonSession instance to use carbon even for read and write operations.
>
> So I am proposing standard spark's FileFormat implementation in carbon for
> simple integration with Spark. Please check the jira for the design
> document.
> https://issues.apache.org/jira/browse/CARBONDATA-2872
>
> --
> Thanks & Regards,
> Ravindra
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/