You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by Matt Casters <ma...@neo4j.com.INVALID> on 2021/03/29 13:18:53 UTC
Apache Hop integration
Dear fellow incubators,
Greetings from the Apache Hop (incubating) devs.
We would like to add Doris as a supported database to Hop. Typically we
support relational databases through JDBC connections. Just a few
questions if I may...
- Do you have a JDBC driver or one that can be used with Doris? We're
looking for one that is APL 2.0 compatible.
- Do you have a specific API or toolset to do bulk loading?
Thanks in advance!
Matt
----
hop.apache.org
Re:Re: Re: Apache Hop integration
Posted by 陈明雨 <mo...@163.com>.
Hi Hop:
We'd like to add more details and generate a PR for this documentation.
Thank you!
--
此致！Best Regards
陈明雨 Mingyu Chen
Email:
chenmingyu@apache.org
在 2021-04-13 03:04:00，"Matt Casters" <ma...@neo4j.com.INVALID> 写道：
>Hello Doris!
>
>We've added more of a placeholder here:
>http://hop.apache.org/manual/latest/database/databases/doris.html
>Apache Doris is also found in the list of relational database types in the
>Hop GUI now.
>
>I would like to invite you to help us maintain the details and limitations
>if you think this is useful.
>Simply generate a pull request against the documentation file
><https://github.com/apache/incubator-hop/blob/master/plugins/databases/doris/src/main/doc/doris.adoc>
>and we'll merge the changes in.
>
>Kind regards,
>Matt
>
>
>On Mon, Apr 5, 2021 at 3:39 PM 陈明雨 <mo...@163.com> wrote:
>
>> Hi Matt:
>> Nice to meet you!
>> Please let us know once you add Doris to that list.
>> Doris supports MySQL protocol, but not all of them.
>> There are some slight difference between Doris's MySQL protocol and
>> MySQL's native protocol.
>> If you encounter any problems, please let us know and we will assist in
>> solving them.
>>
>>
>>
>>
>> --
>>
>> 此致！Best Regards
>> 陈明雨 Mingyu Chen
>>
>> Email:
>> chenmingyu@apache.org
>>
>>
>>
>>
>>
>> At 2021-04-01 02:06:22, "Matt Casters" <ma...@neo4j.com.INVALID>
>> wrote:
>> >Hi Ling Miao,
>> >
>> >That's right, we'll list Apache Doris in that list and as well in the user
>> >interface so that people learn about Doris and if they have it they can
>> >immediately connect.
>> >
>> >Thanks and best of luck,
>> >
>> >Matt
>> >
>> >
>> >On Wed, Mar 31, 2021 at 1:37 PM ling miao <li...@apache.org> wrote:
>> >
>> >> Hi Matt Casters,
>> >>
>> >> It is a great honor that Doris can be used as one of the data sources
>> >> supported by Hop and advertised in your document.
>> >>
>> >> I read>--
>
>>Neo4j Chief Solutions Architect
>>*✉ *matt.casters@neo4j.com
>
>> > +32486972937 the Hop document, do you mean to put Doris in this
>> directory?
>> >> https://hop.apache.org/manual/latest/database/databases.html
>> >> If so, the Doris information is the same as mysql except that the Type
>> is
>> >> `OLAP`.
>> >> The driver version is recommended to use 8.0.
>> >>
>> >> Ling Miao
>> >>
>> >> Matt Casters <ma...@neo4j.com.invalid> 于2021年3月31日周三 下午5:37写道：
>> >>
>> >> > Hi Ling Miao,
>> >> >
>> >> > Thank you for your reply. We already support MySQL in all RDBMS
>> >> transforms
>> >> > and with bulk loading so folks can use that.
>> >> > To "advertise" support I'll create a derivative database plugin for
>> >> Apache
>> >> > Doris so that folks can find it in the list of databases we support.
>> >> >
>> >> > The MySQL JDBC driver license is indeed not compatible with the APL
>> and
>> >> > neither is the one from MariaDB for that matter.
>> >> > Folks need to download their own copy in that case. I don't think
>> it's
>> >> > that big of a deal.
>> >> >
>> >> > Kind regards,
>> >> > Matt
>> >> >
>> >> > On Wed, Mar 31, 2021 at 10:30 AM ling miao <em...@gmail.com>
>> wrote:
>> >> >
>> >> > > Hi Matt,
>> >> > >
>> >> > > Nice to meet Apache Hop (incubating) devs.
>> >> > >
>> >> > > About question2:
>> >> > > Since Doris supports the mysql protocol, general users will use
>> JDBC or
>> >> > > other tools that support the mysql protocol to perform bulk load
>> tasks.
>> >> > > If you want to use the http api, you can use the stream load method.
>> >> > > Stream load can also load data, and it is http api
>> >> > >
>> >> > > About question1:
>> >> > > At present, it is possible to support mysql client version 5.1 and
>> 8.
>> >> > > But I am not sure whether the JDBC driver complies with APL 2.0.
>> >> > >
>> >> > > Ling Miao
>> >> > >
>> >> > > Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一
>> 下午9:19写道：
>> >> > >
>> >> > >> Dear fellow incubators,
>> >> > >>
>> >> > >> Greetings from the Apache Hop (incubating) devs.
>> >> > >> We would like to add Doris as a supported database to Hop.
>> Typically
>> >> we
>> >> > >> support relational databases through JDBC connections. Just a few
>> >> > >> questions if I may...
>> >> > >> - Do you have a JDBC driver or one that can be used with Doris?
>> We're
>> >> > >> looking for one that is APL 2.0 compatible.
>> >> > >> - Do you have a specific API or toolset to do bulk loading?
>> >> > >>
>> >> > >> Thanks in advance!
>> >> > >>
>> >> > >> Matt
>> >> > >> ----
>> >> > >> hop.apache.org
>> >> > >>
>> >> > >
>> >> >
>> >>
>> >
>> >
>>
>>
Re: Re: Apache Hop integration
Posted by Matt Casters <ma...@neo4j.com.INVALID>.
Hello Doris!
We've added more of a placeholder here:
http://hop.apache.org/manual/latest/database/databases/doris.html
Apache Doris is also found in the list of relational database types in the
Hop GUI now.
I would like to invite you to help us maintain the details and limitations
if you think this is useful.
Simply generate a pull request against the documentation file
<https://github.com/apache/incubator-hop/blob/master/plugins/databases/doris/src/main/doc/doris.adoc>
and we'll merge the changes in.
Kind regards,
Matt
On Mon, Apr 5, 2021 at 3:39 PM 陈明雨 <mo...@163.com> wrote:
> Hi Matt:
> Nice to meet you!
> Please let us know once you add Doris to that list.
> Doris supports MySQL protocol, but not all of them.
> There are some slight difference between Doris's MySQL protocol and
> MySQL's native protocol.
> If you encounter any problems, please let us know and we will assist in
> solving them.
>
>
>
>
> --
>
> 此致！Best Regards
> 陈明雨 Mingyu Chen
>
> Email:
> chenmingyu@apache.org
>
>
>
>
>
> At 2021-04-01 02:06:22, "Matt Casters" <ma...@neo4j.com.INVALID>
> wrote:
> >Hi Ling Miao,
> >
> >That's right, we'll list Apache Doris in that list and as well in the user
> >interface so that people learn about Doris and if they have it they can
> >immediately connect.
> >
> >Thanks and best of luck,
> >
> >Matt
> >
> >
> >On Wed, Mar 31, 2021 at 1:37 PM ling miao <li...@apache.org> wrote:
> >
> >> Hi Matt Casters,
> >>
> >> It is a great honor that Doris can be used as one of the data sources
> >> supported by Hop and advertised in your document.
> >>
> >> I read>--
>Neo4j Chief Solutions Architect
>*✉ *matt.casters@neo4j.com
> > +32486972937 the Hop document, do you mean to put Doris in this
> directory?
> >> https://hop.apache.org/manual/latest/database/databases.html
> >> If so, the Doris information is the same as mysql except that the Type
> is
> >> `OLAP`.
> >> The driver version is recommended to use 8.0.
> >>
> >> Ling Miao
> >>
> >> Matt Casters <ma...@neo4j.com.invalid> 于2021年3月31日周三 下午5:37写道：
> >>
> >> > Hi Ling Miao,
> >> >
> >> > Thank you for your reply. We already support MySQL in all RDBMS
> >> transforms
> >> > and with bulk loading so folks can use that.
> >> > To "advertise" support I'll create a derivative database plugin for
> >> Apache
> >> > Doris so that folks can find it in the list of databases we support.
> >> >
> >> > The MySQL JDBC driver license is indeed not compatible with the APL
> and
> >> > neither is the one from MariaDB for that matter.
> >> > Folks need to download their own copy in that case. I don't think
> it's
> >> > that big of a deal.
> >> >
> >> > Kind regards,
> >> > Matt
> >> >
> >> > On Wed, Mar 31, 2021 at 10:30 AM ling miao <em...@gmail.com>
> wrote:
> >> >
> >> > > Hi Matt,
> >> > >
> >> > > Nice to meet Apache Hop (incubating) devs.
> >> > >
> >> > > About question2:
> >> > > Since Doris supports the mysql protocol, general users will use
> JDBC or
> >> > > other tools that support the mysql protocol to perform bulk load
> tasks.
> >> > > If you want to use the http api, you can use the stream load method.
> >> > > Stream load can also load data, and it is http api
> >> > >
> >> > > About question1:
> >> > > At present, it is possible to support mysql client version 5.1 and
> 8.
> >> > > But I am not sure whether the JDBC driver complies with APL 2.0.
> >> > >
> >> > > Ling Miao
> >> > >
> >> > > Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一
> 下午9:19写道：
> >> > >
> >> > >> Dear fellow incubators,
> >> > >>
> >> > >> Greetings from the Apache Hop (incubating) devs.
> >> > >> We would like to add Doris as a supported database to Hop.
> Typically
> >> we
> >> > >> support relational databases through JDBC connections. Just a few
> >> > >> questions if I may...
> >> > >> - Do you have a JDBC driver or one that can be used with Doris?
> We're
> >> > >> looking for one that is APL 2.0 compatible.
> >> > >> - Do you have a specific API or toolset to do bulk loading?
> >> > >>
> >> > >> Thanks in advance!
> >> > >>
> >> > >> Matt
> >> > >> ----
> >> > >> hop.apache.org
> >> > >>
> >> > >
> >> >
> >>
> >
> >
>
>
Re:Re: Apache Hop integration
Posted by 陈明雨 <mo...@163.com>.
Hi Matt:
Nice to meet you!
Please let us know once you add Doris to that list.
Doris supports MySQL protocol, but not all of them.
There are some slight difference between Doris's MySQL protocol and MySQL's native protocol.
If you encounter any problems, please let us know and we will assist in solving them.
--
此致！Best Regards
陈明雨 Mingyu Chen
Email:
chenmingyu@apache.org
At 2021-04-01 02:06:22, "Matt Casters" <ma...@neo4j.com.INVALID> wrote:
>Hi Ling Miao,
>
>That's right, we'll list Apache Doris in that list and as well in the user
>interface so that people learn about Doris and if they have it they can
>immediately connect.
>
>Thanks and best of luck,
>
>Matt
>
>
>On Wed, Mar 31, 2021 at 1:37 PM ling miao <li...@apache.org> wrote:
>
>> Hi Matt Casters,
>>
>> It is a great honor that Doris can be used as one of the data sources
>> supported by Hop and advertised in your document.
>>
>> I read the Hop document, do you mean to put Doris in this directory?
>> https://hop.apache.org/manual/latest/database/databases.html
>> If so, the Doris information is the same as mysql except that the Type is
>> `OLAP`.
>> The driver version is recommended to use 8.0.
>>
>> Ling Miao
>>
>> Matt Casters <ma...@neo4j.com.invalid> 于2021年3月31日周三 下午5:37写道：
>>
>> > Hi Ling Miao,
>> >
>> > Thank you for your reply. We already support MySQL in all RDBMS
>> transforms
>> > and with bulk loading so folks can use that.
>> > To "advertise" support I'll create a derivative database plugin for
>> Apache
>> > Doris so that folks can find it in the list of databases we support.
>> >
>> > The MySQL JDBC driver license is indeed not compatible with the APL and
>> > neither is the one from MariaDB for that matter.
>> > Folks need to download their own copy in that case. I don't think it's
>> > that big of a deal.
>> >
>> > Kind regards,
>> > Matt
>> >
>> > On Wed, Mar 31, 2021 at 10:30 AM ling miao <em...@gmail.com> wrote:
>> >
>> > > Hi Matt,
>> > >
>> > > Nice to meet Apache Hop (incubating) devs.
>> > >
>> > > About question2:
>> > > Since Doris supports the mysql protocol, general users will use JDBC or
>> > > other tools that support the mysql protocol to perform bulk load tasks.
>> > > If you want to use the http api, you can use the stream load method.
>> > > Stream load can also load data, and it is http api
>> > >
>> > > About question1:
>> > > At present, it is possible to support mysql client version 5.1 and 8.
>> > > But I am not sure whether the JDBC driver complies with APL 2.0.
>> > >
>> > > Ling Miao
>> > >
>> > > Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一 下午9:19写道：
>> > >
>> > >> Dear fellow incubators,
>> > >>
>> > >> Greetings from the Apache Hop (incubating) devs.
>> > >> We would like to add Doris as a supported database to Hop. Typically
>> we
>> > >> support relational databases through JDBC connections. Just a few
>> > >> questions if I may...
>> > >> - Do you have a JDBC driver or one that can be used with Doris? We're
>> > >> looking for one that is APL 2.0 compatible.
>> > >> - Do you have a specific API or toolset to do bulk loading?
>> > >>
>> > >> Thanks in advance!
>> > >>
>> > >> Matt
>> > >> ----
>> > >> hop.apache.org
>> > >>
>> > >
>> >
>>
>
>
>--
>Neo4j Chief Solutions Architect
>*✉ *matt.casters@neo4j.com
>☎ +32486972937
Re: Apache Hop integration
Posted by Matt Casters <ma...@neo4j.com.INVALID>.
Hi Ling Miao,
That's right, we'll list Apache Doris in that list and as well in the user
interface so that people learn about Doris and if they have it they can
immediately connect.
Thanks and best of luck,
Matt
On Wed, Mar 31, 2021 at 1:37 PM ling miao <li...@apache.org> wrote:
> Hi Matt Casters,
>
> It is a great honor that Doris can be used as one of the data sources
> supported by Hop and advertised in your document.
>
> I read the Hop document, do you mean to put Doris in this directory?
> https://hop.apache.org/manual/latest/database/databases.html
> If so, the Doris information is the same as mysql except that the Type is
> `OLAP`.
> The driver version is recommended to use 8.0.
>
> Ling Miao
>
> Matt Casters <ma...@neo4j.com.invalid> 于2021年3月31日周三 下午5:37写道：
>
> > Hi Ling Miao,
> >
> > Thank you for your reply. We already support MySQL in all RDBMS
> transforms
> > and with bulk loading so folks can use that.
> > To "advertise" support I'll create a derivative database plugin for
> Apache
> > Doris so that folks can find it in the list of databases we support.
> >
> > The MySQL JDBC driver license is indeed not compatible with the APL and
> > neither is the one from MariaDB for that matter.
> > Folks need to download their own copy in that case. I don't think it's
> > that big of a deal.
> >
> > Kind regards,
> > Matt
> >
> > On Wed, Mar 31, 2021 at 10:30 AM ling miao <em...@gmail.com> wrote:
> >
> > > Hi Matt,
> > >
> > > Nice to meet Apache Hop (incubating) devs.
> > >
> > > About question2:
> > > Since Doris supports the mysql protocol, general users will use JDBC or
> > > other tools that support the mysql protocol to perform bulk load tasks.
> > > If you want to use the http api, you can use the stream load method.
> > > Stream load can also load data, and it is http api
> > >
> > > About question1:
> > > At present, it is possible to support mysql client version 5.1 and 8.
> > > But I am not sure whether the JDBC driver complies with APL 2.0.
> > >
> > > Ling Miao
> > >
> > > Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一 下午9:19写道：
> > >
> > >> Dear fellow incubators,
> > >>
> > >> Greetings from the Apache Hop (incubating) devs.
> > >> We would like to add Doris as a supported database to Hop. Typically
> we
> > >> support relational databases through JDBC connections. Just a few
> > >> questions if I may...
> > >> - Do you have a JDBC driver or one that can be used with Doris? We're
> > >> looking for one that is APL 2.0 compatible.
> > >> - Do you have a specific API or toolset to do bulk loading?
> > >>
> > >> Thanks in advance!
> > >>
> > >> Matt
> > >> ----
> > >> hop.apache.org
> > >>
> > >
> >
>
--
Neo4j Chief Solutions Architect
*✉ *matt.casters@neo4j.com
☎ +32486972937
Re: Apache Hop integration
Posted by ling miao <li...@apache.org>.
Hi Matt Casters,
It is a great honor that Doris can be used as one of the data sources
supported by Hop and advertised in your document.
I read the Hop document, do you mean to put Doris in this directory?
https://hop.apache.org/manual/latest/database/databases.html
If so, the Doris information is the same as mysql except that the Type is
`OLAP`.
The driver version is recommended to use 8.0.
Ling Miao
Matt Casters <ma...@neo4j.com.invalid> 于2021年3月31日周三 下午5:37写道：
> Hi Ling Miao,
>
> Thank you for your reply. We already support MySQL in all RDBMS transforms
> and with bulk loading so folks can use that.
> To "advertise" support I'll create a derivative database plugin for Apache
> Doris so that folks can find it in the list of databases we support.
>
> The MySQL JDBC driver license is indeed not compatible with the APL and
> neither is the one from MariaDB for that matter.
> Folks need to download their own copy in that case. I don't think it's
> that big of a deal.
>
> Kind regards,
> Matt
>
> On Wed, Mar 31, 2021 at 10:30 AM ling miao <em...@gmail.com> wrote:
>
> > Hi Matt,
> >
> > Nice to meet Apache Hop (incubating) devs.
> >
> > About question2:
> > Since Doris supports the mysql protocol, general users will use JDBC or
> > other tools that support the mysql protocol to perform bulk load tasks.
> > If you want to use the http api, you can use the stream load method.
> > Stream load can also load data, and it is http api
> >
> > About question1:
> > At present, it is possible to support mysql client version 5.1 and 8.
> > But I am not sure whether the JDBC driver complies with APL 2.0.
> >
> > Ling Miao
> >
> > Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一 下午9:19写道：
> >
> >> Dear fellow incubators,
> >>
> >> Greetings from the Apache Hop (incubating) devs.
> >> We would like to add Doris as a supported database to Hop. Typically we
> >> support relational databases through JDBC connections. Just a few
> >> questions if I may...
> >> - Do you have a JDBC driver or one that can be used with Doris? We're
> >> looking for one that is APL 2.0 compatible.
> >> - Do you have a specific API or toolset to do bulk loading?
> >>
> >> Thanks in advance!
> >>
> >> Matt
> >> ----
> >> hop.apache.org
> >>
> >
>
Re: Apache Hop integration
Posted by Matt Casters <ma...@neo4j.com.INVALID>.
Hi Ling Miao,
Thank you for your reply. We already support MySQL in all RDBMS transforms
and with bulk loading so folks can use that.
To "advertise" support I'll create a derivative database plugin for Apache
Doris so that folks can find it in the list of databases we support.
The MySQL JDBC driver license is indeed not compatible with the APL and
neither is the one from MariaDB for that matter.
Folks need to download their own copy in that case. I don't think it's
that big of a deal.
Kind regards,
Matt
On Wed, Mar 31, 2021 at 10:30 AM ling miao <em...@gmail.com> wrote:
> Hi Matt,
>
> Nice to meet Apache Hop (incubating) devs.
>
> About question2:
> Since Doris supports the mysql protocol, general users will use JDBC or
> other tools that support the mysql protocol to perform bulk load tasks.
> If you want to use the http api, you can use the stream load method.
> Stream load can also load data, and it is http api
>
> About question1:
> At present, it is possible to support mysql client version 5.1 and 8.
> But I am not sure whether the JDBC driver complies with APL 2.0.
>
> Ling Miao
>
> Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一 下午9:19写道：
>
>> Dear fellow incubators,
>>
>> Greetings from the Apache Hop (incubating) devs.
>> We would like to add Doris as a supported database to Hop. Typically we
>> support relational databases through JDBC connections. Just a few
>> questions if I may...
>> - Do you have a JDBC driver or one that can be used with Doris? We're
>> looking for one that is APL 2.0 compatible.
>> - Do you have a specific API or toolset to do bulk loading?
>>
>> Thanks in advance!
>>
>> Matt
>> ----
>> hop.apache.org
>>
>
Re: Apache Hop integration
Posted by ling miao <em...@gmail.com>.
Hi Matt,
Nice to meet Apache Hop (incubating) devs.
About question2:
Since Doris supports the mysql protocol, general users will use JDBC or
other tools that support the mysql protocol to perform bulk load tasks.
If you want to use the http api, you can use the stream load method.
Stream load can also load data, and it is http api
About question1:
At present, it is possible to support mysql client version 5.1 and 8.
But I am not sure whether the JDBC driver complies with APL 2.0.
Ling Miao
Matt Casters <ma...@neo4j.com.invalid> 于2021年3月29日周一 下午9:19写道：
> Dear fellow incubators,
>
> Greetings from the Apache Hop (incubating) devs.
> We would like to add Doris as a supported database to Hop. Typically we
> support relational databases through JDBC connections. Just a few
> questions if I may...
> - Do you have a JDBC driver or one that can be used with Doris? We're
> looking for one that is APL 2.0 compatible.
> - Do you have a specific API or toolset to do bulk loading?
>
> Thanks in advance!
>
> Matt
> ----
> hop.apache.org
>