You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by rita <ri...@163.com> on 2022/04/01 02:15:17 UTC

【Cooperative Project】 openLooKeng&Linkis the new scenario of data interconnection is displayed

Hi all,

 

With the development of big data technology and its wide application in
various fields, a large amount of fragmented data has been generated in the
process. Under the background of strong business demand, how to respond
quickly and completely avoid the risk of data system has become a problem.
The hot spot of everyone's attention. In addition, how to make full use of
data analysis and data mining to discover more valuable information, thereby
bringing economic benefits, is also an important challenge that everyone
faces when conducting big data analysis and calculation.

 

In order to meet the business needs of different scenarios, enrich the big
data platform architecture, and make it easier for users to manage various
types of data, recently, openLooKeng and Linkis have reached a cooperation
to realize the interconnection of data resources and make big data simpler.

 

The combination of the two parties will further expand each other's
advantages. The powerful cross-source and cross-domain features of
openLooKeng allow Linkis to have richer performance, enabling it to support
query tasks such as cross-source heterogeneous query, cross-domain and
cross-DC. As a computing middleware, Linkis can connect more underlying
computing and storage components by using the connectivity capabilities of
openLooKeng Connector based on Linkis' EngineConn Plugin (ECP), thereby
eliminating data islands, realizing data fusion, reducing resource waste,
and meeting the needs of business development. different needs.

 

Linkis is expected to release this version in late April, and the two
communities will work together to launch other features later, For example,
Linkis supports the openLooKeng on Yarn mode, and optimise the Linkis
Orchestrator's ability based on openLooKeng to complete the mixing ability
of ecs in subsequent plans. I hope that you can download the experience,
provide more powerful suggestions and help for the subsequent optimization,
and build a fully connected and integrated financial-level big data platform
together.

 

 

openLooKeng is an open source high-performance data virtualization engine
that provides a unified SQL entry, which can be easily controlled whether it
is Hive, Hbase, or OLTP database PostgreSQL and MySQL. openLooKeng has a
reliable and powerful capability of joint query across multiple data
sources. The developed cross-data center Data Center Connector provides
high-performance cross-domain collaborative computing, further extends
engine query performance, and solves the problem of complex cross-source
query architecture and too many programming entries in the past. Many
problems and poor system integration have realized the mode conversion of
data from "transportation" to "connection", which is convenient for users to
quickly realize the value of massive data.

 

Learn more:https://mp.weixin.qq.com/s/0C2TPyzFqMy2BPOemyqAOA

-----

康悦Rita

Email:rita0451@163.com <ma...@163.com> 

Twitter:https://twitter.com/Ritakhahaha