You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2019/09/03 01:10:00 UTC
[jira] [Commented] (SPARK-28864) Add spark connector for Alibaba
Log Service
[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921096#comment-16921096 ]
Jungtaek Lim commented on SPARK-28864:
--------------------------------------
I guess general recommendation of new connectors has been "Apache Bahir serves for this purpose", as Spark moved out existing connectors from Spark codebase to Bahir project and tries to keep only the first class of connectors in Spark codebase.
Bahir project is here: [https://bahir.apache.org/]
> Add spark connector for Alibaba Log Service
> -------------------------------------------
>
> Key: SPARK-28864
> URL: https://issues.apache.org/jira/browse/SPARK-28864
> Project: Spark
> Issue Type: New Feature
> Components: Input/Output
> Affects Versions: 3.0.0
> Reporter: Ke Li
> Priority: Major
>
> Alibaba Log Service is a big data service which has been widely used in Alibaba Group and thousands of customers of Alibaba Cloud. The core storage engine of Log Service is named Loghub which is a large scale distributed storage system which provides producer and consumer to push and pull data like Kafka, AWS Kinesis and Azure Eventhub does.
> There are a lot of users of Log Service are using Spark Streaming, Spark SQL and Spark Structured Streaming to analysis data collected from both on premise and cloud data sources.
> Happy to hear any comments.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org