Meeting notes with vipshop for data quality requirements and developing

[William Guo <gu...@apache.org>]

VIP introduction

(http://www.vip.com/)


Vip(vipshop) is a leading online discount retailer for brands in China. The Company offers high quality and popular branded products to consumers throughout China at a significant discount from retail prices. As compared to conventional on-line marketplaces or large-scale multi-category online retailers, Vipshop has successfully created a third e-commerce model and proven that it can provide tremendous scale and profitability. By providing special offers and deep discounts on branded products, the Company has pioneered the online discount retail model in China and become the expert and leader trusted by its customers and brand partners alike. Since its founding in August 2008, the Company has rapidly built a sizeable and growing base of customers and brand partners.


meeting agenda


Introduce griffin as a data quality service

  *   Griffin team introduced Apache griffin architecture, process and plan.



How vipshop can leverage on griffin to meet their data quality requirements

  *   VIP introduced team and typical data quality issues in their daily work.
  *   VIP currently requirements are to support offline data quality check based on different configurable rules.
  *   Griffin team introduced possilbe solutions to handle alerts and email notification requirements in elastic search.
  *   VIP will setup griffin dev environment with griffin support in mail list.


How vip will contribute on griffin

  *   VIP will try to contribute their data quality requirements as general enough rules based on apache griffin dsl.
  *   VIP and griffin team will cooperate to enhance griffin dsl to meet more data qualtiy requirements.


Todos:

  *   VIP will subscribe to griffin dev list and create tickets in griffin jirs dashboard in apache way.
  *   VIP will use griffin to measure data quality for most of offline data.
  *   Griffin and VIP will sync to update status bi-weekly.



William