Gearpump weekly meeting notes (2016/5/13)

[Kam Kasravi <ka...@gmail.com>]

Time:

PST time 11PM, May 12

CEST time 8 AM, May 13

China Standard Time 2PM, May 13

Attending:

Manu, Huafeng, Sean, Weihua, Karol, Kam

Notes recorder: Kam


Completed last week:

1. GEARPUMP-18 Enable publishing gearpump artifacts to
repository.apache.org (kam)

Successfully published to snapshots.

2. GEARPUMP-21 apache beam runner (manu)

Submitted PR to apache beam team. JIRA updated.

3. GEARPUMP-22 akka-stream integration (kam)

Submitted PR to akka team. JIRA updated.

4. GEARPUMP-28 gearpump logo (kam)

Leading candidate is Gearman from Tomek. We will decide in the next meeting.

5. GEARPUMP-46 track serialization / deserialization latency and
display on dashboard (kam)

GEARPUMP-140 subtask opened related to backend. GEARPUMP-46 tracks the
frontend changes.

6. GEARPUMP-82 rename package name to org.apache.gearpump. (huafeng)

Still to do shaded - opened JIRA (GEARPUMP-139)

7. ML related

ML document suggesting a common API created and posted to
dev@beam.incubator.apache.org

7. IoT related

Karol ran worker on a raspberrypi that successful connected to a
master on his laptop


Upcoming:

1. GEARPUMP-18 try to publish to staging folder on repository.apache.org (kam).

Update SONATYPE_USERNAME env variable in travis to be a valid Gearpump
committer and try to stage. Update the target staging area path in
.travis.yml. We already have permission to write to
repository.apache.org since the snapshot publishing succeeded. (kam)

2. We would like to release 0.8.1 in 2 weeks and include the following
JIRA's (currently open)

   - GEARPUMP-124 - SinkTask fails to start after change
   parallelism (Huafeng)
   - GEARPUMP-123 - Metrics about workers is not accurate in UI (Manu)
   - GEARPUMP-122 - KafkaSource stuck (Manu)
   - GEARPUMP-121 - DataSourceProcessor and DataSinkProcessor ... (Huafeng)
   - GEARPUMP-117 - Script for managing cluster (Huafeng)
   - GEARPUMP-115 - Create MQTT source/sink (Kam)
   - GEARPUMP-114 - Dead loop in graph with cycles (Manu)
   - GEARPUMP-113 - Default admin user removal (Manu)
   - GEARPUMP-112 - DAG chart in dashboard does not show data ... (Karol)
   - GEARPUMP-64  - Fail to submit an application from frontend UI when
   ... (Kam)
   - GEARPUMP-54  - Composing dag from dashboard, user can not ... (Kam)
   - GEARPUMP-32  - Minimum clock of source Tasks maybe inaccurate (Manu)

Stretch goals

   - GEARPUMP-95 - Add parquet datasource and datasink connectors (Kam)
   - GEARPUMP-78 - Support DAG with cycles (Manu)
   - GEARPUMP-22 - Support akka-streams Gearpump Materializer (Kam)