You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Xinyu Liu (Confluence)" <no...@apache.org> on 2022/11/29 19:10:01 UTC

[CONF] Apache Samza > Samza Enhancement Proposal

There's **1 new edit** on this page  
---  
|  
---  
|  | [![page icon](cid:page-
icon)](https://cwiki.apache.org/confluence/display/SAMZA/Samza+Enhancement+Proposal?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1669749001152&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=view
"page icon")  
---  
[Samza Enhancement
Proposal](https://cwiki.apache.org/confluence/display/SAMZA/Samza+Enhancement+Proposal?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1669749001152&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=view
"Samza Enhancement Proposal")  
|  |  |  |  | ![](cid:avatar_b0ea71f20b57f89f7d7f369fa220858b) |  | Xinyu Liu
edited this page  
---  
|  
|  | Here's what changed:  
---  
|

...

| SEP | Status | Link to Discussion Thread | Related JIRA  
---|---|---|---  
[SEP-1: Semantics of ProcessorId in
Samza](/confluence/pages/viewpage.action?pageId=68719260) | Accepted |
<http://mail-archives.apache.org/mod_mbox/samza-dev/201703.mbox/browser> |
[SAMZA-1126](https://issues.apache.org/jira/browse/SAMZA-1126)  
[SEP-2: ApplicationRunner
Design](/confluence/pages/viewpage.action?pageId=68719460) | Discuss |  
|

[SAMZA-1130](https://issues.apache.org/jira/browse/SAMZA-1130)  
  
[SEP-3: Heart-beat mechanism between JobCoordinator and all running
containers](/confluence/pages/viewpage.action?pageId=69407014) | Accepted |
<http://mail-archives.apache.org/mod_mbox/samza-
dev/201705.mbox/%3CCANxwKLaVro6MBvUJW2RvoNLDO9-G87Y3Ox%2B5W66K_CxBqeVfgQ%40mail.gmail.com%3E>
| [SAMZA-871](https://issues.apache.org/jira/browse/SAMZA-871)  
[SEP-4: Adjunct Data Store for Unbounded
Datasets](/confluence/pages/viewpage.action?pageId=69410195) | Discuss |
<http://mail-archives.apache.org/mod_mbox/samza-dev/201705.mbox/browser> |
[SAMZA-1278](https://issues.apache.org/jira/browse/SAMZA-1278)  
[SEP-5: Enable partition expansion of input
streams](https://cwiki.apache.org/confluence/display/SAMZA/SEP-5%3A+Enable+partition+expansion+of+input+streams)
| Accepted |  
| [SAMZA-1293](https://issues.apache.org/jira/browse/SAMZA-1293)  
[SEP-6: Support Control Message Across Intermediate
Streams](/confluence/pages/viewpage.action?pageId=70256567) | Discuss |  
| [SAMZA-1260](https://issues.apache.org/jira/browse/SAMZA-1260)  
[SEP-7: Samza on Azure](/confluence/pages/viewpage.action?pageId=71012884) |
Discuss |  
| [SAMZA-1373](https://issues.apache.org/jira/browse/SAMZA-1373)  
[SEP-8 Add in-memory system consumer &
producer](/confluence/pages/viewpage.action?pageId=71013043) | Accepted |
<http://mail-archives.apache.org/mod_mbox/samza-
dev/201708.mbox/%3CCAG2vMJHyxCKqn4K+pst83OCpjc1r79MAPsqY-
VnKBbPUBUEc0g@mail.gmail.com%3E> |
[SAMZA-1395](https://issues.apache.org/jira/browse/SAMZA-1395)  
[SEP-9 Add a Kinesis SystemConsumer and
SystemProducer](/confluence/pages/viewpage.action?pageId=74682795) |  
|  
|  
  
[SEP-10 Exactly-once Processing in
Samza](/confluence/pages/viewpage.action?pageId=74687823) |  
|  
|  
  
[SEP-11: Host affinity in
standalone.](/confluence/pages/viewpage.action?pageId=75957309) | Accepted |  
| [SAMZA-1554](https://issues.apache.org/jira/browse/SAMZA-1554?src=confmacro)  
[SEP-12: Integration Test
Framework](/confluence/pages/viewpage.action?pageId=75977426) | Accepted |
<http://mail-archives.apache.org/mod_mbox/samza-
dev/201805.mbox/%3CDM5PR21MB02827A6FA9F47CB8EF99A339A2810%40DM5PR21MB0282.namprd21.prod.outlook.com%3E>
| [SAMZA-1629](https://issues.apache.org/jira/browse/SAMZA-1629)  
[SEP-13: unify high- and low-level user applications in YARN and
standalone](https://cwiki.apache.org/confluence/display/SAMZA/SEP-13%3A+unify+high-+and+low-
level+user+applications+in+YARN+and+standalone) | Accepted |

<https://lists.apache.org/thread.html/5be324d239633f7433525b0e52f0377ad2f8c25787eefba1b96a492c@%3Cdev.samza.apache.org%3E>

| [SAMZA-1789](https://issues.apache.org/jira/browse/SAMZA-1789)  
[SEP-14: System and Stream
Descriptors](https://cwiki.apache.org/confluence/display/SAMZA/SEP-14%3A+System+and+Stream+Descriptors)
| Accepted |  
| [SAMZA-1804](https://issues.apache.org/jira/browse/SAMZA-1804)  
[SEP-15: New Runtime Context
API](/confluence/pages/viewpage.action?pageId=93323433) | Accepted |  
|

[SAMZA-1714](https://issues.apache.org/jira/browse/SAMZA-1714)  
  
[SEP-16: Extend ExecutionPlanner to Support Stream-Table
Join](https://cwiki.apache.org/confluence/display/SAMZA/SEP-16:+Extend+ExecutionPlanner+to+Support+Stream-
Table+Join) | Accepted |  
| [SAMZA-1889](https://issues.apache.org/jira/browse/SAMZA-1889)  
[SEP-17: Samza SQL Shell](/confluence/pages/viewpage.action?pageId=95652399) |
Accepted |  
|  
  
[SEP-18: Startpoints - Manipulating Starting Offsets for Input
Streams](/confluence/pages/viewpage.action?pageId=95654625) | Accepted |  
| [SAMZA-1983](https://issues.apache.org/jira/browse/SAMZA-1983)  
  
[SEP-19: Hot standby state for Samza
applications](https://cwiki.apache.org/confluence/display/SAMZA/SEP-19%3A+Hot+standby+state+for+Samza+applications)

| Discuss |  
|  
  
[SEP-20: Samza on
Kubernetes](/confluence/pages/viewpage.action?pageId=99844645) | Accepted |  
|  
  
[SEP-21: Samza Async API for High
Level](/confluence/pages/viewpage.action?pageId=107085895) | Accepted |  
| [SAMZA-2055](https://issues.apache.org/jira/browse/SAMZA-2055)  
[SEP-22: Container Placements in
Samza](/confluence/pages/viewpage.action?pageId=135860312) | Accepted |
<http://mail-archives.apache>.org/mod_mbox/samza-
dev/202001.mbox/%3CCAKkRg%3D94NY8cLn89u%3DVeL1K52R3XuOimzxXsy7BLzS7fpS%3DLfg%[40mail.gmail.com](http://40mail.gmail.com)%3E
|

[SAMZA-2373](https://issues.apache.org/jira/browse/SAMZA-2373)  
  
[SEP-23: Simplify Job
Runner](https://cwiki.apache.org/confluence/display/SAMZA/SEP-23%3A+Simplify+Job+Runner)
| Accepted | <https://mail-archives.apache.org/mod_mbox/samza-
dev/201912.mbox/%3C560AD519-A166-4024-B1D6-E1DAE44611A4%40gmail.com%3E> |
[SAMZA-2405](https://issues.apache.org/jira/browse/SAMZA-2405)  
[SEP-24: Cluster-based Job Coordinator Dependency
Isolation](/confluence/pages/viewpage.action?pageId=135861548) | Accepted |
<https://mail-archives.apache.org/mod_mbox/samza-
dev/202003.mbox/%3CCABbqq3yEdAXiiTzXtO%2B%3DUnCBvxFR-5q_aJx3uqcQOoxF7M09vQ%40mail.gmail.com%3E>
|  
  
  
[SEP-25: PR Title And Description
Guidelines](https://cwiki.apache.org/confluence/display/SAMZA/SEP-25%3A+PR+Title+And+Description+Guidelines)

| Accepted | <http://mail-archives.apache.org/mod_mbox/samza-
dev/201912.mbox/%3CCAMja7KeQr9C048UVZwfSC46h%3DEX_9S%2BSEvMF9NPg0V5dPTPfZg%40mail.gmail.com%3E>
|  
  
[SEP-26: Azure Blob Storage
Producer](https://cwiki.apache.org/confluence/display/SAMZA/SEP-26%3A+Azure+Blob+Storage+Producer)
| Discuss |  
|
[SAMZA-2421](https://jira.apache.org/jira/projects/SAMZA/issues/SAMZA-2421?filter=allopenissues)  
[SEP-27: Side Inputs for Local
Stores](https://cwiki.apache.org/confluence/display/SAMZA/SEP-27%3A+Side+Inputs+for+Local+Stores)
| Discuss |  
| [SAMZA-1773](https://issues.apache.org/jira/browse/SAMZA-1773)  
[SEP-28: Samza State Backend Interface and Checkpointing
Improvements](/confluence/pages/viewpage.action?pageId=181309685) | Accepted |
<https://mail-archives.apache.org/mod_mbox/samza-
dev/202106.mbox/%3CCA%2B6YmWVVxz%3DXr244rPG2a-a6QAoR0mjrW9CK41-U7tSuv8oY4Q%40mail.gmail.com%3E>
| [SAMZA-2591](https://issues.apache.org/jira/browse/SAMZA-2591)  
[SEP-29: Blob Store Based State Backup And
Restore](/confluence/pages/viewpage.action?pageId=181309687) | Accepted |
<https://mail-archives.apache.org/mod_mbox/samza-
dev/202106.mbox/%3CCAMja7KcPM4c8iQwMu1wC3tkFmtzUf6U6UK2LKWGbiiucHjDw3w%40mail.gmail.com%3E>
| [SAMZA-2657](https://issues.apache.org/jira/browse/SAMZA-2657)  
[SEP-30: Suport Partial Updates in Table
API](https://cwiki.apache.org/confluence/display/SAMZA/SEP-30%3A+Support+Partial+Updates+in+Table+API)
| Accepted | [https://www.mail-
archive.com/dev@samza.apache.org/msg09162.html](https://www.mail-
archive.com/dev@samza.apache.org/msg09162.html) |
[SAMZA-2709](https://issues.apache.org/jira/browse/SAMZA-2709)  
[SEP-31: Pipeline
Drain](https://cwiki.apache.org/confluence/display/SAMZA/SEP-31%3A+Pipeline+Drain-+Support+the+ability+to+drain+pipelines+to+allow+incompatible+intermediate+schema+changes)
| Discuss |
[https://lists.apache.org/thread/7m2hqcqq9lx9o1d48gb64glplb3g2crt](https://lists.apache.org/thread/7m2hqcqq9lx9o1d48gb64glplb3g2crt)
| [SAMZA-2741](https://issues.apache.org/jira/browse/SAMZA-2741)  
  
  

  
  
  
|  |  | [Go to page
history](https://cwiki.apache.org/confluence/pages/viewpreviousversions.action?pageId=68719085&src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1669749001152&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac "Go to page
history")  
---  
---  
| [View
page](https://cwiki.apache.org/confluence/display/SAMZA/Samza+Enhancement+Proposal?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1669749001152&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=view)  
---  
  
|  | [Stop watching
space](https://cwiki.apache.org/confluence/users/removespacenotification.action?spaceKey=SAMZA&src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1669749001152&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=stop-
watching&jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ4c3JmOjhhYTk4MDg3NWJmMjQ2MzUwMTVjODJhN2QwOTkwMmFjIiwicXNoIjoiNjFjMDdmOWEzMmMyYmZhOTA2ZDgzZWEwMWJhNjhiYWFmYjI4NmZmYmIzMmQyNGQ4MzJmOTQ1MzRkMThkYTBlYyIsImlzcyI6ImNvbmZsdWVuY2Vfbm90aWZpY2F0aW9uc0FSRUgtWFVEMS1QT1FHLUNTQU8iLCJleHAiOjE2NzAzNTM4MDEsImlhdCI6MTY2OTc0OTAwMX0.FgCwEk5wuI95c2cXGkHi_oA-
ItxxYZTccYNG9IP-YDc) | •  
---|---  
[Manage
notifications](https://cwiki.apache.org/confluence/users/editmyemailsettings.action?src=mail&src.mail.product=confluence-
server&src.mail.timestamp=1669749001152&src.mail.notification=com.atlassian.confluence.plugins.confluence-
notifications-batch-plugin%3Abatching-
notification&src.mail.recipient=8aa980875bf24635015c82a7d09902ac&src.mail.action=manage)  
---  
| ![Confluence logo big](cid:footer-desktop-logo)  
---  
This message was sent by Atlassian Confluence 7.13.8  
![](cid:footer-mobile-logo)  
---