Samza - Apache Samza 1.2 <a href="/learn/documentation/1.2.0/"> [Docs] </a>

<!DOCTYPE html>  <html lang="en"> <head> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no"> <meta charset="utf-8"> <title>Samza - Apache Samza 1.2 <a href="/learn/documentation/1.2.0/"> [Docs] </a></title> <link rel="apple-touch-icon-precomposed" sizes="57x57" href="/img/favicon/apple-touch-icon-57x57.png" /> <link rel="apple-touch-icon-precomposed" sizes="114x114" href="/img/favicon/apple-touch-icon-114x114.png" /> <link rel="apple-touch-icon-precomposed" sizes="72x72" href="/img/favicon/apple-touch-icon-72x72.png" /> <link rel="apple-touch-icon-precomposed" sizes="144x144" href="/img/favicon/apple-touch-icon-144x144.png" /> <link rel="apple-touch-icon-precomposed" sizes="60x60" href="/img/favicon/apple-touch-icon-60x60.png" /> <link rel="apple-touch-icon-precomposed" sizes="120x120" href="/img/favicon/apple-touch-icon-120x120.png" /> <link rel="apple-touch-icon-precomposed" sizes="76x76" href="/img/favicon/apple-touch-icon-76x76.png" /> <link rel="apple-touch-icon-precomposed" sizes="152x152" href="/img/favicon/apple-touch-icon-152x152.png" /> <link rel="icon" type="image/png" href="/img/favicon/favicon-196x196.png" sizes="196x196" /> <link rel="icon" type="image/png" href="/img/favicon/favicon-96x96.png" sizes="96x96" /> <link rel="icon" type="image/png" href="/img/favicon/favicon-32x32.png" sizes="32x32" /> <link rel="icon" type="image/png" href="/img/favicon/favicon-16x16.png" sizes="16x16" /> <link rel="icon" type="image/png" href="/img/favicon/favicon-128.png" sizes="128x128" /> <meta name="application-name" content="https://samza.apache.org" /> <meta name="msapplication-TileColor" content="#FFFFFF" /> <meta name="msapplication-TileImage" content="/img/favicon/mstile-144x144.png" /> <meta name="msapplication-square70x70logo" content="/img/favicon/mstile-70x70.png" /> <meta name="msapplication-square150x150logo" content="/img/favicon/mstile-150x150.png" /> <meta name="msapplication-wide310x150logo" content="/img/favicon/mstile-310x150.png" /> <meta name="msapplication-square310x310logo" content="/img/favicon/mstile-310x310.png" /> <link href="/css/ionicons.min.css" rel="stylesheet"> <link href="/css/google-fonts.css" rel="stylesheet"> <link href="/css/syntax.css" rel="stylesheet"/> <link rel="stylesheet" href="/css/main.new.css" /> </head> <body class="page">  <div class="main-navigation" data-plugin="menu"> <div class="main-navigation__toggle" data-menu-closed> <i class="icon ion-md-menu"></i> </div> <div class="main-navigation__toggle main-navigation__toggle--opened" data-menu-opened> <i class="icon ion-md-close"></i> </div> <div class="main-navigation__inner"> <div class="main-navigation__logo"> <a href="/"> <img class="main-navigation__logo-img" src="/img/samza-logo.png" srcset="/img/samza-logo.png 1x, /img/samza-logo@2x.png 2x" alt="Samza Logo" /> </a> </div> <div class="main-navigation__items" data-menu-opened> <a class="main-navigation__item" href="/">Home</a> <a class="main-navigation__item" href="/learn/documentation/latest/core-concepts/core-concepts.html">Docs</a> <a class="main-navigation__item" href="/powered-by/">Powered By</a> <a class="main-navigation__item" href="/startup/download/">Downloads</a> <a class="main-navigation__item" href="/blog/">Blog</a> <div class="main-navigation__item main-navigation__item--group"> <div class="main-navigation__item-group-title"> Community <i class="icon ion-md-arrow-dropdown"></i> </div> <div class="main-navigation__item-group-list"> <a class="main-navigation__item" href="/community/contact-us.html">Contact Us</a> <a class="main-navigation__item" href="/contribute/contributors-corner.html">Contributor's Corner</a> <a class="main-navigation__item" href="/community/committers.html">PMC Members and committers</a> <a class="main-navigation__item" href="/meetups/">Talks and Meetups</a> </div> </div> </div> </div> </div> <div class="container"> <div class="container__toggle"> <i class="icon ion-md-arrow-dropleft-circle container__toggle-icon"></i> <i class="icon ion-md-arrow-dropright-circle container__toggle-icon container__toggle-icon--opened"></i> </div>   <div class="side-navigation">  <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible">  <div class="side-navigation__group-title"> <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Getting Started </div> <div class="side-navigation__group-items " data-sub-menu >  <a class="side-navigation__group-item" data-match-active="" href="/startup/quick-start/latest/">QuickStart</a> <a class="side-navigation__group-item" data-match-active="" href="/startup/code-examples/latest/">Code Examples</a>   </div>  </div>  <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible">  <div class="side-navigation__group-title"> <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Documentation </div> <div class="side-navigation__group-items side-navigation__group-has-submenus" data-sub-menu data-documentation="/learn/documentation/latest/">    </div>  </div>  <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible">  <div class="side-navigation__group-title"> <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Releases </div> <div class="side-navigation__group-items " data-sub-menu >  <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.5.1">1.5.1</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.5.0">1.5.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.4.0">1.4.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.3.1">1.3.1</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.3.0">1.3.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.2.0">1.2.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.1.0">1.1.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/1.0.0">1.0.0</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/0.14">0.14</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/0.13">0.13</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/0.12">0.12</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/0.11">0.11</a> <a class="side-navigation__group-item" data-match-active="" href="/releases/0.10">0.10</a>   </div>  </div>  <div class="side-navigation__group">  <a class="side-navigation__group-title" data-plugin="top-menu" data-match-active="" href="/blog/"> Blog </a>     </div>  <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible">  <div class="side-navigation__group-title"> <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Community </div> <div class="side-navigation__group-items " data-sub-menu >  <a class="side-navigation__group-item" data-match-active="" href="/community/contact-us.html">Contact Us</a> <a class="side-navigation__group-item" data-match-active="" href="/contribute/contributors-corner.html">Contributor's Corner</a> <a class="side-navigation__group-item" data-match-active="" href="/contribute/enhancement-proposal.html">Enhancement Proposal</a> <a class="side-navigation__group-item" data-match-active="" href="/community/committers.html">PMC members & Committers</a> <a class="side-navigation__group-item" data-match-active="" href="/meetups/">Talks and Meetups</a>   </div>  </div>  <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible">  <div class="side-navigation__group-title"> <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Case Studies </div> <div class="side-navigation__group-items " data-sub-menu >  <a class="side-navigation__group-item" data-match-active="exact" href="/case-studies/">View All</a> <hr>  <a class="side-navigation__group-item" href="/case-studies/ebay" data-match-active="">eBay</a> <a class="side-navigation__group-item" href="/case-studies/tripadvisor" data-match-active="">TripAdvisor</a> <a class="side-navigation__group-item" href="/case-studies/slack" data-match-active="">Slack</a> <a class="side-navigation__group-item" href="/case-studies/optimizely" data-match-active="">Optimizely</a> <a class="side-navigation__group-item" href="/case-studies/redfin" data-match-active="">Redfin</a> <a class="side-navigation__group-item" href="/case-studies/linkedin" data-match-active="">LinkedIn</a>  </div>  </div> </div> <div class="section"> <div class="content"> <h2>Apache Samza 1.2 <a href="/learn/documentation/1.2.0/"> [Docs] </a></h2>  <p>We’re thrilled to announce the release of Apache Samza 1.2.0.</p> <p>Today Samza forms the backbone of hundreds of real-time production applications across a multitude of companies, such as LinkedIn, VMWare, Slack, Redfin among many others. Samza provides leading support for large-scale stateful stream processing with:</p> <ul> <li> <p>First class support for local state (with RocksDB store). This allows a stateful application to scale up to 1.1 Million events/sec on a single machine with SSD.</p> </li> <li> <p>Support for incremental checkpointing of state instead of full snapshots. This enables Samza to scale to applications with very large state.</p> </li> <li> <p>A fully asynchronous programming model that makes parallelizing remote calls efficient and effortless.</p> </li> <li> <p>High level API for expressing complex stream processing pipelines in a few lines of code.</p> </li> <li> <p>Beam Samza Runner that marries Beam’s best in class support for EventTime based windowed processing and sophisticated triggering with Samza’s stable and scalable stateful processing model.</p> </li> <li> <p>A fully pluggable model for input sources (e.g. Kafka, Kinesis, DynamoDB streams etc.) and output systems (HDFS, Kafka, ElastiCache etc.).</p> </li> <li> <p>A Table API that provides a common abstraction for accessing remote or local databases and allowing developers are able to “join” an input event stream with such a Table.</p> </li> <li> <p>Flexible deployment model for running the applications in any hosting environment and with cluster managers other than YARN.</p> </li> <li> <p>Features like canaries, upgrades and rollbacks that support extremely large deployments with minimal downtime.</p> </li> </ul> <h3 id="new-features-upgrades-and-bug-fixes"><strong>New Features, Upgrades and Bug Fixes:</strong></h3> <p>This release brings the following features, upgrades, and capabilities:</p> <ul> <li> <p>Upgrade to Kafka 2</p> </li> <li> <p>Beam integration with tables and integration with CouchBase</p> </li> <li> <p>Async high level API</p> </li> <li> <p>Bug fixes</p> </li> </ul> <p>Full list of the jiras addressed in this release can be found <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20fixVersion%20%3D%201.2">here</a>.</p> <h3 id="upgrading-your-application-to-apache-samza-120"><strong>Upgrading your application to Apache Samza 1.2.0</strong></h3> <h3 id="kafka-upgrade">Kafka upgrade</h3> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2127">SAMZA-2127</a> Upgrade to Kafka 2.0</p> <h3 id="async-api-for-high-level">Async API for high level</h3> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2055">SAMZA-2055</a> Design and Implement async API for high level</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2172">SAMZA-2172</a> Async High Level API does not schedule StreamOperatorTasks on separate threads</p> <h4 id="startpoint">Startpoint</h4> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2192">SAMZA-2192</a> Add StartpointVisitor implementation for EventHub.</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2189">SAMZA-2189</a> Integrate startpoint resolution workflow with SamzaContainer startup sequence.</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2179">SAMZA-2179</a> Move the StartpointVisitor abstraction to SystemAdmin interface.</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2046">SAMZA-2046</a> Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2132">SAMZA-2132</a> Startpoint - flatten serialized key</p> <h4 id="table-api">Table API</h4> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2185">SAMZA-2185</a> Ability to expose remote data source specific features in remote table</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2156">SAMZA-2156</a> Couchbase Table Support for Samza Table API</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2153">SAMZA-2153</a> Config for TableRetryPolicy</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2134">SAMZA-2134</a> Enable remote table rate limiter by default</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2116">SAMZA-2116</a> Make sendTo operators non-terminal</p> <h4 id="bug-fixes-testing-and-stability-improvments">Bug Fixes, Testing and Stability improvments</h4> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2202">SAMZA-2202</a> Modify topic creation s.t. all log compacted topics are created with a 5MB message size limit.</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2181">SAMZA-2181</a> Ensure consistency of coordinator store creation and initialization</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2178">SAMZA-2178</a> Utils to directly inject custom IME to InMemorySystem streams</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2176">SAMZA-2176</a> Ignore the configurations with serialized null values from coordinator stream.</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2171">SAMZA-2171</a> Encapsulate creation and loading of metadata streams</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2170">SAMZA-2170</a> Enabling writing of both new and old format offset files for stores and side-input-stores</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2169">SAMZA-2169</a> Preventing task-shuffle after task mode addition</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2161">SAMZA-2161</a> Move ChangelogPartitionManager and CoordinatorStream ConfigReader to MetadataStore</p> <p><a href="https://issues.apache.org/jira/browse/SAMZA-2135">SAMZA-2135</a> Provide a way inject ExternalContext to TestRunner</p> <h3 id="sources-downloads">Sources downloads</h3> <p>A source download of Samza 1.2.0 is available <a href="https://dist.apache.org/repos/dist/release/samza/1.2.0/">here</a>, and is also available in Apache’s Maven repository. See Samza’s download <a href="https://samza.apache.org/startup/download/">page</a> for details and Samza’s feature preview for new features.</p> </div> </div> </div>   <footer> <div class="footer-inner"> <div class="side-by-side"> <div> <div class="footer__heading">Learn More</div> <div class="footer__items"> <a class="footer__item" href="/meetups/">Meetups</a> <a class="footer__item" href="/blog/">Blog</a> <a class="footer__item" href="/learn/documentation/latest/introduction/background.html">About</a> </div> </div> <div> <div class="footer__heading">Community</div> <div class="footer__items"> <a class="footer__item" href="/community/contact-us.html">Contact Us</a> <a class="footer__item" href="/contribute/contributors-corner.html">Contributors' Corner</a> <a class="footer__item" href="/community/committers.html">PMC members and committers</a> <a class="footer__item" href="/powered-by/">Powered By</a> </div> </div> <div> <div class="quick-links"> <a class="quick-link" href="/startup/download" target="_blank"> <i class="icon ion-md-download"></i> </a> <a class="quick-link" href="https://git-wip-us.apache.org/repos/asf?p=samza.git;a=tree" target="_blank"> <i class="icon ion-md-code"></i> </a> <a class="quick-link" href="https://twitter.com/samzastream" target="_blank"> <i class="icon ion-logo-twitter"></i> </a> </div> <p> <script>document.write(new Date().getFullYear());</script> © samza.apache.org</p> </div> </div> </div> </footer>  <script> (function (i, s, o, g, r, a, m) { i['GoogleAnalyticsObject'] = r; i[r] = i[r] || function () { (i[r].q = i[r].q || []).push(arguments) }, i[r].l = 1 * new Date(); a = s.createElement(o), m = s.getElementsByTagName(o)[0]; a.async = 1; a.src = g; m.parentNode.insertBefore(a, m) })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga'); ga('create', 'UA-43122768-1', 'apache.org'); ga('send', 'pageview'); </script> <script src="/js/main.new.js"></script> </body> </html>

CINXE.COM

Samza - Apache Samza 1.2 [Docs]