CINXE.COM
Apache Tez – Welcome to Apache TEZ庐
<!DOCTYPE html> <!-- | Generated by Apache Maven Doxia Site Renderer 1.11.1 from src/site/markdown/index.md at 2024-12-23 | Rendered using Apache Maven Fluido Skin 1.9 --> <html xmlns="http://www.w3.org/1999/xhtml" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1" /> <meta name="generator" content="Apache Maven Doxia Site Renderer 1.11.1" /> <title>Apache Tez – Welcome to Apache TEZ庐</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.9.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> <script src="./js/apache-maven-fluido-1.9.min.js"></script> <script> var _paq = window._paq = window._paq || []; /* tracker methods like "setCustomDimension" should be called before "trackPageView" */ _paq.push(["setDoNotTrack", true]); _paq.push(["disableCookies"]); _paq.push(['trackPageView']); _paq.push(['enableLinkTracking']); (function() { var u="https://analytics.apache.org/"; _paq.push(['setTrackerUrl', u+'matomo.php']); _paq.push(['setSiteId', '63']); var d=document, g=d.createElement('script'), s=d.getElementsByTagName('script')[0]; g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s); })(); </script> <style> .well.sidebar-nav { background-color: #fff; } a.externalLink[href^=http] { background-image: none; padding-right: 0; } body.topBarEnabled { padding-top: 40px; } #leftColumn .nav-list .active a { background-color: #a0a0a0; } .nav-list .active a:hover { background-color: #a0a0a0; } </style> </head> <body class="topBarEnabled"> <header id="topbar" class="navbar navbar-fixed-top "> <div class="navbar-inner"> <div class="container-fluid"> <a data-target=".nav-collapse" data-toggle="collapse" class="btn btn-navbar"> <span class="icon-bar"></span> <span class="icon-bar"></span> <span class="icon-bar"></span> </a> <ul class="nav"> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Getting Started <b class="caret"></b></a> <ul class="dropdown-menu"> <li><a href="index.html" title="Overview">Overview</a></li> <li><a href="talks.html" title="Talks and Meetup Recordings">Talks and Meetup Recordings</a></li> <li><a href="https://www.apache.org/licenses/LICENSE-2.0.txt" title="Project License">Project License</a></li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> <ul class="dropdown-menu"> <li><a href="install.html" title="Install Guide">Install Guide</a></li> <li><a href="localmode.html" title="Local Mode">Local Mode</a></li> <li><a href="tez-ui.html" title="Tez UI">Tez UI</a></li> <li><a href="shuffle-handler.html" title="Tez Shuffle Handler">Tez Shuffle Handler</a></li> <li><a href="user_guides.html" title="User Guides">User Guides</a></li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Community <b class="caret"></b></a> <ul class="dropdown-menu"> <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li> <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li> <li><a href="team-list.html" title="Project Team">Project Team</a></li> <li><a href="by-laws.html" title="Project By-Laws">Project By-Laws</a></li> <li><a href="https://www.meetup.com/Apache-Tez-User-Group" title="User Meetup Group">User Meetup Group</a></li> <li><a href="https://cwiki.apache.org/confluence/display/TEZ" title="Tez Wiki">Tez Wiki</a></li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Download Apache TEZ庐 Releases <b class="caret"></b></a> <ul class="dropdown-menu"> <li><a href="releases/apache-tez-0-8-5.html" title="0.8.5">0.8.5</a></li> <li><a href="releases/apache-tez-0-9-2.html" title="0.9.2">0.9.2</a></li> <li><a href="releases/apache-tez-0-10-3.html" title="0.10.3">0.10.3</a></li> <li><a href="releases/apache-tez-0-10-4.html" title="0.10.4">0.10.4</a></li> <li><a href="releases/index.html" title="All Releases">All Releases</a></li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Contribute <b class="caret"></b></a> <ul class="dropdown-menu"> <li><a href="https://issues.apache.org/jira/browse/TEZ" title="JIRA">JIRA</a></li> <li><a href="https://gitbox.apache.org/repos/asf/tez.git" title="Git (Read/Write)">Git (Read/Write)</a></li> <li><a href="git://git.apache.org/tez.git" title="Git (Read-only)">Git (Read-only)</a></li> <li><a href="https://cwiki.apache.org/confluence/display/TEZ/How+to+Contribute+to+Tez" title="How to Contribute">How to Contribute</a></li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> <ul class="dropdown-menu"> <li><a href="https://www.apache.org/licenses/" title="License">License</a></li> <li><a href="https://www.apache.org/foundation/sponsorship.html" title="Donate">Donate</a></li> <li><a href="https://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a></li> <li><a href="https://www.apache.org/security/" title="Security">Security</a></li> </ul> </li> </ul> </div> </div> </header> <div class="container-fluid"> <header> <div id="banner"> <div class="pull-left"><a href="./" id="bannerLeft"><img src="images/ApacheTezLogo_lowres.png" alt="Apache Tez" width="25%" height="25%"/></a></div> <div class="pull-right"><a href="https://www.apache.org/" id="bannerRight"><img src="https://apache.org/foundation/press/kit/asf_logo_wide.png" alt="Apache Software Foundation"/></a></div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> <li class=""><a href="./" title="Apache TEZ庐">Apache TEZ庐</a><span class="divider">/</span></li> <li class="active ">Welcome to Apache TEZ庐</li> <li id="publishDate" class="pull-right">Last Published: 2024-12-23</li> </ul> </div> </header> <div class="row-fluid"> <header id="leftColumn" class="span2"> <nav class="well sidebar-nav"> <ul class="nav nav-list"> <li class="nav-header">Getting Started</li> <li class="active"><a href="#"><span class="none"></span>Overview</a></li> <li><a href="talks.html" title="Talks and Meetup Recordings"><span class="none"></span>Talks and Meetup Recordings</a></li> <li><a href="https://www.apache.org/licenses/LICENSE-2.0.txt" class="externalLink" title="Project License"><span class="none"></span>Project License</a></li> <li class="nav-header">Documentation</li> <li><a href="install.html" title="Install Guide"><span class="none"></span>Install Guide</a></li> <li><a href="localmode.html" title="Local Mode"><span class="none"></span>Local Mode</a></li> <li><a href="tez-ui.html" title="Tez UI"><span class="none"></span>Tez UI</a></li> <li><a href="shuffle-handler.html" title="Tez Shuffle Handler"><span class="none"></span>Tez Shuffle Handler</a></li> <li><a href="user_guides.html" title="User Guides"><span class="none"></span>User Guides</a></li> <li class="nav-header">Community</li> <li><a href="mail-lists.html" title="Mailing Lists"><span class="none"></span>Mailing Lists</a></li> <li><a href="issue-tracking.html" title="Issue Tracking"><span class="none"></span>Issue Tracking</a></li> <li><a href="team-list.html" title="Project Team"><span class="none"></span>Project Team</a></li> <li><a href="by-laws.html" title="Project By-Laws"><span class="none"></span>Project By-Laws</a></li> <li><a href="https://www.meetup.com/Apache-Tez-User-Group" class="externalLink" title="User Meetup Group"><span class="none"></span>User Meetup Group</a></li> <li><a href="https://cwiki.apache.org/confluence/display/TEZ" class="externalLink" title="Tez Wiki"><span class="none"></span>Tez Wiki</a></li> <li class="nav-header">Download Apache TEZ庐 Releases</li> <li><a href="releases/apache-tez-0-8-5.html" title="0.8.5"><span class="none"></span>0.8.5</a></li> <li><a href="releases/apache-tez-0-9-2.html" title="0.9.2"><span class="none"></span>0.9.2</a></li> <li><a href="releases/apache-tez-0-10-3.html" title="0.10.3"><span class="none"></span>0.10.3</a></li> <li><a href="releases/apache-tez-0-10-4.html" title="0.10.4"><span class="none"></span>0.10.4</a></li> <li><a href="releases/index.html" title="All Releases"><span class="none"></span>All Releases</a></li> <li class="nav-header">Contribute</li> <li><a href="https://issues.apache.org/jira/browse/TEZ" class="externalLink" title="JIRA"><span class="none"></span>JIRA</a></li> <li><a href="https://gitbox.apache.org/repos/asf/tez.git" class="externalLink" title="Git (Read/Write)"><span class="none"></span>Git (Read/Write)</a></li> <li><a href="git://git.apache.org/tez.git" class="externalLink" title="Git (Read-only)"><span class="none"></span>Git (Read-only)</a></li> <li><a href="https://cwiki.apache.org/confluence/display/TEZ/How+to+Contribute+to+Tez" class="externalLink" title="How to Contribute"><span class="none"></span>How to Contribute</a></li> <li class="nav-header">ASF</li> <li><a href="https://www.apache.org/licenses/" class="externalLink" title="License"><span class="none"></span>License</a></li> <li><a href="https://www.apache.org/foundation/sponsorship.html" class="externalLink" title="Donate"><span class="none"></span>Donate</a></li> <li><a href="https://www.apache.org/foundation/thanks.html" class="externalLink" title="Thanks"><span class="none"></span>Thanks</a></li> <li><a href="https://www.apache.org/security/" class="externalLink" title="Security"><span class="none"></span>Security</a></li> </ul> </nav> <div class="well sidebar-nav"> <hr /> <div id="poweredBy"> <div class="clear"></div> <div id="twitter" style="border:none; margin-top: 10px"> <a href="https://twitter.com/ApacheTez" class="twitter-follow-button" data-show-count="false" data-align="left" data-size="medium" data-show-screen-name="true" data-lang="en">Follow ApacheTez</a> <script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0];if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src="//platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs");</script> </div> <div class="clear"></div> <div class="clear"></div> <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a> </div> </div> </header> <main id="bodyColumn" class="span10" > <!-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> <section> <h2><a name="Introduction"></a>Introduction</h2> <p>The Apache TEZ® project is aimed at building an application framework which allows for a complex directed-acyclic-graph of tasks for processing data. It is currently built atop <a class="externalLink" href="https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html">Apache Hadoop YARN</a>.</p> <p>The 2 main design themes for Tez are:</p> <ul> <li><b>Empowering end users by:</b> <ul> <li>Expressive dataflow definition APIs</li> <li>Flexible Input-Processor-Output runtime model</li> <li>Data type agnostic</li> <li>Simplifying deployment</li> </ul> </li> <li><b>Execution Performance</b> <ul> <li>Performance gains over Map Reduce</li> <li>Optimal resource management</li> <li>Plan reconfiguration at runtime</li> <li>Dynamic physical data flow decisions</li> </ul> </li> </ul> <p>By allowing projects like Apache Hive and Apache Pig to run a complex DAG of tasks, Tez can be used to process data, that earlier took multiple MR jobs, now in a single Tez job as shown below.</p> <p><img src="./images/PigHiveQueryOnMR.png" alt="Flow for a Hive or Pig Query on MapReduce" /> <img src="./images/PigHiveQueryOnTez.png" alt="Flow for a Hive or Pig Query on Tez" /></p> <p>To download the Apache Tez software, go to the <a href="./releases/index.html">Releases</a> page.</p></section> </main> </div> </div> <hr/> <footer> <div class="container-fluid"> <div class="row-fluid"> <div class="row span12"> Apache Tez, Apache, the Apache feather logo, and the Apache Tez project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners. </div> <br/> <div class="row span12"> <a href="https://privacy.apache.org/policies/privacy-policy-public.html">Privacy Policy</a> </div> </div> </div> </footer> </body> </html>