CINXE.COM
Oozie - Apache Oozie Workflow Scheduler for Hadoop
<!DOCTYPE html> <!-- | Generated by Apache Maven Doxia at 2021-02-26 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <meta name="author" content="$maven.build.timestamp" /> <meta name="Date-Revision-yyyymmdd" content="20210226" /> <meta http-equiv="Content-Language" content="en" /> <title>Oozie - Apache Oozie Workflow Scheduler for Hadoop</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script> </head> <body class="topBarEnabled"> <div id="topbar" class="navbar navbar-fixed-top "> <div class="navbar-inner"> <div class="container"><div class="nav-collapse"> <ul class="nav"> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Oozie <b class="caret"></b></a> <ul class="dropdown-menu"> <li> <a href="index.html" title="About">About</a> </li> <li> <a href="http://www.apache.org/dyn/closer.lua/oozie/" title="Downloads">Downloads</a> </li> <li> <a href="https://issues.apache.org/jira/browse/OOZIE" title="JIRA">JIRA</a> </li> <li> <a href="https://cwiki.apache.org/confluence/display/OOZIE" title="Wiki">Wiki</a> </li> <li> <a href="http://blogs.apache.org/oozie/" title="Blog">Blog</a> </li> <li> <a href="https://cwiki.apache.org/confluence/display/OOZIE/Powered+by" title="Powered by">Powered by</a> </li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> <ul class="dropdown-menu"> <li> <a href="project-info.html" title="Summary">Summary</a> </li> <li> <a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a> </li> <li> <a href="IRCChannel.html" title="IRC">IRC</a> </li> <li> <a href="team-list.html" title="Team">Team</a> </li> <li> <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a> </li> <li> <a href="source-repository.html" title="Source Repository">Source Repository</a> </li> <li> <a href="license.html" title="License">License</a> </li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> <ul class="dropdown-menu"> <li> <a href="http://www.apache.org/dyn/closer.lua/oozie/5.2.1" title="5.2.1 (latest)">5.2.1 (latest)</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/5.2.0" title="5.2.0">5.2.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/5.1.0" title="5.1.0">5.1.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/5.0.0" title="5.0.0">5.0.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/4.3.1" title="4.3.1">4.3.1</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/5.0.0-beta1" title="5.0.0-beta1">5.0.0-beta1</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/4.3.0" title="4.3.0">4.3.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/4.2.0" title="4.2.0">4.2.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/4.1.0" title="4.1.0">4.1.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/4.0.1" title="4.0.1">4.0.1</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/4.0.0" title="4.0.0">4.0.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/3.3.2" title="3.3.2">3.3.2</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/3.3.1/" title="3.3.1">3.3.1</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/3.3.0/" title="3.3.0">3.3.0</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/3.2.0-incubating/" title="3.2.0-incubating">3.2.0-incubating</a> </li> <li> <a href="http://archive.apache.org/dist/oozie/3.1.3-incubating/" title="3.1.3-incubating">3.1.3-incubating</a> </li> <li> <a href="https://github.com/yahoo/oozie/downloads/" title="Pre Apache releases">Pre Apache releases</a> </li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> <ul class="dropdown-menu"> <li> <a href="docs/5.2.1/index.html" title="5.2.1 (latest)">5.2.1 (latest)</a> </li> <li> <a href="docs/5.2.0/index.html" title="5.2.0">5.2.0</a> </li> <li> <a href="docs/5.1.0/index.html" title="5.1.0">5.1.0</a> </li> <li> <a href="docs/5.0.0/index.html" title="5.0.0">5.0.0</a> </li> <li> <a href="docs/4.3.1/index.html" title="4.3.1">4.3.1</a> </li> <li> <a href="docs/5.0.0-beta1/index.html" title="5.0.0-beta1">5.0.0-beta1</a> </li> <li> <a href="docs/4.3.0/index.html" title="4.3.0">4.3.0</a> </li> <li> <a href="docs/4.2.0/index.html" title="4.2.0">4.2.0</a> </li> <li> <a href="docs/4.1.0/index.html" title="4.1.0">4.1.0</a> </li> <li> <a href="docs/4.0.1/index.html" title="4.0.1">4.0.1</a> </li> <li> <a href="docs/4.0.0/index.html" title="4.0.0">4.0.0</a> </li> <li> <a href="docs/3.3.2/index.html" title="3.3.2">3.3.2</a> </li> <li> <a href="docs/3.3.1/index.html" title="3.3.1">3.3.1</a> </li> <li> <a href="docs/3.3.0/index.html" title="3.3.0">3.3.0</a> </li> <li> <a href="docs/3.2.0-incubating/index.html" title="3.2.0-incubating">3.2.0-incubating</a> </li> <li> <a href="docs/3.1.3-incubating/index.html" title="3.1.3-incubating">3.1.3-incubating</a> </li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Resources <b class="caret"></b></a> <ul class="dropdown-menu"> <li> <a href="https://cwiki.apache.org/confluence/display/OOZIE/Developer+Resources" title="Developer Resources">Developer Resources</a> </li> <li> <a href="https://cwiki.apache.org/confluence/display/OOZIE/User+Resources" title="User Resources">User Resources</a> </li> </ul> </li> <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> <ul class="dropdown-menu"> <li> <a href="http://www.apache.org/foundation/how-it-works.html" title="How Apache Works">How Apache Works</a> </li> <li> <a href="http://www.apache.org/foundation/" title="Foundation">Foundation</a> </li> <li> <a href="http://www.apache.org/foundation/sponsorship.html" title="Sponsoring Apache">Sponsoring Apache</a> </li> <li> <a href="http://www.apache.org/foundation/thanks.html" title="Thanks">Thanks</a> </li> </ul> </li> </ul> <form id="search-form" action="http://www.google.com/search" method="get" class="navbar-search pull-right" > <input value="http://oozie.apache.org" name="sitesearch" type="hidden"/> <input class="search-query" name="q" id="query" type="text" /> </form> <script type="text/javascript" src="http://www.google.com/coop/cse/brand?form=search-form"></script> </div> </div> </div> </div> <div class="container"> <div id="banner"> <div class="pull-left"> <a href="./" id="bannerLeft"> <img src="images/oozie_200x.png" alt="Oozie" width="200px" height="47px"/> </a> </div> <div class="pull-right"> <a href="http://www.apache.org/" id="bannerRight"> <img src="images/asf_logo_wide.png" width="300px"/> </a> </div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> <li class=""> <a href="http://www.apache.org/" class="externalLink" title="Apache"> Apache</a> </li> <li class="divider ">/</li> <li class=""> <a href="./" title="Oozie"> Oozie</a> </li> <li class="divider ">/</li> <li class="">Apache Oozie Workflow Scheduler for Hadoop</li> <li id="publishDate" class="pull-right">Last Published: 2021-02-26</li> </ul> </div> <div id="bodyColumn" > <!-- Licensed under the Apache License, Version 2.0 (the "License"); --><!-- you may not use this file except in compliance with the License. --><!-- You may obtain a copy of the License at --><!-- --><!-- http://www.apache.org/licenses/LICENSE-2.0 --><!-- --><!-- Unless required by applicable law or agreed to in writing, software --><!-- distributed under the License is distributed on an "AS IS" BASIS, --><!-- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. --><!-- See the License for the specific language governing permissions and --><!-- limitations under the License. See accompanying LICENSE file. --><div class="section"> <h2>Apache Oozie Workflow Scheduler for Hadoop<a name="Apache_Oozie_Workflow_Scheduler_for_Hadoop"></a></h2> <div class="section"> <h3>Overview<a name="Overview"></a></h3> <p>Oozie is a workflow scheduler system to manage Apache Hadoop jobs.</p> <p>Oozie Workflow jobs are Directed Acyclical Graphs (DAGs) of actions.</p> <p>Oozie Coordinator jobs are recurrent Oozie Workflow jobs triggered by time (frequency) and data availability.</p> <p>Oozie is integrated with the rest of the Hadoop stack supporting several types of Hadoop jobs out of the box (such as Java map-reduce, Streaming map-reduce, Pig, Hive, Sqoop and Distcp) as well as system specific jobs (such as Java programs and shell scripts).</p> <p>Oozie is a scalable, reliable and extensible system.</p> <p>Developers interested in getting more involved with Oozie may join the <a href="./mail-lists.html">mailing lists</a>, <a class="externalLink" href="https://issues.apache.org/jira/browse/OOZIE">report bugs</a>, retrieve code from the <a href="./source-repository.html">version control system</a>, and make <a class="externalLink" href="https://cwiki.apache.org/confluence/display/OOZIE/How+To+Contribute">contributions</a>.</p></div></div> </div> </div> <hr/> <footer> <div class="container"> <div class="row span12">Copyright © 2011-2021 <a href="http://www.apache.org/">The Apache Software Foundation</a>. All Rights Reserved. </div> <p id="poweredBy" class="pull-right"> <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"> <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> </a> </p> </div> </footer> </body> </html>