Oozie -

<!DOCTYPE html>  <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <meta http-equiv="Content-Language" content="en" /> <title>Oozie - </title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.4.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> <script type="text/javascript" src="./js/apache-maven-fluido-1.4.min.js"></script> </head> <body class="topBarDisabled"> <div class="container-fluid"> <div id="banner"> <div class="pull-left"> <a href="https://oozie.apache.org/" id="bannerLeft"> <img src="https://oozie.apache.org/images/oozie_200x.png" alt="Oozie"/> </a> </div> <div class="pull-right"> </div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> <li class=""> <a href="../../" title="Apache"> Apache</a> <span class="divider">/</span> </li> <li class=""> <a href="../../" title="Oozie"> Oozie</a> <span class="divider">/</span> </li> <li class=""> <a href="../" title="docs"> docs</a> <span class="divider">/</span> </li> <li class=""> <a href="./" title="5.0.0"> 5.0.0</a> <span class="divider">/</span> </li> <li class="active ">Oozie - </li> <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2018-04-09</li> <li id="projectVersion" class="pull-right"> Version: 5.0.0 </li> </ul> </div> <div class="row-fluid"> <div id="leftColumn" class="span2"> <div class="well sidebar-nav"> <ul class="nav nav-list"> </ul> <hr /> <div id="poweredBy"> <div class="clear"></div> <div class="clear"></div> <div class="clear"></div> <div class="clear"></div> <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"> <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> </a> </div> </div> </div> <div id="bodyColumn" class="span10" > <p></p> <a name="Oozie_Workflow_Engine_for_Apache_Hadoop"></a> <div class="section"><h2> Oozie, Workflow Engine for Apache Hadoop</h2> <p>Oozie v3 is a server based <i>Bundle Engine</i> that provides a higher-level oozie abstraction that will batch a set of coordinator applications. The user will be able to start/stop/suspend/resume/rerun a set coordinator jobs in the bundle level resulting a better and easy operational control.</p> <p>Oozie v2 is a server based <i>Coordinator Engine</i> specialized in running workflows based on time and data triggers. It can continuously run workflows based on time (e.g. run it every hour), and data availability (e.g. wait for my input data to exist before running my workflow).</p> <p>Oozie v1 is a server based <i>Workflow Engine</i> specialized in running workflow jobs with actions that execute Hadoop Map/Reduce and Pig jobs.</p> <p><ul><ul><li><a href="#Distribution_Contents">Distribution Contents</a> </li> <li><a href="#Quick_Start">Quick Start</a> </li> <li><a href="#Developer_Documentation">Developer Documentation</a> <ul><li><a href="#Action_Extensions">Action Extensions</a> </li> <li><a href="#Job_Status_and_SLA_Monitoring">Job Status and SLA Monitoring</a> </li> </ul> </li> <li><a href="#Administrator_Documentation">Administrator Documentation</a> </li> <li><a href="#Licensing_Information">Licensing Information</a> </li> <li><a href="#Engineering_Documentation">Engineering Documentation</a> </li> <li><a href="#MiniOozie_Documentation">MiniOozie Documentation</a> </li> <li><a href="#Oozie_User_Authentication_Documentation">Oozie User Authentication Documentation</a> </li> </ul> </ul> </p> <a name="Distribution_Contents"></a> <div class="section"><h3>Distribution Contents</h3> <p>Oozie distribution consists of a single 'tar.gz' file containing:</p> <p><ul><li>Readme, license, notice & <a href="./release-log.txt">Release log</a> files.</li> <li>Oozie server: <tt>oozie-server</tt> directory.</li> <li>Scripts: <tt>bin/</tt> directory, client and server scripts.</li> <li>Binaries: <tt>lib/</tt> directory, client JAR files.</li> <li>Configuration: <tt>conf/</tt> server configuration directory.</li> <li>Archives:<ul><li><tt>oozie-client-*.tar.gz</tt> : Client tools.</li> <li><tt>oozie.war</tt> : Oozie WAR file.</li> <li><tt>docs.zip</tt> : Documentation.</li> <li><tt>oozie-examples-*.tar.gz</tt> : Examples.</li> <li><tt>oozie-sharelib-*.tar.gz</tt> : Share libraries (with Streaming, Pig JARs).</li> </ul> </li> </ul> </p> <a name="Quick_Start"></a> </div> <div class="section"><h3>Quick Start</h3> <p>Enough reading already? Follow the steps in <a href="./DG_QuickStart.html">Oozie Quick Start</a> to get Oozie up and running.</p> <a name="Developer_Documentation"></a> </div> <div class="section"><h3>Developer Documentation</h3> <p><ul><li><a href="./DG_Overview.html">Overview</a> </li> <li><a href="./DG_QuickStart.html">Oozie Quick Start</a> </li> <li><a href="./DG_Examples.html">Running the Examples</a> </li> <li><a href="./WorkflowFunctionalSpec.html">Workflow Functional Specification</a> </li> <li><a href="./CoordinatorFunctionalSpec.html">Coordinator Functional Specification</a> </li> <li><a href="./BundleFunctionalSpec.html">Bundle Functional Specification</a> </li> <li><a class="externalLink" href="https://docs.oracle.com/javaee/7/tutorial/jsf-el.htm">EL Expression Language Quick Reference</a> </li> <li><a href="./DG_CommandLineTool.html">Command Line Tool</a> </li> <li><a href="./DG_WorkflowReRun.html">Workflow Re-runs Explained</a> </li> <li><a href="./DG_HCatalogIntegration.html">HCatalog Integration Explained</a> </li> </ul> </p> <p><ul><li><a href="./client/apidocs/index.html">Oozie Client Javadocs</a> </li> <li><a href="./core/apidocs/index.html">Oozie Core Javadocs</a> </li> <li><a href="./WebServicesAPI.html">Oozie Web Services API</a> </li> <li><a href="./DG_ActionAuthentication.html">Action Authentication</a> </li> </ul> </p> <a name="Action_Extensions"></a> <div class="section"><h4>Action Extensions</h4> <p><ul><li><a href="./DG_EmailActionExtension.html">Email Action</a> </li> <li><a href="./DG_ShellActionExtension.html">Shell Action</a> </li> <li><a href="./DG_HiveActionExtension.html">Hive Action</a> </li> <li><a href="./DG_Hive2ActionExtension.html">Hive 2 Action</a> </li> <li><a href="./DG_SqoopActionExtension.html">Sqoop Action</a> </li> <li><a href="./DG_SshActionExtension.html">Ssh Action</a> </li> <li><a href="./DG_DistCpActionExtension.html">DistCp Action</a> </li> <li><a href="./DG_SparkActionExtension.html">Spark Action</a> </li> <li><a href="./DG_CustomActionExecutor.html">Writing a Custom Action Executor</a> </li> </ul> </p> <a name="Job_Status_and_SLA_Monitoring"></a> </div> <div class="section"><h4>Job Status and SLA Monitoring</h4> <p><ul><li><a href="./DG_JMSNotifications.html">JMS Notifications for Job and SLA</a> </li> <li><a href="./DG_SLAMonitoring.html">Configuring and Monitoring SLA</a> </li> </ul> </p> <a name="Administrator_Documentation"></a> </div> </div> <div class="section"><h3>Administrator Documentation</h3> <p><ul><li><a href="./AG_Install.html">Oozie Install</a> </li> <li><a href="./AG_OozieLogging.html">Oozie Logging</a> </li> <li><a href="./AG_HadoopConfiguration.html">Hadoop Configuration</a> </li> <li><a href="./AG_ActionConfiguration.html">Action Configuration</a> </li> <li><a href="./AG_Monitoring.html">Oozie Monitoring</a> </li> <li><a href="./DG_CommandLineTool.html">Command Line Tool</a> </li> <li><a href="./AG_OozieUpgrade.html">Oozie Upgrade</a> </li> </ul> </p> <p><a name="LicenseInfo"></a> </p> <a name="Licensing_Information"></a> </div> <div class="section"><h3>Licensing Information</h3> <p>Oozie is distributed under <a class="externalLink" href="http://www.apache.org/licenses/LICENSE-2.0">Apache License 2.0</a> .</p> <p>For details on the license of the dependent components, refer to the <a href="./dependencies.html#Licenses">Dependencies Report, Licenses section</a> .</p> <p>Oozie bundles an embedded Jetty 9.x.</p> <p>Some of the components in the dependencies report don't mention their license in the published POM. They are:</p> <p><ul><li>JDOM: <a class="externalLink" href="http://www.jdom.org/docs/faq.html#a0030">JDOM License</a> (Apache style).</li> <li>Oro: <a class="externalLink" href="http://www.apache.org/licenses/LICENSE-2.0">Apache License 2.0</a> .</li> </ul> </p> <p>Oozie uses a modified version of the Apache Doxia core and twiki plugins to generate Oozie documentation.</p> <a name="Engineering_Documentation"></a> </div> <div class="section"><h3>Engineering Documentation</h3> <p><ul><li><a href="./ENG_Building.html">Building Oozie</a> </li> <li><a href="./dependencies.html">Dependencies Report</a> </li> </ul> </p> <a name="MiniOozie_Documentation"></a> </div> <div class="section"><h3>MiniOozie Documentation</h3> <p><ul><li><a href="./ENG_MiniOozie.html">Testing User Oozie Applications Using MiniOozie</a> </li> </ul> </p> <a name="Oozie_User_Authentication_Documentation"></a> </div> <div class="section"><h3>Oozie User Authentication Documentation</h3> <p><ul><li><a href="./ENG_Custom_Authentication.html">Create Custom Oozie Authentication</a> </li> </ul> </p> <p></p> </div> </div> </div> </div> <hr/> <footer> <div class="container-fluid"> <div class="row-fluid"> <p >Copyright © 2018 <a href="http://www.apache.org">Apache Software Foundation</a>. All rights reserved. </p> </div> </div> </footer> </body> </html>

CINXE.COM

Oozie -