CINXE.COM

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML+RDFa 1.0//EN" "http://www.w3.org/MarkUp/DTD/xhtml-rdfa-1.dtd"> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" version="XHTML+RDFa 1.0" dir="ltr" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/terms/" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:og="http://ogp.me/ns#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:sioc="http://rdfs.org/sioc/ns#" xmlns:sioct="http://rdfs.org/sioc/types#" xmlns:skos="http://www.w3.org/2004/02/skos/core#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#"> <head profile="http://www.w3.org/1999/xhtml/vocab"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <meta name="Generator" content="Drupal 7 (http://drupal.org)" /> <link rel="canonical" href="/docs/FarmUsersGuide" /> <link rel="shortlink" href="/docs/node/638" /> <link rel="next" href="/docs/getting_started" /> <link rel="shortcut icon" href="https://scicomp.jlab.org/docs/misc/favicon.ico" type="image/vnd.microsoft.icon" /> <title>Experimental Physics User's Guide | scicomp.jlab.org</title> <style type="text/css" media="all"> @import url("https://scicomp.jlab.org/docs/modules/system/system.base.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/system/system.menus.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/system/system.messages.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/system/system.theme.css?shx9x7"); </style> <style type="text/css" media="all"> @import url("https://scicomp.jlab.org/docs/misc/ui/jquery.ui.core.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/misc/ui/jquery.ui.theme.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/misc/ui/jquery.ui.button.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/misc/ui/jquery.ui.resizable.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/misc/ui/jquery.ui.dialog.css?shx9x7"); </style> <style type="text/css" media="all"> @import url("https://scicomp.jlab.org/docs/modules/aggregator/aggregator.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/book/book.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/sites/all/modules/calendar/css/calendar_multiday.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/comment/comment.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/field/theme/field.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/node/node.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/poll/poll.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/search/search.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/user/user.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/modules/forum/forum.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/sites/all/modules/views/css/views.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/sites/all/modules/ckeditor/css/ckeditor.css?shx9x7"); </style> <style type="text/css" media="all"> @import url("https://scicomp.jlab.org/docs/sites/all/modules/ctools/css/ctools.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/sites/all/modules/event_calendar/event_popup/css/event_popup.css?shx9x7"); @import url("https://scicomp.jlab.org/docs/sites/all/modules/biblio/biblio.css?shx9x7"); </style> <style type="text/css" media="all"> @import url("https://scicomp.jlab.org/docs/themes/garland/style.css?shx9x7"); </style> <style type="text/css" media="print"> @import url("https://scicomp.jlab.org/docs/themes/garland/print.css?shx9x7"); </style>  <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/jquery.js?v=1.4.4"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/jquery-extend-3.4.0.js?v=1.4.4"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/jquery-html-prefilter-3.5.0-backport.js?v=1.4.4"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/jquery.once.js?v=1.2"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/drupal.js?shx9x7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.core.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.widget.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.button.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.mouse.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.draggable.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.position.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.position-1.13.0-backport.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.resizable.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.dialog.min.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/ui/jquery.ui.dialog-1.13.0-backport.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/sites/all/modules/views/js/jquery.ui.dialog.patch.js?v=1.8.7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/misc/form-single-submit.js?v=7.101"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/sites/all/modules/entityreference/js/entityreference.js?shx9x7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/sites/all/modules/event_calendar/event_popup/js/event_popup.js?shx9x7"></script> <script type="text/javascript" src="https://scicomp.jlab.org/docs/sites/all/modules/event_calendar/event_popup/js/event_popup_validate.js?shx9x7"></script> <script type="text/javascript"> <![CDATA[//><!]]> </script> <script type="text/javascript"> <![CDATA[//><!]]> </script> </head> <body class="html not-front not-logged-in one-sidebar sidebar-first page-node page-node- page-node-638 node-type-book fluid-width" > <div id="skip-link"> <a href="#main-content" class="element-invisible element-focusable">Skip to main content</a> </div> <div id="wrapper"> <div id="container" class="clearfix"> <div id="header"> <div id="logo-floater"> <div id="branding"><strong><a href="/docs/"> <img src="https://scicomp.jlab.org/docs/themes/garland/logo.png" alt="scicomp.jlab.org " title="scicomp.jlab.org " id="logo" /> <span>scicomp.jlab.org</span> </a></strong></div> </div> <h2 class="element-invisible">Main menu</h2><ul class="links inline main-menu"><li class="menu-219 first last"><a href="/docs/">Home</a></li> </ul> </div>  <div id="sidebar-first" class="sidebar"> <div class="region region-sidebar-first"> <div id="block-system-navigation" class="block block-system block-menu clearfix"> <h2 class="title">Navigation</h2> <div class="content"> <ul class="menu"><li class="first leaf"><a href="/docs/event-created">Calendar</a></li> <li class="collapsed"><a href="/docs/forum">Forums</a></li> <li class="last leaf"><a href="/docs/tracker">Recent content</a></li> </ul> </div> </div> <div id="block-user-login" class="block block-user clearfix"> <h2 class="title">User login</h2> <div class="content"> <form action="/docs/FarmUsersGuide?destination=node/638" method="post" id="user-login-form" accept-charset="UTF-8"><div><div class="form-item form-type-textfield form-item-name"> <label for="edit-name">Username <span class="form-required" title="This field is required.">*</span></label> <input type="text" id="edit-name" name="name" value="" size="15" maxlength="60" class="form-text required" /> <div class="description">JLAB/CUE Username</div> </div> <div class="form-item form-type-password form-item-pass"> <label for="edit-pass">Password <span class="form-required" title="This field is required.">*</span></label> <input type="password" id="edit-pass" name="pass" size="15" maxlength="128" class="form-text required" /> <div class="description">JLAB/CUE Password</div> </div> <div class="item-list"><ul><li class="first last"><a href="https://cc.jlab.org/">Logon Help</a></li> </ul></div><input type="hidden" name="form_build_id" value="form-DyFT_WMEPQFCtU_0RiwJX70ewgg64wGI6dlSbl9zGLk" /> <input type="hidden" name="form_id" value="user_login_block" /> <div class="form-actions form-wrapper" id="edit-actions"><input type="submit" id="edit-submit" name="op" value="Log in" class="form-submit" /></div></div></form> </div> </div> </div> </div> <div id="center"><div id="squeeze"><div class="right-corner"><div class="left-corner"> <h2 class="element-invisible">You are here</h2><div class="breadcrumb"><a href="/docs/">Home</a></div> <a id="main-content"></a> <div id="tabs-wrapper" class="clearfix"> <h1 class="with-tabs">Experimental Physics User's Guide</h1> </div> <div class="clearfix"> <div class="region region-content"> <div id="block-system-main" class="block block-system clearfix"> <div class="content"> <div id="node-638" class="node node-book" about="/docs/FarmUsersGuide" typeof="sioc:Item foaf:Document"> <span property="dc:title" content="Experimental Physics User's Guide" class="rdf-meta element-hidden"></span><span property="sioc:num_replies" content="0" datatype="xsd:integer" class="rdf-meta element-hidden"></span> <span class="submitted"><span property="dc:date dc:created" content="2022-03-01T09:30:21-05:00" datatype="xsd:dateTime" rel="sioc:has_creator">Tue, 03/01/2022 - 09:30 — <span class="username" xml:lang="" about="/docs/user/35" typeof="sioc:UserAccount" property="foaf:name" datatype="">ychen</span></span></span> <div class="content clearfix"> <div class="field field-name-body field-type-text-with-summary field-label-hidden"><div class="field-items"><div class="field-item even" property="content:encoded"><p>The scientific computing environment for experimental physics is comprised of a data analysis facility and its accompanying mass storage system. Details on the hardware are in the Scientific Computing Resources book.</p> <p>The data analysis environment includes the batch "<strong>farm</strong>" (a compute cluster) plus its associated interactive nodes and disk storage systems. Multiple files systems are accessible from both the interactive and batch nodes, and some of these are also accessible from desktops onsite.</p> <p><a href="https://scicomp.jlab.org/docs/node/692">SWIF2</a> is a software system developed at Jefferson Lab that aims to help users schedule, run, and track computation jobs on batch systems both locally and at remote sites. For those who seek a simple way to handle large data analysis workflow without worrying about staging files from the tape library, we recommand using SWIF2. If you are an experimental physicist, you should use SWIF2.</p> <p>Under the hood, the batch farm uses the<a href="https://slurm.schedmd.com/overview.html"> </a><a href="https://slurm.schedmd.com/overview.html" target="_blank">Slurm workload Manager</a>, an open source, fault-tolerant, and highly scalable cluster management and job scheduling system for large and small Linux clusters, to manage our farm cluster. Slurm can be used to submit jobs directly (<a href="https://scicomp.jlab.org/docs/farm_slurm_batch">Jefferson Lab Slurm Guide documents</a>), but SWIF2 is generally the better way to go.</p> <p>New users of Farm resources (ifarm, farm, swif2, slurm, etc) are encouraged to review the following resources:</p> <ul> <li><a href="https://indico.jlab.org/event/879/sessions/2954/attachments/11663/18089/Computing_tools-tricks-Sep2024.pdf">Basics of Farm Computing</a> (Tips & Tricks)</li> <li><a href="https://code.jlab.org/brads/workshop-sept2024.git">SWIF2 Farm Submission Example</a></li> <li>See also: <a href="https://data.jlab.org/">data.jlab.org</a></li> </ul> </div></div></div> <div id="book-navigation-638" class="book-navigation"> <ul class="menu"><li class="first collapsed"><a href="/docs/getting_started">Getting Started</a></li> <li class="leaf"><a href="/docs/node/683">Slurm for Computing Coordinators</a></li> <li class="collapsed"><a href="/docs/farm_slurm_batch">Batch System (Slurm)</a></li> <li class="leaf"><a href="/docs/swif2">Workflow - Swif2</a></li> <li class="collapsed"><a href="/docs/farm_auger_migration_guide">Auger/SWIF1 Migration Guide</a></li> <li class="leaf"><a href="/docs/batch_job_tracks">Batch Job Tracks</a></li> <li class="collapsed"><a href="/docs/storage">Mass Storage System (Tape)</a></li> <li class="leaf"><a href="/docs/node/600">DAQ Support: Writing Raw Data to Tape</a></li> <li class="last leaf"><a href="/docs/node/553">Physics Software Community Support</a></li> </ul> <div class="page-links clearfix"> <a href="/docs/getting_started" class="page-next" title="Go to next page">Getting Started ›</a> </div> </div> </div> <div class="clearfix"> <div class="links"></div> </div> </div> </div> </div> </div> </div> <div class="region region-footer"> <div id="block-system-powered-by" class="block block-system clearfix"> <div class="content"> <span>Powered by <a href="https://www.drupal.org">Drupal</a></span> </div> </div> </div> </div></div></div></div>  </div>  </div>  </body> </html>