CINXE.COM

<!DOCTYPE html> <html class="writer-html5" lang="en" data-content_root="../"> <head> <meta charset="utf-8" /><meta name="viewport" content="width=device-width, initial-scale=1" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <title>OLCF Policy Guides — OLCF User Documentation</title> <link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=b86133f3" /> <link rel="stylesheet" type="text/css" href="../_static/css/theme.css?v=e59714d7" /> <link rel="stylesheet" type="text/css" href="../_static/copybutton.css?v=76b2166b" /> <link rel="stylesheet" type="text/css" href="https://cdn.datatables.net/2.2.1/css/dataTables.dataTables.css" /> <link rel="stylesheet" type="text/css" href="../_static/sphinx-design.min.css?v=95c83b7e" /> <link rel="stylesheet" type="text/css" href="../_static/css/theme_overrides.css?v=b668e930" /> <link rel="shortcut icon" href="../_static/favicon.ico"/> <link rel="canonical" href="https://docs.olcf.ornl.govaccounts/olcf_policy_guide.html"/> <script src="../_static/jquery.js?v=5d32c60e"></script> <script src="../_static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script> <script src="../_static/documentation_options.js?v=5929fcd5"></script> <script src="../_static/doctools.js?v=9a2dae69"></script> <script src="../_static/sphinx_highlight.js?v=dc90522c"></script> <script src="../_static/clipboard.min.js?v=a7894cd8"></script> <script src="../_static/copybutton.js?v=99362dbf"></script> <script src="https://cdn.datatables.net/2.2.1/js/dataTables.js"></script> <script src="https://code.jquery.com/jquery-3.7.1.js"></script> <script src="../_static/design-tabs.js?v=f930bc37"></script> <script src="../_static/js/custom.js?v=1617c1c8"></script> <script src="../_static/js/theme.js"></script> <link rel="index" title="Index" href="../genindex.html" /> <link rel="search" title="Search" href="../search.html" /> <link rel="next" title="Glossary" href="glossary.html" /> <link rel="prev" title="Documents and Forms" href="documents_and_forms.html" /> </head> <body class="wy-body-for-nav"> <div class="wy-grid-for-nav"> <nav data-toggle="wy-nav-shift" class="wy-nav-side"> <div class="wy-side-scroll"> <div class="wy-side-nav-search" style="background: #efefef" > <a href="../index.html"> <img src="../_static/olcf_logo.png" class="logo" alt="Logo"/> </a> <div role="search"> <form id="rtd-search-form" class="wy-form" action="../search.html" method="get"> <input type="text" name="q" placeholder="Search docs" aria-label="Search docs" /> <input type="hidden" name="check_keywords" value="yes" /> <input type="hidden" name="area" value="default" /> </form> </div> </div><div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="Navigation menu"> <ul> <li class="toctree-l1"><a class="reference internal" href="../support/index.html">Contact & Support</a><ul> <li class="toctree-l2"><a class="reference internal" href="../support/index.html#olcf-user-assistance-center">OLCF User Assistance Center</a></li> <li class="toctree-l2"><a class="reference internal" href="../support/index.html#authentication-support">Authentication Support</a></li> <li class="toctree-l2"><a class="reference internal" href="../support/index.html#olcf-office-hours">OLCF Office Hours</a></li> <li class="toctree-l2"><a class="reference internal" href="../support/index.html#communication-to-users">Communication to Users</a></li> </ul> </li> </ul> <ul class="current"> <li class="toctree-l1 current"><a class="reference internal" href="index.html">Accounts and Projects</a><ul class="current"> <li class="toctree-l2"><a class="reference internal" href="accounts_and_projects.html">Request a New Allocation</a><ul> <li class="toctree-l3"><a class="reference internal" href="accounts_and_projects.html#what-are-the-differences-between-project-types">What are the differences between project types?</a></li> <li class="toctree-l3"><a class="reference internal" href="accounts_and_projects.html#what-happens-after-a-project-request-is-approved">What happens after a project request is approved?</a></li> <li class="toctree-l3"><a class="reference internal" href="accounts_and_projects.html#guidance-on-frontier-allocation-requests">Guidance on Frontier Allocation Requests</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="accounts_and_projects.html#applying-for-a-user-account">Applying for a user account</a></li> <li class="toctree-l2"><a class="reference internal" href="accounts_and_projects.html#checking-the-status-of-your-application">Checking the status of your application</a></li> <li class="toctree-l2"><a class="reference internal" href="accounts_and_projects.html#get-access-to-additional-projects">Get access to additional projects</a></li> <li class="toctree-l2"><a class="reference internal" href="frequently_asked_questions.html">Frequently Asked Questions</a><ul> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#how-do-i-apply-for-an-account">How do I apply for an account?</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#what-is-the-status-of-my-application">What is the status of my application?</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#how-should-i-acknowledge-the-olcf-in-my-publications-and-presentations">How should I acknowledge the OLCF in my publications and presentations?</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#what-is-a-subproject">What is a subproject?</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#i-no-longer-need-my-account-who-should-i-inform-and-what-should-i-do-with-my-olcf-issued-rsa-securid-token">I no longer need my account. Who should I inform and what should I do with my OLCF issued RSA SecurID token?</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#my-securid-token-is-broken-expired-what-should-i-do">My SecurID token is broken/expired. What should I do?</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#getting-help">Getting Help</a></li> <li class="toctree-l3"><a class="reference internal" href="frequently_asked_questions.html#additional-resources">Additional Resources</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="documents_and_forms.html">Documents and Forms</a><ul> <li class="toctree-l3"><a class="reference internal" href="documents_and_forms.html#forms-for-requesting-a-project-allocation">Forms for Requesting a Project Allocation</a></li> <li class="toctree-l3"><a class="reference internal" href="documents_and_forms.html#forms-for-requesting-an-account">Forms for Requesting an Account</a></li> <li class="toctree-l3"><a class="reference internal" href="documents_and_forms.html#forms-to-request-changes-to-computers-jobs-or-accounts">Forms to Request Changes to Computers, Jobs, or Accounts</a></li> <li class="toctree-l3"><a class="reference internal" href="documents_and_forms.html#report-templates">Report Templates</a></li> <li class="toctree-l3"><a class="reference internal" href="documents_and_forms.html#miscellaneous-forms">Miscellaneous Forms</a></li> </ul> </li> <li class="toctree-l2 current"><a class="current reference internal" href="#">OLCF Policy Guides</a><ul> <li class="toctree-l3"><a class="reference internal" href="#olcf-acknowledgement">OLCF Acknowledgement</a></li> <li class="toctree-l3"><a class="reference internal" href="#software-requests">Software Requests</a></li> <li class="toctree-l3"><a class="reference internal" href="#special-requests-and-policy-exemptions">Special Requests and Policy Exemptions</a></li> <li class="toctree-l3"><a class="reference internal" href="#computing-policy">Computing Policy</a><ul> <li class="toctree-l4"><a class="reference internal" href="#computer-use">Computer Use</a></li> <li class="toctree-l4"><a class="reference internal" href="#data-use">Data Use</a></li> <li class="toctree-l4"><a class="reference internal" href="#software-use">Software Use</a></li> <li class="toctree-l4"><a class="reference internal" href="#user-accountability">User Accountability</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="#data-management-policy">Data Management Policy</a><ul> <li class="toctree-l4"><a class="reference internal" href="#introduction">Introduction</a></li> <li class="toctree-l4"><a class="reference internal" href="#data-retention-purge-quotas">Data Retention, Purge, & Quotas</a></li> <li class="toctree-l4"><a class="reference internal" href="#data-prohibitions-safeguards">Data Prohibitions & Safeguards</a></li> <li class="toctree-l4"><a class="reference internal" href="#software">Software</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="#security-policy">Security Policy</a><ul> <li class="toctree-l4"><a class="reference internal" href="#scope">Scope</a></li> <li class="toctree-l4"><a class="reference internal" href="#personal-use">Personal Use</a></li> <li class="toctree-l4"><a class="reference internal" href="#accessing-olcf-computational-resources">Accessing OLCF Computational Resources</a></li> <li class="toctree-l4"><a class="reference internal" href="#data-management">Data Management</a></li> <li class="toctree-l4"><a class="reference internal" href="#sensitive-data">Sensitive Data</a></li> <li class="toctree-l4"><a class="reference internal" href="#data-transfer">Data Transfer</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="#incite-allocation-under-utilization-policy">INCITE Allocation Under-utilization Policy</a></li> <li class="toctree-l3"><a class="reference internal" href="#project-reporting-policy">Project Reporting Policy</a></li> <li class="toctree-l3"><a class="reference internal" href="#non-proprietary-institutional-user-agreement-policy">Non-proprietary Institutional User Agreement Policy</a><ul> <li class="toctree-l4"><a class="reference internal" href="#access">Access</a></li> <li class="toctree-l4"><a class="reference internal" href="#rules-and-regulations">Rules and Regulations</a></li> <li class="toctree-l4"><a class="reference internal" href="#safety-and-health">Safety and Health</a></li> <li class="toctree-l4"><a class="reference internal" href="#intent-to-publish">Intent to Publish</a></li> <li class="toctree-l4"><a class="reference internal" href="#export-control">Export Control</a></li> <li class="toctree-l4"><a class="reference internal" href="#intellectual-property">Intellectual Property</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="#hipaa-itar-project-rules-of-behavior-policy">HIPAA/ITAR Project Rules of Behavior Policy</a></li> <li class="toctree-l3"><a class="reference internal" href="#user-managed-software-ums-policy">User-Managed Software (UMS) Policy</a><ul> <li class="toctree-l4"><a class="reference internal" href="#purpose">Purpose</a></li> <li class="toctree-l4"><a class="reference internal" href="#policies">Policies</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="glossary.html">Glossary</a></li> <li class="toctree-l2"><a class="reference internal" href="index.html#additional-resources">Additional Resources</a></li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../connecting/index.html">Connecting</a><ul> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#connecting-for-the-first-time">Connecting for the first time</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#activating-a-new-securid-fob">Activating a new SecurID fob</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#pins-passcodes-and-tokencodes">PINs, Passcodes, and Tokencodes</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#x11-forwarding">X11 Forwarding</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#id2">Systems Available to All Projects</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#olcf-system-hostnames">OLCF System Hostnames</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#starting-a-tmux-session">Starting a Tmux Session</a></li> <li class="toctree-l2"><a class="reference internal" href="../connecting/index.html#checking-system-availability">Checking System Availability</a></li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../systems/index.html">Systems</a><ul> <li class="toctree-l2"><a class="reference internal" href="../systems/2024_olcf_system_changes.html">2024 Notable System Changes</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#hpss-decommission-and-kronos-availability">HPSS Decommission and Kronos Availability</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#late-july-2024-kronos-available">Late July 2024 - Kronos available</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#august-30-2024-hpss-becomes-read-only">August 30, 2024 - HPSS becomes read-only</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#january-31-2025-hpss-decommissioned">January 31, 2025 - HPSS decommissioned</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#summit-and-alpine2-decommissions">Summit and Alpine2 Decommissions</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#november-15-2024-summit-decommissioned">November 15, 2024 - Summit decommissioned</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#november-19-2024-alpine2-read-only">November 19, 2024 - Alpine2 read-only</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/2024_olcf_system_changes.html#january-31-2025-alpine2-decommissioned">January 31, 2025 - Alpine2 decommissioned</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/frontier_user_guide.html">Frontier User Guide</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#system-overview">System Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#frontier-compute-nodes">Frontier Compute Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#node-types">Node Types</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#system-interconnect">System Interconnect</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#file-systems">File Systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#operating-system">Operating System</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#gpus">GPUs</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#connecting">Connecting</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#data-and-storage">Data and Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#transition-from-alpine-to-orion">Transition from Alpine to Orion</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#lfs-setstripe-wrapper">LFS setstripe wrapper</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#nfs-filesystem">NFS Filesystem</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#lustre-filesystem">Lustre Filesystem</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#kronos-archival-storage">Kronos Archival Storage</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#nvme">NVMe</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#nvme-usage">NVMe Usage</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#using-globus-to-move-data-to-and-from-orion">Using Globus to Move Data to and from Orion</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#amd-gpus">AMD GPUs</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#amd-vs-nvidia-terminology">AMD vs NVIDIA Terminology</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#blocks-workgroups-threads-work-items-grids-wavefronts">Blocks (workgroups), Threads (work items), Grids, Wavefronts</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#the-compute-unit">The Compute Unit</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#hip">HIP</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#things-to-remember-when-programming-for-amd-gpus">Things To Remember When Programming for AMD GPUs</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#programming-environment">Programming Environment</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#environment-modules-lmod">Environment Modules (Lmod)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#compilers">Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#mpi">MPI</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#compiling">Compiling</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id4">Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id7">MPI</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#openmp">OpenMP</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#openmp-gpu-offload">OpenMP GPU Offload</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#openacc">OpenACC</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id9">HIP</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#hip-openmp-cpu-threading">HIP + OpenMP CPU Threading</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#sycl">SYCL</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#running-jobs">Running Jobs</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#login-vs-compute-nodes">Login vs Compute Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#simplified-node-layout">Simplified Node Layout</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#slurm">Slurm</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#batch-scripts">Batch Scripts</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#interactive-jobs">Interactive Jobs</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#common-slurm-options">Common Slurm Options</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#slurm-environment-variables">Slurm Environment Variables</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#job-states">Job States</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#job-reason-codes">Job Reason Codes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#scheduling-policy">Scheduling Policy</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#job-dependencies">Job Dependencies</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#monitoring-and-modifying-batch-jobs">Monitoring and Modifying Batch Jobs</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#srun">Srun</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#process-and-thread-mapping-examples">Process and Thread Mapping Examples</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#ensemble-jobs">Ensemble Jobs</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#tips-for-launching-at-scale">Tips for Launching at Scale</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#software">Software</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#debugging">Debugging</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#linaro-ddt">Linaro DDT</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#gdb">GDB</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#valgrind4hpc">Valgrind4hpc</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#omnitrace">Omnitrace</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#profiling-applications">Profiling Applications</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#getting-started-with-the-hpe-performance-analysis-tools-pat">Getting Started with the HPE Performance Analysis Tools (PAT)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#getting-started-with-hpctoolkit">Getting Started with HPCToolkit</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#getting-started-with-the-rocm-profiler">Getting Started with the ROCm Profiler</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#roofline-profiling-with-the-rocm-profiler">Roofline Profiling with the ROCm Profiler</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#omniperf">Omniperf</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#tips-and-tricks">Tips and Tricks</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#using-reduced-precision-fp16-and-bf16-datatypes">Using reduced precision (FP16 and BF16 datatypes)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#enabling-gpu-page-migration">Enabling GPU Page Migration</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#floating-point-fp-atomic-operations-and-coarse-fine-grained-memory-allocations">Floating-Point (FP) Atomic Operations and Coarse/Fine Grained Memory Allocations</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#performance-considerations-for-lds-fp-atomicadd">Performance considerations for LDS FP atomicAdd()</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#library-considerations-with-atomic-operations">Library considerations with atomic operations</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#system-updates">System Updates</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id17">2025-02-18</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id18">2025-01-14</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id19">2024-11-12</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id20">2024-09-03</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id21">2024-08-20</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id22">2024-07-16</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id23">2024-04-17</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id24">2024-03-19</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id25">2024-01-23</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id26">2023-12-05</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id27">2023-10-03</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id28">2023-09-19</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id29">2023-07-18</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#id30">2023-05-09</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/frontier_user_guide.html#known-issues">Known Issues</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#open-issues">Open Issues</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#open-issues-w-workaround">Open Issues w/Workaround</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/frontier_user_guide.html#resolved-issues">Resolved Issues</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/citadel_user_guide.html">Citadel User Guide</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/citadel_user_guide.html#what-is-citadel">What is Citadel</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/citadel_user_guide.html#citadel-spi-documentation">Citadel (SPI) Documentation</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/andes_user_guide.html">Andes User Guide</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/andes_user_guide.html#system-overview">System Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#compute-nodes">Compute Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#login-nodes">Login Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#file-systems">File Systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#lfs-setstripe-wrapper">LFS setstripe Wrapper</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/andes_user_guide.html#shell-and-programming-environments">Shell and Programming Environments</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#default-shell">Default shell</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#environment-management-with-lmod">Environment Management with lmod</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#installed-software">Installed Software</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/andes_user_guide.html#compiling">Compiling</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#available-compilers">Available Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#changing-compilers">Changing Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#compiler-wrappers">Compiler Wrappers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#compiling-threaded-codes">Compiling Threaded Codes</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/andes_user_guide.html#running-jobs">Running Jobs</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#login-vs-compute-nodes-on-commodity-clusters">Login vs Compute Nodes on Commodity Clusters</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#slurm">Slurm</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#interactive-batch-jobs-on-commodity-clusters">Interactive Batch Jobs on Commodity Clusters</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#common-batch-options-to-slurm">Common Batch Options to Slurm</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#batch-environment-variables">Batch Environment Variables</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#modifying-batch-jobs">Modifying Batch Jobs</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#monitoring-batch-jobs">Monitoring Batch Jobs</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#job-execution">Job Execution</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#batch-queues-on-andes">Batch Queues on Andes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#job-accounting-on-andes">Job Accounting on Andes</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/andes_user_guide.html#andes-debugging">Debugging</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#linaro-ddt">Linaro DDT</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#gdb">GDB</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#valgrind">Valgrind</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/andes_user_guide.html#visualization-tools">Visualization tools</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#paraview">ParaView</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#visit">VisIt</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#remote-visualization-using-vnc-non-gpu">Remote Visualization using VNC (non-GPU)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#remote-visualization-using-vnc-gpu-nodes">Remote Visualization using VNC (GPU nodes)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/andes_user_guide.html#remote-visualization-using-nice-dcv-gpu-nodes-only">Remote Visualization using Nice DCV (GPU nodes only)</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/home_user_guide.html">Home</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/home_user_guide.html#system-overview">System Overview</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/home_user_guide.html#access-connecting">Access & Connecting</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/home_user_guide.html#usage">Usage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/home_user_guide.html#acceptable-tasks">Acceptable Tasks</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/home_user_guide.html#unacceptable-tasks">Unacceptable Tasks</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/dtn_user_guide.html">Data Transfer Nodes (DTNs)</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/dtn_user_guide.html#system-overview">System Overview</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/dtn_user_guide.html#interactive-access">Interactive Access</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/dtn_user_guide.html#access-from-globus-online">Access From Globus Online</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/dtn_user_guide.html#batch-queue-slurm">Batch Queue (Slurm)</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/dtn_user_guide.html#queue-policy">Queue Policy</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/dtn_user_guide.html#submitting-jobs-to-frontier">Submitting jobs to Frontier</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/hpss_user_guide.html">High Performance Storage System</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/hpss_user_guide.html#system-overview">System Overview</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/odo_user_guide.html">Odo</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/odo_user_guide.html#system-overview">System Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/odo_user_guide.html#file-systems">File Systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/odo_user_guide.html#obtaining-access-to-odo">Obtaining Access to Odo</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/odo_user_guide.html#logging-in-to-odo">Logging In to Odo</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/spock_quick_start_guide.html">Spock Quick-Start Guide</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#system-overview">System Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#spock-compute-nodes">Spock Compute Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#system-interconnect">System Interconnect</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#file-systems">File Systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#gpus">GPUs</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#connecting">Connecting</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#data-and-storage">Data and Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#nfs">NFS</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#gpfs">GPFS</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#programming-environment">Programming Environment</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#environment-modules-lmod">Environment Modules (Lmod)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#compilers">Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#mpi">MPI</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#compiling">Compiling</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#id3">MPI</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#openmp">OpenMP</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#openmp-gpu-offload">OpenMP GPU Offload</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#hip">HIP</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#running-jobs">Running Jobs</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#slurm-workload-manager">Slurm Workload Manager</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#slurm-compute-node-partitions">Slurm Compute Node Partitions</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#process-and-thread-mapping">Process and Thread Mapping</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/spock_quick_start_guide.html#nvme-usage">NVMe Usage</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/spock_quick_start_guide.html#getting-help">Getting Help</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../systems/crusher_quick_start_guide.html">Crusher Quick-Start Guide</a><ul> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#system-overview">System Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#crusher-compute-nodes">Crusher Compute Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#system-interconnect">System Interconnect</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#file-systems">File Systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#gpus">GPUs</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#connecting">Connecting</a></li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#data-and-storage">Data and Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#nfs-filesystem">NFS Filesystem</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#lustre-filesystem">Lustre Filesystem</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#programming-environment">Programming Environment</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#environment-modules-lmod">Environment Modules (Lmod)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#compilers">Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#mpi">MPI</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#compiling">Compiling</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id3">MPI</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#openmp">OpenMP</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#openmp-gpu-offload">OpenMP GPU Offload</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#hip">HIP</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#hip-openmp-cpu-threading">HIP + OpenMP CPU Threading</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#sycl">SYCL</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#running-jobs">Running Jobs</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#slurm-workload-manager">Slurm Workload Manager</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#slurm-compute-node-partitions">Slurm Compute Node Partitions</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#process-and-thread-mapping">Process and Thread Mapping</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#nvme-usage">NVMe Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#tips-for-launching-at-scale">Tips for Launching at Scale</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#profiling-applications">Profiling Applications</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#getting-started-with-the-hpe-performance-analysis-tools-pat">Getting Started with the HPE Performance Analysis Tools (PAT)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#getting-started-with-hpctoolkit">Getting Started with HPCToolkit</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#getting-started-with-the-rocm-profiler">Getting Started with the ROCm Profiler</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#roofline-profiling-with-the-rocm-profiler">Roofline Profiling with the ROCm Profiler</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#omnitrace">Omnitrace</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#omniperf">Omniperf</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#notable-differences-between-summit-and-crusher">Notable Differences between Summit and Crusher</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#using-reduced-precision-fp16-and-bf16-datatypes">Using reduced precision (FP16 and BF16 datatypes)</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#enabling-gpu-page-migration">Enabling GPU Page Migration</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#floating-point-fp-atomic-operations-and-coarse-fine-grained-memory-allocations">Floating-Point (FP) Atomic Operations and Coarse/Fine Grained Memory Allocations</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#performance-considerations-for-lds-fp-atomicadd">Performance considerations for LDS FP atomicAdd()</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#system-updates">System Updates</a><ul> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id6">2024-03-19</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id7">2024-01-23</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id8">2023-12-05</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id9">2023-10-03</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id10">2023-09-19</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id11">2023-07-18</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id12">2023-04-05</a></li> <li class="toctree-l4"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#id13">2022-12-29</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../systems/crusher_quick_start_guide.html#getting-help">Getting Help</a></li> </ul> </li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../services_and_applications/index.html">Services and Applications</a><ul> <li class="toctree-l2"><a class="reference internal" href="../services_and_applications/slate/index.html">Slate</a><ul> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/overview.html">Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/overview.html#what-is-slate">What is Slate?</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/overview.html#what-is-kubernetes">What is Kubernetes?</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/overview.html#what-is-openshift">What is OpenShift?</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/getting_started.html">Getting Started</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/getting_started.html#requesting-a-slate-project-allocation">Requesting A Slate Project Allocation</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/getting_started.html#logging-in">Logging in</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/getting_started.html#slate-namespaces">Slate Namespaces</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/getting_started.html#install-the-oc-tool">Install the OC tool</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/getting_started.html#test-login-with-oc-tool">Test login with OC Tool</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/guided_tutorial.html">Guided Tutorial</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/guided_tutorial.html#creating-your-project">Creating your project</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/guided_tutorial.html#guided-web-gui-tutorial">Guided Web GUI Tutorial</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/guided_tutorial_cli.html">Guided Tutorial: CLI</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/guided_tutorial_cli.html#adding-a-pod-to-your-project">Adding a Pod to your Project</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/image_building.html">Image Building</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/image_building.html#build-types">Build Types</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/image_building.html#examples">Examples</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/image_building.html#logging-into-the-registry-externally">Logging into the Registry Externally</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/workloads/index.html">Workloads</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/workloads/pod.html">Pods</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/workloads/deployment.html">Deployments</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/networking/index.html">Networking</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/networking/services.html">Services</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/networking/nodeport.html">NodePorts</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/networking/route.html">Routes</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/networking/networkpolicy.html">Network Policies</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/networking/port_forwarding.html">Quick Access from Outside Slate</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/storage.html">Persistent Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/storage.html#creating-a-persistent-volume-claim">Creating A Persistent Volume Claim</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/storage.html#adding-pvc-to-pod">Adding PVC To Pod</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/storage.html#backups">Backups</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/workflows/index.html">Workflows</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/workflows/overview.html">Workflows Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/workflows/openshift_gitops.html">OpenShift GitOps</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/workflows/openshift_pipelines.html">OpenShift Pipelines</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/use_cases/index.html">Application Deployment Examples</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/simple_website.html">Build and Deploy Simple Website</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/mongodb_service.html">Deploy MongoDB</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/nginx_hello_world.html">Deploy NGINX with Hello World</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/gitlab_runner.html">GitLab Runners</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/helm_example.html">Deploy Packages with Helm</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/helm_prerequisite.html">Helm Prerequisites</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/use_cases/minio.html">MinIO Object Store (On an NCCS Filesystem)</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/access_olcf_resources/index.html">Access OLCF Resources From Containers</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/access_olcf_resources/job_submit.html">Batch Job Submission</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/access_olcf_resources/mount_fs.html">Mount OLCF Filesystems</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/other_resources.html">Schedule Other Slate Resources</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/other_resources.html#gpus">GPUs</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/olcf_provided_applications/index.html">OLCF-Provided Applications on Slate</a><ul class="simple"> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/troubleshooting/index.html">Troubleshooting</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/troubleshooting/fix-writable-directories.html">Fix Container Image Permissions</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/troubleshooting/debugging.html">Debugging</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/examples.html">YAML Object Quick Reference</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/examples.html#cronjobs">CronJobs</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/examples.html#deployments-and-stateful-sets">Deployments and Stateful Sets</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/examples.html#pods">Pods</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/examples.html#roles-and-rolebindings">Roles and Rolebindings</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/examples.html#routes-services-and-nodeports">Routes, Services and Nodeports</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/slate/examples.html#persistent-volume-claims">Persistent Volume Claims</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/slate/glossary.html">Glossary</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../services_and_applications/myolcf/index.html">myOLCF</a><ul> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/myolcf/overview.html">Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/overview.html#what-is-myolcf">What is myOLCF?</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/overview.html#what-can-it-do">What can it do?</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/overview.html#can-i-suggest-a-feature">Can I suggest a feature?</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/myolcf/authenticating.html">Authenticating</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/authenticating.html#olcf-moderate-accounts">OLCF Moderate Accounts</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/authenticating.html#olcf-open-accounts">OLCF Open Accounts</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/myolcf/project_pages/project_pages.html">Project Pages</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/project_pages/project_pages.html#project-context">Project Context</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/project_pages/project_pages.html#switching-project-contexts">Switching Project Contexts</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/project_pages/project_pages.html#available-pages">Available Pages</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/myolcf/account_pages/account_pages.html">Account Pages</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/account_pages/account_pages.html#account-context">Account Context</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/myolcf/account_pages/account_pages.html#available-pages">Available Pages</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/myolcf/account_pages/processing_membership_requests.html">Processing Project Membership Requests</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../services_and_applications/jupyter/index.html">Jupyter</a><ul> <li class="toctree-l3"><a class="reference internal" href="../services_and_applications/jupyter/overview.html">Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#jupyter-at-olcf">Jupyter at OLCF</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#access">Access</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#cpu-vs-gpu-jupyterlab-available-resources">CPU vs. GPU JupyterLab (Available Resources)</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#working-within-lustre-and-nfs-launching-a-notebook">Working within Lustre and NFS (Launching a Notebook)</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#conda-environments-and-custom-notebooks">Conda Environments and Custom Notebooks</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#manually-stopping-your-jupyterlab-session">Manually Stopping Your JupyterLab Session</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#things-to-be-aware-of">Things to Be Aware Of</a></li> <li class="toctree-l4"><a class="reference internal" href="../services_and_applications/jupyter/overview.html#example-jupyter-notebooks">Example Jupyter Notebooks</a></li> </ul> </li> </ul> </li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../data/index.html">Data Storage and Transfers</a><ul> <li class="toctree-l2"><a class="reference internal" href="../data/index.html#summary-of-storage-areas">Summary of Storage Areas</a><ul> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#notes-on-user-centric-data-storage">Notes on User-Centric Data Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#user-home-directories-nfs">User Home Directories (NFS)</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#notes-on-project-centric-data-storage">Notes on Project-Centric Data Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#project-home-directories-nfs">Project Home Directories (NFS)</a></li> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#project-work-areas">Project Work Areas</a></li> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#project-archive-directories">Project Archive Directories</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../data/index.html#data-policies">Data Policies</a><ul> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#information">Information</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#special-requests">Special Requests</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#data-retention">Data Retention</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../data/index.html#orion-lustre-hpe-clusterstor-filesystem">Orion Lustre HPE ClusterStor Filesystem</a><ul> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#orion-performance-tiers-and-file-striping-policy">Orion Performance Tiers and File Striping Policy</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#i-o-patterns-that-benefit-from-file-striping">I/O Patterns that Benefit from File Striping</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#lfs-setstripe-wrapper">LFS setstripe wrapper</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#lustre-file-locking-tips">Lustre File Locking Tips</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#darshan-runtime-and-i-o-profiling">Darshan-runtime and I/O Profiling</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#purge">Purge</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#major-difference-between-lustre-hpe-clusterstor-and-ibm-spectrum-scale">Major difference between Lustre HPE ClusterStor and IBM Spectrum Scale</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../data/index.html#hpss-data-archival-system">HPSS Data Archival System</a></li> <li class="toctree-l2"><a class="reference internal" href="../data/index.html#kronos-nearline-archival-storage-system">Kronos Nearline Archival Storage System</a><ul> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#access-data-transfer">Access / Data Transfer</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#directory-structure">Directory Structure</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#project-quotas">Project Quotas</a></li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#kronos-and-hpss-comparison">Kronos and HPSS Comparison</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../data/index.html#transferring-data">Transferring Data</a><ul> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#data-transferring-data-globus">Globus</a><ul> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#using-globus-to-move-data-between-collections">Using Globus to Move Data Between Collections</a></li> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#using-globus-from-your-local-workstation">Using Globus From Your Local Workstation</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#hsi">HSI</a><ul> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#additional-hsi-documentation">Additional HSI Documentation</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#htar">HTAR</a><ul> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#htar-limitations">HTAR Limitations</a></li> <li class="toctree-l4"><a class="reference internal" href="../data/index.html#additional-htar-documentation">Additional HTAR Documentation</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../data/index.html#command-line-terminal-tools">Command-Line/Terminal Tools</a></li> </ul> </li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../software/index.html">Software</a><ul> <li class="toctree-l2"><a class="reference internal" href="../software/software-news.html">Software News</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/software-news.html#frontier-system-software-update-february-18-2025">Frontier: System Software Update (February 18, 2025)</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/software-news.html#frontier-updated-modules-for-cpe-23-12-october-16-2024">Frontier: Updated Modules for cpe/23.12 (October 16 2024)</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/software-news.html#frontier-core-module-october-15-2024">Frontier: Core Module (October 15, 2024)</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/software-news.html#frontier-system-software-update-july-16-2024">Frontier: System Software Update (July 16, 2024)</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/software-news.html#frontier-user-environment-changes-july-9-2024">Frontier: User Environment Changes (July 9, 2024)</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/analytics/index.html">ML/DL & Data Analytics</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/analytics/apache-spark.html">Apache Spark</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/apache-spark.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/apache-spark.html#getting-started">Getting Started</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/analytics/pytorch_frontier.html">PyTorch on Frontier</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html#table-of-contents">Table of Contents:</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html#installing-pytorch">Installing PyTorch</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html#best-practices">Best Practices</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html#pytorch-geometric">PyTorch Geometric</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html#troubleshooting">Troubleshooting</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html#additional-resources">Additional Resources</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/analytics/jax.html">JAX</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/jax.html#setting-up-the-environment">Setting up the environment</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/jax.html#installing-jax">Installing JAX</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/jax.html#testing-jax">Testing JAX</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/jax.html#additional-resources">Additional Resources</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/python/index.html">Python on OLCF Systems</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/python/index.html#overview">Overview</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/python/index.html#olcf-python-guides">OLCF Python Guides</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/python/conda_basics.html">Conda Basics</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/python/parallel_h5py.html">Installing mpi4py and h5py</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/python/cupy.html">Installing CuPy</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/python/sbcast_conda.html">Sbcast Conda Environments</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/python/jupyter_envs.html">Jupyter Visibility</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/pytorch_frontier.html">PyTorch on Frontier</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/analytics/jax.html">JAX</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/python/index.html#module-usage">Module Usage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/python/index.html#base-environment">Base Environment</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/python/index.html#custom-environments">Custom Environments</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/python/index.html#how-to-run">How to Run</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/python/index.html#frontier-andes">Frontier / Andes</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/python/index.html#best-practices">Best Practices</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/python/index.html#additional-resources">Additional Resources</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/profiling/index.html">Profiling Tools</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/profiling/Scorep.html">Score-P</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#usage">Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#instrumentation">Instrumentation</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#measurement">Measurement</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#profiling">Profiling</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#tracing">Tracing</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#manual-instrumentation">Manual Instrumentation</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/Scorep.html#score-p-demo-video">Score-P Demo Video</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/profiling/TAU.html">Tuning and Analysis Utilities (TAU)</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#enabling-tau-at-olcf">Enabling TAU at OLCF</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#profile-and-trace-using-tau-exec-exe">Profile and trace using “tau_exec exe”</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#automatic-source-instrumentation-using-compiler-wrappers">Automatic source instrumentation using compiler wrappers</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#selective-instrumentation">Selective Instrumentation</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#manual-source-instrumentation">Manual source instrumentation</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#run-time-environment-variables">Run-Time Environment Variables</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#compile-time-environment-variables">Compile-Time Environment Variables</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/profiling/TAU.html#references">References</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/UMS/index.html">User-Managed Software</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/UMS/index.html#introduction">Introduction</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/UMS/index.html#currently-available-user-managed-software">Currently Available User-Managed Software</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/UMS/index.html#usage">Usage</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/UMS/index.html#policies">Policies</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/UMS/index.html#writing-ums-modulefiles">Writing UMS Modulefiles</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/workflows/index.html">Workflows</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/workflows/index.html#running-workflows-on-olcf-resources">Running Workflows on OLCF Resources</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/workflows/index.html#workflow-systems">Workflow Systems</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/workflows/entk.html">Ensemble Toolkit (EnTK)</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/workflows/parsl.html">Parsl</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/workflows/swift_t.html">Swift/T</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/spack_environments.html">Spack Environments</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/spack_environments.html#purpose">Purpose</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/spack_environments.html#getting-started">Getting Started</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/spack_environments.html#add-dependencies-to-the-environment">Add Dependencies to the environment</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/spack_environments.html#adding-olcf-modulefiles-as-external-packages">Adding OLCF Modulefiles as External Packages</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/spack_environments.html#adding-user-defined-dependencies-to-the-environment">Adding User-Defined Dependencies to the environment</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/spack_environments.html#installing-the-environment">Installing the Environment</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/spack_environments.html#more-details">More Details</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/spack_environments.html#references">References</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/viz_tools/index.html">Visualization Tools</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/viz_tools/visit.html">VisIt</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/visit.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/visit.html#installing-and-setting-up-visit">Installing and Setting Up Visit</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/visit.html#remote-gui-usage">Remote GUI Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/visit.html#command-line-example">Command Line Example</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/visit.html#troubleshooting">Troubleshooting</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/visit.html#additional-resources">Additional Resources</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/viz_tools/paraview.html">ParaView</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/paraview.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/paraview.html#installing-and-setting-up-paraview">Installing and Setting Up ParaView</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/paraview.html#remote-gui-usage">Remote GUI Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/paraview.html#command-line-example">Command Line Example</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/paraview.html#troubleshooting">Troubleshooting</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/viz_tools/paraview.html#additional-resources">Additional Resources</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/containers_on_frontier.html">Containers on Frontier</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/containers_on_frontier.html#examples-for-building-and-running-containers">Examples for Building and Running Containers</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/containers_on_frontier.html#building-and-running-a-container-image-from-a-base-linux-distribution-for-mpi">Building and running a container image from a base Linux distribution for MPI</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/containers_on_frontier.html#pushing-your-apptainer-image-to-an-oci-registry-supporting-oras-e-g-dockerhub">Pushing your Apptainer image to an OCI Registry supporting ORAS (e.g. DockerHub)</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/containers_on_frontier.html#building-an-image-on-top-of-an-existing-image-local-docker-image-oci-artifact">Building an image on top of an existing image (local, docker image, OCI artifact)</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/containers_on_frontier.html#olcf-base-images-apptainer-modules">OLCF Base Images & Apptainer Modules</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/containers_on_frontier.html#base-images">Base Images</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/containers_on_frontier.html#apptainer-modules">Apptainer Modules</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/containers_on_frontier.html#example-workflow">Example Workflow</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/containers_on_frontier.html#some-restrictions-and-tips">Some Restrictions and Tips</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../software/debugging/index.html">Debugging</a><ul> <li class="toctree-l3"><a class="reference internal" href="../software/debugging/index.html#linaro-forge-ddt">Linaro Forge DDT</a><ul> <li class="toctree-l4"><a class="reference internal" href="../software/debugging/index.html#client-setup-and-usage">Client Setup and Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/debugging/index.html#download">Download</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/debugging/index.html#installation">Installation</a></li> <li class="toctree-l4"><a class="reference internal" href="../software/debugging/index.html#configuration">Configuration</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../software/debugging/index.html#gnu-gdb">GNU GDB</a></li> <li class="toctree-l3"><a class="reference internal" href="../software/debugging/index.html#valgrind">Valgrind</a></li> </ul> </li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../training/index.html">Training</a><ul> <li class="toctree-l2"><a class="reference external" href="https://www.olcf.ornl.gov/for-users/training/training-calendar" target="_blank">OLCF Training Calendar</a></li> <li class="toctree-l2"><a class="reference external" href="https://github.com/olcf-tutorials" target="_blank">OLCF Tutorials</a></li> <li class="toctree-l2"><a class="reference internal" href="../training/training_archive.html">OLCF Training Archive</a></li> <li class="toctree-l2"><a class="reference internal" href="../training/olcf_gpu_hackathons.html">OLCF GPU Hackathons</a></li> <li class="toctree-l2"><a class="reference internal" href="../training/olcf_gpu_hackathons.html#facultyhack">FacultyHack</a></li> <li class="toctree-l2"><a class="reference external" href="https://vimeo.com/channels/olcftraining" target="_blank">OLCF Vimeo Channel</a></li> <li class="toctree-l2"><a class="reference internal" href="../training/index.html#new-user-quick-start">New User Quick Start</a></li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../quantum/index.html">Quantum</a><ul> <li class="toctree-l2"><a class="reference internal" href="../quantum/quantum_access.html">Quantum Computing User Program (QCUP) Access</a><ul> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_access.html#qcup-priorities">QCUP Priorities</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_access.html#project-allocations">Project Allocations</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#what-happens-after-a-project-request-is-approved">What happens after a project request is approved?</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#project-renewals">Project Renewals</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#closeout-and-quarterly-reports">Closeout and Quarterly Reports</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_access.html#user-accounts">User Accounts</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#checking-the-status-of-your-application">Checking the status of your application</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_access.html#accessing-quantum-resources">Accessing Quantum Resources</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#ibm-quantum-computing">IBM Quantum Computing</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#quantinuum">Quantinuum</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#ionq">IonQ</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_access.html#iqm">IQM</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_access.html#publication-citations">Publication Citations</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../quantum/quantum_systems/index.html">Quantum Systems</a><ul> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html">IBM Quantum</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html#connecting">Connecting</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html#running-jobs-queue-policies">Running Jobs & Queue Policies</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html#checking-system-availability-capability">Checking System Availability & Capability</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html#software">Software</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ibm_quantum.html#additional-resources">Additional Resources</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html">Quantinuum</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html#connecting">Connecting</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html#running-jobs-queue-policies">Running Jobs & Queue Policies</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html#default-quotas">Default Quotas</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html#allocations-credit-usage">Allocations & Credit Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/quantinuum.html#software">Software</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_systems/ionq.html">IonQ</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#ionq-systems">IonQ systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#connecting">Connecting</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#running-jobs-queue-policies">Running Jobs & Queue Policies</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#allocations-credit-usage">Allocations & Credit Usage</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#checking-system-availability-capability">Checking System Availability & Capability</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/ionq.html#additional-resources">Additional Resources</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_systems/iqm.html">IQM</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/iqm.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/iqm.html#connecting">Connecting</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/iqm.html#running-jobs-queue-policies">Running Jobs & Queue Policies</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/iqm.html#checking-system-availability">Checking System Availability</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/iqm.html#software">Software</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_systems/iqm.html#additional-resources">Additional Resources</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../quantum/quantum_software/index.html">Quantum Software</a><ul> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html">Quantum Software on HPC Systems</a><ul> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#overview">Overview</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#qiskit">Qiskit</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#pyquil-forest-sdk-rigetti">PyQuil/Forest SDK (Rigetti)</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#pennylane">PennyLane</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#pytket">Pytket</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#cuda-q">CUDA-Q</a></li> <li class="toctree-l4"><a class="reference internal" href="../quantum/quantum_software/hybrid_hpc.html#batch-jobs">Batch Jobs</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../quantum/hello_qcup.html">Hello QCUP Scripts</a><ul> <li class="toctree-l3"><a class="reference internal" href="../quantum/hello_qcup.html#overview">Overview</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/hello_qcup.html#ibm-quantum">IBM Quantum</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/hello_qcup.html#quantinuum">Quantinuum</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/hello_qcup.html#ionq">IonQ</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/hello_qcup.html#iqm">IQM</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../quantum/quantum_faq.html">Frequently Asked Questions</a><ul> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_faq.html#how-do-quantum-computers-differ-from-classical-computers">How do quantum computers differ from classical computers?</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_faq.html#what-is-a-qubit">What is a qubit?</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_faq.html#how-do-i-access-the-olcf-quantum-computing-resources">How do I access the OLCF quantum computing resources?</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_faq.html#what-happens-after-i-apply-for-access-to-qcup">What happens after I apply for access to QCUP?</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_faq.html#i-formerly-had-access-to-quantum-resources-but-my-backends-lattices-etc-have-disappeared-what-do-i-do">I formerly had access to quantum resources, but my backends/lattices/etc. have disappeared, what do I do?</a></li> <li class="toctree-l3"><a class="reference internal" href="../quantum/quantum_faq.html#i-applied-to-a-quantum-computing-resource-via-the-vendor-website-but-dont-have-access-what-do-i-do">I applied to a quantum computing resource via the vendor website, but don’t have access; what do I do?</a></li> </ul> </li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../spi/index.html">Scalable Protected Infrastructure (SPI)</a><ul> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#what-is-spi">What is SPI</a><ul> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#what-is-citadel">What is Citadel</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#new-user-quickstart">New User QuickStart</a><ul> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#notable-differences">Notable Differences</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#allocations-and-user-accounts">Allocations and User Accounts</a><ul> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#allocations-projects">Allocations (Projects)</a><ul> <li class="toctree-l4"><a class="reference internal" href="../spi/index.html#requesting-a-new-allocation-project">Requesting a New Allocation (Project)</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#user-accounts">User Accounts</a><ul> <li class="toctree-l4"><a class="reference internal" href="../spi/index.html#requesting-a-new-user-account">Requesting a New User Account</a></li> </ul> </li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#available-resources">Available Resources</a><ul> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#compute"><span class="xref std std-ref">Compute</span></a></li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#file-systems"><span class="xref std std-ref">File Systems</span></a></li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#data-transfer"><span class="xref std std-ref">Data Transfer</span></a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#ip-whitelisting">IP Whitelisting</a><ul> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#whitelisting-an-ip-or-range">Whitelisting an IP or range</a></li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#finding-your-ip">Finding your IP</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#citadel">Citadel</a><ul> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#login-nodes">Login Nodes</a></li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#connecting">Connecting</a></li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#building-software">Building Software</a><ul> <li class="toctree-l4"><a class="reference internal" href="../spi/index.html#external-repositories">External Repositories</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../spi/index.html#running-batch-jobs">Running Batch Jobs</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#spi-file-systems">File Systems</a></li> <li class="toctree-l2"><a class="reference internal" href="../spi/index.html#spi-data-transfer">Data Transfer</a></li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../ace_testbed/index.html">Advanced Computing Ecosystem Testbed (ACE)</a><ul> <li class="toctree-l2"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html">Defiant Quick-Start Guide</a><ul> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#system-overview">System Overview</a><ul> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#defiant-compute-nodes">Defiant Compute Nodes</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#system-interconnect">System Interconnect</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#file-systems">File Systems</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#gpus">GPUs</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#connecting">Connecting</a></li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#data-and-storage">Data and Storage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#nfs-filesystem">NFS Filesystem</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#lustre-filesystem-polis">Lustre Filesystem (Polis)</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#programming-environment">Programming Environment</a><ul> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#environment-modules-lmod">Environment Modules (Lmod)</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#compilers">Compilers</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#mpi">MPI</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#compiling">Compiling</a><ul> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#id3">MPI</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#openmp">OpenMP</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#openmp-gpu-offload">OpenMP GPU Offload</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#hip">HIP</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#running-jobs">Running Jobs</a><ul> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#slurm-workload-manager">Slurm Workload Manager</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#slurm-compute-node-partitions">Slurm Compute Node Partitions</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#process-and-thread-mapping">Process and Thread Mapping</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#nvme-usage">NVMe Usage</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#container-usage">Container Usage</a><ul> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#setup-before-building">Setup before Building</a></li> <li class="toctree-l4"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#build-and-run-workflow">Build and Run Workflow</a></li> </ul> </li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#getting-help">Getting Help</a></li> <li class="toctree-l3"><a class="reference internal" href="../ace_testbed/defiant_quick_start_guide.html#known-issues">Known Issues</a></li> </ul> </li> </ul> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../contributing/index.html">Contributing to these docs</a><ul> <li class="toctree-l2"><a class="reference internal" href="../contributing/index.html#submitting-suggestions">Submitting suggestions</a></li> <li class="toctree-l2"><a class="reference internal" href="../contributing/index.html#authoring-content">Authoring content</a><ul> <li class="toctree-l3"><a class="reference internal" href="../contributing/index.html#setup-authoring-environment">Setup authoring environment</a></li> <li class="toctree-l3"><a class="reference internal" href="../contributing/index.html#edit-the-docs">Edit the docs</a></li> <li class="toctree-l3"><a class="reference internal" href="../contributing/index.html#resources">Resources</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="../contributing/index.html#github-guidelines">GitHub Guidelines</a></li> </ul> </li> </ul> </div> </div> </nav> <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap"><nav class="wy-nav-top" aria-label="Mobile navigation menu" style="background: #efefef" > <i data-toggle="wy-nav-top" class="fa fa-bars"></i> <a href="../index.html">OLCF User Documentation</a> </nav> <div class="wy-nav-content"> <div class="rst-content style-external-links"> <div role="navigation" aria-label="Page navigation"> <ul class="wy-breadcrumbs"> <li><a href="../index.html" class="icon icon-home" aria-label="Home"></a></li> <li class="breadcrumb-item"><a href="index.html">Accounts and Projects</a></li> <li class="breadcrumb-item active">OLCF Policy Guides</li> <li class="wy-breadcrumbs-aside"> <a href="https://github.com/olcf/olcf-user-docs/blob/master/accounts/olcf_policy_guide.rst" class="fa fa-github"> Edit on GitHub</a> </li> </ul> <hr/> </div> <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article"> <div itemprop="articleBody"> <section id="olcf-policy-guides"> <h1>OLCF Policy Guides<a class="headerlink" href="#olcf-policy-guides" title="Link to this heading"></a></h1> <section id="olcf-acknowledgement"> <h2>OLCF Acknowledgement<a class="headerlink" href="#olcf-acknowledgement" title="Link to this heading"></a></h2> <p>Users should acknowledge the OLCF in all publications and presentations that speak to work performed on OLCF resources:</p> <blockquote> <div><p>This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.</p> </div></blockquote> </section> <hr class="docutils" /> <section id="software-requests"> <h2>Software Requests<a class="headerlink" href="#software-requests" title="Link to this heading"></a></h2> <p>To request software installation, please contact <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a> with a description of the software, including the following details:</p> <ul class="simple"> <li><p>Software name.</p></li> <li><p>Description of the software and its purpose. Is it export controlled?</p></li> <li><p>How the software is obtained.</p></li> <li><p>Explanation of why the software is needed. If OLCF provides equivalent software, what is different about this software? If requesting an upgrade, describe new features or bug fixes.</p></li> <li><p>Who will be using this software? Approximately how many people will be using it? If possible, list individual users of this software.</p></li> </ul> </section> <section id="special-requests-and-policy-exemptions"> <h2>Special Requests and Policy Exemptions<a class="headerlink" href="#special-requests-and-policy-exemptions" title="Link to this heading"></a></h2> <p>To request exemption to certain system policies, contact <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a> with an overview of the exemption you need. Example requests include:</p> <ul class="simple"> <li><p>Relaxed queue limits for one or more jobs (longer walltime, higher priority)</p></li> <li><p>System reservation (a dedicated set of nodes at a specific date/time)</p></li> <li><p>Increased disk quota</p></li> <li><p>Purge exemption for User/Group/World Work areas</p></li> </ul> <p>Special requests are reviewed weekly by the OLCF Resource Utilization Council. Please contact <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a> for more information.</p> </section> <hr class="docutils" /> <section id="computing-policy"> <h2>Computing Policy<a class="headerlink" href="#computing-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to and use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators (Non-Profit)</p></li> <li><p>Principal Investigators (Industry)</p></li> <li><p>All Users</p></li> </ul> <p><strong>Title:</strong> Computing Policy <strong>Version:</strong> 12.10</p> </div> <section id="computer-use"> <h3>Computer Use<a class="headerlink" href="#computer-use" title="Link to this heading"></a></h3> <p>Computers, software, and communications systems provided by the OLCF are to be used for work associated with and within the scope of the approved project. The use of OLCF resources for personal or non-work-related activities is prohibited. All computers, networks, E-mail, and storage systems are property of the United States Government. Any misuse or unauthorized access is prohibited, and is subject to criminal and civil penalties. OLCF systems are provided to our users without any warranty. OLCF will not be held liable in the event of any system failure or data loss or corruption for any reason including, but not limited to: negligence, malicious action, accidental loss, software errors, hardware failures, network losses, or inadequate configuration of any computing resource or ancillary system.</p> </section> <section id="data-use"> <h3>Data Use<a class="headerlink" href="#data-use" title="Link to this heading"></a></h3> <section id="prohibited-data"> <h4>Prohibited Data<a class="headerlink" href="#prohibited-data" title="Link to this heading"></a></h4> <p>The OLCF computer systems are operated as research systems and only contain data related to scientific research and do not contain personally identifiable information (data that falls under the Privacy Act of 1974 5U.S.C. 552a). Use of OLCF resources to store, manipulate, or remotely access any national security information is strictly prohibited. This includes, but is not limited to: classified information, unclassified controlled nuclear information (UCNI), naval nuclear propulsion information (NNPI), the design or development of nuclear, biological, or chemical weapons or any weapons of mass destruction. Authors/generators/owners of information are responsible for its correct categorization as sensitive or non-sensitive. Owners of sensitive information are responsible for its secure handling, transmission, processing, storage, and disposal on OLCF systems. Principal investigators, users, or project delegates that use OLCF resources, or are responsible for overseeing projects that use OLCF resources, are strictly responsible for knowing whether their project generates any of these prohibited data types or information that falls under Export Control. For questions, contact <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a>.</p> </section> <section id="confidentiality-integrity-and-availability"> <h4>Confidentiality, Integrity, and Availability<a class="headerlink" href="#confidentiality-integrity-and-availability" title="Link to this heading"></a></h4> <p>The OLCF systems provide protections to maintain the confidentiality, integrity, and availability of user data. Measures include the availability of file permissions, archival systems with access control lists, and parity and CRC checks on data paths and files. It is the user’s responsibility to set access controls appropriately for the data. In the event of system failure or malicious actions, the OLCF makes no guarantee against loss of data or that a user’s data can be accessed, changed, or deleted by another individual. It is the user’s responsibility to insure the appropriate level of backup and integrity checks on critical data and programs.</p> </section> <section id="data-modification-destruction"> <h4>Data Modification/Destruction<a class="headerlink" href="#data-modification-destruction" title="Link to this heading"></a></h4> <p>Users are prohibited from taking unauthorized actions to intentionally modify or delete information or programs.</p> </section> <section id="data-retention"> <h4>Data Retention<a class="headerlink" href="#data-retention" title="Link to this heading"></a></h4> <p>The OLCF reserves the right to remove any data at any time and/or transfer data to other users working on the same or similar project once a user account is deleted or a person no longer has a business association with the OLCF. After a sensitive project has ended or has been terminated, all data related to the project must be purged from all OLCF computing resources within 30 days.</p> </section> </section> <section id="software-use"> <h3>Software Use<a class="headerlink" href="#software-use" title="Link to this heading"></a></h3> <p>All software used on OLCF computers must be appropriately acquired and used according to the appropriate software license agreement. Possession, use, or transmission of illegally obtained software is prohibited. Likewise, users shall not copy, store, or transfer copyrighted software, except as permitted by the owner of the copyright. Only export-controlled codes approved by the Export Control Office may be run by parties with sensitive data agreements.</p> <section id="malicious-software"> <h4>Malicious Software<a class="headerlink" href="#malicious-software" title="Link to this heading"></a></h4> <p>Users must not intentionally introduce or use malicious software such as computer viruses, Trojan horses, or worms.</p> </section> <section id="reconstruction-of-information-or-software"> <h4>Reconstruction of Information or Software<a class="headerlink" href="#reconstruction-of-information-or-software" title="Link to this heading"></a></h4> <p>Users are not allowed to reconstruct information or software for which they are not authorized. This includes but is not limited to any reverse engineering of copyrighted software or firmware present on OLCF computing resources.</p> </section> </section> <section id="user-accountability"> <h3>User Accountability<a class="headerlink" href="#user-accountability" title="Link to this heading"></a></h3> <p>Users are accountable for their actions and may be held accountable to applicable administrative or legal sanctions.</p> <section id="monitoring-and-privacy"> <h4>Monitoring and Privacy<a class="headerlink" href="#monitoring-and-privacy" title="Link to this heading"></a></h4> <p>Users are advised that there is no expectation of privacy of your activities on any system that is owned by, leased or operated by UT-Battelle on behalf of the U.S. Department of Energy (DOE). The Company retains the right to monitor all activities on these systems, to access any computer files or electronic mail messages, and to disclose all or part of information gained to authorized individuals or investigative agencies, all without prior notice to, or consent from, any user, sender, or addressee. This access to information or a system by an authorized individual or investigative agency is in effect during the period of your access to information on a DOE computer and for a period of three years thereafter. OLCF personnel and users are required to address, safeguard against, and report misuse, abuse and criminal activities. Misuse of OLCF resources can lead to temporary or permanent disabling of accounts, loss of DOE allocations, and administrative or legal actions. Users who have not accessed a OLCF computing resource in at least 6 months will be disabled. They will need to reapply to regain access to their account. All users must reapply annually.</p> </section> <section id="authentication-and-authorization"> <h4>Authentication and Authorization<a class="headerlink" href="#authentication-and-authorization" title="Link to this heading"></a></h4> <p>All users are required to use a one-time password for authentication. Tokens will be distributed to OLCF users. Users will be required to create a Personal Identification Number (PIN). This is used in conjunction with a generated token code as part of a two-factor authentication implementation. Accounts on the OLCF machines are for the exclusive use of the individual user named in the account application. Users should not share accounts or tokens with anyone. If evidence is found that more than one person is using an account, that account will be disabled immediately. Users are not to attempt to receive unintended messages or access information by some unauthorized means, such as imitating another system, impersonating another user or other person, misuse of legal user credentials (usernames, tokens, etc.), or by causing some system component to function incorrectly. Users are prohibited from changing or circumventing access controls to allow themselves or others to perform actions outside their authorized privileges. Users must notify the OLCF immediately when they become aware that any of the accounts used to access OLCF have been compromised. Users should inform the OLCF promptly of any changes in their contact information (E-mail, phone, affiliation, etc.) Updates should be sent to <a class="reference external" href="mailto:accounts%40ccs.ornl.gov" target="_blank">accounts<span>@</span>ccs<span>.</span>ornl<span>.</span>gov</a>.</p> </section> <section id="foreign-national-access"> <h4>Foreign National Access<a class="headerlink" href="#foreign-national-access" title="Link to this heading"></a></h4> <p>Applicants who appear on a restricted foreign country listing in section 15 CFR 740.7 License Exceptions for Computers are denied access based on US Foreign Policy. The countries cited are Cuba, Iran, North Korea, Sudan, and Syria. Additionally, no work may be performed on OLCF computers on behalf of foreign nationals from these countries.</p> </section> <section id="denial-of-service"> <h4>Denial of Service<a class="headerlink" href="#denial-of-service" title="Link to this heading"></a></h4> <p>Users may not deliberately interfere with other users accessing system resources.</p> </section> </section> </section> <hr class="docutils" /> <section id="data-management-policy"> <h2>Data Management Policy<a class="headerlink" href="#data-management-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to or use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators (Non-Profit)</p></li> <li><p>Principal Investigators (Industry)</p></li> <li><p>All Users</p></li> </ul> <p><strong>Title:</strong> Data Management Policy <strong>Version:</strong> 20.02</p> </div> <section id="introduction"> <h3>Introduction<a class="headerlink" href="#introduction" title="Link to this heading"></a></h3> <p>The OLCF provides a comprehensive suite of hardware and software resources for the creation, manipulation, and retention of scientific data. This document comprises guidelines for acceptable use of those resources. It is an official policy of the OLCF, and as such, must be agreed to by relevant parties as a condition of access to and use of OLCF computational resources.</p> <section id="data-storage-resources"> <h4>Data Storage Resources<a class="headerlink" href="#data-storage-resources" title="Link to this heading"></a></h4> <p>The OLCF provides an array of data storage platforms, each designed with a particular purpose in mind. Storage areas are broadly divided into two categories: those intended for user data and those intended for project data. Within each of the two categories, we provide different sub-areas, each with an intended purpose:</p> <table class="docutils align-default"> <thead> <tr class="row-odd"><th class="head"><p>Purpose</p></th> <th class="head"><p>Storage Area</p></th> <th class="head"><p>Path</p></th> </tr> </thead> <tbody> <tr class="row-even"><td><p>Long-term data for routine access that is unrelated to a project</p></td> <td><p><em>User Home</em></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/ccs/home/[userid]</span></code></p></td> </tr> <tr class="row-odd"><td><p>Long-term data for archival access that is unrelated to a project</p></td> <td><p><em>User Archive</em></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/home/[userid]</span></code></p></td> </tr> <tr class="row-even"><td><p>Long-term project data for routine access that’s shared with other project members</p></td> <td><p><em>Project Home</em></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/ccs/proj/[projid]</span></code></p></td> </tr> <tr class="row-odd"><td><p>Short-term project data for fast, batch job access that you don’t want to share</p></td> <td><p><em>Member Work</em></p></td> <td><div class="line-block"> <div class="line"><code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/[projid]/scratch/[userid]</span></code></div> <div class="line"><code class="docutils literal notranslate"><span class="pre">/lustre/orion/[projid]/scratch/[userid]</span></code></div> </div> </td> </tr> <tr class="row-even"><td><p>Short-term project data for fast, batch job access that’s shared with other project members</p></td> <td><p><em>Project Work</em></p></td> <td><div class="line-block"> <div class="line"><code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/[projid]/proj-shared</span></code></div> <div class="line"><code class="docutils literal notranslate"><span class="pre">/lustre/orion/[projid]/proj-shared</span></code></div> </div> </td> </tr> <tr class="row-odd"><td><p>Short-term project data for fast, batch job access that’s shared with those outside your project</p></td> <td><p><em>World Work</em></p></td> <td><div class="line-block"> <div class="line"><code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/[projid]/world-shared</span></code></div> <div class="line"><code class="docutils literal notranslate"><span class="pre">/lustre/orion/[projid]/world-shared</span></code></div> </div> </td> </tr> <tr class="row-even"><td><p>Long-term project data for archival access that you don’t want to share</p></td> <td><p><em>Member Archive</em></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/hpss/prod/[projid]/users/$USER</span></code></p></td> </tr> <tr class="row-odd"><td><p>Long-term project data for archival access that’s shared with other project members</p></td> <td><p><em>Project Archive</em></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/hpss/prod/[projid]/proj-shared</span></code></p></td> </tr> <tr class="row-even"><td><p>Long-term project data for archival access that’s shared with those outside your project</p></td> <td><p><em>World Archive</em></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/hpss/prod/[projid]/world-shared</span></code></p></td> </tr> </tbody> </table> <p>For more information about using the data storage archiving systems, please refer to the pages on <a class="reference internal" href="../data/index.html#data-storage-and-transfers"><span class="std std-ref">Data Storage and Transfers</span></a>.</p> </section> <section id="user-home"> <h4>User Home<a class="headerlink" href="#user-home" title="Link to this heading"></a></h4> <p>Home directories for each user are NFS-mounted on all OLCF systems and are intended to store long-term, frequently-accessed user data. User Home areas are backed up on a daily basis. This file system does not generally provide the input/output (I/O) performance required by most compute jobs, and is not available to compute jobs on most systems. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="user-archive"> <h4>User Archive<a class="headerlink" href="#user-archive" title="Link to this heading"></a></h4> <p>The High Performance Storage System (HPSS) is the tape-archive storage system at the OLCF and is the storage technology that supports the User Archive areas. HPSS is intended for data that do not require day-to-day access.</p> <div class="admonition note"> <p class="admonition-title">Note</p> <p>Use of this directory for data storage is deprecated in favor of storing data in the User, Project, and World Archive directories. For new users, this directory is a “link farm” with symlinks to that user’s /hpss/prod directories. Data for existing users remains in this directory but should be moved into a User/Project/World Archive directory, at which time this directory will automatically convert to a link farm.</p> </div> </section> <section id="project-home"> <h4>Project Home<a class="headerlink" href="#project-home" title="Link to this heading"></a></h4> <p>Project Home directories are NFS-mounted on selected OLCF systems and are intended to store long-term, frequently-accessed data that is needed by all collaborating members of a project. Project Home areas are backed up on a daily basis. This file system does not generally provide the input/output (I/O) performance required by most compute jobs, and is not available to compute jobs on most systems. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="member-work"> <h4>Member Work<a class="headerlink" href="#member-work" title="Link to this heading"></a></h4> <p>Project members get an individual Member Work directory for each associated project; these reside in the center-wide, high-capacity scratch filesystems on large, fast disk areas intended for global (parallel) access to temporary/scratch storage. Member Work areas are not shared with other users of the system and are intended for project data that the user does not want to make available to other users. Member Work directories are provided commonly across all systems. Because of the scratch nature of the file system, it is not backed up and files are automatically purged on a regular basis. Files should not be retained in this file system for long, but rather should be migrated to Project Home or Project Archive space as soon as the files are not actively being used. If a file system associated with your Member Work directory is nearing capacity, the OLCF may contact you to request that you reduce the size of your Member Work directory. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="project-work"> <h4>Project Work<a class="headerlink" href="#project-work" title="Link to this heading"></a></h4> <p>Each project is granted a Project Work directory; these reside in the center-wide, high-capacity scratch filesystems on large, fast disk areas intended for global (parallel) access to temporary/scratch storage. Project Work directories can be accessed by all members of a project and are intended for sharing data within a project. Project Work directories are provided commonly across most systems. Because of the scratch nature of the file system, it is not backed up and files are automatically purged on a regular bases. Files should not be retained in this file system for long, but rather should be migrated to Project Home or Project Archive space as soon as the files are not actively being used. If a file system associated with Project Work storage is nearing capacity, the OLCF may contact the PI of the project to request that he or she reduce the size of the Project Work directory. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="world-work"> <h4>World Work<a class="headerlink" href="#world-work" title="Link to this heading"></a></h4> <p>Each project has a World Work directory that resides in the center-wide, high-capacity scratch filesystems on large, fast disk areas intended for global (parallel) access to temporary/scratch storage. World Work areas can be accessed by all users of the system and are intended for sharing of data between projects. World Work directories are provided commonly across most systems. Because of the scratch nature of the file system, it is not backed up and files are automatically purged on a regular bases. Files should not be retained in this file system for long, but rather should be migrated to Project Home or Project Archive space as soon as the files are not actively being used. If a file system associated with World Work storage is nearing capacity, the OLCF may contact the PI of the project to request that he or she reduce the size of the World Work directory. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="member-archive"> <h4>Member Archive<a class="headerlink" href="#member-archive" title="Link to this heading"></a></h4> <p>Project members get an individual Member Archive directory for each associated project; these reside on the High Performance Storage System (HPSS), OLCF’s tape-archive storage system. Member Archive areas are not shared with other users of the system and are intended for project data that the user does not want to make available to other users. HPSS is intended for data that do not require day-to-day access. Users should not store data unrelated to OLCF projects on HPSS. Users should periodically review files and remove unneeded ones. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="project-archive"> <h4>Project Archive<a class="headerlink" href="#project-archive" title="Link to this heading"></a></h4> <p>Each project is granted a Project Archive directory; these reside on the High Performance Storage System (HPSS), OLCF’s tape-archive storage system. Project Archive directories are shared among all members of a project and are intended for sharing data within a project. HPSS is intended for data that do not require day-to-day access. Users should not store data unrelated to OLCF projects on HPSS. Project members should also periodically review files and remove unneeded ones. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> <section id="world-archive"> <h4>World Archive<a class="headerlink" href="#world-archive" title="Link to this heading"></a></h4> <p>Each project is granted a World Archive directory; these reside on the High Performance Storage System (HPSS), OLCF’s tape-archive storage system. World Archive areas are shared among all users of the system and are intended for sharing data between projects. HPSS is intended for data that do not require day-to-day access. Users should not store data unrelated to OLCF projects on HPSS. Users should periodically review files and remove unneeded ones. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for more details on applicable quotas, backups, purge, and retention timeframes.</p> </section> </section> <section id="data-retention-purge-quotas"> <span id="retention-policy"></span><h3>Data Retention, Purge, & Quotas<a class="headerlink" href="#data-retention-purge-quotas" title="Link to this heading"></a></h3> <section id="summary"> <h4>Summary<a class="headerlink" href="#summary" title="Link to this heading"></a></h4> <p>The following table details quota, backup, purge, and retention information for each user-centric and project-centric storage area available at the OLCF.</p> <p><strong>User-Centric Storage Areas</strong></p> <table class="docutils align-default"> <thead> <tr class="row-odd"><th class="head"><p>Area</p></th> <th class="head"><p>Path</p></th> <th class="head"><p>Type</p></th> <th class="head"><p>Permissions</p></th> <th class="head"><p>Quota</p></th> <th class="head"><p>Backups</p></th> <th class="head"><p>Purged</p></th> <th class="head"><p>Retention</p></th> <th class="head"><p>On Compute Nodes</p></th> </tr> </thead> <tbody> <tr class="row-even"><td><p>User Home</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/ccs/home/[userid]</span></code></p></td> <td><p>NFS</p></td> <td><p>User set</p></td> <td><p>50 GB</p></td> <td><p>Yes</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>Read-only</p></td> </tr> <tr class="row-odd"><td><p>User Archive <a class="footnote-reference brackets" href="#f1" id="id1" role="doc-noteref"><span class="fn-bracket">[</span>1<span class="fn-bracket">]</span></a></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/home/[userid]</span></code></p></td> <td><p>HPSS</p></td> <td><p>User set</p></td> <td><p>2TB</p></td> <td><p>No</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>No</p></td> </tr> <tr class="row-even"><td><p>User Archive <a class="footnote-reference brackets" href="#f2" id="id2" role="doc-noteref"><span class="fn-bracket">[</span>2<span class="fn-bracket">]</span></a></p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/home/[userid]</span></code></p></td> <td><p>HPSS</p></td> <td><p>700</p></td> <td><p>N/A</p></td> <td><p>N/A</p></td> <td><p>N/A</p></td> <td><p>N/A</p></td> <td><p>No</p></td> </tr> </tbody> </table> <p><strong>Project-Centric Storage Areas</strong></p> <table class="docutils align-default"> <thead> <tr class="row-odd"><th class="head"><p>Area</p></th> <th class="head"><p>Path</p></th> <th class="head"><p>Type</p></th> <th class="head"><p>Permissions</p></th> <th class="head"><p>Quota</p></th> <th class="head"><p>Backups</p></th> <th class="head"><p>Purged</p></th> <th class="head"><p>Retention</p></th> <th class="head"><p>On Compute Nodes</p></th> </tr> </thead> <tbody> <tr class="row-even"><td><p>Project Home</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/ccs/proj/[projid]</span></code></p></td> <td><p>NFS</p></td> <td><p>770</p></td> <td><p>50 GB</p></td> <td><p>Yes</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>Read-only</p></td> </tr> <tr class="row-odd"><td rowspan="2"><p>Member Work</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/[projid]/scratch/[userid]</span></code></p></td> <td><p>Spectrum Scale</p></td> <td><p>700 <a class="footnote-reference brackets" href="#f3" id="id3" role="doc-noteref"><span class="fn-bracket">[</span>3<span class="fn-bracket">]</span></a></p></td> <td><p>50 TB</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>N/A <a class="footnote-reference brackets" href="#f4" id="id4" role="doc-noteref"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></a></p></td> <td><p>Yes</p></td> </tr> <tr class="row-even"><td><p><code class="docutils literal notranslate"><span class="pre">/lustre/orion/[projid]/scratch/[userid]</span></code></p></td> <td><p>Lustre HPE ClusterStor</p></td> <td><p>700 <a class="footnote-reference brackets" href="#f3" id="id5" role="doc-noteref"><span class="fn-bracket">[</span>3<span class="fn-bracket">]</span></a></p></td> <td><p>50 TB</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>N/A <a class="footnote-reference brackets" href="#f4" id="id6" role="doc-noteref"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></a></p></td> <td><p>Yes</p></td> </tr> <tr class="row-odd"><td rowspan="2"><p>Project Work</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/[projid]/proj-shared</span></code></p></td> <td><p>Spectrum Scale</p></td> <td><p>770</p></td> <td><p>50 TB</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>N/A <a class="footnote-reference brackets" href="#f4" id="id7" role="doc-noteref"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></a></p></td> <td><p>Yes</p></td> </tr> <tr class="row-even"><td><p><code class="docutils literal notranslate"><span class="pre">/lustre/orion/[projid]/proj-shared</span></code></p></td> <td><p>Lustre HPE ClusterStor</p></td> <td><p>770</p></td> <td><p>50 TB</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>N/A <a class="footnote-reference brackets" href="#f4" id="id8" role="doc-noteref"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></a></p></td> <td><p>Yes</p></td> </tr> <tr class="row-odd"><td rowspan="2"><p>World Work</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/[projid]/world-shared</span></code></p></td> <td><p>Spectrum Scale</p></td> <td><p>775</p></td> <td><p>50 TB</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>N/A <a class="footnote-reference brackets" href="#f4" id="id9" role="doc-noteref"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></a></p></td> <td><p>Yes</p></td> </tr> <tr class="row-even"><td><p><code class="docutils literal notranslate"><span class="pre">/lustre/orion/[projid]/world-shared</span></code></p></td> <td><p>Lustre HPE ClusterStor</p></td> <td><p>775</p></td> <td><p>50 TB</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>N/A <a class="footnote-reference brackets" href="#f4" id="id10" role="doc-noteref"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></a></p></td> <td><p>Yes</p></td> </tr> <tr class="row-odd"><td><p>Member Archive</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/hpss/prod/[projid]/users/$USER</span></code></p></td> <td><p>HPSS</p></td> <td><p>700</p></td> <td><p>100 TB</p></td> <td><p>No</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>No</p></td> </tr> <tr class="row-even"><td><p>Project Archive</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/hpss/prod/[projid]/proj-shared</span></code></p></td> <td><p>HPSS</p></td> <td><p>770</p></td> <td><p>100 TB</p></td> <td><p>No</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>No</p></td> </tr> <tr class="row-odd"><td><p>World Archive</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/hpss/prod/[projid]/world-shared</span></code></p></td> <td><p>HPSS</p></td> <td><p>775</p></td> <td><p>100 TB</p></td> <td><p>No</p></td> <td><p>No</p></td> <td><p>90 days</p></td> <td><p>No</p></td> </tr> </tbody> </table> <div class="line-block"> <div class="line"><em>Area -</em> The general name of storage area.</div> <div class="line"><em>Path -</em> The path (symlink) to the storage area’s directory.</div> <div class="line"><em>Type -</em> The underlying software technology supporting the storage area.</div> <div class="line"><em>Permissions -</em> UNIX Permissions enforced on the storage area’s top-level directory.</div> <div class="line"><em>Quota -</em> The limits placed on total number of bytes and/or files in the storage area.</div> <div class="line"><em>Backups -</em> States if the data is automatically duplicated for disaster recovery purposes.</div> <div class="line"><em>Purged -</em> Period of time, post-file-access, after which a file will be marked as eligible for permanent deletion.</div> <div class="line"><em>Retention -</em> Period of time, post-account-deactivation or post-project-end, after which data will be marked as eligible for permanent deletion.</div> </div> <blockquote> <div><p><strong>Important!</strong> Files within “Work” directories (i.e., Member Work, Project Work, World Work) are <em>not</em> backed up and are <em>purged</em> on a regular basis according to the timeframes listed above.</p> </div></blockquote> <p class="rubric">Footnotes</p> <aside class="footnote-list brackets"> <aside class="footnote brackets" id="f1" role="doc-footnote"> <span class="label"><span class="fn-bracket">[</span><a role="doc-backlink" href="#id1">1</a><span class="fn-bracket">]</span></span> <p>This entry is for legacy User Archive directories which contained user data on January 14, 2020. There is also a quota/limit of 2,000 files on this directory.</p> </aside> <aside class="footnote brackets" id="f2" role="doc-footnote"> <span class="label"><span class="fn-bracket">[</span><a role="doc-backlink" href="#id2">2</a><span class="fn-bracket">]</span></span> <p>User Archive directories that were created (or had no user data) after January 14, 2020. Settings other than permissions are not applicable because directories are root-owned and contain no user files.</p> </aside> <aside class="footnote brackets" id="f3" role="doc-footnote"> <span class="label"><span class="fn-bracket">[</span>3<span class="fn-bracket">]</span></span> <span class="backrefs">(<a role="doc-backlink" href="#id3">1</a>,<a role="doc-backlink" href="#id5">2</a>)</span> <p>Permissions on Member Work directories can be controlled to an extent by project members. By default, only the project member has any accesses, but accesses can be granted to other project members by setting group permissions accordingly on the Member Work directory. The parent directory of the Member Work directory prevents accesses by “UNIX-others” and cannot be changed (security measures).</p> </aside> <aside class="footnote brackets" id="f4" role="doc-footnote"> <span class="label"><span class="fn-bracket">[</span>4<span class="fn-bracket">]</span></span> <span class="backrefs">(<a role="doc-backlink" href="#id4">1</a>,<a role="doc-backlink" href="#id6">2</a>,<a role="doc-backlink" href="#id7">3</a>,<a role="doc-backlink" href="#id8">4</a>,<a role="doc-backlink" href="#id9">5</a>,<a role="doc-backlink" href="#id10">6</a>)</span> <p>Retention is not applicable as files will follow purge cycle.</p> </aside> </aside> <p>On Summit, Rhea and the DTNs, additional paths to the various project-centric work areas are available via the following symbolic links and/or environment variables:</p> <ul class="simple"> <li><p>Member Work Alpine2 Directory: <code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/scratch/[userid]/[projid]</span></code> or <code class="docutils literal notranslate"><span class="pre">$MEMBERWORK/[projid]</span></code></p></li> <li><p>Project Work Alpine2 Directory: <code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/proj-shared/[projid]</span></code> or <code class="docutils literal notranslate"><span class="pre">$PROJWORK/[projid]</span></code></p></li> <li><p>World Work Alpine2 Directory: <code class="docutils literal notranslate"><span class="pre">/gpfs/alpine2/world-shared/[projid]</span></code> or <code class="docutils literal notranslate"><span class="pre">$WORLDWORK/[projid]</span></code></p></li> <li><p>Member Work Orion Directory: <code class="docutils literal notranslate"><span class="pre">/lustre/orion/scratch/[userid]/[projid]</span></code> or <code class="docutils literal notranslate"><span class="pre">$MEMBERWORK/[projid]</span></code></p></li> <li><p>Project Work Orion Directory: <code class="docutils literal notranslate"><span class="pre">/lustre/orion/proj-shared/[projid]</span></code> or <code class="docutils literal notranslate"><span class="pre">$PROJWORK/[projid]</span></code></p></li> <li><p>World Work Orion Directory: <code class="docutils literal notranslate"><span class="pre">/lustre/orion/world-shared/[projid]</span></code> or <code class="docutils literal notranslate"><span class="pre">$WORLDWORK/[projid]</span></code></p></li> </ul> </section> <section id="data-retention-overview"> <h4>Data Retention Overview<a class="headerlink" href="#data-retention-overview" title="Link to this heading"></a></h4> <p>By default, there is no lifetime retention for any data on OLCF resources. The OLCF specifies a limited post-deactivation timeframe during which user and project data will be retained. When the retention timeframe expires, the OLCF retains the right to delete data. If you have data retention needs outside of the default policy, please notify the OLCF.</p> </section> <section id="user-data-retention"> <h4>User Data Retention<a class="headerlink" href="#user-data-retention" title="Link to this heading"></a></h4> <p>The user data retention policy exists to reclaim storage space after a user account is deactivated, e.g., after the user’s involvement on all OLCF projects concludes. By default, the OLCF will retain data in user-centric storage areas only for a designated amount of time after the user’s account is deactivated. During this time, a user can request a temporary user account extension for data access. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for details on retention timeframes for each user-centric storage area.</p> </section> <section id="project-data-retention"> <h4>Project Data Retention<a class="headerlink" href="#project-data-retention" title="Link to this heading"></a></h4> <p>The project data retention policy exists to reclaim storage space after a project ends. By default, the OLCF will retain data in project-centric storage areas only for a designated amount of time after the project end date. During this time, a project member can request a temporary user account extension for data access. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for details on purge and retention timeframes for each project-centric storage area.</p> </section> <section id="sensitive-project-data-retention"> <h4>Sensitive Project Data Retention<a class="headerlink" href="#sensitive-project-data-retention" title="Link to this heading"></a></h4> <p>For sensitive projects only, all data related to the project must be purged from all OLCF computing resources within 30 days of the project’s end or termination date.</p> </section> <section id="transfer-of-member-work-and-member-archive-data"> <h4>Transfer of Member Work and Member Archive Data<a class="headerlink" href="#transfer-of-member-work-and-member-archive-data" title="Link to this heading"></a></h4> <p>Although the Member Work and Member Archive directories are for storage of data a user does not want to make available to other users on the system, files in these directories are still considered project data and can be reassigned to another user at the PI’s request.</p> </section> <section id="data-purges"> <h4>Data Purges<a class="headerlink" href="#data-purges" title="Link to this heading"></a></h4> <p>Data purge mechanisms are enabled on some OLCF file system directories in order to maintain sufficient disk space availability for job execution. Files in these scratch areas are automatically purged on a regular purge timeframe. If a file system with an active purge policy is nearing capacity, the OLCF may contact you to request that you reduce the size of a directory within that file system, even if the purge timeframe has not been exceeded. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for details on purge timeframes for each storage area, if applicable.</p> </section> <section id="storage-space-quotas"> <h4>Storage Space Quotas<a class="headerlink" href="#storage-space-quotas" title="Link to this heading"></a></h4> <p>Each user-centric and project-centric storage area has an associated quota, which could be a hard (systematically-enforceable) quota or a soft (policy-enforceable) quota. Storage usage will be monitored continually. When a user or project exceeds a soft quota for a storage area, the user or project PI will be contacted and will be asked if at all possible to purge data from the offending area. See the section <a class="reference internal" href="#retention-policy"><span class="std std-ref">Data Retention, Purge, & Quotas</span></a> for details on quotas for each storage area.</p> </section> </section> <section id="data-prohibitions-safeguards"> <h3>Data Prohibitions & Safeguards<a class="headerlink" href="#data-prohibitions-safeguards" title="Link to this heading"></a></h3> <section id="id11"> <h4>Prohibited Data<a class="headerlink" href="#id11" title="Link to this heading"></a></h4> <p>The OLCF computer systems are operated as research systems and only contain data related to scientific research and do not contain personally identifiable information (data that falls under the Privacy Act of 1974 5U.S.C. 552a). Use of OLCF resources to store, manipulate, or remotely access any national security information is strictly prohibited. This includes, but is not limited to: classified information, unclassified controlled nuclear information (UCNI), naval nuclear propulsion information (NNPI), the design or development of nuclear, biological, or chemical weapons or any weapons of mass destruction. Authors/generators/owners of information are responsible for its correct categorization as sensitive or non-sensitive. Owners of sensitive information are responsible for its secure handling, transmission, processing, storage, and disposal on OLCF systems. Principal investigators, users, or project delegates that use OLCF resources, or are responsible for overseeing projects that use OLCF resources, are strictly responsible for knowing whether their project generates any of these prohibited data types or information that falls under Export Control. For questions, contact <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a>.</p> </section> <section id="unauthorized-data-modification"> <h4>Unauthorized Data Modification<a class="headerlink" href="#unauthorized-data-modification" title="Link to this heading"></a></h4> <p>Users are prohibited from taking unauthorized actions to intentionally modify or delete information or programs.</p> </section> <section id="data-confidentiality-integrity-availability"> <h4>Data Confidentiality, Integrity, & Availability<a class="headerlink" href="#data-confidentiality-integrity-availability" title="Link to this heading"></a></h4> <p>The OLCF systems provide protections to maintain the confidentiality, integrity, and availability of user data. Measures include: the availability of file permissions, archival systems with access control lists, and parity/CRC checks on data paths/files. It is the user’s responsibility to set access controls appropriately for data. In the event of system failure or malicious actions, the OLCF makes no guarantee against loss of data nor makes a guarantee that a user’s data could not be potentially accessed, changed, or deleted by another individual. It is the user’s responsibility to insure the appropriate level of backup and integrity checks on critical data and programs.</p> </section> <section id="administrator-access-to-data"> <h4>Administrator Access to Data<a class="headerlink" href="#administrator-access-to-data" title="Link to this heading"></a></h4> <p>OLCF resources are federal computer systems, and as such, users should have no explicit or implicit expectation of privacy. OLCF employees and authorized vendor personnel with “root” privileges have access to all data on OLCF systems. Such employees can also login to OLCF systems as other users. As a general rule, OLCF employees will not discuss your data with any unauthorized entities nor grant access to data files to any person other than the UNIX “owner” of the data file, except in the following situations:</p> <ul class="simple"> <li><p>When the owner of the data requests a change of ownership for any reason, e.g., the owner is leaving the project and grants the PI ownership of the data.</p></li> <li><p>In situations of suspected abuse/misuse computational resources, criminal activity, or cyber-security violations.</p></li> </ul> <p>Note that the above applies even to project PIs. In general, the OLCF will not overwrite existing UNIX permissions on data files owned by project members for the purpose of granting access to the project PI. Project PIs should work closely with project members throughout the duration of the project to ensure UNIX permissions are set appropriately.</p> </section> </section> <section id="software"> <h3>Software<a class="headerlink" href="#software" title="Link to this heading"></a></h3> <section id="software-licensing"> <h4>Software Licensing<a class="headerlink" href="#software-licensing" title="Link to this heading"></a></h4> <p>All software used on OLCF computers must be appropriately acquired and used according to the appropriate software license agreement. Possession, use, or transmission of illegally obtained software is prohibited. Likewise, users shall not copy, store, or transfer copyrighted software, except as permitted by the owner of the copyright. Only export-controlled codes approved by the Export Control Office may be run by parties with sensitive data agreements.</p> </section> <section id="id12"> <h4>Malicious Software<a class="headerlink" href="#id12" title="Link to this heading"></a></h4> <p>Users must not intentionally introduce or use malicious software, including but not limited to, computer viruses, Trojan horses, or computer worms.</p> </section> <section id="id13"> <h4>Reconstruction of Information or Software<a class="headerlink" href="#id13" title="Link to this heading"></a></h4> <p>Users are not permitted to reconstruct information or software for which they are not authorized. This includes but is not limited to any reverse engineering of copyrighted software or firmware present on OLCF computing resources.</p> </section> </section> </section> <hr class="docutils" /> <section id="security-policy"> <h2>Security Policy<a class="headerlink" href="#security-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to or use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators (Non-Profit)</p></li> <li><p>Principal Investigators (Industry)</p></li> <li><p>All Users</p></li> </ul> <p><strong>Title:</strong>Security Policy <strong>Version:</strong> 12.10</p> </div> <p>The Oak Ridge Leadership Computing Facility (OLCF) computing resources are provided to users for research purposes. All users must agree to abide by all security measures described in this document. Failure to comply with security procedures will result in termination of access to OLCF computing resources and possible legal actions.</p> <section id="scope"> <h3>Scope<a class="headerlink" href="#scope" title="Link to this heading"></a></h3> <p>The requirements outlined in this document apply to all individuals who have an OLCF account. It is your responsibility to ensure that all individuals have the proper need-to-know before allowing them access to the information on OLCF computing resources. This document will outline the main security concerns.</p> </section> <section id="personal-use"> <h3>Personal Use<a class="headerlink" href="#personal-use" title="Link to this heading"></a></h3> <p>OLCF computing resources are for business use only. Installation or use of software for personal use is not allowed. Incidents of abuse will result in account termination. Inappropriate uses include, but are not limited to:</p> <ul class="simple"> <li><p>Sexually oriented information</p></li> <li><p>Downloading, copying, or distributing copyrighted materials without prior permission from the owner</p></li> <li><p>Downloading or storing large files or utilizing streaming media for personal use (e.g., music files, graphic files, internet radio, video streams, etc.)</p></li> <li><p>Advertising, soliciting, or selling</p></li> </ul> </section> <section id="accessing-olcf-computational-resources"> <h3>Accessing OLCF Computational Resources<a class="headerlink" href="#accessing-olcf-computational-resources" title="Link to this heading"></a></h3> <p>Access to systems is provided via Secure Shell version 2 (sshv2). You will need to ensure that your ssh client supports keyboard-interactive authentication. The method of setting up this authentication varies from client to client, so you may need to contact your local administrator for assistance. Most new implementations support this authentication type, and many ssh clients are available on the web. Login sessions will be automatically terminated after a period of inactivity. When you apply for an account, you will be mailed an RSA SecurID token. You will also be sent a request to complete identity verification. When your account is approved, your RSA SecurID token will also be enabled. Please refer to our <a class="reference internal" href="../systems/index.html#system-user-guides"><span class="std std-ref">Systems</span></a> for more information on host access. DO NOT share your PIN or RSA SecurID token with anyone. Sharing of accounts will result in termination. If your SecurID token is stolen or misplaced, contact the OLCF immediately and report the missing token. Upon termination of your account access, return the token to the OLCF in person or via mail.</p> </section> <section id="data-management"> <h3>Data Management<a class="headerlink" href="#data-management" title="Link to this heading"></a></h3> <p>The OLCF uses a standard file system structure to assist users with data organization on OLCF systems. Complete details about all file systems available to OLCF users can be found in the Data Management Policy section.</p> </section> <section id="sensitive-data"> <h3>Sensitive Data<a class="headerlink" href="#sensitive-data" title="Link to this heading"></a></h3> <p>Additional file systems and file protections may be employed for sensitive data. If you are a user on a project producing sensitive data, further instructions will be given by the OLCF. The following guidelines apply to sensitive data:</p> <ul class="simple"> <li><p>Only store sensitive data in designated locations. Do not store sensitive data in your User Home directory.</p></li> <li><p>Never allow access to your sensitive data to anyone outside of your group.</p></li> <li><p>Transfer of sensitive data must be through the use encrypted methods (scp, sftp, etc).</p></li> <li><p>All sensitive data must be removed from all OLCF resources when your project has concluded.</p></li> </ul> </section> <section id="data-transfer"> <h3>Data Transfer<a class="headerlink" href="#data-transfer" title="Link to this heading"></a></h3> <p>The OLCF offers a number of dedicated data transfer nodes to users. The nodes have been tuned specifically for wide area data transfers, and also perform well on the local area. There are also several utilities that the OLCF recommends for data transfer. Please refer to our <a class="reference internal" href="../systems/index.html#system-user-guides"><span class="std std-ref">Systems</span></a> for information about the DTNs and available utilities.</p> </section> </section> <hr class="docutils" /> <section id="incite-allocation-under-utilization-policy"> <h2>INCITE Allocation Under-utilization Policy<a class="headerlink" href="#incite-allocation-under-utilization-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to and use of OLCF computational resources:</p> <ul class="simple"> <li><p>INCITE Principal Investigators</p></li> </ul> <p><strong>Title:</strong> INCITE Allocation Under-utilization Policy <strong>Version:</strong> 12.10</p> </div> <p>The OLCF has a <em>pull-back</em> policy for under-utilization of INCITE allocations. Under-utilized INCITE project allocations will have core-hours removed from their outstanding core-hour project balance at specific times during the INCITE calendar year. The following table summarizes the current under-utilization policy:</p> <table class="docutils align-default"> <thead> <tr class="row-odd"><th class="head"><p>Date</p></th> <th class="head"><p>Utilization to-Date</p></th> <th class="head"><p>Forfeited Amount</p></th> </tr> </thead> <tbody> <tr class="row-even"><td rowspan="2"><p>May 1</p></td> <td><p>< 10%</p></td> <td><p>Up to 30% of remaining allocation</p></td> </tr> <tr class="row-odd"><td><p>< 15%</p></td> <td><p>Up to 15% of remaining allocation</p></td> </tr> <tr class="row-even"><td rowspan="3"><p>September 1</p></td> <td><p>< 10%</p></td> <td><p>Up to 75% of remaining allocation</p></td> </tr> <tr class="row-odd"><td><p>< 33%</p></td> <td><p>Up to 50% of remaining allocation</p></td> </tr> <tr class="row-even"><td><p>< 50%</p></td> <td><p>Up to 33% of remaining allocation</p></td> </tr> </tbody> </table> <p>For example, a 1,000,000 core-hour INCITE project that has utilized only 50,000 core-hours (5% of the allocation) on May 1st would forfeit (0.30 * 950,000) = 285,000 core-hours from their remaining allocation.</p> </section> <hr class="docutils" /> <section id="project-reporting-policy"> <h2>Project Reporting Policy<a class="headerlink" href="#project-reporting-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to and use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators (Non-Profit)</p></li> <li><p>Principal Investigators (Industry)</p></li> </ul> <p><strong>Title:</strong> Project Reporting Policy <strong>Version:</strong> 12.10</p> </div> <p>Principal Investigators of current OLCF projects must submit a quarterly progress report. The quarterly reports are essential as the OLCF must diligently track the use of the center’s resources. In keeping with this, the OLCF (and DOE Leadership Computing Facilities in general) imposes the following penalties for late submission:</p> <table class="docutils align-default"> <thead> <tr class="row-odd"><th class="head"><p>Timeframe</p></th> <th class="head"><p>Penalty</p></th> </tr> </thead> <tbody> <tr class="row-even"><td><p>1 Month Late</p></td> <td><p>Job submissions against offending project will be suspended.</p></td> </tr> <tr class="row-odd"><td><p>3 Months Late</p></td> <td><p>Login privileges will be suspended for all OLCF resources for all users associated with offending project.</p></td> </tr> </tbody> </table> </section> <hr class="docutils" /> <section id="non-proprietary-institutional-user-agreement-policy"> <h2>Non-proprietary Institutional User Agreement Policy<a class="headerlink" href="#non-proprietary-institutional-user-agreement-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to and use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators (Non-Profit)</p></li> <li><p>All Users</p></li> </ul> <p><strong>Title:</strong> Non-proprietary Institutional User Agreement Policy <strong>Version:</strong> 12.10</p> </div> <p>Users of DOE-designated User Facilities must understand and agree to the following Institutional User Agreement clause: I understand that my institution has entered into a User Agreement with UT-Battelle, the management and operating contractor for the U.S. Department of Energy’s (DOE) Oak Ridge National Laboratory (ORNL), that governs my research ORNL’s DOE-designated User Facilities. I have read and understand my obligations under that Agreement, including the provisions summarized below. You may check with your institution or contact <a class="reference external" href="mailto:accounts%40ccs.ornl.gov" target="_blank">accounts<span>@</span>ccs<span>.</span>ornl<span>.</span>gov</a> if you require a copy of your User Agreement.</p> <section id="access"> <h3>Access<a class="headerlink" href="#access" title="Link to this heading"></a></h3> <p>I understand that my access is limited to certain designated areas and/or systems, and my access may be revoked if I pose a security, safety, or operational risk.</p> </section> <section id="rules-and-regulations"> <h3>Rules and Regulations<a class="headerlink" href="#rules-and-regulations" title="Link to this heading"></a></h3> <p>I will follow the applicable ORNL rules, regulations and requirements, including those requirements of the ORNL User Facility. I will follow the requirements set forth in training if assigned to me by the ORNL User Facility.</p> </section> <section id="safety-and-health"> <h3>Safety and Health<a class="headerlink" href="#safety-and-health" title="Link to this heading"></a></h3> <p>I will take all reasonable precautions to protect the safety and health of others and comply with all applicable safety and health requirements.</p> </section> <section id="intent-to-publish"> <h3>Intent to Publish<a class="headerlink" href="#intent-to-publish" title="Link to this heading"></a></h3> <p>I will use best efforts to publish the results from my use of the ORNL User Facility in an open scientific journal or significant industry technical journal or conference proceedings. I will <a class="reference external" href="#olcf-acknowledgement" target="_blank">acknowledge use of the ORNL User Facility</a> in the publication and notify the ORNL User Facility of any publications that result from my use of the facility.</p> </section> <section id="export-control"> <h3>Export Control<a class="headerlink" href="#export-control" title="Link to this heading"></a></h3> <p>I will comply with all U.S. Export Control laws and regulations and be responsible for the appropriate handling and transfer of any export controlled information, which may require advance U.S. Government authorization.</p> </section> <section id="intellectual-property"> <h3>Intellectual Property<a class="headerlink" href="#intellectual-property" title="Link to this heading"></a></h3> <div class="line-block"> <div class="line">I will disclose any invention conceived as a part of the work at a ORNL User Facility and will protect the invention until a patent application can be filed. I understand that my institution may elect title to the invention and the U.S. Government retains rights to the invention.</div> </div> </section> </section> <hr class="docutils" /> <section id="hipaa-itar-project-rules-of-behavior-policy"> <h2>HIPAA/ITAR Project Rules of Behavior Policy<a class="headerlink" href="#hipaa-itar-project-rules-of-behavior-policy" title="Link to this heading"></a></h2> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to and use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators of HIPAA/ITAR Projects</p></li> <li><p>Users on HIPAA/ITAR Projects</p></li> </ul> <p><strong>Title:</strong> HIPAA/ITAR Project Rules of Behavior Policy <strong>Version:</strong> 21.01</p> </div> <p>Portions of data and/or software used in your project require extra protections due to requirements for protecting HIPAA/ITAR or other sensitive or controlled information. There are countries from which citizens are restricted from accessing sensitive/controlled information and therefore cannot be a part of your project. When you request users to be added to your project, our user assistance center will check the nationality of those users for conflict.</p> <p>In addition, to protect sensitive data and code identified by these export control restrictions, data and code must be handled in accordance with the following rules:</p> <ol class="arabic simple"> <li><p>HIPAA/ITAR regulated data is <strong>only allowed</strong> within the following directory:</p></li> </ol> <table class="docutils align-default"> <thead> <tr class="row-odd"><th class="head"><p>Area</p></th> <th class="head"><p>Path</p></th> <th class="head"><p>Type</p></th> </tr> </thead> <tbody> <tr class="row-even"><td><p>Project scratch</p></td> <td><p><code class="docutils literal notranslate"><span class="pre">/gpfs/arx/[projid]</span></code></p></td> <td><p>GPFS</p></td> </tr> </tbody> </table> <p>This is your project’s scratch space on the “arx” filesystem. Only members of your project will have access.</p> <p>2. Filenames, application names, job names, environment variables, batch job scripts, or any other unencrypted text must never contain sensitive or controlled information. Transfer of sensitive or controlled information must only take place through designated Data Transfer Nodes (DTNs) over an encrypted transport protocol.</p> <p>3. Prior to your project being initialized, we must have source IP addresses for devices in your organization that are authorized to transfer sensitive/controlled information to/from your organization, or for use in accessing that information. Encryption is necessary for transferring sensitive and/or controlled information to and from the OLCF.</p> <p>4. For codes being used, please make sure that the proper number of licenses have been obtained from the vendors of the respective software. It is also the responsibility of the PI to ensure that all project members have the appropriate authorization to access any sensitive data and/or codes used as required by relevant data use agreements.</p> <p>5. The Principal Investigator (PI) has the responsibility to make sure that other project members follow the sensitive controls outlined in this policy and protect sensitive/controlled information. It is also the responsibility of the PI to alert us of any personnel changes on the project.</p> <p>If you have security-related questions, contact us via email at: <a class="reference external" href="mailto:security-admins%40ccs.ornl.gov" target="_blank">security-admins<span>@</span>ccs<span>.</span>ornl<span>.</span>gov</a>. Other questions can be sent to <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a>.</p> </section> <section id="user-managed-software-ums-policy"> <h2>User-Managed Software (UMS) Policy<a class="headerlink" href="#user-managed-software-ums-policy" title="Link to this heading"></a></h2> <p>More information about the UMS program can be found in the <a class="reference external" href="/software/UMS/index.html" target="_blank">Software</a> section.</p> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This details an official policy of the OLCF, and must be agreed to by the following persons as a condition of access to and use of OLCF computational resources:</p> <ul class="simple"> <li><p>Principal Investigators of UMS Projects</p></li> <li><p>Points of Contact for UMS Projects</p></li> </ul> <p><strong>Title:</strong> UMS Project Policies <strong>Version:</strong> 21.08</p> </div> <section id="purpose"> <h3>Purpose<a class="headerlink" href="#purpose" title="Link to this heading"></a></h3> <p>This document is intended to describe the agreement between the OLCF and the providers of user-managed software installations. User-managed software is built, maintained, and supported by OLCF users rather than as official offerings of the OLCF, but is exposed to all users through the module system.</p> </section> <section id="policies"> <h3>Policies<a class="headerlink" href="#policies" title="Link to this heading"></a></h3> <p>Order is for convenience and no implication of priority is implied.</p> <ul class="simple"> <li><p>Products installed should be limited to those explicitly listed in the project application and approved by the OLCF.</p> <ul> <li><p>The project application is reviewed by the Export Control Office. If you would like to install additional packages not listed in your original application, the Project PI must contact the OLCF at <a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a> before making changes.</p></li> </ul> </li> <li><p>Products must provide appropriate modules for their software.</p></li> <li><p>Products must provide a statement of support, to be displayed via the module system and in other appropriate contexts/locations.</p> <ul> <li><p>The statement should clearly indicate that the product is not supported or maintained by the OLCF, but is supported by the UMS project applicant and/or the UMS project team.</p></li> <li><p>The statement should clearly indicate the organization that is providing support and maintenance, and clearly indicate the preferred method(s) of reporting issues or requesting support.</p></li> </ul> </li> <li><p>Product modules will be grouped under project-level modules.</p> <ul> <li><p>Users will be advised to do a <code class="docutils literal notranslate"><span class="pre">module</span> <span class="pre">load</span> <span class="pre"><UMS</span> <span class="pre">project></span></code>, which will expose modules for the individual products associated with that project, accessed by a second <code class="docutils literal notranslate"><span class="pre">module</span> <span class="pre">load</span> <span class="pre"><product></span></code>.</p></li> </ul> </li> <li><p>Project PI must ensure that support is provided for users of the product, as documented in the statement of support.</p></li> <li><p>Project PI must ensure that the product is updated in response to changes in the system software environment (e.g. updates to OS, compiler, library, or other key tools) and in a timely fashion. If this commitment is not met, the OLCF may remove the software from UMS.</p></li> <li><p>Project PI must ensure that installations are tested to ensure basic functionality before being released to users. These are expected to be at minimum basic function/unit tests to ensure that the build/install was successful.</p> <ul> <li><p>The resources provided by the OLCF for UMS shall not be used for software development or for routine testing purposes beyond the installation testing as described above.</p></li> </ul> </li> <li><p>Products may be removed from UMS at the request of the Project PI by notifying the OLCF (<a class="reference external" href="mailto:help%40olcf.ornl.gov" target="_blank">help<span>@</span>olcf<span>.</span>ornl<span>.</span>gov</a>) of their intent and cleaning up their directory space.</p></li> <li><p>If a product is judged to be problematic for the OLCF, it may be removed by the OLCF staff, who will also notify the Project PI.</p></li> </ul> </section> </section> </section> </div> </div> <footer><div class="rst-footer-buttons" role="navigation" aria-label="Footer"> <a href="documents_and_forms.html" class="btn btn-neutral float-left" title="Documents and Forms" accesskey="p" rel="prev"><span class="fa fa-arrow-circle-left" aria-hidden="true"></span> Previous</a> <a href="glossary.html" class="btn btn-neutral float-right" title="Glossary" accesskey="n" rel="next">Next <span class="fa fa-arrow-circle-right" aria-hidden="true"></span></a> </div> <hr/> <div role="contentinfo"> <p>© Copyright 2025, OLCF.</p> </div> Built with <a href="https://www.sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>. </footer> </div> </div> </section> </div> <script> jQuery(function () { SphinxRtdTheme.Navigation.enable(true); }); </script> </body> </html>