CINXE.COM
FOSDEM 2021 - buildtest: HPC Testing Framework for Acceptance Testing
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en"> <head profile="http://a9.com/-/spec/opensearch/1.1/" prefix="og: http://ogp.me/ns#"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0"/> <meta name="generator" content="nanoc"/> <link rel="apple-touch-icon" sizes="120x120" href="/2021/apple-touch-icon.png" /> <link rel="icon" type="image/png" href="/2021/favicon-32x32.png" sizes="32x32" /> <link rel="icon" type="image/png" href="/2021/favicon-16x16.png" sizes="16x16" /> <link rel="manifest" href="/2021/manifest.json" /> <link rel="mask-icon" href="/2021/safari-pinned-tab.svg" color="#af2c93" /> <meta name="msapplication-TileColor" content="#af2c93"/> <meta name="theme-color" content="#ffffff" /> <link media="all" rel="stylesheet" type="text/css" href="/2021/assets/style/fosdem-1df2d7d48d3e43776f7285ddffdbb20e2d15457b668de6b890f46adb6a16bee4.css" /> <link href="/2021/atom.xml" type="application/atom+xml" rel="alternate" title="FOSDEM 2021 ATOM Feed"/> <link href="/2021/rss.xml" type="application/rss+xml" rel="alternate" title="FOSDEM 2021 RSS Feed"/> <link href="/2021/opensearch.xml" type="application/opensearchdescription+xml" title="FOSDEM 2021 Search"/> <title>FOSDEM 2021 - buildtest: HPC Testing Framework for Acceptance Testing</title> <link rel="schema.DC" href="http://purl.org/DC/elements/1.0/" /> <meta name="DC.Title" content="buildtest: HPC Testing Framework for Acceptance Testing"/> <meta name="DC.Format" content="text/html" /> <meta name="DC.Language" content="en" /> <meta name="DC.Subject" content="FOSDEM 2021" /> <meta name="DC.Rights" content="http://creativecommons.org/licenses/by-sa/2.0/be/" /> <meta property="og:title" content="FOSDEM 2021 - buildtest: HPC Testing Framework for Acceptance Testing" /> <meta property="og:type" content="website" /> <meta property="og:image" content="https://fosdem.org/2021/assets/style/logo-gear-7204a6874eb0128932db10ff4030910401ac06f4e907f8b4a40da24ba592b252.png" /> </head> <body class="schedule-event"> <div id="header"> <div class="header-holder"> <h1 class="logo"><a href="/2021/">FOSDEM21</a></h1> <ul id="nav"> <li class="home"><a href="/2021/">Home</a></li> <li><a href="/2021/about/">About</a></li> <li><a href="/2021/news/">News</a></li> <li class="active"><a href="/2021/schedule/">Schedule</a></li> <li><a href="https://stands.fosdem.org">Stands</a></li> <li><a href="/2021/volunteer/">Volunteer</a></li> <li><a href="/2021/practical/">Practical</a></li> </ul> <!-- #nav --> </div> <!-- .header-holder --> </div> <!-- #header --> <div class="title-box"> <div class="holder"> <div class="frame"> <div class="text-block"> <h2>Online <span>/</span> <strong>6 & 7 February 2021</strong></h2> <a class="btn-purple" href="/2021/live/">visit</a> </div> <ul class="navbar"> <li><a href="/2021/news/">News</a></li> <li><a href="/2021/about/sponsors/">Sponsors</a></li> <li><a href="/2021/contact/">Contact</a></li> </ul> </div> </div> </div> <!-- .title-box --> <div id="main"> <ul class="breadcrumbs"> <li><a href="/2021/">FOSDEM 2021</a></li><li class="separator">/</li><li><a href="/2021/schedule/">Schedule</a></li><li class="separator">/</li><li><a href="/2021/schedule/events/">Events</a></li><li class="separator">/</li><li>Developer rooms</li><li class="separator">/</li><li><a href="/2021/schedule/track/hpc_big_data_and_data_science/">HPC, Big Data and Data Science</a></li><li class="separator">/</li><li class="active">buildtest: HPC Testing Framework for Acceptance Testing</li> </ul> <div id="pagetitles"> <h1>buildtest: HPC Testing Framework for Acceptance Testing</h1> </div> <ul class="side-box"> <li><i class="icon-road"></i> <strong>Track</strong>: <a href="/2021/schedule/track/hpc_big_data_and_data_science/">HPC, Big Data and Data Science devroom</a></li> <li><i class="icon-home"></i> <strong>Room</strong>: <a href="/2021/schedule/room/dhpc/">D.hpc</a></li> <li><i class="icon-calendar"></i> <strong>Day</strong>: <a href="/2021/schedule/day/sunday/">Sunday</a></li> <li><i class="icon-play"></i> <strong>Start</strong>: <a class="value-title" title="2021-02-07T16:00:00+01:00" href="/2021/schedule/day/sunday/#1600">16:00</a></li> <li><i class="icon-stop"></i> <strong>End</strong>: <a class="value-title" title="2021-02-07T16:30:00+01:00" href="/2021/schedule/day/sunday/#1630">16:30</a></li> <li> <i class="icon-facetime-video"></i> <strong>Video with Q&A</strong>: <a href="https://chat.fosdem.org/#/room/#hpc:fosdem.org">D.hpc</a> </li> <li id="live-stream-with-q-and-a" class="visible-desktop"> <i class="icon-film"></i> <strong>Video only</strong>: <a href="https://live.fosdem.org/watch/dhpc">D.hpc</a> </li> <li> <i class="icon-comment"></i> <strong>Chat</strong>: <a href="https://matrix.to/#/#hpc:fosdem.org?web-instance[element.io]=chat.fosdem.org">Join the conversation!</a> </li> </ul> <br style="clear: both;"/> <div class="event-blurb"> <div class="event-abstract"><p>Buildtest (https://buildtest.readthedocs.io/) is an HPC testing framework to aid HPC facilities to perform acceptance testing for their system. HPC systems are growing in complexity, with a tightly coupled software and system stack that requires a degree of automation and continuous testing. In the past decade, two build frameworks (Spack, EasyBuild) have emerged and widely used in HPC community for automating build & installation process for scientific software. On the contrary, testing frameworks for HPC systems are limited to a few handful (ReFrame, Pavilion2, buildtest) that are in active development.</p> <p>In buildtest, users will write test recipes in YAML called buildspecs that buildtest process to generate a shell script. buildtest utilizes versioned-based JSON Schema for validating buildspecs and currently, we support two main schemas (compiler, script). The script schema and compiler schema are used for writing traditional shell-scripts (bash, sh, csh), python-scripts and single source compilation test. In this talk we will present an overview of buildtest and how one can write buildspecs. Furthermore, we will discuss Cori Testsuite (https://github.com/buildtesters/buildtest-cori) in buildtest with several real examples on testing various components for Cori system at NERSC.</p></div> <div class="event-description"></div> </div> <div class="video"> <video preload="none" controls="controls"> <source src="https://video.fosdem.org/2021/D.hpc/buildtest.webm" type='video/webm; codecs="vp9, opus"' /> </video> </div> <h3>Speakers</h3> <table> <tbody> <tr> <td><a href="/2021/schedule/speaker/shahzeb_siddiqui/"><img class="thumb" height="32" width="32" src="/2021/schedule/speaker/shahzeb_siddiqui/989b82f553cf45f68d88b3fb4e7bafbbe2df16873a08bb19936f1144d43435f9.png" alt="Photo of Shahzeb Siddiqui"/></a></td> <td><a href="/2021/schedule/speaker/shahzeb_siddiqui/">Shahzeb Siddiqui</a></td> </tr> </tbody> </table> <h3>Attachments</h3> <ul class="event-attachments unstyled"> <li><i class="icon-download"></i> <a href="/2021/schedule/event/buildtest/attachments/slides/4399/export/events/attachments/buildtest/slides/4399/buildtest_fosdem21.pdf">buildtest: HPC Testing Framework for Acceptance Testing (slides)</a></li> </ul> <h3>Links</h3> <ul> <li><a href="https://github.com/buildtesters/buildtest">GitHub Project</a></li> <li><a href="https://buildtest.readthedocs.io/en/devel/">Documentation</a></li> <li><a href="https://buildtesters.github.io/buildtest/">Schema Docs</a></li> <li><a href="https://video.fosdem.org/2021/D.hpc/buildtest.webm">Video recording (WebM/VP9)</a></li> <li><a href="https://video.fosdem.org/2021/D.hpc/buildtest.mp4">Video recording (mp4)</a></li> <li><a href="https://submission.fosdem.org/feedback/11083.php">Submit feedback</a></li> </ul> </div> <!-- #main --> <div id="footer"> <div class="footer-holder"> <div class="panel-block"> <div class="panel-column"> <h3>FOSDEM</h3> <ul class="panel"> <li class="home"><a accesskey="1" href="/2021/">Home</a></li> <li><a accesskey="2" href="/2021/news/">News</a></li> <li><a href="/2021/about/">About</a></li> <li><a href="/2021/about/sponsors/">Sponsors</a></li> <li><a href="/2021/support/donate/">Donate</a></li> <li><a href="/2021/tshirts/">T-shirts and hoodies</a></li> <li><a accesskey="5" href="/2021/faq/">FAQ</a></li> <li><a href="/2021/archives/">Archives</a></li> </ul> </div> <!-- .panel-column --> <div class="panel-column"> <h3>This year</h3> <ul class="panel"> <li><a href="/2021/live/">Visit</a></li> <li><a accesskey="s" href="/2021/schedule/">Schedule</a></li> <li><a href="/2021/stands/">Stands</a></li> <li><a href="/2021/certification/">Certification exams</a></li> <li><a href="/2021/tshirts/">T-shirts and hoodies</a></li> <li><a href="/2021/volunteer/">Volunteer</a></li> <li><a href="/2021/fringe/">Fringe</a></li> </ul> </div> <!-- .panel-column --> <div class="panel-column"> <h3>Practical information</h3> <ul class="panel"> <li><a href="/2021/practical/online/">FOSDEM 2021 Online</a></li> <li><a href="/2021/practical/matrix_troubleshooting/">Troubleshooting Matrix at FOSDEM 2021</a></li> <li><a href="/2021/tshirts/">T-shirts and hoodies</a></li> <li><a href="/2021/practical/accessibility/">Accessibility</a></li> <li><a href="/2021/practical/conduct/">Code of Conduct</a></li> <li><a href="/2021/practical/services/">During the Event</a></li> </ul> </div> <!-- .panel-column --> <div class="panel-column"> <h3>Media and press</h3> <ul class="panel"> <li><a href="/2021/social/">Social media</a></li> </ul> </div> <!-- .panel-column --> </div> <!-- .panel-block --> <div class="company-info"> <div class="company-info-logo"></div> <strong class="logo-small"><a href="/2021/schedule/">FOSDEM21</a></strong> <p>Online <span>/</span> <strong>6 & 7 February 2021</strong></p> </div> <div class="license-info"> <div class="license-info-logo"></div> This work is licensed under the Creative Commons Attribution 2.0 Belgium Licence.<br/> To view a copy of this licence, visit <a class="quiet" rel="license" href="http://creativecommons.org/licenses/by/2.0/be/deed.en">http://creativecommons.org/licenses/by/2.0/be/deed.en</a><br/> or send a letter to Creative Commons, 444 Castro Street, Suite 900, Mountain View, California, 94041, USA.<br /> All content such as talks and biographies is the sole responsibility of the speaker. </div> </div> </div> </body> </html>