Taskflow: A General-purpose Task-parallel Programming System

<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no"> <meta name="description" content=""> <meta name="author" content=""> <meta property="og:image" content="images/logo.png" /> <link rel="icon" href="favicon/favicon.ico" type="image/x-icon"> <title>Taskflow: A General-purpose Task-parallel Programming System</title>  <link rel="stylesheet" href="fontawesome/css/all.min.css"> <link rel="stylesheet" href="css/bootstrap/4.4.1/bootstrap.min.css"> <script type="text/javascript" src="js/jquery/3.4.1/jquery.min.js"></script> <script type="text/javascript" src="js/bootstrap/4.4.1/bootstrap.min.js"></script>  <script type="text/javascript" src="js/github/buttons.js"></script>  <link rel="stylesheet" href="css/tf.css"> </head> <body> <nav class="navbar navbar-expand-md navbar-light fixed-top bg-light" > <a class="navbar-brand" href="#"><img src="images/logo.png" alt="Logo" style="width:3rem;"></a> <button class="navbar-toggler" type="button" data-toggle="collapse" data-target="#navbarsExampleDefault" aria-controls="navbarsExampleDefault" aria-expanded="false" aria-label="Toggle navigation"> <span class="navbar-toggler-icon"></span> </button> <div class="collapse navbar-collapse" id="navbarsExampleDefault"> <ul class="navbar-nav mr-auto"> <li class="nav-item"> <a class="nav-link" href="#tag_news">News</a> </li> <li class="nav-item"> <a class="nav-link" href="#tag_features">Features</a> </li> <li class="nav-item"> <a class="nav-link" href="#tag_applications">Applications</a> </li> <li class="nav-item"> <a class="nav-link" href="#tag_community">Community</a> </li> <li class="nav-item"> <a class="nav-link" href="#tag_users">Users</a> </li> <li class="nav-item"> <a class="nav-link" href="#tag_sponsors">Sponsors</a> </li> <li class="nav-item"> <a class="nav-link" href="#tag_contact">Contact</a> </li>  </ul>  <a class="github-button" href="https://github.com/taskflow/taskflow" data-size="large" data-show-count="true" aria-label="Star taskflow/taskflow on GitHub">Star</a> </div> </nav> <main role="main">  <div class="jumbotron jumbotron-fluid jumbotron-title"> <div class="container"> <h1><b>Taskflow </b><img src="images/logo.png" alt="Logo" style="width:2.5rem;"></h1> <blockquote class="blockquote"> <p class="mb-0">A General-purpose Task-parallel Programming System</p> <footer class="blockquote-footer"><cite style="color:#f5f5f5">write parallel programs with high performance and simultaneous high productivity</cite></footer> </blockquote> <p><a class="btn btn-primary btn-lg mr-2 mt-2" href="https://github.com/taskflow/taskflow" role="button">GitHub »</a> <a class="btn btn-info btn-lg mr-2 mt-2" href="https://taskflow.github.io/taskflow/index.html" role="button">Handbook »</a> <a class="btn btn-warning btn-lg mr-2 mt-2" href="https://taskflow.github.io/taskflow/release-3-9-0.html" role="button">Releases (latest v3.9) »</a></p> </div> </div> </main> <div class="container" id="tag_news"> <div class="page-header text-center"><h1><i class="far fa-newspaper"></i> News</h1></div> <hr> <p align="center"><a class="btn btn-secondary" href="#" id="moreNews" role="button">View More News »</a></p> </div>  <div class="jumbotron jumbotron-fluid"> <div class="container" id="tag_features"> <div class="page-header text-center"><h1><i class="fas fa-check-circle"></i> Features</h1></div> <hr> <div class="row row-cols-1 row-cols-md-2"> <div class="col mb-4"> <div class="card"> <div class="card-body"> <p><img class="card-img-top" src="images/static_graph.svg" alt="Card image cap"></p> <h5 class="card-title">Expressive Programming Model</h5> <p class="card-text">Taskflow enables developers to express a broad range of computational patterns using task graph-based approaches with minimal programming effort.</p> </div> </div> </div> <div class="col mb-4"> <div class="card"> <div class="card-body"> <p><img class="card-img-top" src="images/parallel_sum.png" alt="Card image cap"></p> <h5 class="card-title">Parallel Algorithm Primitives</h5> <p class="card-text">Taskflow offers parallel algorithm primitives for quickly expressing common parallel algorithm patterns.</p> </div> </div> </div> <div class="col mb-4"> <div class="card"> <div class="card-body"> <p><img class="card-img-top" src="images/runtime.png" alt="Card image cap"></p> <h5 class="card-title">Efficient System Runtime</h5> <p class="card-text">Taskflow develops a highly efficient system runtime optimized for latency, energy efficiency, and throughput.</p> </div> </div> </div> <div class="col mb-4"> <div class="card"> <div class="card-body"> <p><img class="card-img-top" src="images/performance.png" alt="Card image cap"></p> <h5 class="card-title">Scalable to Millions of Tasks</h5> <p class="card-text">Taskflow has demonstrated promising performance in large parallel applications with millions of CPU and GPU tasks.</p> </div> </div> </div> </div> </div> </div>  <div class="container" id="tag_applications"> <div class="page-header text-center"><h1><i class="fas fa-tools"></i> Applications</h1></div> <hr> <div class="card mb-3"> <img class="card-img-top" src="images/cad.jpg" alt="Card image cap"> <div class="card-body"> <h5 class="card-title">Parallelizing Computer-aided Design (CAD) Software</h5> <p class="card-text">We have successfully applied Taskflow to assist developers in the implementation and deployment of parallel CAD algorithms and software that scale to millions of tasks on manycore CPUs and GPUs.</p> <a class="btn btn-success" href="https://taskflow.github.io/taskflow/opentimer.html" role="button">Explore Details »</a> </div> </div> <div class="card mb-3"> <img class="card-img-top" src="images/quantum-computing.jpeg" alt="Card image cap"> <div class="card-body"> <h5 class="card-title">Parallelizing Classical Software for Quantum Computing</h5> <p class="card-text">We have successfully applied Taskflow to accelerate the simulation of quantum circuits in both static and dynamic environments using scalable task parallelism.</p> <a class="btn btn-success" href="https://arxiv.org/abs/2210.01076" role="button">Explore Details »</a> </div> </div> <div class="card mb-3"> <img class="card-img-top" src="images/machine-learning.jpg" alt="machine-learning"> <div class="card-body"> <h5 class="card-title">Computing Large-scale Machine Learning Workloads</h5> <p class="card-text">We have successfully applied Taskflow to design efficient model- and data-parallel algorithms for scaling up large-scale machine learning workloads that incorporate billions of parameters.</p> <a class="btn btn-success" href="https://github.com/dian-lun-lin/SNIG" role="button">Explore Details »</a> </div> </div> </div>  <div class="jumbotron jumbotron-fluid"> <div class="container" id="tag_community"> <div class="page-header text-center"><h1><i class="fas fa-project-diagram"></i> Community</h1></div> <hr>  <div class="row"> <div class="col-md-6"> <h2><i class="fab fa-github"></i> GitHub</h2> <p>Taskflow is open-source on GitHub. Check out the code from <a href="https://github.com/taskflow/taskflow">https://github.com/taskflow/taskflow</a> or download the latest releases.</p> </div> <div class="col-md-6"> <div class="align-left"> <i class="icon-chat sev_icon"></i> </div> <h2><i class="fas fa-book"></i> Documentation</h2> <p>Taskflow <a href="https://taskflow.github.io/taskflow/index.html">handbook</a> is the primary resource for understanding features, concepts, and application programming interface (API).</p> </div> </div> <br> <div class="row"> <div class="col-md-6"> <h2><i class="fas fa-chart-bar"></i> Profiler</h2> <p>Taskflow <a href="https://taskflow.github.io/tfprof/">profiler</a> provides the visualization and tooling you need to profile Taskflow programs on the web.</a> </div> <div class="col-md-6"> <h2><i class="fas fa-file-powerpoint"></i> Showcase</h2> <p>Taskflow <a href="showcase/index.html">showcase presentation</a> gives you a quick head start to understand the project motivation and important features.</a> </div> </div> <br> <div class="row"> <div class="col-md-6"> <h2><i class="fas fa-bug"></i> Issue Tracker</h2> <p>Taskflow <a href="https://github.com/taskflow/taskflow/issues">issue tracker</a> lets you report bugs, request new features, or contribute to the project by fixing open issues.</a> </div> <div class="col-md-6"> <div class="align-left"> <i class="icon-chat sev_icon"></i> </div> <h2><i class="fas fa-mail-bulk"></i> Mailing List</h2> <p>Taskflow <a href="#tag_contact">mailing list</a> keeps you in contact with the project community and stay up-to-date with newest features.</p> </div> </div> <br> <div class="row"> <div class="col-md-12"> <h2><i class="fas fa-quote-right"></i> Research</h2> <p>Please refer to and cite the following paper if you are using Taskflow in your scientific computing projects:</p> <ul> <li>T.-W. Huang, D.-L. Lin, C.-X. Lin, and Y Lin, "<a href="papers/tpds21-taskflow.pdf">Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System</a>," <i>IEEE Transactions on Parallel and Distributed Systems (TPDS)</i>, vol. 33, no. 6, pp. 1303-1320, June 2022.</li> </ol> </div> </div> <div class="row"> <div class="col-md-12"> <h2><i class="fas fa-award"></i> Recognition</h2> <ol> <li>Second Place of Fast Code Programming Challenge at the 2025 ACM PPoPP (<a href="https://fastcode.org/events/fastcode-challenge/">Link</a>)</li> <li>Innovation Award of the 2023 IEEE HPEC/MIT/Amazon Stochastic Block Partition Challenge (<a href="https://graphchallenge.mit.edu/champions">Link</a>)</li> <li>Champion Award of the 2020 IEEE HPEC/MIT/Amazon Sparse Neural Network Graph Challenge (<a href="https://graphchallenge.mit.edu/champions">Link</a>)</li> <li>Second Place of Open-Source Software Competition at the 2019 ACM Multimedia Conference</li> <li>ACM SIGDA Outstanding PhD Dissertation Award at the 2019 ACM/IEEE Design Automation Conference (<a href="http://www.sigda.org/awards/opda/">Link</a>)</li> <li>Best Poster Award at the 2018 Official C++ Conference, voted by hundreds of developers</li> </ol> </div> </div> </div>  </div>  <div class="container" id="tag_users"> <div class="page-header text-center"><h1><i class="fas fa-users"></i> Users</h1></div> <hr> <div class="row align-items-center"> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/OpenTimer/OpenTimer"><img src="images/opentimer.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://ossia.io/"><img src="images/ossia.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://www.dealii.org/"><img src="images/dealii.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://www.mydatamodels.com/"><img src="images/mydatamodels.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://www.xanadu.ai/"><img src="images/xanadu-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/masc-ucsc/livehd"><img src="images/liveHD.png" style="width: 100%;"></a> </div> </div>  <div class="row align-items-center"> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://rosindustrial.org/ric"><img src="images/ROS.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="http://www.revealtech.ai/"><img src="images/reveal-tech.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://intsights.com/"><img src="images/PyRepScan.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/dian-lun-lin/SNIG"><img src="images/snig.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/GrokImageCompression/grok"><img src="images/grok-logo.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://www.vlsisystemdesign.com/"><img src="images/VSD.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://theopenroadproject.org/"><img src="images/openroad.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/heal-research/operon"><img src="images/operon-logo.png" style="width: 100%;"></a> </div> </div>   <div class="row align-items-center mb-4"> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/RavEngine/RavEngine"><img src="images/ravengine-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://nvidia.com"><img src="images/nvidia-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/ExplosionEngine/Explosion"><img src="images/explosion-logo.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/egorodet/MethaneKit"><img src="images/Methane-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/maxbachmann/RapidFuzz"><img src="images/rapidfuzz-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://research.jetbrains.org/"><img src="images/jetbrains-research-logo.jpeg" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/KomodoPlatform/atomicDEX-Desktop"><img src="images/atomicdex-logo.png" style="width: 100%;"></a> </div> </div>  <div class="row align-items-center mb-4"> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://open-ephys.org/"><img src="images/openephys-logo.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/GauravDawra/Beast"><img src="images/beast-logo.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/fragcolor-xyz/shards"><img src="images/shards-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://github.com/rapidsai/cucim.git"><img src="images/rapids-cucim-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://www.amd.com/en.html/"><img src="images/amd-logo.webp" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/tesseract-robotics"><img src="images/tesseract-logo.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/NcStudios/NcEngine"><img src="images/ncengine-logo.png" style="width: 100%;"></a> </div> <div class="col-md-1 col-sm-1 vertical-align"> <a href="https://github.com/NcStudios/NcEngine"><img src="images/cocos-logo.png" style="width: 100%;"></a> </div> <div class="col-md-2 col-sm-2 vertical-align"> <a href="https://www.cda.cit.tum.de/research/quantum/mqt/"><img src="images/mqt-logo.png" style="width: 100%;"></a> </div> </div>  <div class="row align-items-center mb-4"> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://www.moduleworks.com/"><img src="images/moduleworks-logo.png" style="width: 100%;"></a> </div> </div> </div>  <div class="jumbotron jumbotron-fluid jumbotron-sponsors"> <div class="container" id="tag_sponsors"> <div class="page-header text-center"><h1><i class="fas fa-hands-helping"></i> Sponsors</h1></div> <hr> <div class="row align-items-center"> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://www.ece.utah.edu/"><img src="images/utah-ece-logo.png" style="width: 100%;"></a> </div> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://www.darpa.mil/"><img src="images/darpa.png" style="width: 100%;"></a> </div> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://www.nsf.gov/"><img src="images/nsf.png" style="width: 100%;"></a> </div> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://numfocus.org/"><img src="images/NumFocus.png" style="width: 100%;"></a> </div> </div> <div class="row align-items-center"> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://www.nvidia.com/en-us/"><img src="images/nvidia-logo.png" style="width: 100%;"></a> </div> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://summerofcode.withgoogle.com/"><img src="images/gsoc.png" style="width: 100%;"></a> </div> <div class="col-md-3 col-sm-3 vertical-align"> <a href="https://engineering.wisc.edu/departments/electrical-computer-engineering/"><img src="images/uw-madison-ece-logo.png" style="width: 100%;"></a> </div> </div> </div> </div>  <div class="container" id="tag_contact"> <div class="page-header text-center"><h1><i class="fas fa-envelope-open"></i> Contact</h1></div> <hr> <p class="lead" align="center">Schedule a meeting and benefit from our experience in parallel and heterogeneous computing</p> <form action="https://formspree.io/mbjzekzn" method="POST" role="form"> <div class="messages"></div> <div class="controls"> <div class="row"> <div class="col-md-6"> <div class="form-group"> <label for="form_name">First Name *</label> <input id="form_name" type="text" name="name" class="form-control" placeholder="Please enter your first name" required="required" data-error="Firstname is required."> <div class="help-block with-errors"></div> </div> </div> <div class="col-md-6"> <div class="form-group"> <label for="form_lastname">Last Name *</label> <input id="form_lastname" type="text" name="surname" class="form-control" placeholder="Please enter your last name" required="required" data-error="Lastname is required."> <div class="help-block with-errors"></div> </div> </div> </div> <div class="row"> <div class="col-md-6"> <div class="form-group"> <label for="form_email">Email *</label> <input id="form_email" type="email" name="email" class="form-control" placeholder="Please enter your email" required="required" data-error="Valid email is required."> <div class="help-block with-errors"></div> </div> </div> <div class="col-md-6"> <div class="form-group"> <label for="form_need">Please specify your need *</label> <select id="form_need" name="need" class="form-control" required="required" data-error="Please specify your need."> <option value="Subscribe">Subscribe me to the mailing list</option> <option value="Unsubscribe">Unsubscribe me from the mailing list</option> <option value="Request new features">Request new features</option> <option value="Schedule presentation">Schedule a technical presentation</option> <option value="Sponsor taskflow">Sponsor Taskflow (research gift, donation, consulting, etc.)</option> <option value="Other">Other</option> </select> <div class="help-block with-errors"></div> </div> </div> </div> <div class="row"> <div class="col-md-12"> <div class="form-group"> <label for="form_message">Message</label> <textarea id="form_message" name="message" class="form-control" placeholder="Message for me" rows="4"></textarea> <div class="help-block with-errors"></div> </div> </div> <div class="col-md-12"> <input type="submit" class="btn btn-success btn-send" value="Send message"> </div> </div> </div> </form> </div>  <hr> <footer class="text-center"> <p>© <a href="https://tsung-wei-huang.github.io/">Taskflow Team</a>, University of Wisconsin at Madison 2019-2023</p> </footer> </body> <script src="js/news.js"></script> <script src="js/index.js"></script> </html>

CINXE.COM

Taskflow: A General-purpose Task-parallel Programming System