Community Blog | PyTorch

<!DOCTYPE html> <html lang="en"> <head>  <script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= 'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-T8XT4PS');</script>  <meta charset="UTF-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <meta http-equiv="X-UA-Compatible" content="ie=edge"> <link rel="shortcut icon" type="image/x-icon" href="/favicon.ico?"> <title> Community Blog | PyTorch </title> <meta name="robots" content="index, follow" /> <meta name="description" content="" /> <meta property="og:image" content="https://pytorch.org/assets/images/social-share.jpg" /> <meta name="twitter:image" content="https://pytorch.org/assets/images/social-share.jpg" /> <meta property="og:locale" content="en_US" /> <meta property="og:type" content="website" /> <meta property="og:title" content="Community Blog" /> <meta property="og:description" content="" /> <meta property="og:site_name" content="PyTorch" /> <meta name="twitter:card" content="summary_large_image" /> <meta name="twitter:title" content="Community Blog" /> <meta name="twitter:description" content="" /> <link rel="stylesheet" href="/assets/main.css"> <script src="/assets/vendor/jquery.min.js"></script> <script src="/assets/vendor/popper.min.js"></script> <script src="/assets/vendor/bootstrap.min.js"></script> <script src="/assets/vendor/anchor.min.js"></script> <script type="text/x-mathjax-config"> MathJax.Hub.Config({ tex2jax: { skipTags: ['script', 'noscript', 'style', 'textarea', 'pre'], inlineMath: [['$','$']] } }); </script> <script src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML" type="text/javascript"></script> <script type="text/javascript" src="https://cdn.jsdelivr.net/npm/docsearch.js@2/dist/cdn/docsearch.min.js"></script> <script> !function(f,b,e,v,n,t,s) {if(f.fbq)return;n=f.fbq=function(){n.callMethod? n.callMethod.apply(n,arguments):n.queue.push(arguments)}; if(!f._fbq)f._fbq=n;n.push=n;n.loaded=!0;n.version='2.0'; n.queue=[];t=b.createElement(e);t.async=!0; t.src=v;s=b.getElementsByTagName(e)[0]; s.parentNode.insertBefore(t,s)}(window,document,'script', 'https://connect.facebook.net/en_US/fbevents.js'); fbq('init', '243028289693773'); fbq('track', 'PageView'); </script> <noscript> <img height="1" width="1" src="https://www.facebook.com/tr?id=243028289693773&ev=PageView &noscript=1"/> </noscript>  <img height="1" width="1" style="display:none;" alt="" src="https://analytics.twitter.com/i/adsct?p_id=Twitter&p_user_id=0&txn_id=o2gi1&events=%5B%5B%22pageview%22%2Cnull%5D%5D&tw_sale_amount=0&tw_order_quantity=0 (https://urldefense.proofpoint.com/v2/url?u=https-3A__analytics.twitter.com_i_adsct-3Fp-5Fid-3DTwitter-26p-5Fuser-5Fid-3D0-26txn-5Fid-3Do2gi1-26events-3D-255B-255B-2522pageview-2522-252Cnull-255D-255D-26tw-5Fsale-5Famount-3D0-26tw-5Forder-5Fquantity-3D0&d=DwMGaQ&c=5VD0RTtNlTh3ycd41b3MUw&r=GMr8XYCDyeQQZuD3noL91A&m=dAJyokk16UvYy-vMrGn_JwYiGfp_eEgo25B9iGDCG-A&s=o6i4D0V0088WH2RnzIoqiF-vj45PL-2sTrsxQ0SNO3A&e=)" /> <img height="1" width="1" style="display:none;" alt="" src="//t.co/i/adsct?p_id=Twitter&p_user_id=0&txn_id=o2gi1&events=%5B%5B%22pageview%22%2Cnull%5D%5D&tw_sale_amount=0&tw_order_quantity=0 (https://urldefense.proofpoint.com/v2/url?u=https-3A__linkprotect.cudasvc.com_url-3Fa-3Dhttp-253a-252f-252ft.co-252fi-252fadsct-253fp-5Fid-253dTwitter-2526p-5Fuser-5Fid-253d0-2526txn-5Fid-253do2gi1-2526events-253d-25255B-25255B-252522pageview-252522-25252Cnull-25255D-25255D-2526tw-5Fsale-5Famount-253d0-2526tw-5Forder-5Fquantity-253d0-26c-3DE-2C1-2CC33dLwIhtuEcl5FhdztSnUwsioeej5k-2DWy0RYREBAq51kGji32A2Cw94YU9vQBpY5tPN3AukEw3C-5F-2DlbtndnLoR7-5FA-5FLoH0Rr7zLtP1ykptN-26typo-3D1&d=DwMGaQ&c=5VD0RTtNlTh3ycd41b3MUw&r=GMr8XYCDyeQQZuD3noL91A&m=dAJyokk16UvYy-vMrGn_JwYiGfp_eEgo25B9iGDCG-A&s=Abgc3XBkhESv8XBYtLchdDZyISGsK6v_BB6cLMJGyCw&e=)" />  <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/docsearch.js@2/dist/cdn/docsearch.min.css" /> <link href="/feed.xml" type="application/atom+xml" rel="alternate" title="Pythorch Blog Posts" /> </head> <body class="blog">  <noscript><iframe src="https://www.googletagmanager.com/ns.html?id=GTM-T8XT4PS" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript>  <div class="hello-bar"> <div class="container"> Join us at PyTorch Conference in San Francisco, October 22-23. CFP open now! <a target="_blank" href="https://events.linuxfoundation.org/pytorch-conference/">Learn more</a>. </div> </div> <div class="container-fluid header-holder blog-header"> <div class="container"> <div class="header-container"> <a class="header-logo" href="https://pytorch.org" aria-label="PyTorch"></a> <div class="main-menu"> <ul> <li class="main-menu-item"> <div id="dropdownMenuButton" data-toggle="resources-dropdown" class="resources-dropdown"> <a class="with-down-arrow"> Learn </a> <div class="resources-dropdown-menu"> <a class="nav-dropdown-item" href="/get-started"> <span class=dropdown-title>Get Started</span> <p>Run PyTorch locally or get started quickly with one of the supported cloud platforms</p> </a> <a class="nav-dropdown-item" href="https://pytorch.org/tutorials/"> <span class="dropdown-title">Tutorials</span> <p>Whats new in PyTorch tutorials</p> </a> <a class="nav-dropdown-item" href="https://pytorch.org/tutorials/beginner/basics/intro.html"> <span class="dropdown-title">Learn the Basics</span> <p>Familiarize yourself with PyTorch concepts and modules</p> </a> <a class="nav-dropdown-item" href="https://pytorch.org/tutorials/recipes/recipes_index.html"> <span class="dropdown-title">PyTorch Recipes</span> <p>Bite-size, ready-to-deploy PyTorch code examples</p> </a> <a class="nav-dropdown-item" href="https://pytorch.org/tutorials/beginner/introyt.html"> <span class="dropdown-title">Intro to PyTorch - YouTube Series</span> <p>Master PyTorch basics with our engaging YouTube tutorial series</p> </a> <a class="nav-dropdown-item" href="/new"> <span class="dropdown-title">New to PyTorch Foundation</span> </a> </div> </div> </li> <li class="main-menu-item"> <div id="dropdownMenuButton" data-toggle="resources-dropdown" class="resources-dropdown"> <a class="with-down-arrow"> Ecosystem </a> <div class="resources-dropdown-menu"> <a class="nav-dropdown-item" href="https://landscape.pytorch.org/" target="_blank"> <span class="dropdown-title">Tools</span> <p>Learn about the tools and frameworks in the PyTorch Ecosystem</p> </a> <a class="nav-dropdown-item" href="https://github.com/pytorch-fdn/ecosystem" target="_blank"> <span class="dropdown-title">Join the Ecosystem</span> </a> <a class="nav-dropdown-item" href="/#community-module"> <span class=dropdown-title>Community</span> <p>Join the PyTorch developer community to contribute, learn, and get your questions answered.</p> </a> <a class="nav-dropdown-item" href="https://discuss.pytorch.org" target="_blank"> <span class=dropdown-title>Forums</span> <p>A place to discuss PyTorch code, issues, install, research</p> </a> <a class="nav-dropdown-item" href="/resources"> <span class=dropdown-title>Developer Resources</span> <p>Find resources and get questions answered</p> </a> <a class="nav-dropdown-item" href="/ecosystem/contributor-awards-2024"> <span class="dropdown-title">Contributor Awards - 2024</span> <p>Award winners announced at this year's PyTorch Conference</p> </a> </div> </div> </li> <li class="main-menu-item"> <div id="dropdownMenuButton" data-toggle="resources-dropdown" class="resources-dropdown"> <a class="with-down-arrow"> Edge </a> <div class="resources-dropdown-menu"> <a class="nav-dropdown-item" href="/edge"> <span class="dropdown-title">About PyTorch Edge</span> <p>Build innovative and privacy-aware AI experiences for edge devices</p> </a> <a class="nav-dropdown-item" href="/executorch-overview"> <span class="dropdown-title">ExecuTorch</span> <p>End-to-end solution for enabling on-device inference capabilities across mobile and edge devices</p> </a> <a class="nav-dropdown-item" target="_blank" href="https://pytorch.org/executorch/stable/index.html"> <span class="dropdown-title">ExecuTorch Documentation</span> </a> </div> </div> </li> <li class="main-menu-item"> <div id="docsDropdownButton" data-toggle="resources-dropdown" class="resources-dropdown"> <a class="with-down-arrow"> Docs </a> <div class="resources-dropdown-menu"> <a class="nav-dropdown-item" href="https://pytorch.org/docs"> <span class="dropdown-title">PyTorch</span> <p>Explore the documentation for comprehensive guidance on how to use PyTorch.</p> </a> <a class="nav-dropdown-item" href="/pytorch-domains"> <span class="dropdown-title">PyTorch Domains</span> <p> Read the PyTorch Domains documentation to learn more about domain-specific libraries.</p> </a> </div> </div> </li> <li class="main-menu-item"> <div id="dropdownMenuButton" data-toggle="resources-dropdown" class="resources-dropdown"> <a class="with-down-arrow"> Blog & News </a> <div class="resources-dropdown-menu"> <a class="nav-dropdown-item" href="/blog"> <span class="dropdown-title">PyTorch Blog</span> <p>Catch up on the latest technical news and happenings</p> </a> <a class="nav-dropdown-item" href="/community-blog"> <span class="dropdown-title">Community Blog</span> <p>Stories from the PyTorch ecosystem</p> </a> <a class="nav-dropdown-item" href="/videos"> <span class="dropdown-title">Videos</span> <p>Learn about the latest PyTorch tutorials, new, and more </p> </a> <a class="nav-dropdown-item" href="/community-stories"> <span class="dropdown-title">Community Stories</span> <p>Learn how our community solves real, everyday machine learning problems with PyTorch</p> </a> <a class="nav-dropdown-item" href="/events"> <span class=dropdown-title>Events</span> <p>Find events, webinars, and podcasts</p> </a> <a class="nav-dropdown-item" href="/newsletter"> <span class=dropdown-title>Newsletter</span> <p>Stay up-to-date with the latest updates</p> </a> </div> </div> </li> <li class="main-menu-item"> <div id="resourcesDropdownButton" data-toggle="resources-dropdown" class="resources-dropdown"> <a class="with-down-arrow"> About </a> <div class="resources-dropdown-menu"> <a class="nav-dropdown-item" href="/foundation"> <span class=dropdown-title>PyTorch Foundation</span> <p>Learn more about the PyTorch Foundation.</p> </a> <a class="nav-dropdown-item" href="/governing-board"> <span class=dropdown-title>Governing Board</span> </a> <a class="nav-dropdown-item" href="/credits"> <span class=dropdown-title>Cloud Credit Program</span> </a> <a class="nav-dropdown-item" href="/tac"> <span class=dropdown-title>Technical Advisory Council</span> </a> <a class="nav-dropdown-item" href="/staff"> <span class=dropdown-title>Staff</span> </a> <a class="nav-dropdown-item" href="/contact-us"> <span class=dropdown-title>Contact Us</span> </a> </div> </div> </li> <li class="main-menu-item"> <a href="/join" data-cta="join"> Become a Member </a> </li> <li class="main-menu-item" id="github-main-menu-link"> <a href="https://github.com/pytorch/pytorch" title="Go to PyTorch GitHub"> <div id="topnav-gh-icon"></div> </a> </li> <li class="navSearchWrapper reactNavSearchWrapper" key="search"> <div class="search-border"> <div id="search-icon"></div> <input id="search-input" type="text" title="Search" /> <div id="close-search">X</div> </div> </li> </ul> </div> <script src="/assets/main-menu-dropdown.js"></script> <a class="main-menu-open-button" href="#" data-behavior="open-mobile-menu"></a> </div> </div> </div> <div class="main-background features-background"></div> <div class="jumbotron jumbotron-fluid contributor-jumbotron"> <div class="contributor-jumbo-text container"> <h1>Community Blog</h1> <h2 class="lead">Stories from the PyTorch Ecosystem</h2> <p>Also see <a href="/blog">the PyTorch Blog</a></p> </div> </div> <div class="main-content-wrapper"> <div class="main-content"> <div class="container"> <div class="row blog-vertical"> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">March 19, 2025</p> <h4> <a href="/blog/sglang-joins-pytorch/">SGLang Joins PyTorch Ecosystem: Efficient LLM Serving Engine</a> </h4> <p>We’re thrilled to announce that the SGLang project has been integrated into the PyTorch ecosystem! This integration ensures that SGLang aligns with PyTorch’s standards and practices, providing developers with a reliable and community-supported framework for fast and flexible serving of LLMs. </p> </div> <a href="/blog/sglang-joins-pytorch/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">March 16, 2025</p> <h4> <a href="/blog/pytorch-at-gtc/">PyTorch at GTC 2025</a> </h4> <p>GTC is coming back to San Jose on March 17–21, 2025. Join PyTorch Foundation members Arm, AWS, Google Cloud, IBM, Lightning AI, Meta, Microsoft Azure, Snowflake, and thousands of developers as we celebrate PyTorch. Together learn how AI & accelerated computing are helping humanity solve our most complex challenges. </p> </div> <a href="/blog/pytorch-at-gtc/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">March 07, 2025</p> <h4> <a href="/blog/pt-fedora-os-communities/">Powering AI with PyTorch, Fedora, and Open Source Communities</a> </h4> <p>At DevConf.IN 2025 in Pune, I had the opportunity to host a PyTorch Meetup on February 28th. The session, titled “Powering AI with PyTorch, Fedora, and Open Source Communities” was aimed at introducing PyTorch to students and professionals, explaining why PyTorch+Fedora form an ideal AI development platform. The other key aspect I covered was collaboration between open source communities. </p> </div> <a href="/blog/pt-fedora-os-communities/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">February 19, 2025</p> <h4> <a href="/blog/optimize-llms/">Optimize LLMs for Efficiency & Sustainability</a> </h4> <p>The rapid growth of large language model (LLM) applications is linked to rapid growth in energy demand. According to the International Energy Agency (IEA), data center electricity consumption is projected to roughly double by 2026 primarily driven by AI. This is due to the energy-intensive training requirements for massive LLMs – however, the increase in AI Inferencing workloads also plays a role. For example, compared with traditional search queries, a single AI inference can consume about 1...</p> </div> <a href="/blog/optimize-llms/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">February 12, 2025</p> <h4> <a href="/blog/datathon-2025/">Solve Real-Word AI Challenges with PyTorch at Datathon 2025: DataOrbit</a> </h4> <p>We’re excited to have PyTorch sponsor Datathon 2025: DataOrbit, a place where students can collaborate with a team to solve problems using real-world datasets! This event, hosted by Data Science UCSB in collaboration with Gaucho Sports Analytics and ACM@UCSB, will take place on February 22–23rd, 2025 at UC Santa Barbara, with the incredible opportunity to present your project to a panel of corporate and faculty judges – including the executive director of Pytorch! – for a chance to win prizes...</p> </div> <a href="/blog/datathon-2025/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 22, 2025</p> <h4> <a href="/blog/bringing-the-pytorch-community-together/">Bringing the PyTorch Community Together</a> </h4> <p>As we step into a new year, it’s a great moment to reflect on the incredible community events that made 2024 a memorable year for the PyTorch Foundation. Global meetups, events, and conferences brought the community together to learn, connect, and grow. Here’s a quick recap of the year’s highlights and what to expect in 2025. </p> </div> <a href="/blog/bringing-the-pytorch-community-together/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 15, 2025</p> <h4> <a href="/blog/mlops-workflow/">MLOps Workflow Simplified for PyTorch with Arm and GitHub Collaboration</a> </h4> <p>PyTorch is one of the most widely used and most powerful deep learning frameworks for training and deploying complex neural networks. It has never been easier to train and deploy AI applications, and low-cost, high-performance, energy-efficient hardware, tools, and technology for creating optimized workflows are more accessible than ever. But data science, machine learning, and devops can be deep topics unto themselves, and it can be overwhelming for developers with one specialty to see how ...</p> </div> <a href="/blog/mlops-workflow/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">December 18, 2024</p> <h4> <a href="/blog/doctr-joins-pytorch-ecosystem/">docTR joins PyTorch Ecosystem: From Pixels to Data, Building a Recognition Pipeline with PyTorch and docTR</a> </h4> <p>We’re thrilled to announce that the docTR project has been integrated into the PyTorch ecosystem! This integration ensures that docTR aligns with PyTorch’s standards and practices, giving developers a reliable, community-backed solution for powerful OCR workflows. </p> </div> <a href="/blog/doctr-joins-pytorch-ecosystem/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">December 09, 2024</p> <h4> <a href="/blog/vllm-joins-pytorch/">vLLM Joins PyTorch Ecosystem: Easy, Fast, and Cheap LLM Serving for Everyone</a> </h4> <p>We’re thrilled to announce that the vLLM project has become a PyTorch ecosystem project, and joined the PyTorch ecosystem family! </p> </div> <a href="/blog/vllm-joins-pytorch/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">September 08, 2024</p> <h4> <a href="/blog/pytorch-shanghai-notes/">PyTorch Shanghai Meetup Notes</a> </h4> <p>We are honored to successfully host the PyTorch Shanghai Meetup on August 15, 2024. This Meetup has received great attention from the industry. We invited senior PyTorch developers from Intel and Huawei as guest speakers, who shared their valuable experience and the latest technical trends. In addition, this event also attracted PyTorch enthusiasts from many technology companies and well-known universities. A total of more than 40 participants gathered together to discuss and exchange the lat...</p> </div> <a href="/blog/pytorch-shanghai-notes/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">May 12, 2024</p> <h4> <a href="/blog/enhancing-deep-learning/">Enhancing Deep Learning Workflows: PyTorch Ecosystem Tools</a> </h4> <p>Welcome to the thriving PyTorch ecosystem, where a wealth of tools and libraries await, purpose-built to elevate your experience in deep learning as a developer or researcher. The Ecosystem Tools pages host many projects from experts spanning academia, industry, application development, and machine learning. </p> </div> <a href="/blog/enhancing-deep-learning/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">May 11, 2024</p> <h4> <a href="/blog/zeus/">Deep Learning Energy Measurement and Optimization</a> </h4> <p>Zeus is an open-source toolbox for measuring and optimizing the energy consumption of deep learning workloads. Our goal is to make energy optimization based on accurate measurements as easy as possible for diverse deep learning workloads and setups by offering composable tools with minimal assumptions. </p> </div> <a href="/blog/zeus/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">May 11, 2024</p> <h4> <a href="/blog/introducing-depyf/">Introducing depyf: mastering torch.compile with ease</a> </h4> <p>We are thrilled to introduce depyf, a new project to the PyTorch ecosystem designed to help users understand, learn, and adapt to torch.compile! </p> </div> <a href="/blog/introducing-depyf/" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">February 15, 2024</p> <h4> <a href="https://medium.com/pytorch/exploring-scientific-machine-learning-pipelines-through-the-simulai-toolkit-9fda42d6c6a0">Exploring scientific machine learning pipelines through the SimulAI toolkit</a> </h4> <p>SciML, short for Scientific Machine Learning, encompasses work that merges quantitative sciences with machine learning. It has gained significant traction over the past decade, driven by the widespread availability of specialized hardware (such as GPUs and TPUs) and datasets. Additionally, it has been propelled by the overarching influence of the machine learning wave, now ingrained in the zeitgeist of our times. In this context, we’d like to introduce SimulAI, an open-source toolkit under th...</p> </div> <a href="https://medium.com/pytorch/exploring-scientific-machine-learning-pipelines-through-the-simulai-toolkit-9fda42d6c6a0" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 29, 2024</p> <h4> <a href="https://medium.com/pytorch/colossal-llama-2-low-cost-and-high-quality-domain-specific-llm-solution-using-llama-and-26d2e4b9fd92">Colossal-LLaMA-2: Low Cost and High-quality Domain-specific LLM Solution Using LLaMA and Colossal-AI</a> </h4> <p>The most prominent distinction between LLaMA-1 and LLaMA-2 lies in the incorporation of higher-quality corpora, a pivotal factor contributing to significant performance enhancements in LLaMA-2. This, coupled with its commercial availability, extends the potential for creative applications of large models within the open-source community. </p> </div> <a href="https://medium.com/pytorch/colossal-llama-2-low-cost-and-high-quality-domain-specific-llm-solution-using-llama-and-26d2e4b9fd92" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 25, 2024</p> <h4> <a href="https://medium.com/pytorch/3d-rotations-and-spatial-transformations-made-easy-with-roma-356a495a20c4">3D rotations and spatial transformations made easy with RoMa</a> </h4> <p>Struggling with quaternions, rotation vectors, right-hand rules and all these stuffs? Try RoMa: an easy-to-to-use, stable and efficient library to deal with rotations and spatial transformations in PyTorch. </p> </div> <a href="https://medium.com/pytorch/3d-rotations-and-spatial-transformations-made-easy-with-roma-356a495a20c4" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 04, 2024</p> <h4> <a href="https://medium.com/pytorch/torchdistill-a-modular-configuration-driven-framework-for-reproducible-deep-learning-and-9e0ecabf2815">torchdistill — a modular, configuration-driven framework for reproducible deep learning and knowledge distillation experiments</a> </h4> <p>This article summarizes key features and concepts of torchdistill (v1.0.0). Refer to the official documentation for its APIs and research projects. </p> </div> <a href="https://medium.com/pytorch/torchdistill-a-modular-configuration-driven-framework-for-reproducible-deep-learning-and-9e0ecabf2815" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">December 06, 2023</p> <h4> <a href="https://medium.com/pytorch/pypose-a-library-for-robot-learning-with-physics-based-optimization-861bc0bb92f1">PyPose: A Library for Robot Learning with Physics-based Optimization</a> </h4> <p>We are excited to share our new open-source library PyPose. It is a PyTorch-based robotics-oriented library that provides a set of tools and algorithms for connecting deep learning with physics-based optimization. </p> </div> <a href="https://medium.com/pytorch/pypose-a-library-for-robot-learning-with-physics-based-optimization-861bc0bb92f1" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">November 09, 2023</p> <h4> <a href="https://medium.com/pytorch/how-activation-checkpointing-enables-scaling-up-training-deep-learning-models-7a93ae01ff2d">How Activation Checkpointing enables scaling up training deep learning models</a> </h4> <p>Activation checkpointing is a technique used for reducing the memory footprint at the cost of more compute. It utilizes the simple observation that we can avoid saving intermediate tensors necessary for backward computation if we just recompute them on demand instead. </p> </div> <a href="https://medium.com/pytorch/how-activation-checkpointing-enables-scaling-up-training-deep-learning-models-7a93ae01ff2d" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">October 26, 2023</p> <h4> <a href="https://medium.com/pytorch/torch-compile-explained-ae0def293084">torch.compile, explained</a> </h4> <p>Have you ever felt overwhelmed by the complexities of torch.compile? Diving into its workings can feel like black magic, with bytecode and Python internal details that many users fail to understand, hindering them from understanding and debugging torch.compile. </p> </div> <a href="https://medium.com/pytorch/torch-compile-explained-ae0def293084" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">July 06, 2023</p> <h4> <a href="https://medium.com/pytorch/unveiling-the-power-of-semi-supervised-learning-the-unified-semi-supervised-learning-benchmark-849f42bbc32a">Unveiling the Power of Semi-Supervised Learning: The Unified Semi-Supervised Learning Benchmark</a> </h4> <p>Machine Learning models thrive on high-quality, fully-annotated data. The traditional supervised learning approach typically requires data on the scale of millions, or even billions, to train large foundational models. However, obtaining such a vast amount of labeled data is often tedious and labor-intensive. As an alternative, semi-supervised learning (SSL) aims to enhance model generalization with only a fraction of labeled data, complemented by a considerable amount of unlabeled data. This...</p> </div> <a href="https://medium.com/pytorch/unveiling-the-power-of-semi-supervised-learning-the-unified-semi-supervised-learning-benchmark-849f42bbc32a" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">June 29, 2023</p> <h4> <a href="https://medium.com/pytorch/introducing-torchopt-a-high-performance-differentiable-optimization-library-for-pytorch-37c4c0ef6ae1">Introducing TorchOpt: A High-Performance Differentiable Optimization Library for PyTorch</a> </h4> <p>Explore TorchOpt, a PyTorch-based library that revolutionizes differentiable optimization with its unified programming abstraction, high-performance distributed execution runtime, and support for various differentiation modes.” </p> </div> <a href="https://medium.com/pytorch/introducing-torchopt-a-high-performance-differentiable-optimization-library-for-pytorch-37c4c0ef6ae1" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">April 04, 2023</p> <h4> <a href="https://medium.com/pytorch/profiling-pytorch-language-models-with-octoml-profile-eda7ece6b7bd">Profiling PyTorch language models with octoml-profile</a> </h4> <p>The recent launch of PyTorch 2.0 makes it clear that the community is heavily investing in a compiler-powered future for machine learning. The new OctoML Profiler can help any user realize the full potential of these shifts in the ML landscape. </p> </div> <a href="https://medium.com/pytorch/profiling-pytorch-language-models-with-octoml-profile-eda7ece6b7bd" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">February 10, 2023</p> <h4> <a href="https://medium.com/pytorch/how-fashable-achieves-soa-realistic-ai-generated-images-using-pytorch-and-azure-machine-learning-2313c4cf5f44">How FASHABLE achieves SoA realistic AI generated images using PyTorch and Azure Machine Learning</a> </h4> <p>Fashable is a company born at XNFY Lab (a joint initiative with Microsoft). The company’s main goal is to revolutionize the world of fashion with ethical Artificial Intelligence (AI) technologies built on PyTorch framework. Fashable is focused on developing AI models that generates synthetic contents for the global fashion industry. The Fashion industry has been criticized in recent years because it generates a lot of waste and is responsible for up to 10% of global carbon dioxide output. Fas...</p> </div> <a href="https://medium.com/pytorch/how-fashable-achieves-soa-realistic-ai-generated-images-using-pytorch-and-azure-machine-learning-2313c4cf5f44" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 31, 2023</p> <h4> <a href="https://medium.com/pytorch/latest-colossal-ai-boasts-novel-automatic-parallelism-and-offers-savings-up-to-46x-for-stable-1453b48f3f02">Latest Colossal-AI boasts novel automatic parallelism and offers savings up to 46x for Stable Diffusion 2</a> </h4> <p>As a new PyTorch Ecosystem Partner, we at HPC-AI Tech look forward to working with the PyTorch community to advance AI technologies through our open source project, Colossal-AI. We are excited to join forces with the PyTorch community in this effort. </p> </div> <a href="https://medium.com/pytorch/latest-colossal-ai-boasts-novel-automatic-parallelism-and-offers-savings-up-to-46x-for-stable-1453b48f3f02" class="btn btn-lg with-right-arrow"> Read More </a> </div> <div class="vertical-blog-container"> <div class="col-md-4"> <p class="blog-date">January 06, 2023</p> <h4> <a href="https://medium.com/pytorch/distributed-training-with-pytorch-and-azure-ml-898429139098">Distributed training with PyTorch and Azure ML</a> </h4> <p>Suppose you have a very large PyTorch model, and you’ve already tried many common tricks to speed up training: you optimized your code, you moved training to the cloud and selected a fast GPU VM, you installed software packages that improve training performance (for example, by using the ACPT curated environment on Azure ML). And yet, you still wish your model could train faster. Maybe it’s time to give distributed training a try! Continue reading to learn the simplest way to do distributed t...</p> </div> <a href="https://medium.com/pytorch/distributed-training-with-pytorch-and-azure-ml-898429139098" class="btn btn-lg with-right-arrow"> Read More </a> </div> </div> </div> </div> </div> <div class="container-fluid docs-tutorials-resources"> <div class="container"> <div class="row"> <div class="col-md-4 text-center"> <h2>Docs</h2> <p>Access comprehensive developer documentation for PyTorch</p> <a class="with-right-arrow" href="/docs">View Docs</a> </div> <div class="col-md-4 text-center"> <h2>Tutorials</h2> <p>Get in-depth tutorials for beginners and advanced developers</p> <a class="with-right-arrow" href="https://pytorch.org/tutorials">View Tutorials</a> </div> <div class="col-md-4 text-center"> <h2>Resources</h2> <p>Find development resources and get your questions answered</p> <a class="with-right-arrow" href="/resources">View Resources</a> </div> </div> </div> </div> <footer class="site-footer"> <div class="container footer-container"> <div class="newsletter" id="newsletter"> <p class="newsletter__title is-style-max-width-800"><strong>Stay in touch</strong> for updates, event info, and the latest news</p> <script charset="utf-8" type="text/javascript" src="//js.hsforms.net/forms/embed/v2.js"></script> <script> hbspt.forms.create({ region: "na1", portalId: "8112310", formId: "2fb2231c-000b-4ec5-88a0-1ab242549c9e" }); </script> <p class="newsletter__privacy">By submitting this form, I consent to receive marketing emails from the LF and its projects regarding their events, training, research, developments, and related announcements. I understand that I can unsubscribe at any time using the links in the footers of the emails I receive. <a href="https://www.linuxfoundation.org/privacy/">Privacy Policy</a>.</p> </div> <div class="lf-grid"> <div class="footer-logo-wrapper"> <a href="https://pytorch.org" class="footer-logo"> <img src="/assets/images/logo-icon.svg" alt="PyTorch logo" width="40"> </a> </div> <ul class="social-links"> <li><a href="https://www.facebook.com/pytorch" target="_blank" title="PyTorch on Facebook"> <svg xmlns="http://www.w3.org/2000/svg" viewbox="-0.51 -0.26 26.45 26.45" aria-label="Facebook"><path fill="currentColor" d="M25.497 13.075c0-2.45-.698-4.848-2.011-6.911a12.765 12.765 0 0 0-5.398-4.73A12.671 12.671 0 0 0 11.008.38a12.705 12.705 0 0 0-6.529 2.95A12.827 12.827 0 0 0 .563 9.358a12.896 12.896 0 0 0-.07 7.201 12.831 12.831 0 0 0 3.801 6.103 12.709 12.709 0 0 0 6.471 3.078v-8.957H7.53v-3.708h3.235v-2.824c0-3.213 1.903-4.988 4.813-4.988.956.014 1.909.097 2.852.25V8.67h-1.607a1.83 1.83 0 0 0-1.518.497 1.854 1.854 0 0 0-.561 1.505v2.404h3.535l-.563 3.708h-2.97v8.957a12.725 12.725 0 0 0 7.697-4.337 12.87 12.87 0 0 0 3.054-8.328z"/></svg> </a></li> <li><a href="https://twitter.com/pytorch" target="_blank" title="PyTorch on X"> <svg xmlns="http://www.w3.org/2000/svg" viewbox="0 0 300 300" aria-label="X"><path fill="currentColor" d="M178.57 127.15 290.27 0h-26.46l-97.03 110.38L89.34 0H0l117.13 166.93L0 300.25h26.46l102.4-116.59 81.8 116.59h89.34M36.01 19.54H76.66l187.13 262.13h-40.66"/></svg> </a></li> <li><a href="https://www.youtube.com/pytorch" target="_blank" title="PyTorch on YouTube"> <svg xmlns="http://www.w3.org/2000/svg" viewbox="0.21 0.27 34.45 25.07" aria-label="YouTube"><path fill="currentColor" d="M33.729 6.084s-.327-2.33-1.317-3.356a4.691 4.691 0 0 0-3.32-1.432c-4.634-.34-11.589-.34-11.589-.34h-.014s-6.954 0-11.59.342a4.692 4.692 0 0 0-3.32 1.432c-.993 1.025-1.315 3.354-1.315 3.354a52.189 52.189 0 0 0-.331 5.473v2.566c.014 1.829.125 3.656.331 5.472 0 0 .322 2.33 1.316 3.36 1.26 1.345 2.916 1.3 3.653 1.445 2.65.26 11.263.34 11.263.34s6.96-.01 11.597-.353a4.691 4.691 0 0 0 3.32-1.432c.993-1.026 1.316-3.356 1.316-3.356.206-1.817.316-3.644.33-5.473v-2.57a52.26 52.26 0 0 0-.33-5.472zM14.076 17.232V7.729l8.951 4.768-8.95 4.735z"/></svg> </a></li> <li><a href="https://www.linkedin.com/company/pytorch" target="_blank" title="PyTorch on LinkedIn"> <svg xmlns="http://www.w3.org/2000/svg" viewbox="-10.23 -10.23 531.96 531.96" aria-label="LinkedIn"><rect width="512" height="512" rx="0" fill="currentColor"/><circle fill="#000" cx="142" cy="138" r="37"/><path stroke="#000" stroke-width="66" d="M244 194v198M142 194v198"/><path fill="#000" d="M276 282c0-20 13-40 36-40 24 0 33 18 33 45v105h66V279c0-61-32-89-76-89-34 0-51 19-59 32"/></svg> </a></li> <li><a href="https://join.slack.com/t/pytorch/shared_invite/zt-2j2la612p-miUinTTaxXczKOJw48poHA" target="_blank" title="PyTorch Slack"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0.16 -0.03 21.19 21.19" aria-label="Slack"><path fill="currentColor" d="M4.896 13.27a2.147 2.147 0 0 1-2.141 2.142A2.147 2.147 0 0 1 .613 13.27c0-1.178.963-2.141 2.142-2.141h2.141v2.141zm1.08 0c0-1.178.962-2.141 2.141-2.141s2.142.963 2.142 2.141v5.363a2.147 2.147 0 0 1-2.142 2.141 2.147 2.147 0 0 1-2.141-2.142V13.27zm2.141-8.6a2.147 2.147 0 0 1-2.141-2.14c0-1.18.962-2.142 2.141-2.142s2.142.963 2.142 2.141v2.142H8.117zm0 1.08c1.179 0 2.141.962 2.141 2.141a2.147 2.147 0 0 1-2.141 2.142H2.755A2.147 2.147 0 0 1 .613 7.89c0-1.179.963-2.141 2.142-2.141h5.362zm8.599 2.141c0-1.179.963-2.141 2.141-2.141 1.179 0 2.143.962 2.143 2.14a2.147 2.147 0 0 1-2.142 2.142h-2.141V7.89zm-1.08 0a2.147 2.147 0 0 1-2.141 2.142 2.147 2.147 0 0 1-2.141-2.142V2.53c0-1.178.962-2.141 2.141-2.141s2.142.963 2.142 2.141v5.362zm-2.141 8.6c1.179 0 2.142.962 2.142 2.14a2.147 2.147 0 0 1-2.142 2.142 2.147 2.147 0 0 1-2.141-2.141V16.49h2.141zm0-1.08a2.147 2.147 0 0 1-2.141-2.141c0-1.179.962-2.142 2.141-2.142h5.362c1.179 0 2.142.963 2.142 2.142a2.147 2.147 0 0 1-2.142 2.142h-5.362z"></path></svg> </a></li> <li><a href="/wechat" title="PyTorch on WeChat"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0.14 -0.17 38.02 33.02" aria-label="WeChat"><path fill="currentColor" d="M26.289 10.976a12.972 12.972 0 0 0-8.742 3.53 10.386 10.386 0 0 0-3.224 8.795c-1.326-.164-2.535-.345-3.75-.448a2.332 2.332 0 0 0-1.273.216c-1.18.666-2.311 1.418-3.652 2.255.246-1.112.405-2.087.687-3.024a1.15 1.15 0 0 0-.523-1.52C1.737 17.902.02 13.601 1.307 9.165c1.189-4.1 4.11-6.587 8.077-7.884A13.54 13.54 0 0 1 24.18 5.617a10.135 10.135 0 0 1 2.109 5.359zM10.668 9.594a1.564 1.564 0 0 0-2.095-1.472 1.52 1.52 0 0 0-.895 1.964 1.502 1.502 0 0 0 1.391.966 1.545 1.545 0 0 0 1.598-1.46v.002zm8.15-1.566a1.567 1.567 0 0 0-1.528 1.543 1.528 1.528 0 0 0 1.571 1.492 1.52 1.52 0 0 0 1.375-2.117 1.518 1.518 0 0 0-1.415-.919l-.003.001z"></path><path fill="currentColor" d="M33.914 32.137c-1.075-.478-2.062-1.196-3.11-1.306-1.049-.11-2.145.494-3.24.605a10.821 10.821 0 0 1-8.781-2.864c-4.682-4.33-4.013-10.97 1.403-14.518 4.811-3.154 11.874-2.102 15.268 2.273a8.671 8.671 0 0 1-1.002 12.095c-1.046.929-1.422 1.693-.751 2.917.102.257.174.525.213.798zM21.68 20.292a1.264 1.264 0 1 0 .01-2.528 1.264 1.264 0 0 0-.01 2.528zm7.887-2.526a1.266 1.266 0 0 0-1.256 1.21 1.247 1.247 0 1 0 1.256-1.21z"></path></svg> </a></li> </ul> </div> <div class="privacy-policy"> <div class="copyright"> <p>© Copyright The Linux Foundation. The PyTorch Foundation is a project of The Linux Foundation. For web site terms of use, trademark policy and other policies applicable to The PyTorch Foundation please see <a href="https://www.linuxfoundation.org/legal/policies/">Linux Foundation Policies</a>. The PyTorch Foundation supports the PyTorch open source project, which has been established as PyTorch Project a Series of LF Projects, LLC. For policies applicable to the PyTorch Project a Series of LF Projects, LLC, please see <a href="https://www.lfprojects.org/policies/">LF Projects, LLC Policies</a>. <a href="https://www.linuxfoundation.org/privacy">Privacy Policy</a> and <a href="https://www.linuxfoundation.org/terms">Terms of Use</a>.</p> </div> </div> </div> </footer> <div class="mobile-main-menu"> <div class="container-fluid"> <div class="container"> <div class="mobile-main-menu-header-container"> <a class="header-logo" href="https://pytorch.org" aria-label="PyTorch"></a> <a class="main-menu-close-button" href="#" data-behavior="close-mobile-menu"></a> </div> </div> </div> <div class="mobile-main-menu-links-container"> <div class="main-menu"> <ul> <li class="navSearchWrapper reactNavSearchWrapper tabletSearchWrapper" key="search"> <div class="mobile-search-border"> <input id="mobile-search-input" type="text" title="Search" /> <div id="mobile-search-icon"></div> </div> </li> <li class="resources-mobile-menu-title"> <a>Learn</a> </li> <ul class="resources-mobile-menu-items"> <li> <a href="/get-started">Get Started</a> </li> <li> <a href="https://pytorch.org/tutorials">Tutorials</a> </li> <li> <a href="https://pytorch.org/tutorials/beginner/basics/intro.html">Learn the Basics</a> </li> <li> <a href="https://pytorch.org/tutorials/recipes/recipes_index.html">PyTorch Recipes</a> </li> <li> <a href="https://pytorch.org/tutorials/beginner/introyt.html">Introduction to PyTorch - YouTube Series</a> </li> <li> <a href="/new">New to PyTorch Foundation</a> </li> </ul> <li class="resources-mobile-menu-title"> <a>Ecosystem</a> </li> <ul class="resources-mobile-menu-items"> <li> <a href="https://landscape.pytorch.org/">Tools</a> </li> <li> <a href="https://github.com/pytorch-fdn/ecosystem">Join the Ecosystem</a> </li> <li> <a href="/#community-module">Community</a> </li> <li> <a href="https://discuss.pytorch.org">Forums</a> </li> <li> <a href="/resources">Developer Resources</a> </li> <li> <a href="/ecosystem/contributor-awards-2024">Contributor Awards - 2024</a> </li> </ul> <li class="resources-mobile-menu-title"> <a>Edge</a> </li> <ul class="resources-mobile-menu-items"> <li> <a href="/edge">About PyTorch Edge</a> </li> <li> <a href="/executorch-overview">ExecuTorch</a> </li> <li> <a href="https://pytorch.org/executorch/stable/index.html">ExecuTorch Documentation</a> </li> </ul> <li class="resources-mobile-menu-title"> <a>Docs</a> </li> <ul class="resources-mobile-menu-items"> <li> <a href="https://pytorch.org/docs">PyTorch</a> </li> <li> <a href="/pytorch-domains">PyTorch Domains</a> </li> </ul> <li class="resources-mobile-menu-title"> <a>Blog & News</a> </li> <ul class="resources-mobile-menu-items"> <li> <a href="/blog">PyTorch Blog</a> </li> <li> <a href="/community-blog">Community Blog</a> </li> <li> <a href="/videos">Videos</a> </li> <li> <a href="/community-stories">Community Stories</a> </li> <li> <a href="/events">Events</a> </li> <li> <a href="/newsletter">Newsletter</a> </li> </ul> <li class="resources-mobile-menu-title"> <a>About</a> </li> <ul class="resources-mobile-menu-items"> <li> <a href="/foundation">PyTorch Foundation</a> </li> <li> <a href="/governing-board">Governing Board</a> </li> <li> <a href="/credits">Cloud Credit Program</a> </li> <li> <a href="/tac">Technical Advisory Council</a> </li> <li> <a href="/staff">Staff</a> </li> <li> <a href="/contact-us">Contact Us</a> </li> </ul> <li class="resources-mobile-menu-title"> <a href="/join">Become a Member</a> </li> <li class="resources-mobile-menu-title"> <a href="https://github.com/pytorch/pytorch" title="Go to PyTorch GitHub"><div id="topnav-gh-icon"></div></a> </li> </ul> </div> </div> </div> <script src="/assets/mobile-menu.js"></script> <script src="/assets/scroll-to-anchor.js"></script> <script src="/assets/external-links-new-tab.js"></script> <script src="/assets/search-bar.js"></script> <script src="/assets/cookie-banner.js"></script> <script type="text/javascript"> mobileMenu.bind(); anchors.add('.pytorch-article h2, .pytorch-article h3, .pytorch-article h4, .pytorch-article h5'); // Add class to links that have code blocks, since we cannot create links in code blocks $("a code.highlighter-rouge").each(function(e) { $(this).closest("a").addClass("has-code"); }); scrollToAnchor.bind(); var hasStaticHeader = $(".blog-header, .blog-detail-header, .resources-header, .get-started-header, .features-header, .ecosystem-header, .hub-header, .mobile-header, .announcement-header, .comm-stories-header").length > 0; if (!hasStaticHeader) { $(window).on("scroll", function() { var top = $(this).scrollTop(); var fullPosition = $(".main-background").height() - $(".header-holder").height(); if (top <= 40) { $(".header-holder").css({"backgroundColor": "rgba(0, 0, 0, 0.165)"}); } else if (top >= fullPosition) { $(".header-holder").css({"backgroundColor": "#000000"}); } else { var bgColor = "rgba(0, 0, 0, " + top / fullPosition + ")"; $(".header-holder").css({"backgroundColor": bgColor}); } }); } </script> <script src="/assets/track-events.js"></script> <script>trackEvents.bind();</script> <div class="cookie-banner-wrapper"> <div class="container"> <p class="gdpr-notice">To analyze traffic and optimize your experience, we serve cookies on this site. By clicking or navigating, you agree to allow our usage of cookies. As the current maintainers of this site, Facebook’s Cookies Policy applies. Learn more, including about available controls: <a href="https://www.facebook.com/policies/cookies/">Cookies Policy</a>.</p> <img class="close-button" src="/assets/images/pytorch-x.svg"> </div> </div> </body> </html>

CINXE.COM

Community Blog | PyTorch