CINXE.COM
Magenta
<!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <title>Magenta</title> <meta name="description" content="A research project exploring the role of machine learning in the process of creating art and music."> <!-- OpenGraph data --> <meta property="og:image" content="https://magenta.tensorflow.org/assets/magenta-logo-card.jpg"> <meta property="og:title" content="Magenta"> <meta property="og:description" content="A research project exploring the role of machine learning in the process of creating art and music."> <meta property="og:url" content="https://magenta.tensorflow.org/"> <meta property="og:site_name" content="Magenta"> <!-- Twitter Card data --> <meta name="twitter:card" content="summary"> <meta name="twitter:title" content="Magenta"> <meta name="twitter:description" content="A research project exploring the role of machine learning in the process of creating art and music."> <meta name="twitter:image" content="https://magenta.tensorflow.org/assets/magenta-logo-card.jpg"> <link rel="stylesheet" href="/css/main.css"> <link rel="canonical" href="https://magenta.tensorflow.org/"> <link rel="alternate" type="application/rss+xml" title="Magenta" href="https://magenta.tensorflow.org/feed.xml"> <link href="https://fonts.googleapis.com/css?family=Google+Sans:+400,500,700" media="all" rel="stylesheet"> <script src="//www.google.com/js/gweb/analytics/autotrack.js"></script> <script> new gweb.analytics.AutoTrack({ profile: 'UA-80107903-1' }); </script> </head> <body> <div class="scrim" onclick="document.body.classList.toggle('drawer-opened', false)"></div> <header class="with-hero"> <div class="top-bar"> <div class="top-bar-content"> <div class="logo"> </div> <nav> <button class="menu-button" onclick="document.body.classList.toggle('drawer-opened', true)" aria-label="open nav menu"> <svg viewBox="0 0 18 15"> <path fill="#424242" d="M18,1.484c0,0.82-0.665,1.484-1.484,1.484H1.484C0.665,2.969,0,2.304,0,1.484l0,0C0,0.665,0.665,0,1.484,0 h15.031C17.335,0,18,0.665,18,1.484L18,1.484z"/> <path fill="#424242" d="M18,7.516C18,8.335,17.335,9,16.516,9H1.484C0.665,9,0,8.335,0,7.516l0,0c0-0.82,0.665-1.484,1.484-1.484 h15.031C17.335,6.031,18,6.696,18,7.516L18,7.516z"/> <path fill="#424242" d="M18,13.516C18,14.335,17.335,15,16.516,15H1.484C0.665,15,0,14.335,0,13.516l0,0 c0-0.82,0.665-1.484,1.484-1.484h15.031C17.335,12.031,18,12.696,18,13.516L18,13.516z"/> </svg> </button> <div class="links"> <a href="/get-started">Get Started</a> <a href="/studio">Studio</a> <a href="/ddsp-vst">DDSP-VST</a> <a href="/demos">Demos</a> <a href="/blog">Blog</a> <a href="/research">Research</a> <a href="/talks">Talks</a> <a href="/community">Community</a> </div> </nav> </div> </div> <div class="hero"> <div class="hero-pianoroll"> <img src="/assets/hero-pianoroll.png" alt="background animation of a pianoroll"> </div> <div class="hero-content"> <a href="/"><img src="/assets/magenta-logo-bottom-text.png" height="100" alt="magenta logo"></a> <div> <h1>Make Music and Art <br>Using Machine Learning</h1> <div class="action-container"> <a class="action hero white" href="/blog">Read the Blog</a> <a class="action hero dark" href="/demos">Try the Demos</a> </div> </div> </div> </div> </header> <div class="drawer"> <div class="drawer-content"> <a href="/get-started">Get Started</a> <a href="/studio">Studio</a> <a href="/ddsp-vst">DDSP-VST</a> <a href="/demos">Demos</a> <a href="/blog">Blog</a> <a href="/research">Research</a> <a href="/talks">Talks</a> <a href="/community">Community</a> </div> </div> <div class="main"> <section class="about"> <div class="content single"> <h2 class="section-title">What is Magenta?</h2> <div class="section-callout">An open source research project exploring the role of machine learning as a tool in the creative process.</div> </div> <!--- <div class="content double"> <div> <h3>Python</h3> <p> <b>Magenta</b> is distributed as an open source Python library, powered by <a href="https://www.tensorflow.org">TensorFlow</a>. This library includes utilities for manipulating source data (primarily music and images), using this data to train machine learning models, and finally generating new content from these models. </p> <div class="action-container"> <a class="action grey" href="https://goo.gl/magenta/hello-py">Try it live</a> <a class="action grey" href="https://pypi.org/project/magenta/">pip</a> <a class="action grey" href="https://github.com/tensorflow/magenta">GitHub</a> </div> </div> <div> <h3>JavaScript</h3> <p><b>Magenta.js</b> is an open source JavaScript API for using the pre-trained Magenta models in the browser. It is built with <a href="https://js.tensorflow.org">TensorFlow.js</a>, which allows for fast, GPU-accelerated inference. If you're interested in seeing how Magenta models have been used in <a href="/demos/web/">existing applications</a> or want to build your own, this is probably the place to start!</p> <div class="action-container"> <a class="action grey" href="https://goo.gl/magenta/hello-js">Try it live</a> <a class="action grey" href="https://www.npmjs.com/org/magenta">npm</a> <a class="action grey" href="https://github.com/tensorflow/magenta-js">GitHub</a> </div> </div> </div> --> </section> <!-- <section> <div class="content single"> <h2 class="section-title">Featured projects</h2> <div class="card-wrapper"> <div class="card"> <div class="image"> <figure> <a href="https://g.co/magenta/studio"> <video autoplay="" loop="" muted="" playsinline="" alt="video of the different plugins in magenta studio"> <source src="/assets/studio/hero.mp4" type="video/mp4" /> </video> </a> </figure> </div> <div> <div class="title">Magenta Studio (beta)</div> <div class="tagline">Magenta Studio is a collection of music plugins built on Magenta’s open source tools and models.</div> <a href="/studio">Learn more.</a> </div> </div> <div class="card"> <div class="image"> <iframe src="https://www.youtube.com/embed/g56pKqVpSrY?rel=0&showinfo=0" frameborder="0" allow="autoplay; encrypted-media" style="height:100%;width:100%" title="onsets and frames synthesized transcription demo" allowfullscreen=""> </iframe> </div> <div> <div class="title">Onsets and Frames</div> <div class="tagline">Transcribing piano with a neural network.</div> <a href="/onsets-frames">Learn more.</a> </div> </div> <div class="card"> <div class="image"> <iframe src="https://www.youtube.com/embed/videoseries?list=PLBUMAYA6kvGU8Cgqh709o5SUvo-zHGTxr&rel=0&showinfo=0" frameborder="0" allow="autoplay; encrypted-media" style="height:100%;width:100%" title="music vae melody interpolation demo" allowfullscreen=""> </iframe> </div> <div> <div class="title">MusicVAE</div> <div class="tagline">Creating palettes for blending and exploring musical loops and scores.</div> <a href="/music-vae">Learn more.</a> </div> </div> <div class="card"> <div class="image"> <iframe src="https://www.youtube.com/embed/iTXU9Z0NYoU?rel=0&showinfo=0" frameborder="0" allow="autoplay; encrypted-media" style="height:100%;width:100%" allowfullscreen="" title="demo of making music with nsynth"> </iframe> </div> <div> <div class="title">NSynth</div> <div class="tagline">Making music using new sounds generated with machine learning.</div> <a href="https://g.co/nsynthsuper">Learn more.</a> </div> </div> </div> </div> </section> <hr> --> <section class="white"> <div class="content single"> <h2 class="section-title">What's new?</h2> <div class="card"> <div class="title large">Magenta Studio 2.0</div> <div class="tagline">Magenta Studio has been upgraded to more seamlessly integrate with Ableton Live. It is a collection of music creativity tools built on Magenta’s open source models, using cutting-edge machine learning techniques for music generation. <a href="/studio-announce-2">Read the blog post.</a></div> </div> <div class="card"> <div class="title large">The 2023 I/O Preshow – Composed by Dan Deacon (with some help from MusicLM)</div> <div class="tagline">A look into Dan Deacon's creative process for the 2023 Google I/O preshow. <a href="/dandeacon-io-preshow">Read the blog post.</a></div> </div> <div class="card"> <div class="title large">The Wordcraft Writers Workshop: Creative Co-Writing with AI</div> <div class="tagline">We invited 13 professional writers to explore the limits of co-writing with LaMDA and foster an honest and earnest conversation about the rapidly changing relationship between technology and creativity. <a href="/wordcraft-writers-workshop">Read the blog post.</a></div> </div> <div class="card"> <div class="title large">The Chamber Ensemble Generator and CocoChorales Dataset</div> <div class="tagline">We combine Coconet and MIDI-DDSP into a system called the Chamber Ensemble Generator, which we use to make a giant dataset of four-part Bach chorales called CocoChorales. <a href="/ceg-and-cocochorales">Read the blog post.</a></div> </div> <div> <a href="/blog">See more posts.</a> </div> </div> </section> </div> <footer> <div class="footer-content"> <div class="logo"> <a href="https://ai.google/" target="_blank" rel="noopener" title="Google AI"> <svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 157.2 40.88"><defs><style>.cls-1{fill:none;}.cls-2{fill:#80868b;}.cls-3{fill:#80868b;}.cls-4{fill:#80868b;}.cls-5{fill:#80868b;}.cls-6{fill:#80868b;}</style></defs><g id="Running_copy" data-name="Running copy"><path class="cls-1" d="M82.91,16.35A4.8,4.8,0,0,0,79.29,18a5.66,5.66,0,0,0-1.49,4,5.53,5.53,0,0,0,1.49,3.94,4.78,4.78,0,0,0,3.62,1.58,4.47,4.47,0,0,0,3.49-1.58A5.7,5.7,0,0,0,87.81,22a5.84,5.84,0,0,0-1.41-4A4.48,4.48,0,0,0,82.91,16.35Z"></path><path class="cls-1" d="M42.8,16.35a4.92,4.92,0,0,0-3.66,1.57,5.49,5.49,0,0,0-1.51,4,5.52,5.52,0,0,0,1.52,4,5,5,0,0,0,7.3,0,5.48,5.48,0,0,0,1.53-4,5.49,5.49,0,0,0-1.51-4A4.93,4.93,0,0,0,42.8,16.35Z"></path><path class="cls-1" d="M62.89,16.35a4.93,4.93,0,0,0-3.67,1.57,5.53,5.53,0,0,0-1.51,4,5.48,5.48,0,0,0,1.53,4,5,5,0,0,0,7.3,0,5.48,5.48,0,0,0,1.53-4,5.49,5.49,0,0,0-1.51-4A4.93,4.93,0,0,0,62.89,16.35Z"></path><path class="cls-1" d="M111,16.82a4.15,4.15,0,0,0-2.12-.54,4.79,4.79,0,0,0-3.32,1.46,4.9,4.9,0,0,0-1.47,3.9l8.2-3.41A2.82,2.82,0,0,0,111,16.82Z"></path><rect class="cls-2" x="94.13" y="3.56" width="4.03" height="26.97"></rect><path class="cls-3" d="M42.8,12.74a9,9,0,0,0-6.53,2.62,8.83,8.83,0,0,0-2.68,6.55,8.84,8.84,0,0,0,2.68,6.56,9.46,9.46,0,0,0,13.07,0A8.83,8.83,0,0,0,52,21.91a8.82,8.82,0,0,0-2.67-6.55A9,9,0,0,0,42.8,12.74Zm3.65,13.15a5,5,0,0,1-7.3,0,5.52,5.52,0,0,1-1.52-4,5.49,5.49,0,0,1,1.51-4,5.06,5.06,0,0,1,7.33,0,5.49,5.49,0,0,1,1.51,4A5.48,5.48,0,0,1,46.45,25.89Z"></path><path class="cls-4" d="M18.89,15.55v3.9h9.32a8.27,8.27,0,0,1-2.12,4.9,9.76,9.76,0,0,1-7.2,2.85,9.75,9.75,0,0,1-7.24-3,10.07,10.07,0,0,1-3-7.33,10.07,10.07,0,0,1,3-7.33,9.75,9.75,0,0,1,7.24-3,9.89,9.89,0,0,1,7,2.78l2.75-2.74a13.63,13.63,0,0,0-9.77-3.93A14.07,14.07,0,0,0,8.71,6.78,13.58,13.58,0,0,0,4.44,16.84,13.56,13.56,0,0,0,8.71,26.9a14.07,14.07,0,0,0,10.18,4.19,13.12,13.12,0,0,0,9.94-4q3.38-3.36,3.37-9.1a12.59,12.59,0,0,0-.2-2.44Z"></path><path class="cls-4" d="M87.53,14.79h-.14a5.64,5.64,0,0,0-2-1.46,6.66,6.66,0,0,0-2.83-.59,8.37,8.37,0,0,0-6.15,2.69A9,9,0,0,0,73.77,22a8.86,8.86,0,0,0,2.64,6.46,8.36,8.36,0,0,0,6.15,2.68A5.87,5.87,0,0,0,87.39,29h.14v1.32a5.63,5.63,0,0,1-1.3,4,4.69,4.69,0,0,1-3.6,1.39,4.34,4.34,0,0,1-2.88-1A5.94,5.94,0,0,1,78,32.44L74.5,33.9a9.43,9.43,0,0,0,3,3.79,8.07,8.07,0,0,0,5.14,1.64,8.61,8.61,0,0,0,6.27-2.39c1.64-1.58,2.45-4,2.45-7.17V13.3H87.53ZM86.4,25.89a4.47,4.47,0,0,1-3.49,1.58,4.78,4.78,0,0,1-3.62-1.58A5.53,5.53,0,0,1,77.8,22a5.66,5.66,0,0,1,1.49-4,4.8,4.8,0,0,1,3.62-1.6A4.48,4.48,0,0,1,86.4,18a5.84,5.84,0,0,1,1.41,4A5.7,5.7,0,0,1,86.4,25.89Z"></path><path class="cls-5" d="M62.89,12.74a9,9,0,0,0-6.53,2.62,8.79,8.79,0,0,0-2.68,6.55,8.8,8.8,0,0,0,2.68,6.56,9.45,9.45,0,0,0,13.06,0,8.8,8.8,0,0,0,2.68-6.56,8.79,8.79,0,0,0-2.68-6.55A9,9,0,0,0,62.89,12.74Zm3.65,13.15a5,5,0,0,1-7.3,0,5.48,5.48,0,0,1-1.53-4,5.53,5.53,0,0,1,1.51-4,5.07,5.07,0,0,1,7.34,0,5.49,5.49,0,0,1,1.51,4A5.48,5.48,0,0,1,66.54,25.89Z"></path><path class="cls-3" d="M109.22,27.47a4.68,4.68,0,0,1-4.45-2.78L117,19.62l-.42-1a11,11,0,0,0-.91-1.81,10.64,10.64,0,0,0-1.49-1.86,7.14,7.14,0,0,0-2.36-1.56,7.73,7.73,0,0,0-3.1-.61,8.27,8.27,0,0,0-6.13,2.57,9.05,9.05,0,0,0-2.52,6.6,8.93,8.93,0,0,0,2.61,6.54,8.74,8.74,0,0,0,6.5,2.64,8.43,8.43,0,0,0,4.69-1.25,10.13,10.13,0,0,0,3-2.82l-3.13-2.08A5.26,5.26,0,0,1,109.22,27.47Zm-3.64-9.73a4.79,4.79,0,0,1,3.32-1.46,4.15,4.15,0,0,1,2.12.54,2.82,2.82,0,0,1,1.29,1.41l-8.2,3.41A4.9,4.9,0,0,1,105.58,17.74Z"></path><path class="cls-6" d="M127.47,30.54h-3.55l9.39-24.9h3.62l9.39,24.9h-3.55l-2.4-6.75H129.9Zm7.58-21L131,20.8h8.28L135.19,9.57Z"></path><path class="cls-6" d="M152.44,30.54h-3.2V5.64h3.2Z"></path></g></svg> </a> </div> <ul> <li> <a href="https://twitter.com/search?q=%23madewithmagenta" target="_blank" rel="noopener"> Twitter </a> </li> <li> <a href="/blog" target="_blank" rel="noopener"> Blog </a> </li> <li> <a href="https://github.com/tensorflow/magenta" target="_blank" rel="noopener"> GitHub </a> </li> <li> <a href="https://www.google.com/policies/privacy/" target="_blank" rel="noopener"> Privacy </a> </li> <li> <a href="https://www.google.com/policies/terms/" target="_blank" rel="noopener"> Terms </a> </li> </ul> </div> </footer> </body> <script src="/js/main.js"></script> </html>