CINXE.COM

<!DOCTYPE html> <html> <head> <meta name="viewport" content="width=device-width, initial-scale=1.0">   <script async src="https://www.googletagmanager.com/gtag/js?id=UA-46457317-11"></script> <script> window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'UA-46457317-11'); </script> <title>What-If Tool</title> <link rel="stylesheet" href="https://fonts.googleapis.com/icon?family=Material+Icons"> <link rel="stylesheet" href="/what-if-tool/assets/css/material.min.css"> <link rel="stylesheet" href="/what-if-tool/assets/css/material-components-web.min.css"> <link href="https://fonts.googleapis.com/css?family=Open+Sans:400,400italic,500,500italic,700,700italic" rel="stylesheet" type="text/css"> <link href="https://fonts.googleapis.com/css?family=Manrope:400,400italic,500,500italic,700,700italic" rel="stylesheet" type="text/css">  <link href='/what-if-tool/assets/css/new.css' rel='stylesheet' type='text/css'> <link rel="icon" href="/what-if-tool/assets/images/favicon.png" type="image/png"/> <style> .main-bg { background-image:url(/what-if-tool/assets/images/home-bg.png); } </style> </head> <body> <div class="mdl-layout mdl-layout--no-desktop-drawer-button mdl-js-layout mdl-layout--fixed-header"> <header class="mdl-layout__header"> <div class="mdl-layout__header-row">  <span class="mdl-layout__title"><a href="/what-if-tool/">What-If Tool</a></span>  <div class="mdl-layout-spacer"></div>  <nav class="mdl-navigation mdl-layout--large-screen-only"> <a class="mdl-navigation__link" href="/what-if-tool/get-started/">GET STARTED</a> <a class="mdl-navigation__link" href="/what-if-tool/learn/">TUTORIALS</a> <a class="mdl-navigation__link" href="/what-if-tool/explore/">DEMOS</a> <a class="mdl-navigation__link" href="/what-if-tool/faqs/">FAQs</a> <a class="mdl-navigation__link" href="https://groups.google.com/forum/#!forum/what-if-tool" target="-_blank">GET INVOLVED<img class="header-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></a> <a class="mdl-navigation__link" href="https://github.com/pair-code/what-if-tool" target="-_blank">GITHUB<img class="header-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></a> </nav> </div> </header> <div class="mdl-layout__drawer"> <span class="mdl-layout__title"><a href="/what-if-tool/">What-If Tool</a></span> <nav class="mdl-navigation"> <a class="mdl-navigation__link" href="/what-if-tool/get-started/">GET STARTED</a> <a class="mdl-navigation__link" href="/what-if-tool/learn/">TUTORIALS</a> <a class="mdl-navigation__link" href="/what-if-tool/explore/">DEMOS</a> <a class="mdl-navigation__link" href="/what-if-tool/faqs/">FAQs</a> <a class="mdl-navigation__link" href="https://groups.google.com/forum/#!forum/what-if-tool" target="_blank">GET INVOLVED<img class="header-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></a> <a class="mdl-navigation__link" href="https://github.com/pair-code/what-if-tool" target="-_blank">GITHUB<img class="header-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></a>  </nav> </div> <main class="mdl-layout__content hero-banner main-bg"> <div class="mdl_grid main-page-container"> <div class="mdl-cell--12-col mdl-cell--8-col-tablet mdl-cell--4-col-phone"> <div class="mdl-cell--8-col mdl-cell--12-col-tablet mdl-cell--8-col-phone"> <div class="display1"><strong>Visually probe</strong> the behavior of <strong>trained machine learning models</strong>, with minimal coding.</div> <a class="home-cta-button" href="/what-if-tool/get-started" > <button class="mdl-button mdl-js-button mdl-button--raised mdl-js-ripple-effect"> Get started </button> </a> <div class="spacer" style="height:60px;"></div> </div> <p><img src="/what-if-tool/assets/images/home-hero.gif" alt="overview of WIT"></p> <div class="spacer" style="height:60px;"></div> <div class="mdl-cell--8-col mdl-cell--12-col-tablet mdl-cell--8-col-phone"> <p>A key challenge in developing and deploying responsible Machine Learning (ML) systems is understanding their performance across a wide range of inputs.</p> <p>Using WIT, you can test performance in hypothetical situations, analyze the importance of different data features, and visualize model behavior across multiple models and subsets of input data, and for different ML fairness metrics.</p> </div> <div class="spacer" style="height:50px;"></div> <div class="display2">Model probing, from within any workflow</div> <div class="mdl-grid no-padding"> <div class="mdl-cell mdl-cell--4-col mdl-cell--8-col-tablet mdl-cell--6-col-phone"> <h3>Platforms and Integrations</h3> <div> <p><a href="https://colab.research.google.com/">Colaboratory notebooks</a></p> <p><a href="https://jupyter.org/">Jupyter notebooks</a></p> <p><a href="https://cloud.google.com/ai-platform-notebooks">Cloud AI Notebooks</a></p> <p><a href="https://www.tensorflow.org/tensorboard">TensorBoard</a></p> <p><a href="https://www.tensorflow.org/tfx/guide/fairness_indicators">TFMA Fairness Indicators</a></p> </div> </div> <div class="mdl-cell mdl-cell--4-col mdl-cell--8-col-tablet mdl-cell--6-col-phone"> <h3>Compatible models<br/> and frameworks</h3> <div> <p>TF Estimators</p> <p>Models served by <a href="https://www.tensorflow.org/tfx/guide/serving">TF serving</a></p> <p>Cloud AI Platform Models</p> <p>Models that can be wrapped in a python function</p> </div> </div> <div class="mdl-cell mdl-cell--4-col mdl-cell--8-col-tablet mdl-cell--6-col-phone"> <h3>Supported data and task types</h3> <div> <p>Binary classification</p> <p>Multi-class classification</p> <p>Regression</p> <p>Tabular, Image, Text data</p> </div> </div> </div> <div class="spacer" style="height:50px;"></div> <h2>Ask and answer questions about models, features, and data points</h2> <div class="spacer" style="height:20px;"></div> <div class="video-container"> <iframe src="https://www.youtube.com/embed/qTUUwfG1vSs" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe> </div> <div class="spacer" style="height:20px;"></div> <h2>What’s the latest</h2> <div class="mdl-grid no-padding"> <div class="mdl-cell mdl-cell--6-col mdl-cell--4-col-tablet mdl-cell--8-col-phone"> <img class="home-card-image" src="/what-if-tool/assets/images/home-card-code.png"/> <div class="home-card-action">CODE</div> <h3 class="home-card-title">Contribute to the What-If Tool</h3> <div class="home-card-desc">The What-If Tool is open to anyone who wants to help develop and improve it!</div> <div class="home-card-cta-button"><a href="https://github.com/PAIR-code/what-if-tool/blob/master/CONTRIBUTING.md" target="_blank" >View developer guide</a><img class="external-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></div> </div> <div class="mdl-cell mdl-cell--6-col mdl-cell--4-col-tablet mdl-cell--8-col-phone"> <img class="home-card-image" src="/what-if-tool/assets/images/home-card-updates.png"/> <div class="home-card-action">UPDATES</div> <h3 class="home-card-title">Latest updates to the What-If Tool</h3> <div class="home-card-desc">New features, updates, and improvements to the What-If Tool.</div> <div class="home-card-cta-button"><a href="https://github.com/PAIR-code/what-if-tool/blob/master/RELEASE.md" target="_blank" >See release notes</a><img class="external-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></div> </div> <div class="mdl-cell mdl-cell--6-col mdl-cell--4-col-tablet mdl-cell--8-col-phone"> <img class="home-card-image" src="/what-if-tool/assets/images/home-card-research.png"/> <div class="home-card-action">RESEARCH</div> <h3 class="home-card-title">Systems Paper at IEEE VAST ‘19</h3> <div class="home-card-desc">Read about what went into the What-If Tool in our systems papers, presented at IEEE VAST ‘19.</div> <div class="home-card-cta-button"><a href="https://ieeexplore.ieee.org/abstract/document/8807255" target="_blank" >Go to proceedings</a><img class="external-arrow" src="/what-if-tool/assets/images/arrow-link-out.png"/></div> </div> <div class="mdl-cell mdl-cell--6-col mdl-cell--4-col-tablet mdl-cell--8-col-phone"> <img class="home-card-image" src="/what-if-tool/assets/images/home-card-article.png"/> <div class="home-card-action">ARTICLE</div> <h3 class="home-card-title">Playing with AI Fairness</h3> <div class="home-card-desc">The What-If Tool lets you try on five different types of fairness. What do they mean?</div> <div class="home-card-cta-button"><a href="./ai-fairness.html" >Read the article</a><span class="home-card-icon material-icons">arrow_right_alt</span></div> </div> </div> </div> <div class="footer-container mdl-grid"> <div class="mdl-cell mdl-cell--2-col mdl-cell--2-col-tablet mdl-cell--4-col-phone"><a href="https://pair.withgoogle.com/" target="_blank"><img src="/what-if-tool/assets/images/pair-logo.svg"/></a></div> <div class="mdl-cell mdl-cell--2-col mdl-cell--2-col-tablet mdl-cell--4-col-phone"><a href="https://research.google/teams/brain/pair/" target="_blank">Google Research</a></div> <div class="mdl-cell mdl-cell--2-col mdl-cell--2-col-tablet mdl-cell--4-col-phone"><a href="https://groups.google.com/forum/#!forum/what-if-tool" target="_blank">Get Involved</a></div> <div class="mdl-cell mdl-cell--2-col mdl-cell--2-col-tablet mdl-cell--4-col-phone"><a href="https://github.com/pair-code" target="_blank">Github</a></div> <div class="footer-icons mdl-cell mdl-cell--4-col mdl-cell--8-col-tablet mdl-cell--4-col-phone"> <a href="mailto:peopleai@google.com" target="_blank"><img src="/what-if-tool/assets/images/mail.png"/></a> <a href="https://medium.com/people-ai-research" target="_blank"><img src="/what-if-tool/assets/images/medium.png"/></a> <a href="https://www.youtube.com/channel/UCnnns-uu4yy9BXfYSPIX5AA" target="_blank"><img src="/what-if-tool/assets/images/youtube.png"/></a> </div> </div> </div> </main> </div> </body> <script defer src="/what-if-tool/assets/js/material.min.js"></script> <script defer src="/what-if-tool/assets/js/material-components-web.min.js"></script> </html>