CINXE.COM

<!DOCTYPE html> <html lang="en"> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> <meta name="google-site-verification" content=""> <meta http-equiv="Permissions-Policy" content="interest-cohort=()"> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <title>William Merrill</title> <meta name="author" content="William Merrill"> <meta name="description" content="This is the personal website of William Merrill "> <meta name="keywords" content="artificial-intelligence, theory-of-computation, deep-learning, language-models"> <link href="https://cdn.jsdelivr.net/npm/bootstrap@4.6.1/dist/css/bootstrap.min.css" rel="stylesheet" integrity="sha256-DF7Zhf293AJxJNTmh5zhoYYIMs2oXitRfBjY+9L//AY=" crossorigin="anonymous"> <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/mdbootstrap@4.20.0/css/mdb.min.css" integrity="sha256-jpjYvU3G3N6nrrBwXJoVEYI/0zw8htfFnhT9ljN3JJw=" crossorigin="anonymous"> <link defer rel="stylesheet" href="https://unpkg.com/bootstrap-table@1.21.4/dist/bootstrap-table.min.css"> <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/@fortawesome/fontawesome-free@6.4.0/css/all.min.css" integrity="sha256-HtsXJanqjKTc8vVQjO4YMhiqFoXkfBsjBWcX91T1jr8=" crossorigin="anonymous"> <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/academicons@1.9.1/css/academicons.min.css" integrity="sha256-i1+4qU2G2860dGGIOJscdC30s9beBXjFfzjWLjBRsBg=" crossorigin="anonymous"> <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Roboto:300,400,500,700|Roboto+Slab:100,300,400,500,700|Material+Icons"> <link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/jwarby/jekyll-pygments-themes@master/github.css" media="" id="highlight_theme_light"> <link rel="shortcut icon" href="/assets/img/icon.png"> <link rel="stylesheet" href="/assets/css/main.css?d41d8cd98f00b204e9800998ecf8427e"> <link rel="canonical" href="https://lambdaviking.com/"> </head> <body class="fixed-top-nav "> <header> <nav id="navbar" class="navbar navbar-light navbar-expand-sm fixed-top"> <div class="container"> <button class="navbar-toggler collapsed ml-auto" type="button" data-toggle="collapse" data-target="#navbarNav" aria-controls="navbarNav" aria-expanded="false" aria-label="Toggle navigation"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar top-bar"></span> <span class="icon-bar middle-bar"></span> <span class="icon-bar bottom-bar"></span> </button> <div class="collapse navbar-collapse text-right" id="navbarNav"> <ul class="navbar-nav ml-auto flex-nowrap"> <li class="nav-item active"> <a class="nav-link" href="/">About<span class="sr-only">(current)</span></a> </li> <li class="nav-item "> <a class="nav-link" href="/blog/">Blog</a> </li> <li class="nav-item "> <a class="nav-link" href="/cv">CV</a> </li> </ul> </div> </div> </nav> <progress id="progress" value="0"> <div class="progress-container"> <span class="progress-bar"></span> </div> </progress> </header> <div class="container mt-5"> <div class="post"> <header class="post-header"> <h1 class="post-title"> <span class="font-weight-bold">William</span> Merrill </h1> <p class="desc"></p> </header> <article> <div class="profile float-left"> <figure> <picture> <source class="responsive-img-srcset" media="(max-width: 480px)" srcset="/assets/img/whiteboard-headshot-480.webp"></source> <source class="responsive-img-srcset" media="(max-width: 800px)" srcset="/assets/img/whiteboard-headshot-800.webp"></source> <source class="responsive-img-srcset" media="(max-width: 1400px)" srcset="/assets/img/whiteboard-headshot-1400.webp"></source> <img src="/assets/img/whiteboard-headshot.jpeg?5aaedd72bce48f1e24ba190f3c4465a2" class="img-fluid z-depth-1 rounded-circle" width="auto" height="auto" alt="whiteboard-headshot.jpeg" onerror="this.onerror=null; $('.responsive-img-srcset').remove();"> </picture> </figure> <div class="address"> </div> </div> <div class="clearfix"> <p>I am a Ph.D. student at the <a href="https://cds.nyu.edu/" rel="external nofollow noopener" target="_blank">CDS</a> at <a href="https://www.nyu.edu/" rel="external nofollow noopener" target="_blank">NYU</a>, where I am advised by <a href="https://tallinzen.net/" rel="external nofollow noopener" target="_blank">Tal Linzen</a>. I also work closely with <a href="https://allenai.org/team/ashishs" rel="external nofollow noopener" target="_blank">Ashish Sabharwal</a> at <a href="https://allenai.org/" rel="external nofollow noopener" target="_blank">Ai2</a>, where I used to be a <a href="https://allenai.org/predoctoral-young-investigators" rel="external nofollow noopener" target="_blank">PYI</a>. My Ph.D. is supported by an <a href="https://www.nsfgrfp.org/resources/about-grfp/" rel="external nofollow noopener" target="_blank">NSF graduate research fellowship</a>, <a href="https://www.twosigma.com/community/academic-partnerships/team-phd-fellowship/" rel="external nofollow noopener" target="_blank">Two Sigma Ph.D. Fellowship</a>, and <a href="https://allenai.org/" rel="external nofollow noopener" target="_blank">Ai2</a>.</p> <p>My research uses formal methods to better understand the capabilities and limitations of <b>language models</b>. I've worked on characterizing the <b>computational power of transformers</b> for representing linguistic structure and solving reasoning problems. I've also worked on understanding the aspects of <b>semantics that can be learned from co-occurrence patterns</b> in a large text corpus. Overall, I am interesting in building out theoretical foundations for the alchemy of large language models. Why have LMs been successful? What are their limitations? How can we more systematically understand design choices around pretraining and deployment?</p> <p> <b>Contact:</b> <code>willm[忙t]nyu.edu</code> or <a href="https://www.admonymous.co/lambdaviking" rel="external nofollow noopener" target="_blank">here</a> for anonymous feedback </p> <p>I'm on the <b>academic job market</b>! Feel free to reach out if you have a relevant faculty or postdoc opening.</p> <p>Outside of research, I like exploring New York City by foot, train, and boat. I like cooking new things and trying hole-in-the-wall restaurants. I also play basketball, ping pong, and Age of Empires II.</p> <p><br> <br></p> <h2><a href="/blog/" style="color: inherit;">Latest posts</a></h2> <div> <div class="news"> <div class="table-responsive" style="max-height: 60vw"> <table class="table table-sm table-borderless"> <tr> <th scope="row">Apr 15, 2022</th> <td> <a class="news-title" href="/blog/2022/improved-adversarial-robustness/">Project: Improved Adversarial Robustness via Abstract Interpretation</a> </td> </tr> <tr> <th scope="row">Apr 16, 2020</th> <td> <a class="news-title" href="/blog/2020/formal-hierarchy-of-rnn-architectures/">A Formal Hierarchy of RNN Architectures</a> </td> </tr> <tr> <th scope="row">Sep 6, 2019</th> <td> <a class="news-title" href="/blog/2019/theory-of-saturated-neural-networks/">Theory of Saturated Neural Networks</a> </td> </tr> </table> </div> </div> </div> <h2 id="publications">Publications</h2> <div class="publications"> <h2 class="bibliography">2024</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">EMNLP</abbr></div> <div id="merrill2024evaluating" class="col-sm-8"> <div class="title">Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG</div> <div class="author"> William Merrill,聽Noah A. Smith,聽and聽Yanai Elazar</div> <div class="periodical"> <em>In EMNLP</em>, Nov 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=NgWSakw55z" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">COLM</abbr></div> <div id="anonymous2024lets" class="col-sm-8"> <div class="title">Let鈥檚 Think Dot by Dot: Hidden computation in transformer language models</div> <div class="author"> Jacob Pfau,聽William Merrill,聽and聽Samuel Bowman</div> <div class="periodical"> <em>In COLM</em>, Oct 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=NikbrdtYvG" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ICML</abbr></div> <div id="merrill2024illusion" class="col-sm-8"> <div class="title">The Illusion of State in State-Space Models</div> <div class="author"> William Merrill,聽Jackson Petty,聽and聽Ashish Sabharwal</div> <div class="periodical"> <em>In ICML</em>, Jul 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=QZgo9JZpLq" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ACL</abbr></div> <div id="merrill2024learn" class="col-sm-8"> <div class="title">Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment</div> <div class="author"> William Merrill,聽Zhaofeng Wu,聽Norihito Naka, and <span class="more-authors" title="click to view 2 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '2 more authors' ? 'Yoon Kim, Tal Linzen' : '2 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">2 more authors</span> </div> <div class="periodical"> <em>In ACL</em>, Aug 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=htTKX762mV" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">TACL</abbr></div> <div id="strobl2024formalLanguages" class="col-sm-8"> <div class="title">What Formal Languages Can Transformers Express? A Survey</div> <div class="author"> Lena Strobl,聽William Merrill,聽Gail Weiss, and <span class="more-authors" title="click to view 2 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '2 more authors' ? 'David Chiang, Dana Angluin' : '2 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">2 more authors</span> </div> <div class="periodical"> <em>TACL</em>, May 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00663/120983/What-Formal-Languages-Can-Transformers-Express-A" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ACL</abbr></div> <div id="groeneveld2024olmo" class="col-sm-8"> <div class="title">OLMo: Accelerating the Science of Language Models</div> <div class="author"> Dirk Groeneveld,聽Iz Beltagy,聽Pete Walsh, and <span class="more-authors" title="click to view 40 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '40 more authors' ? 'Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi' : '40 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">40 more authors</span> </div> <div class="periodical"> <em>In ACL</em>, Aug 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=x6nm6qAVfg" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ICML</abbr></div> <div id="zhang2024how" class="col-sm-8"> <div class="title">How Language Model Hallucinations Can Snowball</div> <div class="author"> Muru Zhang,聽Ofir Press,聽William Merrill, and <span class="more-authors" title="click to view 2 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '2 more authors' ? 'Alisa Liu, Noah A. Smith' : '2 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">2 more authors</span> </div> <div class="periodical"> <em>In ICML</em>, Jul 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=FPlaQyAGHu" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ICLR</abbr></div> <div id="merrill2024cot" class="col-sm-8"> <div class="title">The Expressive Power of Transformers with Chain of Thought</div> <div class="author"> William Merrill,聽and聽Ashish Sabharwal</div> <div class="periodical"> <em>In ICLR</em>, May 2024 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=NjNGlPh8Wh" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> <h2 class="bibliography">2023</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">DLT</abbr></div> <div id="10.1007/978-3-031-33264-7_1" class="col-sm-8"> <div class="title">Formal Languages and the NLP Black Box</div> <div class="author"> William Merrill</div> <div class="periodical"> <em>In Developments in Language Theory</em>, Jun 2023 </div> <div class="periodical"> </div> <div class="links"> <a href="https://lambdaviking.com/assets/pdf/papers/formal-languages-and-nlp-blackbox.pdf" class="btn btn-sm z-depth-0" role="button">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-isbn="978-3-031-33264-7"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ME-FoMo</abbr></div> <div id="merrill2023a" class="col-sm-8"> <div class="title">A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks</div> <div class="author"> William Merrill,聽Nikolaos Tsilivis,聽and聽Aman Shukla</div> <div class="periodical"> <em>In ICLR Workshop on Mathematical and Empirical Understanding of Foundation Models</em>, May 2023 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=8GZxtu46Kx" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">TACL</abbr></div> <div id="wu2023transparency" class="col-sm-8"> <div class="title">Transparency Helps Reveal When Language Models Learn Meaning</div> <div class="author"> Zhaofeng Wu,聽William Merrill,聽Hao Peng, and <span class="more-authors" title="click to view 2 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '2 more authors' ? 'Iz Beltagy, Noah A. Smith' : '2 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">2 more authors</span> </div> <div class="periodical"> <em>TACL</em>, May 2023 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2023.tacl-1.36" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.1162/tacl_a_00565"></span> <span class="__dimensions_badge_embed__" data-doi="10.1162/tacl_a_00565" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">NeurIPS</abbr></div> <div id="merrill2023logic" class="col-sm-8"> <div class="title">A Logic for Expressing Log-Precision Transformers</div> <div class="author"> William Merrill,聽and聽Ashish Sabharwal</div> <div class="periodical"> <em>In NeurIPS</em>, Dec 2023 </div> <div class="periodical"> </div> <div class="links"> <a href="https://openreview.net/forum?id=uR8TtWCIsr" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">TACL</abbr></div> <div id="merill2023parallelism" class="col-sm-8"> <div class="title">The Parallelism Tradeoff: Limitations of Log-Precision Transformers</div> <div class="author"> William Merrill,聽and聽Ashish Sabharwal</div> <div class="periodical"> <em>TACL</em>, Jun 2023 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2023.tacl-1.31/" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.1162/tacl_a_00562"></span> <span class="__dimensions_badge_embed__" data-doi="10.1162/tacl_a_00562" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> <h2 class="bibliography">2022</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">CoNLL</abbr></div> <div id="merrill-etal-2022-entailment" class="col-sm-8"> <div class="title">Entailment Semantics Can Be Extracted from an Ideal Language Model</div> <div class="author"> William Merrill,聽Alex Warstadt,聽and聽Tal Linzen</div> <div class="periodical"> <em>In CoNLL</em>, Dec 2022 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2022.conll-1.13" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">arXiv</abbr></div> <div id="merrill2022state" class="col-sm-8"> <div class="title">Extracting Finite Automata from RNNs Using State Merging</div> <div class="author"> William Merrill,聽and聽Nikolaos Tsilivis</div> <div class="periodical"> Jan 2022 </div> <div class="periodical"> </div> <div class="links"> <a href="https://arxiv.org/abs/2201.12451" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.48550/ARXIV.2201.12451"></span> <span class="__dimensions_badge_embed__" data-doi="10.48550/ARXIV.2201.12451" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">TACL</abbr></div> <div id="merrill2022saturated" class="col-sm-8"> <div class="title">Saturated Transformers are Constant-Depth Threshold Circuits</div> <div class="author"> William Merrill,聽Ashish Sabharwal,聽and聽Noah A. Smith</div> <div class="periodical"> <em>TACL</em>, Aug 2022 </div> <div class="periodical"> </div> <div class="links"> <a href="https://doi.org/10.1162/tacl_a_00493" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.1162/tacl_a_00493"></span> <span class="__dimensions_badge_embed__" data-doi="10.1162/tacl_a_00493" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ACL</abbr></div> <div id="subramanian-etal-2022-reclip" class="col-sm-8"> <div class="title">ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension</div> <div class="author"> Sanjay Subramanian,聽William Merrill,聽Trevor Darrell, and <span class="more-authors" title="click to view 3 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '3 more authors' ? 'Matt Gardner, Sameer Singh, Anna Rohrbach' : '3 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">3 more authors</span> </div> <div class="periodical"> <em>In ACL</em>, May 2022 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2022.acl-long.357" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.18653/v1/2022.acl-long.357"></span> <span class="__dimensions_badge_embed__" data-doi="10.18653/v1/2022.acl-long.357" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> <h2 class="bibliography">2021</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">EMNLP</abbr></div> <div id="gardner-etal-2021-competency" class="col-sm-8"> <div class="title">Competency Problems: On Finding and Removing Artifacts in Language Data</div> <div class="author"> Matt Gardner,聽William Merrill,聽Jesse Dodge, and <span class="more-authors" title="click to view 4 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '4 more authors' ? 'Matthew Peters, Alexis Ross, Sameer Singh, Noah A. Smith' : '4 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">4 more authors</span> </div> <div class="periodical"> <em>In EMNLP</em>, Nov 2021 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2021.emnlp-main.135" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.18653/v1/2021.emnlp-main.135"></span> <span class="__dimensions_badge_embed__" data-doi="10.18653/v1/2021.emnlp-main.135" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"></div> <div id="merrill2021formal" class="col-sm-8"> <div class="title">Formal Language Theory Meets Modern NLP</div> <div class="author"> William Merrill</div> <div class="periodical"> Feb 2021 </div> <div class="periodical"> </div> <div class="links"> <a href="https://arxiv.org/abs/2102.10094" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-arxiv-id="2102.10094"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">TACL</abbr></div> <div id="merrill2021provable" class="col-sm-8"> <div class="title">Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand?</div> <div class="author"> William Merrill,聽Yoav Goldberg,聽Roy Schwartz, and <span class="more-authors" title="click to view 1 more author" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '1 more author' ? 'Noah A. Smith' : '1 more author'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">1 more author</span> </div> <div class="periodical"> <em>TACL</em>, Sep 2021 </div> <div class="periodical"> </div> <div class="links"> <a href="https://doi.org/10.1162/tacl_a_00412" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-arxiv-id="https://direct.mit.edu/tacl/article-pdf/doi/10.1162/tacl_a_00412/1963983/tacl_a_00412.pdf"></span> <span class="__dimensions_badge_embed__" data-doi="10.1162/tacl_a_00412" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">EMNLP</abbr></div> <div id="merrill-etal-2021-effects" class="col-sm-8"> <div class="title">Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent</div> <div class="author"> William Merrill,聽Vivek Ramanujan,聽Yoav Goldberg, and <span class="more-authors" title="click to view 2 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '2 more authors' ? 'Roy Schwartz, Noah A. Smith' : '2 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">2 more authors</span> </div> <div class="periodical"> <em>In EMNLP</em>, Nov 2021 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2021.emnlp-main.133" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.18653/v1/2021.emnlp-main.133"></span> <span class="__dimensions_badge_embed__" data-doi="10.18653/v1/2021.emnlp-main.133" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> <h2 class="bibliography">2020</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">ACL</abbr></div> <div id="merrill-etal-2020-formal" class="col-sm-8"> <div class="title">A Formal Hierarchy of RNN Architectures</div> <div class="author"> William Merrill,聽Gail Weiss,聽Yoav Goldberg, and <span class="more-authors" title="click to view 3 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '3 more authors' ? 'Roy Schwartz, Noah A. Smith, Eran Yahav' : '3 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">3 more authors</span> </div> <div class="periodical"> <em>In ACL</em>, Jul 2020 </div> <div class="periodical"> </div> <div class="links"> <a href="https://www.aclweb.org/anthology/2020.acl-main.43" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-doi="10.18653/v1/2020.acl-main.43"></span> <span class="__dimensions_badge_embed__" data-doi="10.18653/v1/2020.acl-main.43" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">COVID19</abbr></div> <div id="wang-etal-2020-cord" class="col-sm-8"> <div class="title">CORD-19: The COVID-19 Open Research Dataset</div> <div class="author"> Lucy Lu Wang,聽Kyle Lo,聽Yoganand Chandrasekhar, and <span class="more-authors" title="click to view 25 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '25 more authors' ? 'Russell Reas, Jiangjiang Yang, Doug Burdick, Darrin Eide, Kathryn Funk, Yannis Katsis, Rodney Michael Kinney, Yunyao Li, Ziyang Liu, William Merrill, Paul Mooney, Dewey A. Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex D. Wade, Kuansan Wang, Nancy Xin Ru Wang, Christopher Wilhelm, Boya Xie, Douglas M. Raymond, Daniel S. Weld, Oren Etzioni, Sebastian Kohlmeier' : '25 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">25 more authors</span> </div> <div class="periodical"> <em>In ACL Workshop on NLP for COVID-19</em>, Jul 2020 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/2020.nlpcovid19-acl.1" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">arXiv</abbr></div> <div id="merrill2020linguistic" class="col-sm-8"> <div class="title">On the Linguistic Capacity of Real-Time Counter Automata</div> <div class="author"> William Merrill</div> <div class="periodical"> Sep 2020 </div> <div class="periodical"> </div> <div class="links"> <a href="https://arxiv.org/abs/2004.06866" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right" data-arxiv-id="2004.06866"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> <h2 class="bibliography">2019</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">DeLeFoL</abbr></div> <div id="merrill2019sequential" class="col-sm-8"> <div class="title">Sequential Neural Networks as Automata</div> <div class="author"> William Merrill</div> <div class="periodical"> <em>In ACL Workshop on Deep Learning and Formal Languages</em>, Aug 2019 </div> <div class="periodical"> </div> <div class="links"> <a href="https://www.aclweb.org/anthology/W19-3901" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">BlackboxNLP</abbr></div> <div id="merrill2019finding" class="col-sm-8"> <div class="title">Finding Hierarchical Structure in Neural Stacks Using Unsupervised Parsing</div> <div class="author"> William Merrill,聽Lenny Khazan,聽Noah Amsel, and <span class="more-authors" title="click to view 3 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '3 more authors' ? 'Yiding Hao, Simon Mendelsohn, Robert Frank' : '3 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">3 more authors</span> </div> <div class="periodical"> <em>In ACL Workshop BlackboxNLP</em>, Aug 2019 </div> <div class="periodical"> </div> <div class="links"> <a href="https://www.aclweb.org/anthology/W19-4823" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">LChange</abbr></div> <div id="merrill2019detecting" class="col-sm-8"> <div class="title">Detecting Syntactic Change Using a Neural Part-of-Speech Tagger</div> <div class="author"> William Merrill,聽Gigi Stark,聽and聽Robert Frank</div> <div class="periodical"> <em>In ACL Workshop on Computational Approaches to Historical Language Change</em>, Aug 2019 </div> <div class="periodical"> </div> <div class="links"> <a href="https://www.aclweb.org/anthology/W19-4721" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> <h2 class="bibliography">2018</h2> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">BlackboxNLP</abbr></div> <div id="haoContextFreeTransductionsNeural2018b" class="col-sm-8"> <div class="title">Context-Free Transductions with Neural Stacks</div> <div class="author"> Yiding Hao,聽William Merrill,聽Dana Angluin, and <span class="more-authors" title="click to view 4 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '4 more authors' ? 'Robert Frank, Noah Amsel, Andrew Benz, Simon Mendelsohn' : '4 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">4 more authors</span> </div> <div class="periodical"> <em>In EMNLP Workshop BlackboxNLP</em>, Nov 2018 </div> <div class="periodical"> </div> <div class="links"> <a href="https://www.aclweb.org/anthology/W18-5433" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">NAACL</abbr></div> <div id="kasai2018end2end" class="col-sm-8"> <div class="title">End-to-End Graph-Based TAG Parsing with Neural Networks</div> <div class="author"> Jungo Kasai,聽Robert Frank,聽Pauli Xu, and <span class="more-authors" title="click to view 2 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '2 more authors' ? 'William Merrill, Owen Rambow' : '2 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, '10'); ">2 more authors</span> </div> <div class="periodical"> <em>In NAACL</em>, Nov 2018 </div> <div class="periodical"> </div> <div class="links"> <a href="https://aclanthology.org/N18-1107/" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-2 abbr"><abbr class="badge">TULCon</abbr></div> <div id="merrill2018semantics" class="col-sm-8"> <div class="title">A Semantics of Subordinate Clauses Using Delayed Evaluation</div> <div class="author"> William Merrill</div> <div class="periodical"> <em>Toronto Undergraduate Linguistics Conference</em>, Nov 2018 </div> <div class="periodical"> </div> <div class="links"> <a href="https://ling.auf.net/lingbuzz/003487" class="btn btn-sm z-depth-0" role="button" rel="external nofollow noopener" target="_blank">HTML</a> </div> <div class="badges"> <span class="altmetric-embed" data-hide-no-mentions="true" data-hide-less-than="15" data-badge-type="2" data-badge-popover="right"></span> <span class="__dimensions_badge_embed__" data-pmid="" data-hide-zero-citations="true" data-style="small_rectangle" data-legend="hover-right" style="margin-bottom: 3px;"></span> </div> </div> </div> </li> </ol> </div> </div> </article> </div> </div> <footer class="fixed-bottom"> <div class="container mt-0"> 漏 Copyright 2024 William Merrill. Powered by <a href="https://jekyllrb.com/" target="_blank" rel="external nofollow noopener">Jekyll</a> with <a href="https://github.com/alshedivat/al-folio" rel="external nofollow noopener" target="_blank">al-folio</a> theme and inspired by <a href="https://gbrlfaria.github.io/" rel="external nofollow noopener" target="_blank">Gabriel Faria's website</a>. <br>Photo by Brian Kitano. Last updated: November 07, 2024. </div> </footer> <script src="https://cdn.jsdelivr.net/npm/jquery@3.6.0/dist/jquery.min.js" integrity="sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=" crossorigin="anonymous"></script> <script src="https://cdn.jsdelivr.net/npm/bootstrap@4.6.1/dist/js/bootstrap.bundle.min.js" integrity="sha256-fgLAgv7fyCGopR/gBNq2iW3ZKIdqIcyshnUULC4vex8=" crossorigin="anonymous"></script> <script src="https://cdn.jsdelivr.net/npm/mdbootstrap@4.20.0/js/mdb.min.js" integrity="sha256-NdbiivsvWt7VYCt6hYNT3h/th9vSTL4EDWeGs5SN3DA=" crossorigin="anonymous"></script> <script defer src="https://cdn.jsdelivr.net/npm/masonry-layout@4.2.2/dist/masonry.pkgd.min.js" integrity="sha256-Nn1q/fx0H7SNLZMQ5Hw5JLaTRZp0yILA/FRexe19VdI=" crossorigin="anonymous"></script> <script defer src="https://cdn.jsdelivr.net/npm/imagesloaded@4/imagesloaded.pkgd.min.js"></script> <script defer src="/assets/js/masonry.js" type="text/javascript"></script> <script defer src="https://cdn.jsdelivr.net/npm/medium-zoom@1.0.8/dist/medium-zoom.min.js" integrity="sha256-7PhEpEWEW0XXQ0k6kQrPKwuoIomz8R8IYyuU1Qew4P8=" crossorigin="anonymous"></script> <script defer src="/assets/js/zoom.js"></script> <script defer src="https://unpkg.com/bootstrap-table@1.21.4/dist/bootstrap-table.min.js"></script> <script src="/assets/js/no_defer.js?d633890033921b33e0ceb13d22340a9c"></script> <script defer src="/assets/js/common.js?acdb9690d7641b2f8d40529018c71a01"></script> <script defer src="/assets/js/copy_code.js?c9d9dd48933de3831b3ee5ec9c209cac" type="text/javascript"></script> <script async src="https://d1bxh8uas1mnw7.cloudfront.net/assets/embed.js"></script> <script async src="https://badge.dimensions.ai/badge.js"></script> <script type="text/javascript">window.MathJax={tex:{tags:"ams"}};</script> <script defer type="text/javascript" id="MathJax-script" src="https://cdn.jsdelivr.net/npm/mathjax@3.2.0/es5/tex-mml-chtml.js"></script> <script defer src="https://polyfill.io/v3/polyfill.min.js?features=es6"></script> <script type="text/javascript">function progressBarSetup(){"max"in document.createElement("progress")?(initializeProgressElement(),$(document).on("scroll",function(){progressBar.attr({value:getCurrentScrollPosition()})}),$(window).on("resize",initializeProgressElement)):(resizeProgressBar(),$(document).on("scroll",resizeProgressBar),$(window).on("resize",resizeProgressBar))}function getCurrentScrollPosition(){return $(window).scrollTop()}function initializeProgressElement(){let e=$("#navbar").outerHeight(!0);$("body").css({"padding-top":e}),$("progress-container").css({"padding-top":e}),progressBar.css({top:e}),progressBar.attr({max:getDistanceToScroll(),value:getCurrentScrollPosition()})}function getDistanceToScroll(){return $(document).height()-$(window).height()}function resizeProgressBar(){progressBar.css({width:getWidthPercentage()+"%"})}function getWidthPercentage(){return getCurrentScrollPosition()/getDistanceToScroll()*100}const progressBar=$("#progress");window.onload=function(){setTimeout(progressBarSetup,50)};</script> </body> </html>