CINXE.COM

<!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <title>Jiawei Liu</title> <meta name="author" content="Jiawei Liu"/> <meta name="description" content=""/> <link href="https://cdn.jsdelivr.net/npm/bootstrap@4.6.1/dist/css/bootstrap.min.css" rel="stylesheet" integrity="sha256-DF7Zhf293AJxJNTmh5zhoYYIMs2oXitRfBjY+9L//AY=" crossorigin="anonymous"> <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/mdbootstrap@4.20.0/css/mdb.min.css" integrity="sha256-jpjYvU3G3N6nrrBwXJoVEYI/0zw8htfFnhT9ljN3JJw=" crossorigin="anonymous"/> <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/@fortawesome/fontawesome-free@6.6.0/css/all.min.css" crossorigin="anonymous"> <link rel="stylesheet" href="https://cdn.jsdelivr.net/npm/academicons@1.9.1/css/academicons.min.css" integrity="sha256-i1+4qU2G2860dGGIOJscdC30s9beBXjFfzjWLjBRsBg=" crossorigin="anonymous"> <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Roboto:300,400,500,700|Roboto+Slab:100,300,400,500,700|Material+Icons"> <link href="https://cdn.jsdelivr.net/gh/jwarby/jekyll-pygments-themes@master/github.css" rel="stylesheet" media="" id="highlight_theme_light"/> <link rel="shortcut icon" href="/assets/img/favicon.png"/> <link rel="stylesheet" href="/assets/css/main.css"> <link rel="canonical" href="https://ganler.github.io//"> </head> <body class="fixed-top-nav "> <header> <nav id="navbar" class="navbar navbar-light navbar-expand-sm fixed-top"> <div class="container"> <div class="navbar-brand social"> <a href="https://scholar.google.com/citations?user=Vw6el1AAAAAJ" title="Google Scholar" target="_blank" rel="noopener noreferrer"><i class="ai ai-google-scholar"></i></a> <a href="https://github.com/ganler" title="GitHub" target="_blank" rel="noopener noreferrer"><i class="fab fa-github"></i></a> <a href="https://www.linkedin.com/in/jiawei-liu-uiuc" title="LinkedIn" target="_blank" rel="noopener noreferrer"><i class="fab fa-linkedin"></i></a> <a href="https://twitter.com/JiaweiLiu_" title="Twitter" target="_blank" rel="noopener noreferrer"><i class="fab fa-x-twitter"></i></a> <a id="WeChatBtn" title="WeChat"><i class="fa-brands fa-weixin"></i></a> <div id="WeChatMod" class="wechat-modal"> <img src="/assets/img/wxqr.jpg" alt="WeChat QR" id="WeChatQR"> </div> <script>for(var wechatModal=document.getElementById("WeChatMod"),wechatBtn=document.querySelectorAll('[id="WeChatBtn"]'),i=0;i<wechatBtn.length;i++)wechatBtn[i].onclick=function(){wechatModal.style.display="block"};window.onclick=function(t){t.target==wechatModal&&(wechatModal.style.display="none")};</script> </div> <button class="navbar-toggler collapsed ml-auto" type="button" data-toggle="collapse" data-target="#navbarNav" aria-controls="navbarNav" aria-expanded="false" aria-label="Toggle navigation"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar top-bar"></span> <span class="icon-bar middle-bar"></span> <span class="icon-bar bottom-bar"></span> </button> <div class="collapse navbar-collapse text-right" id="navbarNav"> <ul class="navbar-nav ml-auto flex-nowrap"> <li class="nav-item active"> <a class="nav-link" href="/">About<span class="sr-only">(current)</span></a> </li> <li class="nav-item "> <a class="nav-link" href="/blog/">Blog</a> </li> <li class="nav-item "> <a class="nav-link" href="/random/">Random</a> </li> <li class="nav-item active"> <a class="nav-link" href="https://drive.google.com/file/d/1fXexaC2ka6jWp6nIJM9dMaMTGW32DCXi/view" target="_blank" rel="noopener noreferrer">CV</a> </li> </ul> </div> </div> </nav> </header> <div class="container mt-5"> <div class="post"> <header class="post-header"> <h1 class="post-title"> <span class="font-weight-bold">Jiawei</span> Liu </h1> <p class="desc"></p> </header> <article> <div class="profile float-right"> </div> <div class="clearfix"> <p>I’m a Ph.D. candidate at <a href="https://cs.illinois.edu/research/areas/programming-languages-formal-methods-and-software-engineering" target="_blank" rel="noopener noreferrer">UIUC PL/FM/SE</a> (2021-Present), advised by <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a>.</p> <p>I am generally interested in Programming Systems and Machine Learning.</p> <p>📬 Shortest path to find me: <code class="language-plaintext highlighter-rouge">jiawei6@illinois.edu</code></p> </div> <div class="publications"> <h2>Papers <a id="toggleText" style="cursor: pointer; text-decoration: underline; float: right; color: #d9cef2">Show More</a> </h2> <div id="selectedPapers"> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">Pre-print</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="liu2024learning" class="col-sm-9"> <div class="title">Learning Code Preference via Synthetic Evolution</div> <div class="author"> <em><b>Jiawei Liu</b></em>, <a href="https://scholar.google.com/citations?user=HnkaCSQAAAAJ&hl=en" target="_blank" rel="noopener noreferrer">Thanh Nguyen</a>, <a href="https://scholar.google.com/citations?user=phbnAuIAAAAJ" target="_blank" rel="noopener noreferrer">Mingyue Shang</a>, <a href="https://scholar.google.com/citations?user=nEuMO58AAAAJ" target="_blank" rel="noopener noreferrer">Hantian Ding</a>, <a href="https://eelxpeng.github.io/" target="_blank" rel="noopener noreferrer">Xiaopeng Li</a>, <a href="https://www.irisyuyu.com/" target="_blank" rel="noopener noreferrer">Yu Yu</a>, <a href="https://www.amazon.science/author/varun-kumar" target="_blank" rel="noopener noreferrer">Varun Kumar</a>, <a href="https://zijianwang.me/" target="_blank" rel="noopener noreferrer">Zijian Wang</a> </div> <div class="periodical"> <em>arXiv preprint arXiv:2410.03837</em>. 2024 </div> <div class="links"> <a href="http://arxiv.org/abs/2410.03837" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://llm-code-preference.github.io/" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://github.com/amazon-science/llm-code-preference" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/amazon-science/llm-code-preference?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">liu2024learning</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Learning Code Preference via Synthetic Evolution}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Nguyen, Thanh and Shang, Mingyue and Ding, Hantian and Li, Xiaopeng and Yu, Yu and Kumar, Varun and Wang, Zijian}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{arXiv preprint arXiv:2410.03837}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">COLM’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="liu2024evaluating" class="col-sm-9"> <div class="title">Evaluating Language Models for Efficient Code Generation</div> <div class="author"> <em><b>Jiawei Liu</b></em>, Songrun Xie, Junhao Wang, <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="https://yifeng-ding.com/" target="_blank" rel="noopener noreferrer">Yifeng Ding</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>First Conference on Language Modeling</em>. 2024 </div> <div class="links"> <a href="https://openreview.net/forum?id=IBCBMeAhmC" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="/assets/pdf/jiawei-colm-evalperf-poster.pdf" class="btn btn-sm z-depth-0" role="button">Poster</a> <a href="https://evalplus.github.io/evalperf.html" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://huggingface.co/evalplus" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">🤗 HF</a> <a href="https://github.com/evalplus/evalplus" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/evalplus/evalplus?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2024evaluating</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Evaluating Language Models for Efficient Code Generation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Xie, Songrun and Wang, Junhao and Wei, Yuxiang and Ding, Yifeng and Zhang, Lingming}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{First Conference on Language Modeling}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://openreview.net/forum?id=IBCBMeAhmC}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ICML’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="wei2023magic" class="col-sm-9"> <div class="title">Magicoder: Empowering Code Generation with OSS-Instruct</div> <div class="author"> <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="https://zhewang2001.github.io/" target="_blank" rel="noopener noreferrer">Zhe Wang</a>, <em><b>Jiawei Liu</b></em>, <a href="https://yifeng-ding.com/" target="_blank" rel="noopener noreferrer">Yifeng Ding</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Forty-first International Conference on Machine Learning</em>. 2024 </div> <b style="color:#FF0000;font-weight:800"> Adopted by Meta Llama 3.1, Google CodeGemma, and IBM Granite</b> <div class="links"> <a href="https://openreview.net/forum?id=XUeoOBid3x" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://yuxiang.cs.illinois.edu/static/documents/Magicoder-Talk-Snowflake.pdf" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Slides</a> <a href="https://github.com/ise-uiuc/magicoder" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/magicoder?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">wei2023magic</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Magicoder: Empowering Code Generation with {OSS}-Instruct}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Wei, Yuxiang and Wang, Zhe and Liu, Jiawei and Ding, Yifeng and Zhang, Lingming}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Forty-first International Conference on Machine Learning}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://openreview.net/forum?id=XUeoOBid3x}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">NeurIPS’23</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="liu2023is" class="col-sm-9"> <div class="title">Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation</div> <div class="author"> <em><b>Jiawei Liu*</b></em>, <a href="https://steven.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Chunqiu Steven Xia*</a>, <a href="https://kristoff-starling.github.io/" target="_blank" rel="noopener noreferrer">Yuyao Wang</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Thirty-seventh Conference on Neural Information Processing Systems</em>. 2023 </div> <b style="color:#FF0000;font-weight:800"> Over 400k HuggingFace downloads; integrated by various industries</b> <div class="links"> <a href="https://openreview.net/forum?id=1qvx610Cu7" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://docs.google.com/presentation/d/1eTxzUQG9uHaU13BGhrqm4wH5NmMZiM3nI0ezKlODxKs" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Slides</a> <a href="https://evalplus.github.io/" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://huggingface.co/evalplus" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">🤗 HF</a> <a href="https://github.com/evalplus/evalplus" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/evalplus/evalplus?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2023is</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Is Your Code Generated by Chat{GPT} Really Correct? Rigorous Evaluation of Large Language Models for Code Generation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Xia, Chunqiu Steven and Wang, Yuyao and Zhang, Lingming}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Thirty-seventh Conference on Neural Information Processing Systems}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://openreview.net/forum?id=1qvx610Cu7}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ESEC/FSE’23</abbr></div> <div class="row justify-content-center"> <img class="artifact" src="/assets/img/availablev11.png" alt="Atifact Available"><img class="artifact" src="/assets/img/reusablev11.png" alt="Atifact Reusable"> </div> </center> </div> <div id="liu2023neuri" class="col-sm-9"> <div class="title">NeuRI: Diversifying DNN Generation via Inductive Rule Inference</div> <div class="author"> <em><b>Jiawei Liu</b></em>, <a href="https://co1in.me/" target="_blank" rel="noopener noreferrer">Jinjun Peng</a>, <a href="https://kristoff-starling.github.io/" target="_blank" rel="noopener noreferrer">Yuyao Wang</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering</em>. 2023 </div> <b style="color:#FF0000;font-weight:800"> 🏆 ACM SIGSOFT Distinguished Paper Award</b> <div class="links"> <a href="https://dl.acm.org/doi/10.1145/3611643.3616337" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://docs.google.com/presentation/d/1Z8BU9SygcAC5SIx61jA9DCkr_xRL7NWMD9_lIufkKiU" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Slides</a> <a href="https://github.com/ise-uiuc/neuri-artifact" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Artifact</a> <a href="https://github.com/ise-uiuc/neuri-artifact" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/neuri-artifact?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2023neuri</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{NeuRI: Diversifying DNN Generation via Inductive Rule Inference}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Peng, Jinjun and Wang, Yuyao and Zhang, Lingming}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="na">isbn</span> <span class="p">=</span> <span class="s">{9798400703270}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computing Machinery}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3611643.3616337}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3611643.3616337}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{657--669}</span><span class="p">,</span> <span class="na">numpages</span> <span class="p">=</span> <span class="s">{13}</span><span class="p">,</span> <span class="na">location</span> <span class="p">=</span> <span class="s">{San Francisco, CA, USA}</span><span class="p">,</span> <span class="na">series</span> <span class="p">=</span> <span class="s">{ESEC/FSE 2023}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ASPLOS’23</abbr></div> <div class="row justify-content-center"> <img class="artifact" src="/assets/img/availablev11.png" alt="Atifact Available"><img class="artifact" src="/assets/img/functionalv11.png" alt="Atifact Functional"><img class="artifact" src="/assets/img/reproducedv11.png" alt="Results Reproduced"> </div> </center> </div> <div id="liu2023nnsmith" class="col-sm-9"> <div class="title">NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers</div> <div class="author"> <em><b>Jiawei Liu*</b></em>, <a href="https://cs.nyu.edu/~jl10439/" target="_blank" rel="noopener noreferrer">Jinkun Lin*</a>, <a href="https://www.ruffy.eu/" target="_blank" rel="noopener noreferrer">Fabian Ruffy</a>, <a href="https://naizhengtan.github.io/" target="_blank" rel="noopener noreferrer">Cheng Tan</a>, <a href="http://www.news.cs.nyu.edu/~jinyang/" target="_blank" rel="noopener noreferrer">Jinyang Li</a>, <a href="https://cs.nyu.edu/~apanda/" target="_blank" rel="noopener noreferrer">Aurojit Panda</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2</em>. 2023 </div> <b style="color:#FF0000;font-weight:800"> 🏆 Distinguished Artifact Award</b> <div class="links"> <a href="http://arxiv.org/abs/2207.13066" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="/assets/pdf/nnsmith_asplos_poster_jiawei.pdf" class="btn btn-sm z-depth-0" role="button">Poster</a> <a href="/assets/pdf/nnsmith-asplos-main-jiawei-v4.pdf" class="btn btn-sm z-depth-0" role="button">Slides</a> <a href="http://nnsmith-asplos.rtfd.io/" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Artifact</a> <a href="https://github.com/ise-uiuc/nnsmith" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/nnsmith?style=social&logo=github&logoColor=b509ac"></a><a href="https://pypi.org/project/nnsmith" target="_blank" rel="noopener noreferrer"> <img alt="PyPI Downloads" src="https://raw.githubusercontent.com/ganler/ganler/master/nnsmith_pypi.svg"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2023nnsmith</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Lin, Jinkun and Ruffy, Fabian and Tan, Cheng and Li, Jinyang and Panda, Aurojit and Zhang, Lingming}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="na">isbn</span> <span class="p">=</span> <span class="s">{9781450399166}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computing Machinery}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3575693.3575707}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3575693.3575707}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{530--543}</span><span class="p">,</span> <span class="na">numpages</span> <span class="p">=</span> <span class="s">{14}</span><span class="p">,</span> <span class="na">keywords</span> <span class="p">=</span> <span class="s">{Deep Learning Compilers, Compiler Testing, Fuzzing}</span><span class="p">,</span> <span class="na">location</span> <span class="p">=</span> <span class="s">{Vancouver, BC, Canada}</span><span class="p">,</span> <span class="na">series</span> <span class="p">=</span> <span class="s">{ASPLOS 2023}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">OOPSLA’22</abbr></div> <div class="row justify-content-center"> <img class="artifact" src="/assets/img/availablev11.png" alt="Atifact Available"><img class="artifact" src="/assets/img/reusablev11.png" alt="Atifact Reusable"> </div> </center> </div> <div id="liu2022coverage" class="col-sm-9"> <div class="title">Coverage-guided tensor compiler fuzzing with joint IR-pass mutation</div> <div class="author"> <em><b>Jiawei Liu</b></em>, <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="https://scholar.google.com/citations?user=LawrlxIAAAAJ" target="_blank" rel="noopener noreferrer">Sen Yang</a>, <a href="https://dengyinlin.github.io/" target="_blank" rel="noopener noreferrer">Yinlin Deng</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the ACM on Programming Languages 6 (OOPSLA1)</em>. Apr 2022 </div> <div class="links"> <a href="https://dl.acm.org/doi/10.1145/3527317" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="/assets/pdf/tzer-presentation.pdf" class="btn btn-sm z-depth-0" role="button">Slides</a> <a href="https://tzer.rtfd.io/en/latest/markdown/artifact.html" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Artifact</a> <a href="https://github.com/ise-uiuc/tzer" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/tzer?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">liu2022coverage</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Coverage-guided tensor compiler fuzzing with joint IR-pass mutation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Wei, Yuxiang and Yang, Sen and Deng, Yinlin and Zhang, Lingming}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{Proceedings of the ACM on Programming Languages}</span><span class="p">,</span> <span class="na">volume</span> <span class="p">=</span> <span class="s">{6}</span><span class="p">,</span> <span class="na">number</span> <span class="p">=</span> <span class="s">{OOPSLA1}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{1--26}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2022}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{ACM New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3527317}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3527317}</span><span class="p">,</span> <span class="na">month</span> <span class="p">=</span> <span class="nv">apr</span><span class="p">,</span> <span class="na">articleno</span> <span class="p">=</span> <span class="s">{73}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> </ol> </div> <div id="allPapers" style="display:none;"> <ol class="bibliography"> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">NeurIPS’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="wei2024self" class="col-sm-9"> <div class="title">SelfCodeAlign: Self-Alignment for Code Generation</div> <div class="author"> <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, Federico Cassano, <em><b>Jiawei Liu</b></em>, <a href="https://yifeng-ding.com/" target="_blank" rel="noopener noreferrer">Yifeng Ding</a>, Naman Jain, Zachary Mueller, Harm Vries, Leandro Werra, Arjun Guha, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>arXiv preprint arXiv:2410.24198</em>. 2024 </div> <div class="links"> <a href="http://arxiv.org/abs/2410.24198" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://huggingface.co/blog/sc2-instruct" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://github.com/bigcode-project/selfcodealign" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/bigcode-project/selfcodealign?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">wei2024self</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{SelfCodeAlign: Self-Alignment for Code Generation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Wei, Yuxiang and Cassano, Federico and Liu, Jiawei and Ding, Yifeng and Jain, Naman and Mueller, Zachary and de Vries, Harm and von Werra, Leandro and Guha, Arjun and Zhang, Lingming}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{arXiv preprint arXiv:2410.24198}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">Pre-print</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="liu2024learning" class="col-sm-9"> <div class="title">Learning Code Preference via Synthetic Evolution</div> <div class="author"> <em><b>Jiawei Liu</b></em>, <a href="https://scholar.google.com/citations?user=HnkaCSQAAAAJ&hl=en" target="_blank" rel="noopener noreferrer">Thanh Nguyen</a>, <a href="https://scholar.google.com/citations?user=phbnAuIAAAAJ" target="_blank" rel="noopener noreferrer">Mingyue Shang</a>, <a href="https://scholar.google.com/citations?user=nEuMO58AAAAJ" target="_blank" rel="noopener noreferrer">Hantian Ding</a>, <a href="https://eelxpeng.github.io/" target="_blank" rel="noopener noreferrer">Xiaopeng Li</a>, <a href="https://www.irisyuyu.com/" target="_blank" rel="noopener noreferrer">Yu Yu</a>, <a href="https://www.amazon.science/author/varun-kumar" target="_blank" rel="noopener noreferrer">Varun Kumar</a>, <a href="https://zijianwang.me/" target="_blank" rel="noopener noreferrer">Zijian Wang</a> </div> <div class="periodical"> <em>arXiv preprint arXiv:2410.03837</em>. 2024 </div> <div class="links"> <a href="http://arxiv.org/abs/2410.03837" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://llm-code-preference.github.io/" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://github.com/amazon-science/llm-code-preference" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/amazon-science/llm-code-preference?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">liu2024learning</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Learning Code Preference via Synthetic Evolution}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Nguyen, Thanh and Shang, Mingyue and Ding, Hantian and Li, Xiaopeng and Yu, Yu and Kumar, Varun and Wang, Zijian}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{arXiv preprint arXiv:2410.03837}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">COLM’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="liu2024evaluating" class="col-sm-9"> <div class="title">Evaluating Language Models for Efficient Code Generation</div> <div class="author"> <em><b>Jiawei Liu</b></em>, Songrun Xie, Junhao Wang, <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="https://yifeng-ding.com/" target="_blank" rel="noopener noreferrer">Yifeng Ding</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>First Conference on Language Modeling</em>. 2024 </div> <div class="links"> <a href="https://openreview.net/forum?id=IBCBMeAhmC" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="/assets/pdf/jiawei-colm-evalperf-poster.pdf" class="btn btn-sm z-depth-0" role="button">Poster</a> <a href="https://evalplus.github.io/evalperf.html" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://huggingface.co/evalplus" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">🤗 HF</a> <a href="https://github.com/evalplus/evalplus" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/evalplus/evalplus?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2024evaluating</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Evaluating Language Models for Efficient Code Generation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Xie, Songrun and Wang, Junhao and Wei, Yuxiang and Ding, Yifeng and Zhang, Lingming}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{First Conference on Language Modeling}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://openreview.net/forum?id=IBCBMeAhmC}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">OOPSLA’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="yang2023white" class="col-sm-9"> <div class="title">WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Models</div> <div class="author"> <a href="https://yangchenyuan.github.io/" target="_blank" rel="noopener noreferrer">Chenyuan Yang</a>, <a href="https://dengyinlin.github.io/" target="_blank" rel="noopener noreferrer">Yinlin Deng</a>, <a href="https://lry89757.github.io/" target="_blank" rel="noopener noreferrer">Runyu Lu</a>, Jiayi Yao, <em><b>Jiawei Liu</b></em>, <a href="https://reyhaneh.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Reyhaneh Jabbarvand</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proc. ACM Program. Lang. 8 (OOPSLA2)</em>. Oct 2024 </div> <div class="links"> <a href="https://dl.acm.org/doi/10.1145/3689736" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://github.com/ise-uiuc/WhiteFox" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/WhiteFox?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">yang2023white</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Yang, Chenyuan and Deng, Yinlin and Lu, Runyu and Yao, Jiayi and Liu, Jiawei and Jabbarvand, Reyhaneh and Zhang, Lingming}</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Models}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="na">issue_date</span> <span class="p">=</span> <span class="s">{October 2024}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computing Machinery}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{New York, NY, USA}</span><span class="p">,</span> <span class="na">volume</span> <span class="p">=</span> <span class="s">{8}</span><span class="p">,</span> <span class="na">number</span> <span class="p">=</span> <span class="s">{OOPSLA2}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3689736}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3689736}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{Proc. ACM Program. Lang.}</span><span class="p">,</span> <span class="na">month</span> <span class="p">=</span> <span class="nv">oct</span><span class="p">,</span> <span class="na">articleno</span> <span class="p">=</span> <span class="s">{296}</span><span class="p">,</span> <span class="na">numpages</span> <span class="p">=</span> <span class="s">{27}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ICML’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="wei2023magic" class="col-sm-9"> <div class="title">Magicoder: Empowering Code Generation with OSS-Instruct</div> <div class="author"> <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="https://zhewang2001.github.io/" target="_blank" rel="noopener noreferrer">Zhe Wang</a>, <em><b>Jiawei Liu</b></em>, <a href="https://yifeng-ding.com/" target="_blank" rel="noopener noreferrer">Yifeng Ding</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Forty-first International Conference on Machine Learning</em>. Oct 2024 </div> <b style="color:#FF0000;font-weight:800"> Adopted by Meta Llama 3.1, Google CodeGemma, and IBM Granite</b> <div class="links"> <a href="https://openreview.net/forum?id=XUeoOBid3x" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://yuxiang.cs.illinois.edu/static/documents/Magicoder-Talk-Snowflake.pdf" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Slides</a> <a href="https://github.com/ise-uiuc/magicoder" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/magicoder?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">wei2023magic</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Magicoder: Empowering Code Generation with {OSS}-Instruct}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Wei, Yuxiang and Wang, Zhe and Liu, Jiawei and Ding, Yifeng and Zhang, Lingming}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Forty-first International Conference on Machine Learning}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://openreview.net/forum?id=XUeoOBid3x}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ACL’24</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="ding2024xft" class="col-sm-9"> <div class="title">XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts</div> <div class="author"> <a href="https://yifeng-ding.com/" target="_blank" rel="noopener noreferrer">Yifeng Ding</a>, <em><b>Jiawei Liu</b></em>, <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)</em>. Aug 2024 </div> <div class="links"> <a href="https://dl.acm.org/doi/10.18653/v1/2024.acl-long.699" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://github.com/ise-uiuc/xft" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/xft?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">ding2024xft</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{{XFT}: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Ding, Yifeng and Liu, Jiawei and Wei, Yuxiang and Zhang, Lingming}</span><span class="p">,</span> <span class="na">editor</span> <span class="p">=</span> <span class="s">{Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)}</span><span class="p">,</span> <span class="na">month</span> <span class="p">=</span> <span class="nv">aug</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{Bangkok, Thailand}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computational Linguistics}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://aclanthology.org/2024.acl-long.699}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.18653/v1/2024.acl-long.699}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{12941--12955}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">Pre-print</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="feng2024emerging" class="col-sm-9"> <div class="title">Emerging Platforms Meet Emerging LLMs: A Year-Long Journey of Top-Down Development</div> <div class="author"> <a href="https://syfeng.net/" target="_blank" rel="noopener noreferrer">Siyuan Feng*</a>, <em><b>Jiawei Liu*</b></em>, <a href="https://ruihanglai.com/" target="_blank" rel="noopener noreferrer">Ruihang Lai</a>, <a href="https://www.charlieruan.com/" target="_blank" rel="noopener noreferrer">Charlie F. Ruan</a>, Yong Yu, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a>, <a href="https://tqchen.com/" target="_blank" rel="noopener noreferrer">Tianqi Chen</a> </div> <div class="periodical"> <em>arXiv preprint arXiv:2404.09151</em>. Aug 2024 </div> <div class="links"> <a href="http://arxiv.org/abs/2404.09151" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://github.com/mlc-ai/mlc-llm" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/mlc-ai/mlc-llm?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">feng2024emerging</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Emerging Platforms Meet Emerging LLMs: A Year-Long Journey of Top-Down Development}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Feng, Siyuan and Liu, Jiawei and Lai, Ruihang and Ruan, Charlie F. and Yu, Yong and Zhang, Lingming and Chen, Tianqi}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{arXiv preprint arXiv:2404.09151}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">Pre-print</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="Lozhkov2024StarCoder2A" class="col-sm-9"> <div class="title">StarCoder 2 and The Stack v2: The Next Generation</div> <div class="author"> Anton Lozhkov, Raymond Li, Loubna Ben Allal, Federico Cassano, Joel Lamy-Poirier, Nouamane Tazi, Ao Tang, Dmytro Pykhtar, <em><b>Jiawei Liu</b></em>, <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a> and <span class="more-authors" title="click to view 56 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '56 more authors' ? 'Tianyang Liu, Max Tian, Denis Kocetkov, Arthur Zucker, Younes Belkada, Zijian Wang, Qian Liu, Dmitry Abulkhanov, Indraneil Paul, Zhuang Li, Wen-Ding Li, Megan L. Risdal, Jia Li, Jian Zhu, Terry Yue Zhuo, Evgenii Zheltonozhskii, Nii Osae Osae Dade, Wenhao Yu, Lucas Krauss, Naman Jain, Yixuan Su, Xuanli He, Manan Dey, Edoardo Abati, Yekun Chai, Niklas Muennighoff, Xiangru Tang, Muhtasham Oblokulov, Christopher Akiki, Marc Marone, Chenghao Mou, Mayank Mishra, Alexander Gu, Binyuan Hui, Tri Dao, Armel Zebaze, Olivier Dehaene, Nicolas Patry, Canwen Xu, Julian McAuley, Han Hu, Torsten Scholak, Sébastien Paquet, Jennifer Robinson, Carolyn Jane Anderson, Nicolas Chapados, Mostofa Patwary, Nima Tajbakhsh, Yacine Jernite, Carlos Muñoz Ferrandis, Lingming Zhang, Sean Hughes, Thomas Wolf, Arjun Guha, Leandro Werra, Harm Vries' : '56 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, 15); ">56 more authors</span> </div> <div class="periodical"> <em>arXiv preprint arXiv:2402.19173</em>. Aug 2024 </div> <div class="links"> <a href="http://arxiv.org/abs/2402.19173" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://github.com/bigcode-project/starcoder2" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/bigcode-project/starcoder2?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">Lozhkov2024StarCoder2A</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{StarCoder 2 and The Stack v2: The Next Generation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Lozhkov, Anton and Li, Raymond and Allal, Loubna Ben and Cassano, Federico and Lamy-Poirier, Joel and Tazi, Nouamane and Tang, Ao and Pykhtar, Dmytro and Liu, Jiawei and Wei, Yuxiang and Liu, Tianyang and Tian, Max and Kocetkov, Denis and Zucker, Arthur and Belkada, Younes and Wang, Zijian and Liu, Qian and Abulkhanov, Dmitry and Paul, Indraneil and Li, Zhuang and Li, Wen-Ding and Risdal, Megan L. and Li, Jia and Zhu, Jian and Zhuo, Terry Yue and Zheltonozhskii, Evgenii and Dade, Nii Osae Osae and Yu, Wenhao and Krauss, Lucas and Jain, Naman and Su, Yixuan and He, Xuanli and Dey, Manan and Abati, Edoardo and Chai, Yekun and Muennighoff, Niklas and Tang, Xiangru and Oblokulov, Muhtasham and Akiki, Christopher and Marone, Marc and Mou, Chenghao and Mishra, Mayank and Gu, Alexander and Hui, Binyuan and Dao, Tri and Zebaze, Armel and Dehaene, Olivier and Patry, Nicolas and Xu, Canwen and McAuley, Julian and Hu, Han and Scholak, Torsten and Paquet, S{\'e}bastien and Robinson, Jennifer and Anderson, Carolyn Jane and Chapados, Nicolas and Patwary, Mostofa and Tajbakhsh, Nima and Jernite, Yacine and Ferrandis, Carlos Mu{\~n}oz and Zhang, Lingming and Hughes, Sean and Wolf, Thomas and Guha, Arjun and von Werra, Leandro and de Vries, Harm}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{arXiv preprint arXiv:2402.19173}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2024}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">Pre-print</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="lai2023relax" class="col-sm-9"> <div class="title">Relax: Composable Abstractions for End-to-End Dynamic Machine Learning</div> <div class="author"> <a href="https://ruihanglai.com/" target="_blank" rel="noopener noreferrer">Ruihang Lai</a>, Junru Shao, <a href="https://syfeng.net/" target="_blank" rel="noopener noreferrer">Siyuan Feng</a>, Steven S. Lyubomirsky, Bohan Hou, Wuwei Lin, Zihao Ye, Hongyi Jin, <a href="https://yuchenjin.github.io/" target="_blank" rel="noopener noreferrer">Yuchen Jin</a>, <em><b>Jiawei Liu</b></em> and <span class="more-authors" title="click to view 9 more authors" onclick=" var element=$(this); element.attr('title', ''); var more_authors_text=element.text() == '9 more authors' ? 'Lesheng Jin, Yaxing Cai, Ziheng Jiang, Yong Wu, Sunghyun Park, Prakalp Srivastava, Jared G. Roesch, Todd C. Mowry, Tianqi Chen' : '9 more authors'; var cursorPosition=0; var textAdder=setInterval(function(){ element.text(more_authors_text.substring(0, cursorPosition + 1)); if (++cursorPosition == more_authors_text.length){ clearInterval(textAdder); } }, 15); ">9 more authors</span> </div> <div class="periodical"> <em>arXiv preprint arXiv:2311.02103</em>. Aug 2023 </div> <div class="links"> <a href="http://arxiv.org/abs/2311.02103" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://github.com/apache/tvm" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/apache/tvm?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">lai2023relax</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Relax: Composable Abstractions for End-to-End Dynamic Machine Learning}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Lai, Ruihang and Shao, Junru and Feng, Siyuan and Lyubomirsky, Steven S. and Hou, Bohan and Lin, Wuwei and Ye, Zihao and Jin, Hongyi and Jin, Yuchen and Liu, Jiawei and Jin, Lesheng and Cai, Yaxing and Jiang, Ziheng and Wu, Yong and Park, Sunghyun and Srivastava, Prakalp and Roesch, Jared G. and Mowry, Todd C. and Chen, Tianqi}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{arXiv preprint arXiv:2311.02103}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">NeurIPS’23</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="liu2023is" class="col-sm-9"> <div class="title">Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation</div> <div class="author"> <em><b>Jiawei Liu*</b></em>, <a href="https://steven.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Chunqiu Steven Xia*</a>, <a href="https://kristoff-starling.github.io/" target="_blank" rel="noopener noreferrer">Yuyao Wang</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Thirty-seventh Conference on Neural Information Processing Systems</em>. Aug 2023 </div> <b style="color:#FF0000;font-weight:800"> Over 400k HuggingFace downloads; integrated by various industries</b> <div class="links"> <a href="https://openreview.net/forum?id=1qvx610Cu7" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://docs.google.com/presentation/d/1eTxzUQG9uHaU13BGhrqm4wH5NmMZiM3nI0ezKlODxKs" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Slides</a> <a href="https://evalplus.github.io/" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Website</a> <a href="https://huggingface.co/evalplus" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">🤗 HF</a> <a href="https://github.com/evalplus/evalplus" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/evalplus/evalplus?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2023is</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Is Your Code Generated by Chat{GPT} Really Correct? Rigorous Evaluation of Large Language Models for Code Generation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Xia, Chunqiu Steven and Wang, Yuyao and Zhang, Lingming}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Thirty-seventh Conference on Neural Information Processing Systems}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://openreview.net/forum?id=1qvx610Cu7}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ESEC/FSE’23</abbr></div> <div class="row justify-content-center"> <img class="artifact" src="/assets/img/availablev11.png" alt="Atifact Available"><img class="artifact" src="/assets/img/reusablev11.png" alt="Atifact Reusable"> </div> </center> </div> <div id="liu2023neuri" class="col-sm-9"> <div class="title">NeuRI: Diversifying DNN Generation via Inductive Rule Inference</div> <div class="author"> <em><b>Jiawei Liu</b></em>, <a href="https://co1in.me/" target="_blank" rel="noopener noreferrer">Jinjun Peng</a>, <a href="https://kristoff-starling.github.io/" target="_blank" rel="noopener noreferrer">Yuyao Wang</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering</em>. Aug 2023 </div> <b style="color:#FF0000;font-weight:800"> 🏆 ACM SIGSOFT Distinguished Paper Award</b> <div class="links"> <a href="https://dl.acm.org/doi/10.1145/3611643.3616337" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://docs.google.com/presentation/d/1Z8BU9SygcAC5SIx61jA9DCkr_xRL7NWMD9_lIufkKiU" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Slides</a> <a href="https://github.com/ise-uiuc/neuri-artifact" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Artifact</a> <a href="https://github.com/ise-uiuc/neuri-artifact" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/neuri-artifact?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2023neuri</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{NeuRI: Diversifying DNN Generation via Inductive Rule Inference}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Peng, Jinjun and Wang, Yuyao and Zhang, Lingming}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="na">isbn</span> <span class="p">=</span> <span class="s">{9798400703270}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computing Machinery}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3611643.3616337}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3611643.3616337}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{657--669}</span><span class="p">,</span> <span class="na">numpages</span> <span class="p">=</span> <span class="s">{13}</span><span class="p">,</span> <span class="na">location</span> <span class="p">=</span> <span class="s">{San Francisco, CA, USA}</span><span class="p">,</span> <span class="na">series</span> <span class="p">=</span> <span class="s">{ESEC/FSE 2023}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">ASPLOS’23</abbr></div> <div class="row justify-content-center"> <img class="artifact" src="/assets/img/availablev11.png" alt="Atifact Available"><img class="artifact" src="/assets/img/functionalv11.png" alt="Atifact Functional"><img class="artifact" src="/assets/img/reproducedv11.png" alt="Results Reproduced"> </div> </center> </div> <div id="liu2023nnsmith" class="col-sm-9"> <div class="title">NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers</div> <div class="author"> <em><b>Jiawei Liu*</b></em>, <a href="https://cs.nyu.edu/~jl10439/" target="_blank" rel="noopener noreferrer">Jinkun Lin*</a>, <a href="https://www.ruffy.eu/" target="_blank" rel="noopener noreferrer">Fabian Ruffy</a>, <a href="https://naizhengtan.github.io/" target="_blank" rel="noopener noreferrer">Cheng Tan</a>, <a href="http://www.news.cs.nyu.edu/~jinyang/" target="_blank" rel="noopener noreferrer">Jinyang Li</a>, <a href="https://cs.nyu.edu/~apanda/" target="_blank" rel="noopener noreferrer">Aurojit Panda</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2</em>. Aug 2023 </div> <b style="color:#FF0000;font-weight:800"> 🏆 Distinguished Artifact Award</b> <div class="links"> <a href="http://arxiv.org/abs/2207.13066" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="/assets/pdf/nnsmith_asplos_poster_jiawei.pdf" class="btn btn-sm z-depth-0" role="button">Poster</a> <a href="/assets/pdf/nnsmith-asplos-main-jiawei-v4.pdf" class="btn btn-sm z-depth-0" role="button">Slides</a> <a href="http://nnsmith-asplos.rtfd.io/" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Artifact</a> <a href="https://github.com/ise-uiuc/nnsmith" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/nnsmith?style=social&logo=github&logoColor=b509ac"></a><a href="https://pypi.org/project/nnsmith" target="_blank" rel="noopener noreferrer"> <img alt="PyPI Downloads" src="https://raw.githubusercontent.com/ganler/ganler/master/nnsmith_pypi.svg"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">liu2023nnsmith</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Lin, Jinkun and Ruffy, Fabian and Tan, Cheng and Li, Jinyang and Panda, Aurojit and Zhang, Lingming}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2023}</span><span class="p">,</span> <span class="na">isbn</span> <span class="p">=</span> <span class="s">{9781450399166}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computing Machinery}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3575693.3575707}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3575693.3575707}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{530--543}</span><span class="p">,</span> <span class="na">numpages</span> <span class="p">=</span> <span class="s">{14}</span><span class="p">,</span> <span class="na">keywords</span> <span class="p">=</span> <span class="s">{Deep Learning Compilers, Compiler Testing, Fuzzing}</span><span class="p">,</span> <span class="na">location</span> <span class="p">=</span> <span class="s">{Vancouver, BC, Canada}</span><span class="p">,</span> <span class="na">series</span> <span class="p">=</span> <span class="s">{ASPLOS 2023}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">OOPSLA’22</abbr></div> <div class="row justify-content-center"> <img class="artifact" src="/assets/img/availablev11.png" alt="Atifact Available"><img class="artifact" src="/assets/img/reusablev11.png" alt="Atifact Reusable"> </div> </center> </div> <div id="liu2022coverage" class="col-sm-9"> <div class="title">Coverage-guided tensor compiler fuzzing with joint IR-pass mutation</div> <div class="author"> <em><b>Jiawei Liu</b></em>, <a href="https://yuxiang.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Yuxiang Wei</a>, <a href="https://scholar.google.com/citations?user=LawrlxIAAAAJ" target="_blank" rel="noopener noreferrer">Sen Yang</a>, <a href="https://dengyinlin.github.io/" target="_blank" rel="noopener noreferrer">Yinlin Deng</a>, <a href="http://lingming.cs.illinois.edu/" target="_blank" rel="noopener noreferrer">Lingming Zhang</a> </div> <div class="periodical"> <em>Proceedings of the ACM on Programming Languages 6 (OOPSLA1)</em>. Apr 2022 </div> <div class="links"> <a href="https://dl.acm.org/doi/10.1145/3527317" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="/assets/pdf/tzer-presentation.pdf" class="btn btn-sm z-depth-0" role="button">Slides</a> <a href="https://tzer.rtfd.io/en/latest/markdown/artifact.html" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">Artifact</a> <a href="https://github.com/ise-uiuc/tzer" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/ise-uiuc/tzer?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@article</span><span class="p">{</span><span class="nl">liu2022coverage</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Coverage-guided tensor compiler fuzzing with joint IR-pass mutation}</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Liu, Jiawei and Wei, Yuxiang and Yang, Sen and Deng, Yinlin and Zhang, Lingming}</span><span class="p">,</span> <span class="na">journal</span> <span class="p">=</span> <span class="s">{Proceedings of the ACM on Programming Languages}</span><span class="p">,</span> <span class="na">volume</span> <span class="p">=</span> <span class="s">{6}</span><span class="p">,</span> <span class="na">number</span> <span class="p">=</span> <span class="s">{OOPSLA1}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{1--26}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2022}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{ACM New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3527317}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3527317}</span><span class="p">,</span> <span class="na">month</span> <span class="p">=</span> <span class="nv">apr</span><span class="p">,</span> <span class="na">articleno</span> <span class="p">=</span> <span class="s">{73}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> <li> <div class="row"> <div class="col-sm-3 abbr"> <center> <div class="row justify-content-center"><abbr class="badge">MM’21 OSC</abbr></div> <div class="row justify-content-center"></div> </center> </div> <div id="guo2021fast" class="col-sm-9"> <div class="title">Fast and Flexible Human Pose Estimation with HyperPose</div> <div class="author"> Yixiao Guo*, <em><b>Jiawei Liu*</b></em>, Guo Li*, <a href="https://luomai.github.io/" target="_blank" rel="noopener noreferrer">Luo Mai</a>, <a href="https://zsdonghao.github.io/" target="_blank" rel="noopener noreferrer">Hao Dong</a> </div> <div class="periodical"> <em>Proceedings of the 29th ACM International Conference on Multimedia</em>. Apr 2021 </div> <div class="links"> <a href="https://dl.acm.org/doi/10.1145/3474085.3478325" class="btn btn-sm z-depth-0" role="button" target="_blank" rel="noopener noreferrer">PAPER</a> <a class="bibtex btn btn-sm z-depth-0" role="button">Bib</a> <a href="https://github.com/tensorlayer/HyperPose" target="_blank" rel="noopener noreferrer"> <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/tensorlayer/HyperPose?style=social&logo=github&logoColor=b509ac"></a> </div> <div class="bibtex hidden"> <figure class="highlight"><pre><code class="language-bibtex" data-lang="bibtex"><span class="nc">@inproceedings</span><span class="p">{</span><span class="nl">guo2021fast</span><span class="p">,</span> <span class="na">author</span> <span class="p">=</span> <span class="s">{Guo, Yixiao and Liu, Jiawei and Li, Guo and Mai, Luo and Dong, Hao}</span><span class="p">,</span> <span class="na">title</span> <span class="p">=</span> <span class="s">{Fast and Flexible Human Pose Estimation with HyperPose}</span><span class="p">,</span> <span class="na">year</span> <span class="p">=</span> <span class="s">{2021}</span><span class="p">,</span> <span class="na">isbn</span> <span class="p">=</span> <span class="s">{9781450386517}</span><span class="p">,</span> <span class="na">publisher</span> <span class="p">=</span> <span class="s">{Association for Computing Machinery}</span><span class="p">,</span> <span class="na">address</span> <span class="p">=</span> <span class="s">{New York, NY, USA}</span><span class="p">,</span> <span class="na">url</span> <span class="p">=</span> <span class="s">{https://doi.org/10.1145/3474085.3478325}</span><span class="p">,</span> <span class="na">doi</span> <span class="p">=</span> <span class="s">{10.1145/3474085.3478325}</span><span class="p">,</span> <span class="na">booktitle</span> <span class="p">=</span> <span class="s">{Proceedings of the 29th ACM International Conference on Multimedia}</span><span class="p">,</span> <span class="na">pages</span> <span class="p">=</span> <span class="s">{3763--3766}</span><span class="p">,</span> <span class="na">numpages</span> <span class="p">=</span> <span class="s">{4}</span><span class="p">,</span> <span class="na">keywords</span> <span class="p">=</span> <span class="s">{computer vision, high-performance computing, pose estimation}</span><span class="p">,</span> <span class="na">location</span> <span class="p">=</span> <span class="s">{Virtual Event, China}</span><span class="p">,</span> <span class="na">series</span> <span class="p">=</span> <span class="s">{MM '21}</span><span class="p">,</span> <span class="p">}</span></code></pre></figure> </div> </div> </div> </li> </ol> </div> <br> </div> <script src="https://code.jquery.com/jquery-3.6.4.min.js"></script> <script>$(document).ready(function(){$("#toggleText").click(function(e){e.preventDefault(),$("#selectedPapers").toggle(),$("#allPapers").toggle();var t=$("#selectedPapers").is(":visible")?"Show More":"Show Selected";$("#toggleText").text(t)})});</script> <div class="news"> <h2>Awards & Honors</h2> <p> <b><a href="https://www.amazon.science/trusted-ai-challenge" target="_blank" rel="noopener noreferrer"> Selected Proposal, Amazon Trusted AI Challenge ($250K)</a></b> <span style="float:right;">2024</span> </p> <p> <b><a href="https://openai.com/form/researcher-access-program/" target="_blank" rel="noopener noreferrer"> OpenAI Researcher Access Program</a></b> <span style="float:right;">2024</span> </p> <p> <b><a href="https://mlcommons.org/2024/06/2024-mlc-rising-stars/" target="_blank" rel="noopener noreferrer"> Machine Learning and Systems Rising Stars</a></b> <span style="float:right;">2024</span> </p> <p> <b><a href="https://cs.illinois.edu/about/awards/graduate-fellowships-awards/yee-memorial-fund-fellowship" target="_blank" rel="noopener noreferrer"> Warren W. Yee Memorial Fellowship, University of Illinois</a></b> <span style="float:right;">2024</span> </p> <p> <b><a href="https://www.acm.org/conferences/best-paper-awards" target="_blank" rel="noopener noreferrer"> ACM SIGSOFT Distinguished Paper Award (FSE'23)</a></b> <span style="float:right;">2023</span> </p> <p> <b><a href="https://asplos-conference.org/asplos2023/index.html" target="_blank" rel="noopener noreferrer">Distinguished Artifact Award (ASPLOS'23)</a></b> <span style="float:right;">2023</span> </p> </div> <div class="news"> <h2>Invited Talk</h2> <p> <b><a href="https://www.uber.com/fr/en/about/science/" target="_blank" rel="noopener noreferrer">Programming Systems, Uber</a></b>: Evaluating LLMs for Correct & Efficient Code Generation <span style="float:right;">Sept 2024</span> </p> <p> <b><a href="https://www.rayb.info/ariselab" target="_blank" rel="noopener noreferrer">ARiSE Lab, Columbia University</a></b>: Simplify the Making of Great Software in the ML Era <span style="float:right;">April 2024</span> </p> <p> <b><a href="https://www.snowflake.com/blog/use-ai-snowflake-cortex/" target="_blank" rel="noopener noreferrer">Snowflake GenAI</a></b>: Rigorous Evaluation of LLMs for Code (<a href="https://docs.google.com/presentation/d/1eTxzUQG9uHaU13BGhrqm4wH5NmMZiM3nI0ezKlODxKs" target="_blank" rel="noopener noreferrer">Slides</a>) <span style="float:right;">Feb 2024</span> </p> <p> <b><a href="https://ast.ethz.ch/" target="_blank" rel="noopener noreferrer">AST Lab, ETH Zürich</a></b>: Generating Test-Cases for ML Compilers (<a href="https://docs.google.com/presentation/d/1GkALbU1Gq4mbAqQkqeUpw92dJV5efcwcscsLU0JnI6Y" target="_blank" rel="noopener noreferrer">Slides</a>) <span style="float:right;">Jan 2024</span> </p> <p> <b><a href="https://github.com/gai4se/GAI4SE-Course" target="_blank" rel="noopener noreferrer">GAI4SE, NC State University</a></b>: LLMs for Software Testing (Guest Lecture) <span style="float:right;">Nov 2023</span> </p> <p> <b><a href="https://www.tvmcon.org/talks/automating-dl-compiler-bug-finding-with-nnsmith" target="_blank" rel="noopener noreferrer">Apache TVM Conference</a></b>: Automating DL Compiler Bug Finding with NNSmith <span style="float:right;">Mar 2023</span> </p> <p> <b><a href="https://sampl.cs.washington.edu/talks.html" target="_blank" rel="noopener noreferrer">SAMPL, University of Washington</a></b>: Coverage-Guided Tensor Compiler Fuzzing (<a href="assets/pdf/tzer-presentation.pdf">Slides</a>) <span style="float:right;">May 2022</span> </p> </div> <div class="news"> <h2>Service</h2> <p> <b>Organizing</b>: <a href="https://llm4code.github.io/" target="_blank" rel="noopener noreferrer"><b>LLM4Code@ICSE</b>'{24,25} (Publicity Chair)</a> </p> <p> <b>Program Committee/Reviewer</b>: <a href="https://ase-conferences.org/" target="_blank" rel="noopener noreferrer"><b>ASE</b>'24</a>, <a href="https://www.computer.org/csdl/journal/ts" target="_blank" rel="noopener noreferrer"><b>TSE</b></a>, <a href="https://dl.acm.org/journal/tosem" target="_blank" rel="noopener noreferrer"><b>TOSEM</b></a>, <a href="https://neurips.cc/" target="_blank" rel="noopener noreferrer"><b>NeurIPS</b>'24</a>, <a href="https://iclr.cc/" target="_blank" rel="noopener noreferrer"><b>ICLR</b>'25</a> </p> <p> <b>Artifact Evaluation Committee</b>: <a href="https://pldi23.sigplan.org/track/pldi-2023-pldi-research-artifacts" target="_blank" rel="noopener noreferrer"><b>PLDI</b>'23</a>, <a href="https://www.usenix.org/conference/osdi22/call-for-artifacts" target="_blank" rel="noopener noreferrer"><b>OSDI</b>'22</a>, <a href="https://www.usenix.org/conference/atc22/call-for-artifacts" target="_blank" rel="noopener noreferrer"><b>ATC</b>'22</a> </p> </div> <br> <div class="social"> <div class="contact-icons"> <a href="https://scholar.google.com/citations?user=Vw6el1AAAAAJ" title="Google Scholar" target="_blank" rel="noopener noreferrer"><i class="ai ai-google-scholar"></i></a> <a href="https://github.com/ganler" title="GitHub" target="_blank" rel="noopener noreferrer"><i class="fab fa-github"></i></a> <a href="https://www.linkedin.com/in/jiawei-liu-uiuc" title="LinkedIn" target="_blank" rel="noopener noreferrer"><i class="fab fa-linkedin"></i></a> <a href="https://twitter.com/JiaweiLiu_" title="Twitter" target="_blank" rel="noopener noreferrer"><i class="fab fa-x-twitter"></i></a> <a id="WeChatBtn" title="WeChat"><i class="fa-brands fa-weixin"></i></a> <div id="WeChatMod" class="wechat-modal"> <img src="/assets/img/wxqr.jpg" alt="WeChat QR" id="WeChatQR"> </div> <script>for(var wechatModal=document.getElementById("WeChatMod"),wechatBtn=document.querySelectorAll('[id="WeChatBtn"]'),i=0;i<wechatBtn.length;i++)wechatBtn[i].onclick=function(){wechatModal.style.display="block"};window.onclick=function(t){t.target==wechatModal&&(wechatModal.style.display="none")};</script> </div> <div class="contact-note"> </div> </div> </article> </div> </div> <footer class="fixed-bottom"> <div class="container mt-0"> © Copyright 2024 Jiawei Liu. </div> </footer> <script src="https://cdn.jsdelivr.net/npm/jquery@3.6.0/dist/jquery.min.js" integrity="sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=" crossorigin="anonymous"></script> <script src="https://cdn.jsdelivr.net/npm/bootstrap@4.6.1/dist/js/bootstrap.bundle.min.js" integrity="sha256-fgLAgv7fyCGopR/gBNq2iW3ZKIdqIcyshnUULC4vex8=" crossorigin="anonymous"></script> <script src="https://cdn.jsdelivr.net/npm/mdbootstrap@4.20.0/js/mdb.min.js" integrity="sha256-NdbiivsvWt7VYCt6hYNT3h/th9vSTL4EDWeGs5SN3DA=" crossorigin="anonymous"></script> <script defer src="https://cdn.jsdelivr.net/npm/masonry-layout@4.2.2/dist/masonry.pkgd.min.js" integrity="sha256-Nn1q/fx0H7SNLZMQ5Hw5JLaTRZp0yILA/FRexe19VdI=" crossorigin="anonymous"></script> <script defer src="https://cdn.jsdelivr.net/npm/imagesloaded@4/imagesloaded.pkgd.min.js"></script> <script defer src="/assets/js/masonry.js" type="text/javascript"></script> <script defer src="https://cdn.jsdelivr.net/npm/medium-zoom@1.0.6/dist/medium-zoom.min.js" integrity="sha256-EdPgYcPk/IIrw7FYeuJQexva49pVRZNmt3LculEr7zM=" crossorigin="anonymous"></script> <script defer src="/assets/js/zoom.js"></script> <script defer src="/assets/js/common.js"></script> <script type="text/javascript">window.MathJax={tex:{tags:"ams"}};</script> <script defer type="text/javascript" id="MathJax-script" src="https://cdn.jsdelivr.net/npm/mathjax@3.2.0/es5/tex-mml-chtml.js"></script> <script defer src="https://polyfill.io/v3/polyfill.min.js?features=es6"></script> <script>for(var wechatModal=document.getElementById("WeChatMod"),wechatBtn=document.querySelectorAll('[id="WeChatBtn"]'),i=0;i<wechatBtn.length;i++)wechatBtn[i].onclick=function(){wechatModal.style.display="block"};window.onclick=function(t){t.target==wechatModal&&(wechatModal.style.display="none")};</script> </body> </html>