CINXE.COM

<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8">  <title>FACTS-IR Workshop @ SIGIR 2019 | facts-ir</title> <meta name="generator" content="Jekyll v3.8.5" /> <meta property="og:title" content="FACTS-IR Workshop @ SIGIR 2019" /> <meta property="og:locale" content="en_US" /> <meta name="description" content="FACTS IR Workshop @ SIGIR 2019" /> <meta property="og:description" content="FACTS IR Workshop @ SIGIR 2019" /> <link rel="canonical" href="https://fate-events.github.io/facts-ir/" /> <meta property="og:url" content="https://fate-events.github.io/facts-ir/" /> <meta property="og:site_name" content="facts-ir" /> <script type="application/ld+json"> {"headline":"FACTS-IR Workshop @ SIGIR 2019","@type":"WebSite","url":"https://fate-events.github.io/facts-ir/","name":"facts-ir","description":"FACTS IR Workshop @ SIGIR 2019","@context":"http://schema.org"}</script>  <meta name="viewport" content="width=device-width, initial-scale=1"> <meta name="theme-color" content="#157878"> <meta name="apple-mobile-web-app-status-bar-style" content="black-translucent"> <link rel="stylesheet" href="/facts-ir/assets/css/style.css?v=48b21799ad269b90ea9c37be5cd8b2c4b030b459"> </head> <body> <header class="page-header" role="banner"> <h1 class="project-name">FACTS-IR Workshop @ SIGIR 2019</h1>  </header> <main id="content" class="main-content" role="main"> <h2 id="facts-ir-workshop--sigir-2019">FACTS-IR Workshop @ SIGIR 2019</h2> <h1 id="workshop-objectives">Workshop Objectives</h1> <p>This workshop explores challenges in responsible information retrieval system development and deployment. The focus will be on determining actionable research agendas on five key dimensions of responsible information retrieval: fairness, accountability, confidentiality, transparency, and safety. Rather than just a mini-conference, this workshop will be an event during which participants will also be expected to work. The workshop aims to bring together a diverse set of researchers and practitioners interested in helping to develop the technical research agenda for responsible information retrieval.</p> <p>The full-day workshop will be organized in two parts:</p> <ul> <li>The first half-day will include presentations, based on the accepted papers by our PC members</li> <li>For the second half-day, participants will be organized in working groups and tasked with articulating a research agenda for one of the FACTS-IR topics (Fairness, Accountability, Confidentiality, Transparency, and Safety)</li> </ul> <p>To ensure that the working groups in the second part of the workshop will be productive, we may cap the number of participants.</p> <h3 id="proceedings">Proceedings</h3> <p>You can find the non-archival proceeding for the FACTS-IR workshop at: <a href="https://arxiv.org/html/1907.05755">https://arxiv.org/html/1907.05755</a></p> <h1 id="agenda">Agenda</h1> <h2 id="morning-sessions">Morning sessions</h2> <p>9:00-9:10 Welcome (10)</p> <h3 id="fairness">FAIRNESS</h3> <p>9:10-9:25 Invited talk - <strong>Preethi Lahoti (MPI-INF)</strong>: Operationalizing Individual Fairness for Algorithmic Decision Making (15)</p> <p>9:25-9:35 Paper talk - Fairness in Recommendation Ranking through Pairwise Comparisons (10)</p> <h3 id="accountability">ACCOUNTABILITY</h3> <p>9:35-9:50 Invited speaker - <strong>Maria Panteli (BBC)</strong> (15)</p> <p>9:50-10:00 Paper talk - CobWeb: A Research Prototype for Exploring User Bias in Political Fact-Checking (10)</p> <h3 id="transparency-1">TRANSPARENCY (1)</h3> <p>10:00-10:10 Paper talk - Do Transformer Attention Heads Provide Transparency in Abstractive Summarization? (10)</p> <p>10:10-10:20 Paper talk - Explaining Predictions from Tree-based Boosting Ensembles (10)</p> <p>10:20-10:30 Paper talk - Global Aggregations of Local Explanations for Black Box models (10)</p> <p><strong>10:30-11:00 BREAK</strong></p> <h3 id="transparency-2">TRANSPARENCY (2)</h3> <p>11:00-11:15 Invited talk – <strong>Krisztian Balog (University of Stavanger & Google)</strong> (15)</p> <h3 id="confidentiality">CONFIDENTIALITY</h3> <p>11:15-11:30 Invited talk - <strong>Mahmoud F. Sayed (University of Maryland)</strong> (15)</p> <p>11:30-11:40 The FACTS of Technology-Assisted Sensitivity Review (10)</p> <h3 id="ethics">ETHICS</h3> <p>11:40-11:55 Invited talk - <strong>Pierre-Nicolas Schwab (RTBF)</strong> (15)</p> <h3 id="breakout-groups-and-goal-setting">Breakout groups and goal setting</h3> <p>11:55-12:10 Overview of the afternoon session (15)</p> <p>12:10-12:30 Breakout group assignment (20)</p> <p><strong>12:30-1:30 LUNCH</strong></p> <h2 id="afternoon-sessions">Afternoon sessions</h2> <p>1:30-3:00 Breakout groups</p> <p><strong>3:00-3:30 BREAK</strong></p> <p>3:30-3:50 Breakout groups wrap-up</p> <p>3:50-4:40 Group discussion</p> <p>4:40-5:00 Next steps and farewell</p> <h1 id="call-for-papers">Call for Papers</h1> <p>The purpose of the workshop is to identify gaps in the technical emerging work on responsible IR, including undertheorized and underspecified issues related to each of these five areas of focus. We aim to create actionable technical research agendas for each of them.</p> <p>To this end, we welcome technical contributions and position papers as either long papers (8 pages) or extended abstracts (2-4 pages) on a wide range of topics, including:</p> <h3 id="fair-ir">Fair IR</h3> <p>The IR system should avoid discrimination across people and communities. To do so the notion of fairness should be contextual and well grounded in the application setup and domain. Achieving fairness may be further complicated by the multi-stakeholder nature of most IR systems.</p> <h3 id="accountable-ir">Accountable IR</h3> <p>The IR system should be able to justify its recommendations or actions to users and other stakeholders, as well as be reliable at all times. This requires an understanding of the potential harms of using the system and of who is more likely to be affected. It also requires recourse avenues and processes for redress.</p> <h3 id="confidential-ir">Confidential IR</h3> <p>The output or actions of the IR system should not reveal secrets. For example, IR systems often combine extensive behavioral logs to model their users, which if not properly handled can result in unintended leakage of information.</p> <h3 id="transparent-ir">Transparent IR</h3> <p>The IR system should be able to explain why and how the suggested results were obtained to users and other interested stakeholders. Providing proper explanations may require to answer who the users and the stakeholders are. More broadly, the IR systems should be able to enable third parties to monitor and probe that they behave as expected.</p> <h3 id="safe-ir">Safe IR</h3> <p>The IR system should be resilient to manipulation by possible adversarial parties, and should not expose the users to undesirable, harmful content.</p> <p>FACTS-IR is interested in technical contributions on these topics.</p> <h1 id="important-dates">Important Dates</h1> <ul> <li><strong>May 12, 2019</strong>: Workshop paper submissions due</li> <li><strong>May 31, 2019</strong>: Workshop paper notifications</li> <li><strong>June 30, 2019</strong>: Upload final version to arXiv</li> <li><strong>July 25, 2019</strong>: Workshop Day at SIGIR 2019</li> </ul> <h1 id="how-to-submit">How to submit</h1> <p>Papers should be in English, in PDF, and formatted using the standard ACM <em>sigconf</em> format, using the template available at <a href="https://www.acm.org/publications/proceedings-template">the ACM site</a>; Word users should use the Interim Template. FACTS-IR uses the HotCRP submission system: <a href="https://facts-ir-2019.hotcrp.com/">FACTS-IR submission site</a>.</p> <p>No official proceedings will be published, however accepted long paper submissions will be expected to be posted on <a href="arXiv.org">arXiv.org</a>. This is optional for extended abstract submissions. The review process is a single-blind.</p> <h1 id="organization">Organization</h1> <ul> <li>Alexandra Olteanu (Microsoft Research, US & Canada)</li> <li>Jean Garcia-Gathright (Spotify, US)</li> <li>Maarten de Rijke (University of Amsterdam, The Netherlands)</li> <li>Michael Ekstrand (Boise State University, US)</li> </ul> <h1 id="pc-members">PC Members</h1> <ul> <li>Ana-Andreea Stoica (Columbia University, US)</li> <li>Asia Biega (MPI, Germany)</li> <li>Ashudeep Singh (Cornell University, US)</li> <li>Avishek Anand (L3S, Germany)</li> <li>Carlos Castillo (UPF, Spain)</li> <li>Christo Wilson (Northeastern University, US)</li> <li>Damiano Spina (RMIT, Australia)</li> <li>Daniel Kluver (University of Minnesota, US)</li> <li>Diane Kelly (University of Tennessee, US)</li> <li>Dong Nguyen (Alan Turing Institute, UK)</li> <li>Emilia Gómez (UPF, Spain)</li> <li>Emre Kiciman (Microsoft Research, US)</li> <li>Faegheh Hasibi (Radboud University Nijmegen, The Netherlands)</li> <li>Fernando Diaz (Microsoft Research, Canada)</li> <li>Gianluca Demartini (The University of Queensland, Australia)</li> <li>Hinda Haned (Ahold Delhaize & University of Amsterdam, The Netherlands)</li> <li>Ingmar Weber (QCRI, Qatar)</li> <li>James Thom (RMIT, Australia)</li> <li>Mark D. Smucker (University of Waterloo, Canada)</li> <li>Meike Zehlike (TU Berlin, Germany)</li> <li>Min Zhang (Tsinghua University, China)</li> <li>Pierre-Nicolas Schwab (Solvay Brussels School of Economics and Management, Belgium)</li> <li>Rishabh Mehrotra (Spotify, UK)</li> <li>Ronald Robertson (Northeastern University, US)</li> <li>Solon Barocas (Cornell University & Microsoft Research, US)</li> <li>Stefano Balietti (Microsoft Research, US)</li> <li>Suzan Verberne (Leiden University, The Netherlands)</li> <li>Toshihiro Kamishima (National Institute of Advanced Industrial Science and Technology, Japan)</li> </ul> <h1 id="questions">Questions?</h1> <p>Please mail us at facts.ir.2019@gmail.com if you have any questions about the workshop.</p> <footer class="site-footer"> <span class="site-footer-credits">This page was generated by <a href="https://pages.github.com">GitHub Pages</a>.</span> </footer> </main> </body> </html>