CINXE.COM
CHAIR HOW-TO: Automatic Assignment of Reviewer | Microsoft Conference Management Toolkit Documentation
<!DOCTYPE html> <!--[if IE]><![endif]--> <html> <head> <meta charset="utf-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> <title>CHAIR HOW-TO: Automatic Assignment of Reviewer | Microsoft Conference Management Toolkit Documentation </title> <meta name="viewport" content="width=device-width"> <meta name="title" content="CHAIR HOW-TO: Automatic Assignment of Reviewer | Microsoft Conference Management Toolkit Documentation "> <meta name="generator" content="docfx 2.45.1.0"> <meta name="description" content="Microsoft's Conference Management Toolkit is a hosted academic conference management system. Modern interface, high scalability, extensive features and outstanding support are the signatures of Microsoft CMT."> <meta name="keywords" content="Microsoft CMT, conference submission system, conference submission software, conference submission tools, conference management system, conference management software, conference management tools, abstract management system, abstract management software, abstract management tools, abstract submission system, abstract submission software, abstract submission tools, abstract review system, abstract review software, abstract review tools, paper submission system, paper submission software, paper submission tools, peer review system, peer review software, conference reviewing system, conference reviewing tools"> <link rel="shortcut icon" href="../../favicon.ico"> <link rel="stylesheet" href="../../styles/docfx.vendor.css"> <link rel="stylesheet" href="../../styles/docfx.css"> <link rel="stylesheet" href="../../styles/main.css"> <meta property="docfx:navrel" content="../../toc.html"> <meta property="docfx:tocrel" content="../toc.html"> </head> <body data-spy="scroll" data-target="#affix" data-offset="120"> <div id="wrapper"> <header> <nav id="autocollapse" class="navbar navbar-inverse ng-scope" role="navigation"> <div class="container"> <div class="navbar-header"> <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar"></span> <span class="icon-bar"></span> <span class="icon-bar"></span> </button> <a class="navbar-brand" href="../../index.html"> </a> </div> <div class="collapse navbar-collapse" id="navbar"> <p class="navbar-center navbar-text" style="font-size: 22px">Microsoft Conference Management Toolkit</p> <form class="navbar-form navbar-right"> <a href="https://cmt3.research.microsoft.com/CMTSRM/" class="btn btn-success">Request Free CMT Site</a> <a href="/" class="btn btn-success">Login</a> </form> </div> </div> </nav> <div class="subnav navbar navbar-default"> <div class="container hide-when-search" id="breadcrumb"> <ul class="breadcrumb"> <li></li> </ul> </div> </div> </header> <div role="main" class="container body-content hide-when-search"> <div class="sidenav hide-when-search"> <a class="btn toc-toggle collapse" data-toggle="collapse" href="#sidetoggle" aria-expanded="false" aria-controls="sidetoggle">Show / Hide Table of Contents</a> <div class="sidetoggle collapse" id="sidetoggle"> <div id="sidetoc"></div> </div> </div> <div class="article row grid-right"> <div class="col-md-10"> <article class="content wrap" id="_content" data-uid=""> <h1 id="chair-how-to-automatic-assignment-of-reviewer">CHAIR HOW-TO: Automatic Assignment of Reviewer</h1> <div class="alert alert-warning" role="alert"> <p>Assigned papers are not visible until reviewing is enabled (for reviewers), or until meta-reviewing is enabled (for meta-reviewers).</p> </div> <h2 id="overview">OVERVIEW</h2> <p>Assigning Reviewers to Papers can be done with the Automatic Assignment wizard. This will be broken down in the following sections:</p> <ul> <li>Select Papers</li> <li>Select Reviewers</li> <li>Configure Options</li> <li>Confirm Assignments</li> </ul> <div class="NOTE"> <h5>Note</h5> <p>Use the status filter in the Chair Console to filter out unwanted papers, such as Desk Reject.</p> </div> <h2 id="pre-requisite">PRE-REQUISITE</h2> <p>There must be Reviewers in the conference before using the Automatic Assignment Wizard.</p> <div class="alert alert-warning" role="alert"><p>If there already Reviewer assignments but starting fresh is desired, then you can easily bulk delete the Reviewer assignments by going to the Chair Console, clicking 'Actions>Bulk Delete Assignment>' then 'Reviewer' in the secondary menu.</p></div> <h2 id="open-wizard">OPEN WIZARD</h2> <ul> <li>Click Actions, then select 'Automatic Assignment.'</li> </ul> <p><img src="images/auto-assign-reviewers/chair-consloe-auto-assign-reviewer.png" alt="Auto Assign Reviewers"></p> <ul> <li>In the secondary menu, click 'Reviewer.'</li> </ul> <p><img src="images/auto-assign-reviewers/secondary-menu-reviewer.png" alt="Auto Assign Reviewers"></p> <div class="IMPORTANT"> <h5>Important</h5> <p>Emails for assignments are not sent out automatically. They must be sent out <a href="https://cmt3.research.microsoft.com/docs/help/chair/email-reviewers.html">manually</a>.</p> </div> <h2 id="select-papers">SELECT PAPERS</h2> <p>From the Automatic Assignment Wizard page, you select the minimum number of Reviewers per Paper. You can first do this in bulk and then edit individual papers if needed.</p> <ul> <li>To do it in bulk, enter the minimum number of Reviewers per Paper, then click apply. In this case, we chose 2 Reviewers per Paper.</li> </ul> <p><img src="images/auto-assign-reviewers/set-min-number-reviewers.png" alt="Auto Assign Reviewers"></p> <ul> <li>This sets all selected Papers equally to 2.</li> </ul> <p><img src="images/auto-assign-reviewers/set-min-number-reviewers-applied.png" alt="Auto Assign Reviewers"></p> <ul> <li>Now, we want to adjust the minimum number of Reviewers for 2 papers. Let’s say you want Paper ID 28 to have a minimum of 4 reviewers, and Paper ID 26 to have a minimum of 1. Enter the number of reviewers in the corresponding rows and click ‘Next.’</li> </ul> <p><img src="images/auto-assign-reviewers/adjust-min-number-reviewers-next.png" alt="Auto Assign Reviewers"></p> <h2 id="select-reviewers">SELECT REVIEWERS</h2> <p>Here you select the maximum number of Papers per Reviewer. You can first do this in bulk and then edit individual papers if need be.</p> <ul> <li>To do it in bulk, enter the maximum number of Papers per Reviewer. In this case we chose 4. Click apply.<br> This sets all selected Reviewers equally to 4.</li> </ul> <p><img src="images/auto-assign-reviewers/set-reviewers-max-number-papers-no-quota.png" alt="Auto Assign Reviewers"></p> <p>Sometimes there are quotas set for some reviewers. For example, rev1@contoso.com has a quota of 2, and author-two@cmt.cmt has a quota of 1. The quotas will not be exceeded when setting maximum number of papers.</p> <p><img src="images/auto-assign-reviewers/auto-assign-reviewer-show-quota.png" alt="Auto Assign Reviewers"></p> <ul> <li>As before, set the maximum number of papers to 4 and click apply. You see that maximum number of papers is set to their respective quota instead of 4.</li> </ul> <p><img src="images/auto-assign-reviewers/set-reviewers-max-number-papers-with-quota.png" alt="Auto Assign Reviewers"></p> <ul> <li>You can also edit the maximum number of papers per reviewer individually. For example, you can set ReviewerFive@cmt.cmt to handle no more than 6 papers. When you are satisfied with the maximum number of papers for each reviewer, click ‘Next.’</li> </ul> <p><img src="images/auto-assign-reviewers/edit-reviewers-max-number-papers-with-quota-next.png" alt="Auto Assign Reviewers"></p> <h2 id="configure-options">CONFIGURE OPTIONS</h2> <p>You have the option to run the automatic assignment wizard with default settings or with your own configuration.</p> <h3 id="weights">Weights</h3> <p>The Automatic Assignment algorithm uses reviewers’ bids, candidate suggestions, Subject Area Relevance and TPMS scores, to suggest assignments. By default, it uses all three above and assigns certain weights to them. You may specify your own custom weights (must be between 0 and 1) to obtain desired assignment result.</p> <ul> <li>Click on the ‘Custom’ radio button. Then enter the weights you want to assign, making sure the weights add up to 1.</li> </ul> <p><img src="images/auto-assign-reviewers/auto-assign-wizard-custom-weights-reviewers.png" alt="Auto Assign Reviewers"></p> <ul> <li>Click ‘Run Automatic Assignment’.</li> </ul> <p><img src="images/auto-assign-reviewers/run-auto-assign-wizard-reviewer.png" alt="Auto Assign Reviewers"></p> <ul> <li>A progress bar will be visible. When progress shows ‘100%’, click ‘View Assignment Result.’</li> </ul> <p><img src="images/auto-assign-reviewers/auto-assign-wizard-progress-bar-reviewers.png" alt="Auto Assign Reviewers"></p> <h2 id="confirm-assignments">CONFIRM ASSIGNMENTS</h2> <p>The <strong>‘Possible assignments suggestion’</strong> page gives the results.<br> The <strong>'Summary'</strong> section has two columns.<br> One column is papers assigned to Reviewers, the other column is Reviewers assigned to papers.<br> The <strong>'Details'</strong> section has two tabs; <strong>'By papers'</strong> and <strong>'By reviewers.'</strong></p> <ul> <li>This is the view of the ‘By papers’ tab. It shows reviewer suggestions for each paper.</li> </ul> <p><img src="images/auto-assign-reviewers/possible-reviewers-assign-results-by-papers.png" alt="Auto Assign Reviewers"></p> <ul> <li>This is the view of the ‘By reviewer’ tab. It shows paper suggestions for each reviewer.</li> </ul> <p><img src="images/auto-assign-reviewers/possible-assign-results-by-reviewers.png" alt="Auto Assign Reviewers"></p> <p>• If you are happy with the results, click the ‘Save assignments’ button. Click ‘Start over’ to re-run the automatic assignment wizard from the beginning. Note that all values and filters that were entered will be lost when starting over. No assignments will be made without clicking the ‘Save Assignments’ button. </p> <h2 id="advanced-tips">ADVANCED TIPS</h2> <p>This wizard can also be used for incremental assignment. It can be run at different/multiple times to gradually add more reviewers.<br> You can use a custom paper status to set the minimum number of reviewers for different groups of papers in the Automatic Assignment Wizard.</p> <ol> <li>In the ‘Settings’ tab of CMT, select Features>Paper Status to create new Paper status labels (for example, ‘Group1’, ‘Group2’, etc.).</li> <li>On the ‘Submissions’ page in the ‘Chair Console,’ change the Status of the papers you want to assign to the group, to ‘Group 1.’</li> <li>Apply the filter ‘Group 1’ (or ‘Group 2’, etc.) in the Status column of the Automatic Assignment Wizard, then set the minimum number of reviewers in bulk, respectively.</li> </ol> <p><img src="images/auto-assign-reviewers/set-paper-status-group.png" alt="Auto Assign Reviewers"></p> <h3 id="related">Related:</h3> <p><a href="https://cmt3.research.microsoft.com/docs/help/chair/import-reviewer-assignments.html">Import Reviewer Assignments</a></p> <p><a href="https://cmt3.research.microsoft.com/docs/help/chair/email-reviewers.html">Email Reviewers</a></p> </article> </div> <div class="hidden-sm col-md-2" role="complementary"> <div class="sideaffix"> <div class="contribution"> <ul class="nav"> </ul> </div> <nav class="bs-docs-sidebar hidden-print hidden-xs hidden-sm affix" id="affix"> <!-- <p><a class="back-to-top" href="#top">Back to top</a><p> --> </nav> </div> </div> </div> </div> <footer> <div class="grad-bottom"></div> <div class="footer"> <div class="container"> <span> <span class="visible-desktop"> © Microsoft Corporation <span style="padding-left: 20px;"> <a href="/About" target="_blank">About CMT</a> | <a href="https://www.microsoft.com/en-us/legal/terms-of-use" target="_blank">Terms of Use</a> | <a href="https://go.microsoft.com/fwlink/?LinkId=521839" target="_blank">Privacy & Cookies</a> | <a href="https://cmt3.research.microsoft.com/CMTSRM/" target="_blank">Request Free CMT Site</a> | <a href="mailto:support@msr-cmt.org">Email CMT Support</a> </span> </span> <div class="pull-right"> <a href="#top">Back to top</a> </div> </span> </div> </div> </footer> <footer> </footer> </div> <script type="text/javascript" src="../../styles/docfx.vendor.js"></script> <script type="text/javascript" src="../../styles/docfx.js"></script> <script type="text/javascript" src="../../styles/main.js"></script> </body> </html>