CINXE.COM
Baidu Research
<!doctype html> <html> <head> <meta charset="utf-8"> <meta name="renderer" content="webkit" /> <meta name="format-detection" content="telephone=no"/> <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" /> <meta content="width=device-width, initial-scale=1, maximum-scale=1, minimum-scale=1" name="viewport" /> <title>Baidu Research</title> <link rel="shortcut icon" href="../web/images/favicon.png" type="image/x-icon"> <link rel="stylesheet" href="../web/css/reset.css"> <link rel="stylesheet" href="../web/css/animate.css"> <link rel="stylesheet" href="../web/css/Bootstrap.css"> <link rel="stylesheet" href="../web/css/style.css"> <link rel="stylesheet" href="../web/css/media.css?3333"> <script src="../web/js/jquery.min.js"></script> </head> <body class="n_body" ondragstart="return false"> <!--[if lt IE 9]> <p class="browserupgrade">您在使用一个 <strong>旧版本的</strong> 浏览器。请 <a href="http://browsehappy.com/">更新你的浏览器</a> 来更好的体验本网站.</p> <![endif]--> <div class="n_header"> <div class="container"> <div class="header01"> <div class="logo"> <a class="h_logo" href="/Index" style="background-image: url(../web/images/logo.png);"><img src="../web/images/logo.png" alt="Baidu Research"></a> </div> <div class="nav"> <ul> <li><a href="/Index">Home</a></li> <li><a href="/Publications">Publications</a></li> <li><a href="/Research_Areas?id=55">Research Areas</a> <div class="nav_er"> <ul class="div_dl "> <li><a href="/Research_Areas/index-view?id=55">Data Science and Data Mining</a></li> <li><a href="/Research_Areas/index-view?id=56">Natural Language and Speech</a></li> <li><a href="/Research_Areas/index-view?id=57">Business Intelligence</a></li> <li><a href="/Research_Areas/index-view?id=58">Robotics and Autonomous Driving</a></li> <li><a href="/Research_Areas/index-view?id=59">Computer Vision</a></li> <li><a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a></li> <li><a href="/Research_Areas/index-view?id=61">Computational Biology and Bioinformatics</a></li> <li><a href="/Research_Areas/index-view?id=62">High Performance Computing</a></li> <li><a href="/Research_Areas/index-view?id=75">Quantum Computing</a></li> </ul> </div> </li> <li><a class="active" href="/Blog">Blog</a></li> <li><a href="/Career">Careers</a></li> <li><a href="/Downloads">Downloads</a></li> <li><a href="/AI_Colloquium">AI Colloquium</a></li> </ul> <div class="nav_btn"><span></span></div> </div> </div> </div> <div class="header03 "> <div class="logo"><a href="/Index"><img src="../web/images/logo.png" alt="Baidu Research"></a></div> <div class="nav"> <ul> <li><a href="/Index">Home</a></li> <li><a href="/Publications">Publications</a></li> <li><a href="/Research_Areas?id=55">Research Areas</a> <div class="nav_er"> <ul class="div_dl "> <li><a href="/Research_Areas/index-view?id=55">Data Science and Data Mining</a></li> <li><a href="/Research_Areas/index-view?id=56">Natural Language and Speech</a></li> <li><a href="/Research_Areas/index-view?id=57">Business Intelligence</a></li> <li><a href="/Research_Areas/index-view?id=58">Robotics and Autonomous Driving</a></li> <li><a href="/Research_Areas/index-view?id=59">Computer Vision</a></li> <li><a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a></li> <li><a href="/Research_Areas/index-view?id=61">Computational Biology and Bioinformatics</a></li> <li><a href="/Research_Areas/index-view?id=62">High Performance Computing</a></li> <li><a href="/Research_Areas/index-view?id=75">Quantum Computing</a></li> </ul> </div> </li> <li><a href="/Blog">Blog</a></li> <li><a href="/Career">Careers</a></li> <li><a href="/Downloads">Downloads</a></li> <li><a href="/AI_Colloquium">AI Colloquium</a></li> </ul> </div> <div class="nav_btn"><span></span></div> </div> </div> <div class="baidu-page-banner blog-side" style="background: url(/Public/uploads/5ae96c0a7676c.png);"> <div class="container"> <div class="baidu-page-title wow fadeIn">Blog</div> </div> </div> <div class="content-info"> <div class="container-details-er"> <div class="blog-details-title">Baidu Team Wins the Suggestion Mining Challenge at SemEval 2019</div> <div class="blog-details-date"><p>2019-03-11</p><a href="/Blog">Back to list</a></div> <p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">The 13th International Workshop on Semantic Evaluation (SemEval 2019) </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">has concluded</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">in </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">February 2019. In the Suggestion Mining from Online Reviews and Forums (Task 9A), Baidu triumphed over 210 teams from around the world and </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">became </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">the champion with an F score of 78.12%, demonstrating the company’s pioneering </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">achievements in </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">this</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">field</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">.</span></p><p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black"><img src="/ueditor/upload/20190311/1552288259984135.png" title="1552288259984135.png" alt="图片 1.png"/></span></p><h2 style=";font-size: 24px;font-family: 'Times New Roman', serif;white-space: normal;text-align: center"><em><span style="font-size: 15px;font-family: Calibri, sans-serif">Baidu ranks No.1 in SemEval-2019 Task 9A.</span></em></h2><p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black"><br/>As the top international competition in natural language processing (NLP), SemEval is organized by a subsidiary of the Association for Computational Linguistics (ACL). I</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">t</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">has been successfully held 12 times since 2001 and attracted many universities and research institutions from around the world. O</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">ne of the</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">tasks </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">of SemEval this year</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">was Suggestion Mining from Online Reviews and Forums which aims to automatically identify constructive suggestions from online forums or reviews. </span></p><p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black"> </span></p><p style=";text-align: justify;font-size: 14px;font-family: Calibri, sans-serif;white-space: normal"><span style="font-size: 15px">Nowadays, <span style="background-color: white">consumer opinions towards commercial entities like brands, services, and products are usually expressed through online reviews, blogs, discussion forums, or social media platforms. Such opinion</span>s not only contain the expression of consumers’ emotions, but also give suggestions for improving the entity or advice to the other consumers. For example, "I like the food of this restaurant, but it’d be better if the place is cozier." Traditional research on sentiment analysis placed more emphasis on whether users express negative emotions and tend to ignore those reviews like the one above even though it can be extremely valuable for improving services. The industry is trying to advance research on sentiment analysis, however, Suggestion Mining remains a relatively young area. Baidu is now leading the pioneering progress in this field.</span></p><p style=";text-align: justify;font-size: 14px;font-family: Calibri, sans-serif;white-space: normal"><span style="font-size: 15px"> </span></p><p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">Suggestion Mining requires a comprehensive analysis </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">of</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">the semantics, voice, emotion, structure, context and more information of sentences to make accurate judgment. For instance, sentences such as "consider adding more flights </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">for </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">holiday seasons" and "I would stay in this hotel again if they </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">provide </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">kettles in the room" have completely different sentence structures, sentence patterns, and entities </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">to be </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">reviewed, but they offer valuable suggestions. Understanding the core and extended meanings of "suggestions" is a subjective task, </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">leaving room for inconsistency in defining questions and labeling information and thus, more difficulty in extracting suggestions. </span></p><p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black"> </span></p><p style=";font-size: 12px;font-family: 'Helvetica Neue';color: rgb(69, 69, 69);white-space: normal"><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">In the competition, Baidu’s team adopted multiple technical approaches to resolve the difficulties. Firstly, the team constructed a cross-domain, multi-structure deep semantic classification model based on large-scale unsupervised data. An ensemble learning model is used to integrate shallow learning and deep learning to resolve the </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">issues of an </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">imbalanced </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">dataset</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">. </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">To process the diverse styles and non-standard expressions in online content, </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">Baidu’s team </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">utilized </span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">fine-grained feature</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">s</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">and attention tran</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">sfer</span><span style="font-size: 15px;font-family: Calibri, sans-serif;color: black">mechanisms. In the end, the team won the championship with an F score of 78.12%.</span></p><p style=";text-align: justify;font-size: 14px;font-family: Calibri, sans-serif;white-space: normal"><span style="font-size: 15px"> </span></p><p style=";text-align: justify;font-size: 14px;font-family: Calibri, sans-serif;white-space: normal"><span style="font-size: 15px">While companies seek consumers' reviews to effectively improve their services, governments and media publications hope to obtain opinions from massive information online as a reference. Therefore, the use of suggestion mining to assist in decision-making is undoubtedly a practical and valuable practice of NLP. It can empower both public and private sectors by extracting suggestions which are spontaneously expressed on various online platforms, enabling organizations to collect suggestions from much larger and varied sources. </span></p><p style=";text-align: justify;font-size: 14px;font-family: Calibri, sans-serif;white-space: normal"><span style="font-size: 15px"> </span></p><p><span style="font-size: 15px;font-family: Calibri, sans-serif">Giving machines cognitive abilities is one of the biggest challenges in artificial intelligence for which NLP is crucial. With more than ten years of experience in NLP, Baidu has the most advanced technologies and a commitment to applying the technologies to resolve actual problems. Baidu's semantic technology has been widely adopted within and outside of Baidu in products such as search and news feed.</span></p><p><br/></p> <div class="pager"> <a href="/Blog/index-view?id=113"> <i class="glyphicon glyphicon-menu-up"></i>Previous One:Baidu released knowledge integration language representation model ERNIE which outperforms Google’s BERT in certain Chinese NLP tasks </a> <a href="/Blog/index-view?id=111"> <i class="glyphicon glyphicon-menu-down"></i>Next One:Measuring Lesion Geometry with AI </a> </div> </div> </div> <footer> <div class="baidu-bottom"> <div class="container"> <div class="col-md-6 col-xs-12"> <h2>Baidu Research</h2> <p>1195 Bordeaux Drive Sunnyvale, CA 94089<br>Baidu Technology Park, No. 10 Xibeiwang East Road, Haidian District, Beijing, China<br>Media Inquiries: <a href="mailto:intlcomm@baidu.com">intlcomm@baidu.com</a><br>General Inquries: <a href="mailto:air-info@baidu.com">air-info@baidu.com</a></p> </div> <div class="col-md-6 col-xs-12"> <ul class="social-icons"> <li><a href="https://twitter.com/baiduresearch" target="_blank"><img src="../web/images/ico-2.png"></a> </li> <li><a href="https://www.linkedin.com/company/baidu-usa" target="_blank"><img src="../web/images/ico-3.png"></a> </li> </ul> <div class="baidu-weibu"> <div class="baidu-img"><img src="../web/images/f-logo.png"></div> <div class="baidu-links"> <a class="baidu-links-title" href="javascript:;">Links</a> <ul class="baidu-links-friends"> <li><a href="http://ai.baidu.com/" target="_blank">Baidu AI Open Platform</a> </li> <li><a href="http://www.dlnel.org/" target="_blank">DLNEL</a> </li> </ul> </div> </div> </div> </div> </div> <div class="baidu-foot">© 2018 Baidu Research</div> </footer> <script src="../web/js/bootstrap.min.js"></script> <script src="../web/js/wow.js"></script> <script src="../web/js/base.js"></script> </body> </html>