Baidu Research

<!doctype html> <html> <head> <meta charset="utf-8"> <meta name="renderer" content="webkit" /> <meta name="format-detection" content="telephone=no" /> <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" /> <meta content="width=device-width, initial-scale=1, maximum-scale=1, minimum-scale=1" name="viewport" /> <title>Baidu Research</title> <link rel="shortcut icon" href="../web/images/favicon.png" type="image/x-icon"> <link rel="stylesheet" href="../web/css/reset.css"> <link rel="stylesheet" href="../web/css/animate.css"> <link rel="stylesheet" href="../web/css/Bootstrap.css">  <link rel="stylesheet" href="../web/css/style.css?333"> <link rel="stylesheet" href="../web/css/media.css">  <script src="../web/js/jquery.min.js"></script>  </head> <body class="n_body" ondragstart="return false">  <div class="n_header"> <div class="container"> <div class="header01"> <div class="logo"> <a class="h_logo" href="/Index" style="background-image: url(../web/images/logo.png);"><img src="../web/images/logo.png" alt="Baidu Research"></a> </div> <div class="nav"> <ul> <li><a href="/Index">Home</a></li> <li><a href="/Publications">Publications</a></li> <li><a class="active" href="/Research_Areas?id=55">Research Areas</a> <div class="nav_er"> <ul class="div_dl "> <li><a href="/Research_Areas/index-view?id=55">Data Science and Data Mining</a></li> <li><a href="/Research_Areas/index-view?id=56">Natural Language and Speech</a></li> <li><a href="/Research_Areas/index-view?id=57">Business Intelligence</a></li> <li><a href="/Research_Areas/index-view?id=58">Robotics and Autonomous Driving</a></li> <li><a href="/Research_Areas/index-view?id=59">Computer Vision</a></li> <li><a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a></li> <li><a href="/Research_Areas/index-view?id=61">Computational Biology and Bioinformatics</a></li> <li><a href="/Research_Areas/index-view?id=62">High Performance Computing</a></li> <li><a href="/Research_Areas/index-view?id=75">Quantum Computing</a></li> </ul> </div> </li> <li><a href="/Blog">Blog</a></li> <li><a href="/Career">Careers</a></li> <li><a href="/Downloads">Downloads</a></li> <li><a href="/AI_Colloquium">AI Colloquium</a></li> </ul> <div class="nav_btn"><span></span></div> </div> </div> </div> <div class="header03 "> <div class="logo"><a href="/Index"><img src="../web/images/logo.png" alt="Baidu Research"></a></div> <div class="nav"> <ul> <li><a href="/Index">Home</a></li> <li><a href="/Publications">Publications</a></li> <li><a href="/Research_Areas?id=55">Research Areas</a> <div class="nav_er"> <ul class="div_dl "> <li><a href="/Research_Areas/index-view?id=55">Data Science and Data Mining</a></li> <li><a href="/Research_Areas/index-view?id=56">Natural Language and Speech</a></li> <li><a href="/Research_Areas/index-view?id=57">Business Intelligence</a></li> <li><a href="/Research_Areas/index-view?id=58">Robotics and Autonomous Driving</a></li> <li><a href="/Research_Areas/index-view?id=59">Computer Vision</a></li> <li><a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a></li> <li><a href="/Research_Areas/index-view?id=61">Computational Biology and Bioinformatics</a></li> <li><a href="/Research_Areas/index-view?id=62">High Performance Computing</a></li> <li><a href="/Research_Areas/index-view?id=75">Quantum Computing</a></li> </ul> </div> </li> <li><a href="/Blog">Blog</a></li> <li><a href="/Career">Careers</a></li> <li><a href="/Downloads">Downloads</a></li> <li><a href="/AI_Colloquium">AI Colloquium</a></li> </ul> </div> <div class="nav_btn"><span></span></div> </div> </div> <div class="baidu-page-banner research_areas"> <div class="container"> <div class="baidu-page-title wow fadeIn"> Machine Learning and Deep Learning </div> </div> </div> <div class="content-info"> <div class="container-details-er"> <p class="home-title page-title" style="font-size: 36px; color: rgb(68, 68, 68); text-align: center;">INTRODUCTION</p><p><span style="color: rgb(0, 0, 0);">We are creating and developing a wide spectrum of machine learning algorithms with a focus on deep learning. Our algorithms are integrated in our PaddlePaddle platform supporting over 100 product developments. We are also exploring learning methods to build machines that can learn from their interactions with the environment and humans, instead of making a machine that is sufficient at a predefined set of tasks.</span></p> </div> </div> <div class="home-publications"> <div class="content-info"> <div class="home-title">PUBLICATIONS</div> <ul class="home-publications-info"> <ul class="row"> <li class="col-md-6 col-xs-12"> <div class="tt"> <div class="home-publications-title"> On the Overlooked Structure of Stochastic Gradients </div> <div class="home-publications-date"> NeurIPS 2023 </div> <div class="home-publications-introduce">  <span> <a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a> <a href="https://openreview.net/pdf?id=H4GsteoL0M" target="_blank"><i></i></a> </span> </div> </div> </li> <li class="col-md-6 col-xs-12"> <div class="tt"> <div class="home-publications-title"> Context Matters: Cross-domain Cell Detection in Histopathology Images via Contextual Regularization </div> <div class="home-publications-date"> 27th Conference on Medical Image Understanding and Analysis </div> <div class="home-publications-introduce">  <span> <a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a> <a href="https://link.springer.com/chapter/10.1007/978-3-031-48593-0_11" target="_blank"><i></i></a> </span> </div> </div> </li> <li class="col-md-6 col-xs-12"> <div class="tt"> <div class="home-publications-title"> Overcoming Catastrophic Forgetting for Fine-tuning Pre-trained GANs </div> <div class="home-publications-date"> The 2023 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases </div> <div class="home-publications-introduce">  <span> <a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a> <a href="https://link.springer.com/chapter/10.1007/978-3-031-43424-2_18" target="_blank"><i></i></a> </span> </div> </div> </li> <li class="col-md-6 col-xs-12"> <div class="tt"> <div class="home-publications-title"> LtrGCN: Large-Scale Graph Convolutional Networks-based Learning to Rank for Web Search </div> <div class="home-publications-date"> The 2023 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases </div> <div class="home-publications-introduce">  <span> <a href="/Research_Areas/index-view?id=60">Machine Learning and Deep Learning</a> <a href="https://link.springer.com/chapter/10.1007/978-3-031-43427-3_38" target="_blank"><i></i></a> </span> </div> </div> </li> </ul> </ul> <a href="/publications" class="home-more"><em></em><span>MORE</span></a> </div> </div> <div class="content-info"> <div class="home-blog"> <div class="home-title">BLOG</div> <ul class="recommend-blog-info"> <ul class="row" pagesize="3"> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=169"> <div class="recommend-blog-img"><img src="/uploads/628b4003d5ceb.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Research at 2022 Leading Robotics and Control Conferences: ICRA, RSS, and ACC </div> <div class="recommend-blog-introduce"> This week marks the start of the 2022 IEEE International Conference on Robotics... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=166"> <div class="recommend-blog-img"><img src="/uploads/61eea00dc92e9.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Top 10 Tech Trends in 2022 by Baidu Research </div> <div class="recommend-blog-introduce"> Baidu Research shares with you the top 10 technology trends of 2022.... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=157"> <div class="recommend-blog-img"><img src="/uploads/60af1eaa1e344.jpeg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> PaddlePaddle Receives Full Upgrade to Facilitate Integrated Innovation and Lower Thresholds </div> <div class="recommend-blog-introduce"> We are excited to announce a major upgrade of Baidu’s deep learning platform Pa... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=156"> <div class="recommend-blog-img"><img src="/uploads/6065622e26792.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Releases PaddlePaddle 2.0 with New Features Including Dynamic Graphs, Reorganized APIs and Heterogeneous Parameter Server </div> <div class="recommend-blog-introduce"> We are excited to announce that PaddlePaddle 2.0 is now available. The deep lear... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=155"> <div class="recommend-blog-img"><img src="/uploads/605aa9c1c8318.jpeg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> PaddlePaddle’s Graph Neural Networks Advance Drug Design </div> <div class="recommend-blog-introduce"> Our AI models, trained with Baidu’s open-source deep learning platform PaddlePa... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=152"> <div class="recommend-blog-img"><img src="/uploads/601cdd6483024.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu at AAAI 2021: Multimodal Transformer, Supervised Quantum Learning, Early Detection of COVID-19 High-Risk Areas </div> <div class="recommend-blog-introduce"> The 35th annual AAAI Conference on Artificial Intelligence is now underway from... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=147"> <div class="recommend-blog-img"><img src="/uploads/5f6ab59b69279.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Exploring Baidu Brain 6.0: Updated PaddlePaddle, 2nd-Gen AI Processor, and New Quantum Computing Platform </div> <div class="recommend-blog-introduce"> Join us for a quick look at Baidu Brain 6.0, including new updates in Baidu’s d... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=137"> <div class="recommend-blog-img"><img src="/uploads/5ecdfb99ecc7f.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Introducing Paddle Quantum: How Baidu's Deep Learning Platform PaddlePaddle Empowers Quantum Computing </div> <div class="recommend-blog-introduce"> Baidu recently announced Paddle Quantum, a quantum machine learning development... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=134"> <div class="recommend-blog-img"><img src="/uploads/5e9d331b4b28f.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> VidPress: Baidu’s New AI Tool Creating Videos from a URL with One-Click </div> <div class="recommend-blog-introduce"> The ability to edit videos quickly is a skill standing out in the era of social... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=130"> <div class="recommend-blog-img"><img src="/uploads/5e27f91954403.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> A Look Back on Baidu’s AI Innovations in 2019 </div> <div class="recommend-blog-introduce"> AI has become a key driver of innovation in the tech industry over the past deca... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=129"> <div class="recommend-blog-img"><img src="/uploads/5e00956132a91.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Research: 10 Technological Trends in 2020 </div> <div class="recommend-blog-introduce"> In the past year alone, the integration of multiple emerging technologies has sp... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=126"> <div class="recommend-blog-img"><img src="/uploads/5dcd13ff06325.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu PaddlePaddle Releases 21 New Capabilities to Accelerate Industry-Grade Model Development </div> <div class="recommend-blog-introduce"> Featuring 100+ models, new mobile inference engine, and frameworks for graph & f... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=125"> <div class="recommend-blog-img"><img src="/uploads/5d5adc075a754.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Research launched the </div> <div class="recommend-blog-introduce"> The "Polaris Program" of Baidu Research provides the most advanced and cutting-e... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=121"> <div class="recommend-blog-img"><img src="/uploads/5d3fd2b729323.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu’s Optimized ERNIE Achieves State-of-the-Art Results in Natural Language Processing Tasks </div> <div class="recommend-blog-introduce"> Baidu today released ERNIE 2.0 (Enhanced Representation through kNowledge IntEgr... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=120"> <div class="recommend-blog-img"><img src="/uploads/5d1abedf21f8c.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Research Bolsters Capabilities with New Labs and World-renowned Appointment to Advisory Board </div> <div class="recommend-blog-introduce"> Baidu Research now counts seven major research labs and welcomes Artur Konrad Ek... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=119"> <div class="recommend-blog-img"><img src="/uploads/5d08266890cc8.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Hubless Nearest Neighbor Search for Bilingual Lexicon Induction </div> <div class="recommend-blog-introduce"> This blogpost introduces our recent publication in ACL 2019.... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=116"> <div class="recommend-blog-img"><img src="/uploads/5ce4e4e1cddfd.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Parallel Neural Text-to-Speech </div> <div class="recommend-blog-introduce"> Text-to-Speech (TTS), also called speech synthesis, has a variety of application... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=114"> <div class="recommend-blog-img"><img src="/uploads/5cc283bb2480a.png"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Announced 11 News tools to PaddlePaddle and RMB 100 Million Worth of Free Computing Resources to Support Developers </div> <div class="recommend-blog-introduce"> At Baidu’s Wave Summit, Baidu demonstrated new features of its deep learning pl... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=111"> <div class="recommend-blog-img"><img src="/uploads/5c78ea29b39ce.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Measuring Lesion Geometry with AI </div> <div class="recommend-blog-introduce"> Lesions characterized by computed tomography (CT) scans, are arguably often elli... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=110"> <div class="recommend-blog-img"><img src="/uploads/5c78e367e5f5a.jpeg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Teams up with Academia, awarding Grand Prizes for Breakthroughs in the ICDAR 2019 Competitions </div> <div class="recommend-blog-introduce"> The Competitions of International Conference on Document Analysis and Recognitio... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=108"> <div class="recommend-blog-img"><img src="/uploads/5becd2dabd871.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Research Establishes an Advisory Board, Holds 1st Board Meeting in Silicon Valley </div> <div class="recommend-blog-introduce"> Baidu Research brings together more world-renowned scientists to jointly advance... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=106"> <div class="recommend-blog-img"><img src="/uploads/5b521fa67d095.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech </div> <div class="recommend-blog-introduce"> ClariNet, the first end-to-end TTS model, directly converts text to a speech wav... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=104"> <div class="recommend-blog-img"><img src="/uploads/5b2738927a5a4.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Using Deep Learning to Help Pathologists Find Tumors </div> <div class="recommend-blog-introduce"> While there are various methods to diagnose cancer, a pathology review of biopsi... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=87"> <div class="recommend-blog-img"><img src="/uploads/5ac08cef5a63b.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> PaddlePaddle Fluid: Elastic Deep Learning on Kubernetes </div> <div class="recommend-blog-introduce"> Two open source communities—PaddlePaddle, the deep learning framework originate... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=89"> <div class="recommend-blog-img"><img src="/uploads/5ac4919713d91.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Deep Learning Scaling is Predictable, Empirically </div> <div class="recommend-blog-introduce"> Our digital world and data are growing faster today than any time in the past—e... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=90"> <div class="recommend-blog-img"><img src="/uploads/5ac493f231e7f.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Deep Speech 3: Even more end-to-end speech recognition </div> <div class="recommend-blog-introduce"> Accurate speech recognition systems are vital to many businesses, whether they a... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=91"> <div class="recommend-blog-img"><img src="/uploads/5ac4958f5a108.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Deep Voice 3: 2000-Speaker Neural Text-to-Speech </div> <div class="recommend-blog-introduce"> Today, we are excited to announce Deep Voice 3, the latest milestone of Baidu Re... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=92"> <div class="recommend-blog-img"><img src="/uploads/5ac4973480978.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Mixed Precision Training </div> <div class="recommend-blog-introduce"> In this blog post, we introduce a new technique to train deep learning models ti... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=95"> <div class="recommend-blog-img"><img src="/uploads/5ac49ca6de067.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Baidu Research Announces Next Generation Open Source Deep Learning Benchmark Tool </div> <div class="recommend-blog-introduce"> Baidu Research today unveiled the next generation of DeepBench, the open source... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=97"> <div class="recommend-blog-img"><img src="/uploads/5ac49e65ddf43.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Deep Voice 2: Multi-Speaker Neural Text-to-Speech </div> <div class="recommend-blog-introduce"> In February, Baidu Silicon Valley AI Lab published Deep Voice 1, a system for ge... </div> </div> </a> </li> <li class="col-md-4 col-sm-6 col-xs-12"> <a href="/Blog/index-view?id=98"> <div class="recommend-blog-img"><img src="/uploads/5ac49fbe96c4c.jpg"><i></i></div> <div class="recommend-blog-text"> <div class="recommend-blog-title"> Deep Speaker: an End-to-End System for Large-Scale Speaker Recognition </div> <div class="recommend-blog-introduce"> Speaker recognition algorithms seek to determine the identity of a speaker from... </div> </div> </a> </li> </ul> </ul> </div> </div> <footer> <div class="baidu-bottom"> <div class="container"> <div class="col-md-6 col-xs-12"> <h2>Baidu Research</h2> <p>1195 Bordeaux Drive Sunnyvale, CA 94089<br>Baidu Technology Park, No. 10 Xibeiwang East Road, Haidian District, Beijing, China<br>Media Inquiries: <a href="mailto:intlcomm@baidu.com">intlcomm@baidu.com</a><br>General Inquries: <a href="mailto:air-info@baidu.com">air-info@baidu.com</a></p> </div> <div class="col-md-6 col-xs-12"> <ul class="social-icons"> <li><a href="https://twitter.com/baiduresearch" target="_blank"><img src="../web/images/ico-2.png"></a> </li> <li><a href="https://www.linkedin.com/company/baidu-usa" target="_blank"><img src="../web/images/ico-3.png"></a> </li> </ul> <div class="baidu-weibu"> <div class="baidu-img"><img src="../web/images/f-logo.png"></div> <div class="baidu-links"> <a class="baidu-links-title" href="javascript:;">Links</a> <ul class="baidu-links-friends"> <li><a href="http://ai.baidu.com/" target="_blank">Baidu AI Open Platform</a> </li> <li><a href="http://www.dlnel.org/" target="_blank">DLNEL</a> </li> </ul> </div> </div> </div> </div> </div> <div class="baidu-foot">© 2018 Baidu Research</div> </footer> <script src="../web/js/bootstrap.min.js"></script> <script src="../web/js/jquery.more.js"></script> <script src="../web/js/wow.js"></script> <script src="../web/js/base.js"></script> <script type="text/javascript"> //调用显示更多插件。参数是标准的 jquery 选择符 $.showMore(".recommend-blog-info .row"); </script> </body> </html>

CINXE.COM

Baidu Research