Robots.txt Generator | BloggingQnA Tools

<!DOCTYPE html> <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> <meta charset="utf-8" /> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta http-equiv="Content-Language" content="en" /> <meta name="viewport" content="width=device-width, initial-scale=1" /> <link rel="icon" type="image/png" href="https://tools.bloggingqna.com/uploads/tools.bloggingqna.png" />  <title>Robots.txt Generator | BloggingQnA Tools</title> <meta property="site_name" content="BloggingQnA Tools"/> <meta name="description" content="" /> <meta name="keywords" content="robots.txt generator, online robots.txt generator, generate robots.txt free" /> <meta name="author" content="Balaji" />  <meta property="og:title" content="Robots.txt Generator | BloggingQnA Tools" /> <meta property="og:site_name" content="BloggingQnA Tools" /> <meta property="og:type" content="website" /> <meta property="og:description" content="" /> <meta property="og:image" content="https://tools.bloggingqna.com/theme/default/img/logo.png"/> <meta property="og:url" content="https://tools.bloggingqna.com/robots-txt-generator" /> <link rel="canonical" href="https://tools.bloggingqna.com/robots-txt-generator" /> <link rel="alternate" hreflang="x-default" href="https://tools.bloggingqna.com/robots-txt-generator" />  <link href="https://tools.bloggingqna.com/theme/default/css/theme.css" rel="stylesheet" />  <link href="https://tools.bloggingqna.com/theme/default/css/font-awesome.min.css" rel="stylesheet" />  <link href="https://tools.bloggingqna.com/theme/default/css/custom.css" rel="stylesheet" type="text/css" />  <script src="//ajax.googleapis.com/ajax/libs/jquery/1.10.2/jquery.min.js"></script> </head> <body> <nav class="navbar navbar-default navbar-static-top" role="navigation"> <div class="container">  <div class="navbar-header"> <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#collapse-menu"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar"></span> <span class="icon-bar"></span> <span class="icon-bar"></span> </button> <a class="navbar-brand" href="https://tools.bloggingqna.com/"> <span class="themeLogoText"><i class="fa fa-cubes iconBig"></i> BloggingQnA Tools</span> </a> </div>  <div class="collapse navbar-collapse" id="collapse-menu"> <ul class="nav navbar-nav navbar-right"> <li><a href="https://tools.bloggingqna.com/">Home</a></li><li><a href="https://tools.bloggingqna.com/contact">Contact US</a></li> <li class="dropdown"> <a href="javascript:void(0)" data-toggle="dropdown" class="dropdown-toggle" aria-expanded="false"><i class="fa fa-globe fa-lg"></i>   EN</a> <ul class="dropdown-menu"> <li><a href="https://tools.bloggingqna.com/en/robots-txt-generator">English</a></li> </ul> </li> </ul> </div> </div> </nav> <div class="submasthead"> <div class="container"> <div class="col-md-6 seobannerSmall"> <h1 class="sub_seobannerh1">Robots.txt Generator</h1> </div> <div class="col-md-6"> <img class="visible-lg visible-md" alt="Search Engine Optimization" src="https://tools.bloggingqna.com/theme/default/img/seobanner_mini.png" /> </div> </div> </div> <script> var msg1 = "Create robots.txt file ?"; var msg2 = "# robots.txt generated by atozseotools.com\n"; </script> <script src='https://tools.bloggingqna.com/core/library/robots.js'></script> <div class="container main-container"> <div class="row"> <div class="col-md-8 main-index"> <div class="xd_top_box"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-7368588034091893" crossorigin="anonymous"></script>  <ins class="adsbygoogle" style="display:inline-block;width:720px;height:90px" data-ad-client="ca-pub-7368588034091893" data-ad-slot="6145309479"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> <h2 id="title">Robots.txt Generator</h2> <br /> <form> <div> <table id="roboTable" class="nostyle"> <tbody><tr> <td><b>Default - All Robots are:</b></td> <td> <select size="1" name="allow" id="allow" class="form-control" > <option value=" " selected="">Allowed</option> <option value=" /">Refused</option> </select></td> <td> </td> </tr> <tr><td> </td><td> </td> <td> </td></tr> <tr> <td><b>Crawl-Delay:</b></td> <td colspan="2"> <select size="1" name="delay" id="delay" class="form-control"> <option value="" selected="">Default - No Delay</option> <option value="5">5 Seconds</option> <option value="10">10 Seconds</option> <option value="20">20 Seconds</option> <option value="60">60 seconds</option> <option value="120">120 Seconds</option> </select></td> </tr> <tr><td> </td><td> </td> <td> </td></tr> <tr> <td><strong>Sitemap: <small>(leave blank if you don't have) </small></strong></td> <td colspan="2"> <input type="text" value="" placeholder="http://www.example.com/sitemap.xml" name="sitemap" class="form-control" /></td> </tr> <tr> <td> </td> <td>  </td> <td>  </td> </tr><tr> <td><b>Search Robots:</b></td> <td> Google</td> <td> <select size="1" name="google" id="google" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Google Image</td> <td> <select size="1" name="gimage" id="gimage" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Google Mobile</td> <td> <select size="1" name="gmobile" id="gmobile" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> MSN Search</td> <td> <select size="1" name="msn" id="msn" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Yahoo</td> <td> <select size="1" name="yahoo" id="yahoo" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Yahoo MM</td> <td> <select size="1" name="ymm" id="ymm" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Yahoo Blogs</td> <td> <select size="1" name="blogs" id="blogs" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Ask/Teoma</td> <td> <select size="1" name="teoma" id="teoma" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> GigaBlast</td> <td> <select size="1" name="gigablast" id="gigablast" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> DMOZ Checker</td> <td> <select size="1" name="dmoz" id="dmoz" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Nutch</td> <td> <select size="1" name="nutch" id="nutch" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Alexa/Wayback</td> <td> <select size="1" name="alexa" id="alexa" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Baidu</td> <td> <select size="1" name="baidu" id="baidu" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> Naver</td> <td> <select size="1" name="naver" id="naver" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td> MSN PicSearch</td> <td> <select size="1" name="psbot" id="psbot" class="form-control"> <option value="" selected="">Same as Default</option> <option value=" ">Allowed</option> <option value=" /">Refused</option> </select></td> </tr> <tr> <td> </td> <td colspan="2">  </td> </tr> <tr> <td><b>Restricted Directories:</b></td> <td colspan="2"> <i>The path is relative to root and must contain a trailing slash "/"</i></td> </tr> <tr> <td> </td> <td colspan="2"> <input type="text" value="/cgi-bin/" size="70" name="dir1" class="form-control" /></td> </tr> <tr> <td> </td> <td colspan="2"> <input type="text" size="70" name="dir2" class="form-control" /></td> </tr> <tr> <td> </td> <td colspan="2"> <input type="text" size="70" name="dir3" class="form-control" /></td> </tr> <tr> <td> </td> <td colspan="2"> <input type="text" size="70" name="dir4" class="form-control" /></td> </tr> <tr> <td> </td> <td colspan="2"> <input type="text" size="70" name="dir5" class="form-control" /></td> </tr> <tr> <td> </td> <td colspan="2"> <input type="text" size="70" name="dir6" class="form-control" /></td> </tr> <tr> <td> </td> <td colspan="2">  </td> </tr> </tbody></table> </div> <p> <input type="button" class="btn btn-success" onclick="genRobots(this.form,msg1,msg2)" value="Create Robots.txt" /> <input type="button" class="btn btn-danger" onclick="genRobots(this.form,msg1,msg2,true)" value="Create and Save as Robots.txt" /> <input type="reset" class="btn btn-primary" value="Clear" /> <br /><br /> <textarea class="form-control" readonly="" style="height: 270px;" rows="3" id="robolist" name="robolist"></textarea> </p> <p>Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.</p> </form> <br /> <div class="xd_top_box"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-7368588034091893" crossorigin="anonymous"></script>  <ins class="adsbygoogle" style="display:inline-block;width:720px;height:90px" data-ad-client="ca-pub-7368588034091893" data-ad-slot="6145309479"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> <h2 id="sec1" class="about_tool">About Robots.txt Generator</h2> <p> <p>Enter more information about the Robots.txt Generator tool!</p> <p>Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book. It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged. It was popularised in the 1960s with the release of Letraset sheets containing Lorem Ipsum passages, and more recently with desktop publishing software like Aldus PageMaker including versions of Lorem Ipsum.</p> </p> <br /> </div> <div class="col-md-4" id="rightCol"> <div class="well"> <div id="sidebarSc" class="col-md-12"> <div class="form-group"> <div class="input-group green shadow"> <div class="input-group-addon"><i class="fa fa-search"></i></div> <input type="text" class="form-control" placeholder="Search SEO tools" autocomplete="off" id="sidebarsearch" /> </div> </div> <div class="search-results" id="sidebar-results"></div> </div> <div class="sideXd"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-7368588034091893" crossorigin="anonymous"></script>  <ins class="adsbygoogle" style="display:inline-block;width:250px;height:300px" data-ad-client="ca-pub-7368588034091893" data-ad-slot="7266819457"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> <div class="sideXd"> <script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-7368588034091893" crossorigin="anonymous"></script>  <ins class="adsbygoogle" style="display:inline-block;width:250px;height:125px" data-ad-client="ca-pub-7368588034091893" data-ad-slot="3327574446"></ins> <script> (adsbygoogle = window.adsbygoogle || []).push({}); </script> </div> </div> </div> </div> </div> <br /><footer class="footer">  <div class="b-widgets"> <div class="container layout"> <div class="row">  <div class="row-item col-md-6"> <h3 class="footer-title">About Us</h3> <div class="b-twitter m-footer"> <p>Our aim to make search engine optimization (SEO) easy. We provide simple, professional-quality SEO analysis and critical SEO monitoring for websites. By making our tools intuitive and easy to understand, we've helped thousands of small-business owners, webmasters and SEO professionals improve their online presence.</p> </div> <div class="top10"> <a class="ultm ultm-facebook ultm-32 ultm-color-to-gray" href="https://www.facebook.com/akaMangeshBhardwaj/" target="_blank" rel="nofollow"></a> <a class="ultm ultm-twitter ultm-32 ultm-color-to-gray" href="https://twitter.com/Mangeshbhardwaj" target="_blank" rel="nofollow"></a> <a class="ultm ultm-google-plus-1 ultm-32 ultm-color-to-gray" href="https://linkedin.com" target="_blank" rel="nofollow"></a> </div> </div>   <div class="row-item col-md-3"> <h3 class="footer-title">Top 5 Tools</h3> <ul class="b-list just-links m-dark"> <li><a href="https://tools.bloggingqna.com/plagiarism-checker">Plagiarism Checker </a></li><li><a href="https://tools.bloggingqna.com/xml-sitemap-generator">XML Sitemap Generator </a></li><li><a href="https://tools.bloggingqna.com/whois-checker">Whois Checker </a></li><li><a href="https://tools.bloggingqna.com/mozrank-checker">Mozrank Checker </a></li> </ul> </div>   <div class="row-item col-md-3"> <h3 class="footer-title">Links</h3> <ul class="b-list just-links m-dark"> <li><a href="https://tools.bloggingqna.com/">Home</a></li><li><a href="https://tools.bloggingqna.com/contact">Contact US</a></li><li><a href="https://tools.bloggingqna.com/page/about-us">About Us</a></li> </ul> </div>  </div> </div> </div>  <div class="container"> <div class="row"> <div class="text-center footerCopyright">   Copyright 漏 2025 All rights reserved. </div> </div> </div> <script> (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); ga('create', '', 'auto'); ga('send', 'pageview'); </script> </footer>  <script src="https://tools.bloggingqna.com/theme/default/js/bootstrap.min.js" type="text/javascript"></script>  <script type='text/javascript' src='https://tools.bloggingqna.com/theme/default/js/sweetalert.min.js'></script>  <script src="https://tools.bloggingqna.com/theme/default/js/app.js" type="text/javascript"></script>  <script src="https://tools.bloggingqna.com/rainbow/master-js" type="text/javascript"></script>  <div class="modal fade loginme" id="signin" role="dialog" aria-hidden="true"> <div class="modal-dialog"> <div class="modal-content"> <div class="modal-header"> <button type="button" class="close" data-dismiss="modal" aria-hidden="true">×</button> <h4 class="modal-title">Sign In</h4> </div> <form method="POST" action="https://tools.bloggingqna.com/account/login" class="loginme-form"> <div class="modal-body"> <div class="alert alert-warning"> <button type="button" class="close dismiss">×</button><span></span> </div> <div class="info">Sign in with your username</div> <div class="form-group"> <label>Username <br /> <input type="text" name="username" class="form-input width96" /> </label> </div> <div class="form-group"> <label>Password <br /> <input type="password" name="password" class="form-input width96" /> </label> </div> </div> <div class="modal-footer"> <button type="submit" class="btn btn-primary pull-left">Sign In</button> <div class="pull-right align-right"> <a href="https://tools.bloggingqna.com/account/forget">Forgot Password</a><br /> <a href="https://tools.bloggingqna.com/account/resend">Resend Activation Email</a> </div> </div> <input type="hidden" name="signin" value="7f70e9150d521e05cdaf2f793ffc98ec" /> <input type="hidden" name="quick" value="1c6117c1c81e66b4098190453310b38c" /> </form> </div> </div> </div>  <div class="modal fade loginme" id="signup" role="dialog" aria-hidden="true"> <div class="modal-dialog"> <div class="modal-content"> <div class="modal-header"> <button type="button" class="close" data-dismiss="modal" aria-hidden="true">×</button> <h4 class="modal-title">Sign Up</h4> </div> <form action="https://tools.bloggingqna.com/account/register" method="POST" class="loginme-form"> <div class="modal-body"> <div class="alert alert-warning"> <button type="button" class="close dismiss">×</button><span></span> </div> <div class="info">Sign up with your email address</div> <div class="form-group"> <label>Username <br /> <input type="text" name="username" class="form-input width96" /> </label> </div> <div class="form-group"> <label>Email <br /> <input type="text" name="email" class="form-input width96" /> </label> </div> <div class="form-group"> <label>Full Name <br /> <input type="text" name="full" class="form-input width96" /> </label> </div> <div class="form-group"> <label>Password <br /> <input type="password" name="password" class="form-input width96" /> </label> </div> </div> <div class="modal-footer"> <button type="submit" class="btn btn-primary">Sign Up</button> </div> <input type="hidden" name="signup" value="7f70e9150d521e05cdaf2f793ffc98ec" /> <input type="hidden" name="quick" value="781723542fd99edafa63719a71c17d8e" /> </form> </div> </div> </div>  <div class="modal fade loginme" id="xdBox" role="dialog" aria-hidden="true"> <div class="modal-dialog"> <div class="modal-content"> <div class="modal-header"> <button id="xdClose" type="button" class="close" data-dismiss="modal" aria-hidden="true">×</button> <h4 class="modal-title" id="xdTitle"></h4> </div> <div class="modal-body" id="xdContent"> </div> </div> </div> </div> </body> </html>

CINXE.COM

Robots.txt Generator | BloggingQnA Tools