Data validation

<!DOCTYPE html> <html lang="en"> <head> <title>Data validation</title> <meta name="viewport" content="width=device-width, user-scalable=no"> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><META name="description" content=""> <link rel="STYLESHEET" type="text/css" href="https://staticdatabase.bsbi.org/yui/build.2.9.0/reset/reset-min.css"><link rel="STYLESHEET" type="text/css" href="https://staticdatabase.bsbi.org/yui/build.2.9.0/fonts/fonts-min.css"><link rel="STYLESHEET" type="text/css" href="/css/autocomplete.css"><link rel="STYLESHEET" type="text/css" href="https://staticdatabase.bsbi.org/css/yuicss/menu.css"><link rel="STYLESHEET" type="text/css" href="https://staticdatabase.bsbi.org/css/bsbidb.034.css"><link rel="STYLESHEET" type="text/css" href="/css/fontawesome.css"><link rel="STYLESHEET" type="text/css" href="/css/solid.css"><link rel="STYLESHEET" type="text/css" href="/css/regular.css"><script type="text/javascript" src="https://staticdatabase.bsbi.org/yui/build.2.9.0/yahoo-dom-event/yahoo-dom-event.js"></script><script type="text/javascript" src="https://staticdatabase.bsbi.org/yui/build.2.9.0/datasource/datasource-min.js"></script><script type="text/javascript" src="https://staticdatabase.bsbi.org/yui/build.2.9.0/autocomplete/autocomplete-min.js"></script><script type="text/javascript" src="/js/container_patched-min.js"></script><script type="text/javascript" src="https://staticdatabase.bsbi.org/yui/build.2.9.0/menu/menu-min.js"></script><script type="text/javascript" src="https://staticdatabase.bsbi.org/js/bsbidb_common.098b.js"></script><script type="text/javascript">try { YAHOO.util.Event.onDOMReady(function () { try { var oMenuBar = new YAHOO.widget.MenuBar("topmenubar"); oMenuBar.render(); document.getElementById("topmenubar").style.position="relative"; } catch (e) { e.message += " while initialising menu bar (inner)"; throw e; } }); } catch (e) { e.message += " while initialising menu bar (outer)"; throw e; } var scriptUrl = window.location.protocol + "//database.bsbi.org/";var uid = BsbiDb.uid = null;</script>  <script async src="https://www.googletagmanager.com/gtag/js?id=UA-46443495-1"></script> <script> window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'UA-46443495-1'); gtag('config', 'G-893ZP3CW9G'); </script> </head> <body class="yui-skin-sam"> <div id="bodycontent">  <div id="headerbarwidget"> <div> <div class="headerbarright" id="loginpanel"><UL class="headerlinks headerrhslinks"><LI><a href='/help.php'>help</a> </LI><LI><a href='/datavalidation.php?login'>login</a> </LI><LI><a href='/createuser.php'>register</a></LI></UL></div><a href="https://bsbi.org/" title="Botanical Society of Britain and Ireland" style="position: absolute; top: 0px; left: 4px;"><img src="https://staticdatabase.bsbi.org/img/icons/BSBI_long.svg" alt="BSBI" width="189" height="64"/></a> <span style="position: relative; left: 212px; top: -8px;"><a class="headerwidgettitle" href="/">Distribution Database</a> > Data validation</span> </div> <div id="topmenubar" class="yuimenubar yuimenubarnav" style="position: relative; display: none; z-index: 5; margin-left: 212px;"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenubaritem first-of-type"><a class="yuimenubaritemlabel" href="#toolsmenu">Tools</a> <div id="toolsmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/checklists.php">Checklists</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/gridref.php">Grid reference lookup</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/reports/sitetaxa.php">Taxon list for a grid-square</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/datavalidation.php">Data validation</a> <div id="datavalidationmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/taxonnameparser.php">Taxon name lookup and validation</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/partynameparser.php">Name formatting (people and organisations)</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/gridrefparser.php">Grid-reference validation</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/dateparser.php">Date validation</a> </li><li class="yuimenuitem"><a class="yuimenuitemlabel" href="/taxondistributionchecker.php">Taxon distribution validator</a></li> </ul> </div> </div> </li> </ul> </div> </div> </li> <li style="display: none;"><a class="yuimenubaritemlabel" href="#linksmenu">Links</a> <div id="linksmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="#mapsandgazmenu">Maps and gazetteers</a> <div id="mapsandgazmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="/gridref.php">Vice-county lookup</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://wtp2.appspot.com/wheresthepath.htm">Where's the path</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://www.ordnancesurvey.co.uk/oswebsite/getamap/">Ordnance Survey GB</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://maps.osi.ie/publicviewer/">Ordnance Survey Ireland</a> </li> </ul> </div> </div> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="#plantdistmenu">Plant distribution</a> <div id="plantdistmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://data.nbn.org.uk/">NBN Gateway</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://data.gbif.org/welcome.htm">GBIF Data Portal</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://www.botanicalkeys.co.uk/flora/vccc/">Vice-county census catalogue</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://herbariaunited.org/atHome/">Herbarium@home</a> </li> </ul> </div> </div> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="#botlitmenu">Botanical literature</a> <div id="botlitmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="https://archive.bsbi.org/">BSBI Archive</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://rbg-web2.rbge.org.uk/BSBI/litsearch.php">BSBI Database (Leicester)</a> </li> <li class="yuimenuitem"> <a class="yuimenuitemlabel" href="http://www.biodiversitylibrary.org/">Biodiversity Heritage Library</a> </li> </ul> </div> </div> </li> </ul> </div> </div> </li> <li style="display: none"><a class="yuimenubaritemlabel" href="#newmenu">New</a> <div id="newmenu" class="yuimenu"> <div class="bd"> <ul class="first-of-type"><li class='yuimenuitem'><a class='yuimenuitemlabel' href='/editor.php?class=PartyInstance' title=''>Party (recorder/collector/author etc.)</a></li><li class='yuimenuitem'><a class='yuimenuitemlabel' href='/editor.php?class=RecordInstance' title=''>Record (observation or specimen)</a></li><li class='yuimenuitem'><a class='yuimenuitemlabel' href='/editor.php?class=LocalityInstance' title=''>Locality (named site)</a></li><li class='yuimenuitem'><a class='yuimenuitemlabel' href='/editor.php?class=DataSetInstance' title=''>Data set (herbarium, collection or other collation)</a></li><li class='yuimenuitem'><a class='yuimenuitemlabel' href='/editor.php?class=JournalInstance' title=''>Publication (book, periodical etc.)</a></li><li class='yuimenuitem'><a class='yuimenuitemlabel' href='/editor.php?class=ReferenceInstance' title=''>Reference (a reference to a publicaton or other source)</a></li></ul> <ul>  <li class='yuimenuitem'> <a class='yuimenuitemlabel' href='/createchecklist.php' title=''> Checklist or attribute set</a> </li> </ul> </div> </div> </li> <li><a href="/maps/" title="Taxon distribution maps drawn using data from the BSBI Atlas or the DDb">maps</a></li> <li><a href="/search.php" title="">search</a></li> <li style="display: none"><a href="/searchhistory.php">search history</a></li> <li style="display: none"><span style="border-bottom: none; border-top: none; display: none;" id="versionwidget"> <a href="/workspace.php" class="linknovisit">workspace</a>: </span></li> </ul> </div> </div> </div> <script type="text/javascript">YAHOO.util.Event.onDOMReady(function () {try {workspaceVersion.build_version_widget("versionwidget", "0.1", "c");workspaceVersion.version_conflict_banner("headerbarwidget");} catch (e) {e.message += " while initialising workspace"; throw e;}});</script> <div class="content"> <section> <h1>Stand-alone data validation tools</h1> <p>The DDb provides a few data validation tools to check tabular data files prior to <a href="/tabulardataimport.php">upload</a>. The eventual plan is to integrate all these into a single checking system, but until that work is complete it's worth passing data files through each of these tools separately prior to importing into the DDb.</p> <dl> <dt><a href="/taxonnameparser.php">Taxon names</a></dt> <dd><p>Matches taxon names from other sources against accepted names in the DDb taxon lists (largely a variant of the Stace Edition 3 flora lists).</p></dd> <dt><a href="/partynameparser.php">Recorder name formats</a></dt> <dd><p>This tool attempts to apply standard formating (e.g. <samp><strong>Surname</strong>, Forename</samp> or <samp><strong>Surname</strong>, A.; <strong>Other</strong>, A.N.</samp>) to a list of names of people or organisations. Names which cannot be parsed are indicated and should be reformatted manually prior to data upload.</p></dd> <dt><a href="/gridrefparser.php">Grid-references</a></dt> <dd><p>Checks for malformed references and matches grid-references to vice-county boundaries.</p></dd> <dt><a href="/dateparser.php">Dates</a></dt> <dd><p>Parses various date layouts into a standard format.</p></dd> <dt><a href="/taxondistributionchecker.php">Taxon distribution</a></dt> <dd><p>Matches taxon occurrences against the distribution from the BSBI's 2000 Atlas, and against known vice-county occurrence and with pre-existing records in the DDb.</p></dd> </dl> </section> </div> </div> <div id='browserversion' style="display: none;"></div> </body>  </html>

CINXE.COM

Data validation