Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees | Briefings in Bioinformatics

<!DOCTYPE html> <html lang="en" class="no-js"> <head>  <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <title>Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees | Briefings in Bioinformatics | Oxford Academic</title> <script type='text/javascript' defer src='//js.trendmd.com/trendmd.min.js' data-trendmdconfig='{"element":"#trendmd-suggestions"}' class='optanon-category-C0002'></script> <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.7.1/jquery.min.js" type="text/javascript"></script> <script>window.jQuery || document.write('<script src="//oup.silverchair-cdn.com/Themes/Silver/app/js/jquery.3.7.1.min.js" type="text/javascript">\x3C/script>')</script> <script src="//oup.silverchair-cdn.com/Themes/Silver/app/vendor/v-638654880267142888/jquery-migrate-1.4.1.min.js" type="text/javascript"></script> <script type='text/javascript' src='https://platform-api.sharethis.com/js/sharethis.js#property=643701de45aa460012e1032e&product=sop' async='async' class='optanon-category-C0004'></script> <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=10" /> <meta http-equiv="X-UA-Compatible" content="IE=Edge" />  <meta name="format-detection" content="telephone=no" />  <link rel="apple-touch-icon" sizes="180x180" href="//oup.silverchair-cdn.com/UI/app/img/v-638654879241847311/apple-touch-icon.png"> <link rel="icon" type="image/png" href="//oup.silverchair-cdn.com/UI/app/img/v-638654879242047735/favicon-32x32.png" sizes="32x32"> <link rel="icon" type="image/png" href="//oup.silverchair-cdn.com/UI/app/img/v-638654879241997236/favicon-16x16.png" sizes="16x16"> <link rel="mask-icon" href="//oup.silverchair-cdn.com/UI/app/img/v-638654879242697268/safari-pinned-tab.svg" color="#001C54"> <link rel="icon" href="//oup.silverchair-cdn.com/UI/app/img/v-638654879242147229/favicon.ico"> <link rel="manifest" href="//oup.silverchair-cdn.com/UI/app/img/v-638654879242447968/manifest.json"> <meta name="msapplication-config" content="//oup.silverchair-cdn.com/UI/app/img/v-638654879241847311/browserconfig.xml"> <meta name="theme-color" content="#002f65"> <link rel="stylesheet" type="text/css" href="//oup.silverchair-cdn.com/UI/app/fonts/icons.css" /> <link rel="stylesheet" type="text/css" href="//oup.silverchair-cdn.com/Themes/Client/app/css/v-638669719594245124/site.min.css" /> <link rel="preload" href="https://fonts.googleapis.com/css?family=Merriweather:300,400,400italic,700,700italic|Source+Sans+Pro:400,400italic,700,700italic" as="style" onload="this.onload=null;this.rel='stylesheet'"> <link href="//oup.silverchair-cdn.com/data/SiteBuilderAssetsOriginals/Live/CSS/journals/v-638647548564311250/global.css" rel="stylesheet" type="text/css" /> <link href="//oup.silverchair-cdn.com/data/SiteBuilderAssets/Live/CSS/bib/v-638567327252713419/Site.css" rel="stylesheet" type="text/css" /> <script> var dataLayer = [{"full_title":"Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees","short_title":"Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees","authors":"Brigitte Boeckmann,Marc Robinson-Rechavi,Ioannis Xenarios,Christophe Dessimoz","issue_and_volume":"Volume 12 | Issue 5","type":"research-article","online_publication_date":"2011-07-07","access_type":"Open Access","license_type":"cc-by-nc","event_type":"full-text","supplier_tag":"SC_Journals","object_type":"Article","taxonomy":"taxId%3a39%7ctaxLabel%3aAcademicSubjects%7cnodeId%3aSCI01060%7cnodeLabel%3aBioinformatics+and+Computational+Biology%7cnodeLevel%3a3","siteid":"bib","authzrequired":"false","doi":"10.1093/bib/bbr034"}]; </script> <script> (function (w, d, s, l, i) { w[l] = w[l] || []; w[l].push({ 'gtm.start': new Date().getTime(), event: 'gtm.js' }); var f = d.getElementsByTagName(s)[0], j = d.createElement(s), dl = l != 'dataLayer' ? '&l=' + l : ''; j.async = true; j.src = 'https://www.googletagmanager.com/gtm.js?id=' + i + dl; f.parentNode.insertBefore(j, f); })(window, document, 'script', 'dataLayer', 'GTM-W6DD7HV'); </script> <script type="text/javascript"> var App = App || {}; App.LoginUserInfo = { isInstLoggedIn: 0, isIndividualLoggedIn: 0 }; App.CurrentSubdomain = 'bib'; App.SiteURL = 'academic.oup.com/bib'; </script> <link href="https://cdn.jsdelivr.net/chartist.js/latest/chartist.min.css" media="print" onload="this.onload=null;this.removeAttribute('media');" rel="stylesheet" type="text/css" /> <script type="application/ld+json"> {"@context":"https://schema.org","@type":"ScholarlyArticle","@id":"https://academic.oup.com/bib/article/12/5/423/270085","name":"Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees","datePublished":"2011-07-07","isPartOf":{"@id":"https://academic.oup.com/bib/issue/12/5","@type":"PublicationIssue","issueNumber":"5","datePublished":"2011-09-01","isPartOf":{"@id":"https://academic.oup.com/bib/bib","@type":"Periodical","name":"Briefings in Bioinformatics","issn":["1477-4054"]}},"url":"https://dx.doi.org/10.1093/bib/bbr034","keywords":["conceptual comparison","phylogenomic databases","quality assessment","reference gene trees"],"inLanguage":"en","copyrightHolder":"Oxford University Press","copyrightYear":"2024","publisher":"Oxford University Press","author":[{"name":"Boeckmann, Brigitte","@type":"Person"},{"name":"Robinson-Rechavi, Marc","@type":"Person"},{"name":"Xenarios, Ioannis","@type":"Person"},{"name":"Dessimoz, Christophe","@type":"Person"}],"description":"Abstract. Phylogenomic databases provide orthology predictions for species with fully sequenced genomes. Although the goal seems well-defined, the content ","pageStart":"423","pageEnd":"435","siteName":"OUP Academic","thumbnailURL":"https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f1.jpeg?Expires=1794545297&Signature=TgUaULS11xbSP1K~AhovCsnAMDT813hpEuhIi~ftS4B-8WrABVt~jU84NNZdwTDcI7Dtxl5O7uNaDCzdmMY6Nf8nakGbeX5cCt53dHtDzLc4FTZpP-fFDwsFUxEoVOGXzQA~AzGX0q0H9Wylqgi7AZe4BwcIE29OBVUhn61FNEn~JUpHlWkPTQssMsoQMKvMT0eN7~JOS3uTJis9GC-mAv7zIOVhGW-ymSONiuSxu3~SrBiFWMDZ8NHIvvwnQnCzamjBwa8AYz-oq9ZaqMPF65nJknsARmhkA5TtN8x1awEKRtLLyPdjbF1JO6~lJeF0Q7Joci~JL8N6G-0vC0fJtw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA","headline":"Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees","image":"https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f1.jpeg?Expires=1794545297&Signature=TgUaULS11xbSP1K~AhovCsnAMDT813hpEuhIi~ftS4B-8WrABVt~jU84NNZdwTDcI7Dtxl5O7uNaDCzdmMY6Nf8nakGbeX5cCt53dHtDzLc4FTZpP-fFDwsFUxEoVOGXzQA~AzGX0q0H9Wylqgi7AZe4BwcIE29OBVUhn61FNEn~JUpHlWkPTQssMsoQMKvMT0eN7~JOS3uTJis9GC-mAv7zIOVhGW-ymSONiuSxu3~SrBiFWMDZ8NHIvvwnQnCzamjBwa8AYz-oq9ZaqMPF65nJknsARmhkA5TtN8x1awEKRtLLyPdjbF1JO6~lJeF0Q7Joci~JL8N6G-0vC0fJtw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA","image:alt":"Concepts of selected phylogenomic databases. Rows (from top to bottom) indicate the different database concepts, the structure of ortholog groups, the completeness of predicted gene relationships and the implied tree structures. Latter visualizes the captured phylogenetic information."} </script> <meta property="og:site_name" content="OUP Academic" /> <meta property="og:title" content="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" /> <meta property="og:description" content="Abstract. Phylogenomic databases provide orthology predictions for species with fully sequenced genomes. Although the goal seems well-defined, the content " /> <meta property="og:type" content="article" /> <meta property="og:url" content="https://dx.doi.org/10.1093/bib/bbr034" /> <meta property="og:updated_time" content="" /> <meta property="og:image" content="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f1.jpeg?Expires=1794545297&Signature=TgUaULS11xbSP1K~AhovCsnAMDT813hpEuhIi~ftS4B-8WrABVt~jU84NNZdwTDcI7Dtxl5O7uNaDCzdmMY6Nf8nakGbeX5cCt53dHtDzLc4FTZpP-fFDwsFUxEoVOGXzQA~AzGX0q0H9Wylqgi7AZe4BwcIE29OBVUhn61FNEn~JUpHlWkPTQssMsoQMKvMT0eN7~JOS3uTJis9GC-mAv7zIOVhGW-ymSONiuSxu3~SrBiFWMDZ8NHIvvwnQnCzamjBwa8AYz-oq9ZaqMPF65nJknsARmhkA5TtN8x1awEKRtLLyPdjbF1JO6~lJeF0Q7Joci~JL8N6G-0vC0fJtw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" /> <meta property="og:image:url" content="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f1.jpeg?Expires=1794545297&Signature=TgUaULS11xbSP1K~AhovCsnAMDT813hpEuhIi~ftS4B-8WrABVt~jU84NNZdwTDcI7Dtxl5O7uNaDCzdmMY6Nf8nakGbeX5cCt53dHtDzLc4FTZpP-fFDwsFUxEoVOGXzQA~AzGX0q0H9Wylqgi7AZe4BwcIE29OBVUhn61FNEn~JUpHlWkPTQssMsoQMKvMT0eN7~JOS3uTJis9GC-mAv7zIOVhGW-ymSONiuSxu3~SrBiFWMDZ8NHIvvwnQnCzamjBwa8AYz-oq9ZaqMPF65nJknsARmhkA5TtN8x1awEKRtLLyPdjbF1JO6~lJeF0Q7Joci~JL8N6G-0vC0fJtw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" /> <meta property="og:image:secure_url" content="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f1.jpeg?Expires=1794545297&Signature=TgUaULS11xbSP1K~AhovCsnAMDT813hpEuhIi~ftS4B-8WrABVt~jU84NNZdwTDcI7Dtxl5O7uNaDCzdmMY6Nf8nakGbeX5cCt53dHtDzLc4FTZpP-fFDwsFUxEoVOGXzQA~AzGX0q0H9Wylqgi7AZe4BwcIE29OBVUhn61FNEn~JUpHlWkPTQssMsoQMKvMT0eN7~JOS3uTJis9GC-mAv7zIOVhGW-ymSONiuSxu3~SrBiFWMDZ8NHIvvwnQnCzamjBwa8AYz-oq9ZaqMPF65nJknsARmhkA5TtN8x1awEKRtLLyPdjbF1JO6~lJeF0Q7Joci~JL8N6G-0vC0fJtw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" /> <meta property="og:image:alt" content="Concepts of selected phylogenomic databases. Rows (from top to bottom) indicate the different database concepts, the structure of ortholog groups, the completeness of predicted gene relationships and the implied tree structures. Latter visualizes the captured phylogenetic information." /> <meta name="twitter:card" content="summary_large_image" /> <meta name="citation_author" content="Boeckmann, Brigitte" /><meta name="citation_author" content="Robinson-Rechavi, Marc" /><meta name="citation_author" content="Xenarios, Ioannis" /><meta name="citation_author" content="Dessimoz, Christophe" /><meta name="citation_title" content="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" /><meta name="citation_firstpage" content="423" /><meta name="citation_lastpage" content="435" /><meta name="citation_doi" content="10.1093/bib/bbr034" /><meta name="citation_journal_title" content="Briefings in Bioinformatics" /><meta name="citation_journal_abbrev" content="Brief Bioinform" /><meta name="citation_volume" content="12" /><meta name="citation_issue" content="5" /><meta name="citation_publication_date" content="2011/09/01" /><meta name="citation_issn" content="1467-5463" /><meta name="citation_publisher" content="Oxford Academic" /><meta name="citation_reference" content="citation_title=Distinguishing homologous from analogous proteins; Syst Zool; citation_year=1970; citation_volume=19; citation_pages=99-113; " /><meta name="citation_reference" content="citation_title=How confident can we be that orthologs are similar, but paralogs differ?; Trends Genet; citation_year=2009; citation_volume=25; citation_pages=210-6; " /><meta name="citation_reference" content="citation_title=Overview and comparison of ortholog databases; Drug Discov Today: Technol; citation_year=2006; citation_volume=3; citation_pages=137-43; " /><meta name="citation_reference" content="citation_title=Assessing performance of orthology detection strategies applied to eukaryotic genomes; PLoS One; citation_year=2007; citation_volume=2; citation_pages=e383" /><meta name="citation_reference" content="citation_title=Benchmarking ortholog identification methods using functional genomics data; Genome Biol; citation_year=2006; citation_volume=7; citation_pages=R31" /><meta name="citation_reference" content="citation_title=Phylogenetic and functional assessment of orthologs inference projects and methods; PLoS Comput Biol; citation_year=2009; citation_volume=5; citation_pages=e1000262" /><meta name="citation_reference" content="citation_title=EnsemblCompara GeneTrees: Complete, duplication-aware phylogenetic trees in vertebrates; Genome Res; citation_year=2009; citation_volume=19; citation_pages=327-35; " /><meta name="citation_reference" content="citation_title=The quest for orthologs: finding the corresponding gene across genomes; Trends Genet; citation_year=2008; citation_volume=24; citation_pages=539-51; " /><meta name="citation_reference" content="citation_title=Ensembl's 10th year; Nucleic Acids Res; citation_year=2010; citation_volume=38; citation_pages=D557-62; " /><meta name="citation_reference" content="citation_title=eggNOG v2.0: extending the evolutionary genealogy of genes with enhanced non-supervised orthologous groups, species and functional annotations; Nucleic Acids Res; citation_year=2010; citation_volume=38; citation_pages=D190-5; " /><meta name="citation_reference" content="citation_title=Databases of homologous gene families for comparative genomics; BMC Bioinformatics; citation_year=2009; citation_volume=10; citation_pages=S3" /><meta name="citation_reference" content="citation_title=InParanoid 7: new algorithms and tools for eukaryotic orthology analysis; Nucleic Acids Res; citation_year=2010; citation_volume=38; citation_pages=D196-203; " /><meta name="citation_reference" content="citation_title=OMA 2011: orthology inference among 1000 complete genomes; Nucleic Acids Res; citation_year=2011; citation_volume=39; citation_pages=D289-94; " /><meta name="citation_reference" content="citation_title=OrthoDB: the hierarchical catalog of eukaryotic orthologs in 2011; Nucleic Acids Res; citation_year=2011; citation_volume=39; citation_pages=D283-8; " /><meta name="citation_reference" content="citation_title=PANTHER version 7: improved phylogenetic trees, orthologs and collaboration with the Gene Ontology Consortium; Nucleic Acids Res; citation_year=2010; citation_volume=38; citation_pages=D204-10; " /><meta name="citation_reference" content="citation_title=ExPASy: The proteomics server for in-depth protein knowledge and analysis; Nucleic Acids Res; citation_year=2003; citation_volume=31; citation_pages=3784-8; " /><meta name="citation_reference" content="citation_title=Phylogeny.fr: robust phylogenetic analysis for the non-specialist; Nucleic Acids Res; citation_year=2008; citation_volume=36; citation_pages=W465-69; " /><meta name="citation_reference" content="citation_title=MUSCLE: multiple sequence alignment with high accuracy and high throughput; Nucleic Acids Res; citation_year=2004; citation_volume=32; citation_pages=1792-7; " /><meta name="citation_reference" content="citation_title=ProbCons: Probabilistic consistency-based multiple sequence alignment; Genome Res; citation_year=2005; citation_volume=15; citation_pages=330-40; " /><meta name="citation_reference" content="citation_title=New algorithms and methods to estimate maximum-likelihood phylogenies: assessing the performance of PhyML 3.0; Syst Biol; citation_year=2010; citation_volume=59; citation_pages=307-21; " /><meta name="citation_reference" content="citation_title=The rapid generation of mutation data matrices from protein sequences; Comput Appl Biosci; citation_year=1992; citation_volume=8; citation_pages=275-82; " /><meta name="citation_reference" content="citation_title=A general empirical model of protein evolution derived from multiple protein families using a maximum-likelihood approach; Mol Biol Evol; citation_year=2001; citation_volume=18; citation_pages=691-9; " /><meta name="citation_reference" content="citation_title=Approximate likelihood-ratio test for branches: a fast, accurate, and powerful alternative; Syst Biol; citation_year=2006; citation_volume=55; citation_pages=539-52; " /><meta name="citation_reference" content="citation_title=MrBayes 3: Bayesian phylogenetic inference under mixed models; Bioinformatics; citation_year=2003; citation_volume=19; citation_pages=1572-4; " /><meta name="citation_reference" content="citation_title=BIONJ: an improved version of the NJ algorithm based on a simple model of sequence data; Mol Biol Evol; citation_year=1997; citation_volume=14; citation_pages=685-95; " /><meta name="citation_reference" content="citation_title=Maximum-likelihood analysis using TREE-PUZZLE; citation_text=Chapter 6:Unit 6 6; Curr Protoc Bioinformatics; citation_year=2007; " /><meta name="citation_reference" content="citation_title=Orthology prediction at scalable resolution by phylogenetic tree analysis; BMC Bioinformatics; citation_year=2007; citation_volume=8; citation_pages=83" /><meta name="citation_reference" content="citation_title=Dealing with incongruence in phylogenomic analyses; Philos Trans R Soc Lond B Biol Sci; citation_year=2008; citation_volume=363; citation_pages=4023-9; " /><meta name="citation_reference" content="citation_title=Gene conversion: mechanisms, evolution and human disease; Nat Rev Genet; citation_year=2007; citation_volume=8; citation_pages=762-75; " /><meta name="citation_reference" content="citation_title=Biased gene conversion and the evolution of mammalian genomic landscapes; Annu Rev Genomics Hum Genet; citation_year=2009; citation_volume=10; citation_pages=285-311; " /><meta name="citation_reference" content="citation_title=Detecting non-orthology in the COGs database and other approaches grouping orthologs using genome-specific best hits; Nucleic Acids Res; citation_year=2006; citation_volume=34; citation_pages=3309-16; " /><meta name="citation_reference" content="citation_title=Comparison of phylogenetic trees; Math Biosci; citation_year=1981; citation_volume=53; citation_pages=131-47; " /><meta name="citation_reference" content="citation_title=The Universal Protein Resource (UniProt) in 2010; Nucleic Acids Res; citation_year=2010; citation_volume=38; citation_pages=D142-48; " /><meta name="citation_fulltext_world_readable" content="" /><meta name="citation_pdf_url" content="https://academic.oup.com/bib/article-pdf/12/5/423/753549/bbr034.pdf" /><meta name="description" content="Abstract. Phylogenomic databases provide orthology predictions for species with fully sequenced genomes. Although the goal seems well-defined, the content " /><meta name="citation_xml_url" content="https://academic.oup.com/bib/article-xml/12/5/423/270085" /> <link rel="canonical" href="https://academic.oup.com/bib/article/12/5/423/270085" /> <meta name="citation_fulltext_world_readable" /> <meta name="product_code" content="J_BIB_2009_09_124" /> <meta name="product_code" content="J_BIB_2010_05_116" /> <meta name="product_code" content="J_BIB_2007_01_72" /> <meta name="product_code" content="J_BIB_2011_01_36" /> <meta name="product_code" content="J_BIB_2007_01_84" /> <meta name="product_code" content="J_BIB_2011_01_48" /> <meta name="product_code" content="J_BIB_2011_01_60" /> <meta name="product_code" content="J_BIB_2011_01_72" /> <meta name="product_code" content="J_bib_2009_01_192" /> <meta name="product_code" content="J_BIB_2000_01_216" /> <meta name="product_code" content="J_BIB_2000_01_252" /> <meta name="product_code" content="J_BIB_2000_01_228" /> <meta name="product_code" content="J_BIB_2008_01_132" /> <meta name="product_code" content="J_BIB_2007_01_60" /> <meta name="product_code" content="J_BIB_2007_01_66" /> <meta name="product_code" content="J_BIB_2011_01_24" /> <meta name="product_code" content="J_BIB_2007_01_120" /> <meta name="product_code" content="J_BIB_2010_01_48" /> <meta name="product_code" content="J_BIB_2006_01_144" /> <meta name="product_code" content="J_BIB_2010_01_60" /> <meta name="product_code" content="J_BIB_2007_01_132" /> <meta name="product_code" content="J_BIB_2010_01_72" /> <meta name="product_code" content="J_BIB_2010_01_84" /> <meta name="product_code" content="J_BIB_2006_01_72" /> <meta name="product_code" content="J_BIB_2010_01_24" /> <meta name="product_code" content="J_BIB_2006_01_96" /> <meta name="product_code" content="J_BIB_2007_01_108" /> <meta name="product_code" content="J_BIB_2010_01_30" /> <meta name="product_code" content="J_BIB_2008_01_120" /> <meta name="product_code" content="J_BIB_2010_01_36" /> <meta name="product_code" content="J_BIB_2011_01_12" /> <meta name="product_code" content="J_BIB_2011_01_18" /> <meta name="product_code" content="OPEN_ACCESS" /> <meta name="product_code" content="j_ALLJOURNALS" /> <meta name="product_code" content="J_BIB_2006_01_108" /> <meta name="product_code" content="J_BIB_2006_01_132" /> <meta name="product_code" content="J_BIB_2009_01_120" /> <meta name="product_code" content="J_BIB_2009_01_108" /> <meta name="product_code" content="J_BIB_2011_01_108" /> <meta name="product_code" content="J_bib_2000_01_264" /> <meta name="product_code" content="J_BIB_2009_01_36" /> <meta name="product_code" content="J_BIB_2009_01_48" /> <meta name="product_code" content="J_BIB_2009_01_60" /> <meta name="product_code" content="J_BIB_2000_01_168" /> <meta name="product_code" content="J_BIB_2000_01_180" /> <meta name="product_code" content="J_BIB_2008_01_96" /> <meta name="product_code" content="J_BIB_2007_01_144" /> <meta name="product_code" content="J_BIB_2000_01_192" /> <meta name="product_code" content="J_BIB_2005_01_144" /> <meta name="product_code" content="J_BIB_2011_01_84" /> <meta name="product_code" content="J_BIB_2000_01_9999" /> <meta name="product_code" content="J_BIB_2009_01_72" /> <meta name="product_code" content="J_BIB_2009_01_84" /> <meta name="product_code" content="J_BIB_2009_01_96" /> <meta name="product_code" content="J_BIB_2009_09_112" /> <meta name="product_code" content="J_BIB_2000_01_144" /> <meta name="product_code" content="J_BIB_2010_01_98" /> <meta name="product_code" content="J_BIB_2007_01_96" /> <meta name="product_code" content="J_BIB_2008_01_108" /> <meta name="product_code" content="J_BIB_2008_01_48" /> <meta name="product_code" content="J_BIB_2008_01_60" /> <meta name="product_code" content="bib_oa_flip_archive_free" /> <meta name="product_code" content="J_BIB_2008_01_72" /> <meta name="product_code" content="J_BIB_2008_01_84" /> <meta name="product_code" content="bib_FBI_12m" /> <meta name="product_code" content="J_bib_2000_01_240" /> <meta name="product_code" content="J_BIB_2009_09_52" /> <meta name="product_code" content="J_BIB_2010_05_104" /> <meta name="product_code" content="SOLR_FACET_FREE" /> <meta name="product_code" content="J_270085" /> <meta name="product_code" content="I_9688" /> <script> var SCM = SCM || {}; SCM.pubGradeAdsEnabled = true; SCM.pubGradeJSLibrary = 'https://cdn.pbgrd.com/core-oup-new.js'; </script> <script async="async" src="https://securepubads.g.doubleclick.net/tag/js/gpt.js"></script> <script> var googletag = googletag || {}; googletag.cmd = googletag.cmd || []; </script> <script type='text/javascript'> var gptAdSlots = []; googletag.cmd.push(function() { var mapping_ad1 = googletag.sizeMapping() .addSize([1024, 0], [[970, 90], [728, 90]]) .addSize([768, 0], [728, 90]) .addSize([0, 0], [320, 50]) .build(); gptAdSlots["ad1"] = googletag.defineSlot('/116097782/bib_Supplement_Ad1', [[970, 90], [728, 90], [320, 50]], 'adBlockHeader') .defineSizeMapping(mapping_ad1) .addService(googletag.pubads()); var mapping_ad2 = googletag.sizeMapping() .addSize([768, 0], [[300, 250], [300, 600], [160, 600]]) .build(); gptAdSlots["ad2"] = googletag.defineSlot('/116097782/bib_Supplement_Ad2', [[300, 250], [160, 600], [300, 600]], 'adBlockMainBodyTop') .defineSizeMapping(mapping_ad2) .addService(googletag.pubads()); var mapping_ad3 = googletag.sizeMapping() .addSize([768, 0], [[300, 250], [300, 600], [160, 600]]) .build(); gptAdSlots["ad3"] = googletag.defineSlot('/116097782/bib_Supplement_Ad3', [[300, 250], [160, 600], [300, 600]], 'adBlockMainBodyBottom') .defineSizeMapping(mapping_ad3) .addService(googletag.pubads()); var mapping_ad4 = googletag.sizeMapping() .addSize([0,0], [320, 50]) .addSize([768, 0], [728, 90]) .build(); gptAdSlots["ad4"] = googletag.defineSlot('/116097782/bib_Supplement_Ad4', [728, 90], 'adBlockFooter') .defineSizeMapping(mapping_ad4) .addService(googletag.pubads()); var mapping_ad6 = googletag.sizeMapping() .addSize([1024, 0], [[970, 90], [728, 90]]) .addSize([768, 0], [728, 90]) .addSize([0, 0], [320, 50]) .build(); gptAdSlots["ad6"] = googletag.defineSlot('/116097782/bib_Supplement_Ad6', [[728, 90], [970, 90]], 'adBlockStickyFooter') .defineSizeMapping(mapping_ad6) .addService(googletag.pubads()); gptAdSlots["adInterstitial"] = googletag.defineOutOfPageSlot('/116097782/bib_Interstitial_Ad', googletag.enums.OutOfPageFormat.INTERSTITIAL) .addService(googletag.pubads()); googletag.pubads().addEventListener('slotRenderEnded', function (event) { if (!event.isEmpty) { $('.js-' + event.slot.getSlotElementId()).each(function () { if ($(this).find('iframe').length) { $(this).removeClass('hide'); } }); } }); googletag.pubads().addEventListener('impressionViewable', function (event) { if (!event.isEmpty) { $('.js-' + event.slot.getSlotElementId()).each(function () { var $adblockDiv = $(this).find('.js-adblock'); var $adText = $(this).find('.js-adblock-advertisement-text'); if ($adblockDiv && $adblockDiv.is(':visible') && $adblockDiv.find('*').length > 1) { $adText.removeClass('hide'); App.CenterAdBlock.Init($adblockDiv, $adText); } else { $adText.addClass('hide'); } //Initialize logic for Sticky Footer Ad var $stickyFooterDiv = $(this).parents('.js-sticky-footer-ad'); if ($stickyFooterDiv && $stickyFooterDiv.is(':visible') && $stickyFooterDiv.find('*').length > 1) { App.StickyFooterAd.Init(); } }); } }); googletag.pubads().setTargeting("jnlspage", "article"); googletag.pubads().setTargeting("jnlsurl", "bib/article/12/5/423/270085"); googletag.pubads().enableSingleRequest(); googletag.pubads().disableInitialLoad(); googletag.pubads().collapseEmptyDivs(); }); </script> <input type="hidden" class="hfInterstitial" data-interstitiallinks="bib/issue,bib/advance-articles,bib/advance-article,bib/supplements,bib/article,bib/article-abstract,bib/pages" data-subdomain="bib" /> <script type="text/javascript"> googletag.cmd.push(function () { googletag.pubads().setTargeting("jnlsdoi", "10.1093/bib/bbr034"); googletag.enableServices(); }); </script> <script type="text/javascript"> var NTPT_PGEXTRA= 'event_type=full-text&supplier_tag=SC_Journals&object_type=Article&taxonomy=taxId%3a39%7ctaxLabel%3aAcademicSubjects%7cnodeId%3aSCI01060%7cnodeLabel%3aBioinformatics+and+Computational+Biology%7cnodeLevel%3a3&siteid=bib&authzrequired=false&doi=10.1093/bib/bbr034'; </script> <script src="https://scholar.google.com/scholar_js/casa.js" async></script> </head> <body data-sitename="briefingsinbioinformatics" class="off-canvas pg_Article pg_article " theme-bib data-sitestyletemplate="Journal" > <noscript> <iframe src="https://www.googletagmanager.com/ns.html?id=GTM-W6DD7HV" height="0" width="0" style="display:none;visibility:hidden"></iframe> </noscript> <a href="#skipNav" class="skipnav">Skip to Main Content</a> <input id="hdnSiteID" name="hdnSiteID" type="hidden" value="5143" /><input id="hdnAdDelaySeconds" name="hdnAdDelaySeconds" type="hidden" value="5000" /><input id="hdnAdConfigurationTop" name="hdnAdConfigurationTop" type="hidden" value="scrolldelay" /><input id="hdnAdConfigurationRightRail" name="hdnAdConfigurationRightRail" type="hidden" value="sticky" /> <div class="master-container js-master-container"> <section class="master-header row js-master-header vt-site-page-header"> <div class="widget widget-SitePageHeader widget-instance-SitePageHeader"> <div class="ad-banner js-ad-banner-header"> <div class="widget widget-AdBlock widget-instance-HeaderAd"> <div class="js-adBlock-parent-wrap adblock-parent-wrap"> <div class="adBlockHeader-wrap js-adBlockHeader hide"> <div id="adBlockHeader" class="js-adblock at-adblock" data-lazy-load-margin="150"> <script> googletag.cmd.push(function () { googletag.display('adBlockHeader'); }); </script> </div> <div class="advertisement-text at-adblock js-adblock-advertisement-text hide">Advertisement</div> </div> </div> </div> </div> <div class="oup-header sigma "> <div class="center-inner-row"> <div class="oup-header-logo"> <a href="/"> <img src="//oup.silverchair-cdn.com/UI/app/svg/umbrella/oxford-academic-logo.svg" alt="Oxford Academic" class="oup-header-image at-oup-header-image " /> </a> </div> <div class="widget widget-CustomNavLinks widget-instance-CustomNavLinksDeskTop"> <div class="custom-nav-links-box"> <div class="custom-nav-link"> <a href="/journals">Journals</a> </div> <div class="custom-nav-link"> <a href="/books">Books</a> </div> </div> </div> <ul class="oup-header-menu account-menu sigma-account-menu "> <li class="oup-header-menu-item mobile"> <a href="javascript:;" class="mobile-dropdown-toggle mobile-search-toggle"> <i class="icon-menu_search"><span class="screenreader-text">Search Menu</span></i> </a> </li> <li class="oup-header-menu-item mobile info-icon-menu-item"> <a href="/pages/information" target="_blank" class="at-info-button sigma-info-wrapper" role="button"> <img class="sigma-info-icon" src="//oup.silverchair-cdn.com/UI/app/svg/i.svg" alt="Information" /> </a> </li> <li class="oup-header-menu-item mobile account-icon-menu-item"> <a href="javascript:;" class="account-button js-account-button at-account-button " role="button" data-turnawayparams="journal%3dbib"> <img class="sigma-account-icon" src="//oup.silverchair-cdn.com/UI/app/svg/account.svg" alt="Account" /> </a> </li> <li class="oup-header-menu-item mobile"> <a href="javascript:;" class="mobile-dropdown-toggle mobile-nav-toggle"> <i class="icon-menu_hamburger"><span class="screenreader-text">Menu</span></i> </a> </li> <li class="oup-header-menu-item desktop info-icon-menu-item"> <a href="/pages/information" target="_blank" class="at-info-button sigma-info-wrapper" role="button"> <img class="sigma-info-icon" src="//oup.silverchair-cdn.com/UI/app/svg/i.svg" alt="Information" /> </a> </li> <li class="oup-header-menu-item desktop account-icon-menu-item"> <a href="javascript:;" class="account-button js-account-button at-account-button sigma-logo-wrapper" role="button" data-turnawayparams="journal%3dbib"> <img class="sigma-account-icon" src="//oup.silverchair-cdn.com/UI/app/svg/account.svg" alt="Account" /> </a> </li> <li class="oup-header-menu-item desktop account-icon-menu-item"> <div class="widget widget-SeamlessAccess widget-instance-SitePageHeader"> <a href="javascript:;" class="js-shibboleth-action seamless-access-button seamless-button-header button-call-to-action at-institutional-sign-in" rel="nofollow" data-action-type="" data-entity-id=""> <span class="seamless-access-text">Sign in through your institution</span> </a> </div> </li> </ul> <div class="login-box-placeholder js-login-box-placeholder hide"> <div class="spinner"></div> </div> </div> </div> <div class="dropdown-panel-wrap"> <div class="dropdown-panel mobile-search-dropdown"> <div class="mobile-search-inner-wrap"> <div class="navbar-search"> <div class="mobile-microsite-search"> <label for="SitePageHeader-mobile-navbar-search-filter" class="screenreader-text js-mobile-navbar-search-filter-label"> Navbar Search Filter </label> <select class="mobile-navbar-search-filter js-mobile-navbar-search-filter at-navbar-search-filter" id="SitePageHeader-mobile-navbar-search-filter"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="">Briefings in Bioinformatics</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Issue">This issue</option> <optgroup class="navbar-search-optgroup" label="Search across Oxford Academic"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="AcademicSubjects/SCI01060">Bioinformatics and Computational Biology</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Books">Books</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Journals">Journals</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Umbrella">Oxford Academic</option> </optgroup> </select> <label for="SitePageHeader-mobile-microsite-search-term" class="screenreader-text js-mobile-microsite-search-term-label"> Mobile Enter search term </label> <input class="mobile-search-input mobile-microsite-search-term js-mobile-microsite-search-term at-microsite-search-term" type="text" maxlength="255" placeholder="Search" id="SitePageHeader-mobile-microsite-search-term"> <a href="javascript:;" class="mobile-microsite-search-icon mobile-search-submit icon-menu_search"> <span class="screenreader-text">Search</span> </a> </div> </div> </div> </div> <div class="dropdown-panel mobile-nav-dropdown"> <ul class="site-menu site-menu-lvl-0 at-site-menu"> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700552"> <a href="/bib/issue" class="nav-link"> Issues </a> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700549"> <a href="javascript:;" class="nav-link js-nav-dropdown at-nav-dropdown" role="button" aria-expanded="false"> Submit <i class="desktop-nav-arrow icon-general-arrow-filled-down arrow-icon"></i> </a> <i class="mobile-nav-arrow icon-general_arrow-down"></i> <ul class="site-menu site-menu-lvl-1 at-site-menu"> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700553"> <a href="/bib/pages/General_Instructions" class="nav-link"> Author Guidelines </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700554"> <a href="http://mc.manuscriptcentral.com/bib" class="nav-link"> Submission Site </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700555"> <a href="https://academic.oup.com/bib/pages/open-access" class="nav-link"> Open Access </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700556"> <a href="https://academic.oup.com/bib/pages/why-publish-with-briefings-in-bioinformatics" class="nav-link"> Reasons to publish with us </a> </li> </ul> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700557"> <a href="/my-account/email-alerts" class="nav-link"> Alerts </a> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700550"> <a href="javascript:;" class="nav-link js-nav-dropdown at-nav-dropdown" role="button" aria-expanded="false"> About <i class="desktop-nav-arrow icon-general-arrow-filled-down arrow-icon"></i> </a> <i class="mobile-nav-arrow icon-general_arrow-down"></i> <ul class="site-menu site-menu-lvl-1 at-site-menu"> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700558"> <a href="/bib/pages/About" class="nav-link"> About Briefings in Bioinformatics </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700559"> <a href="http://science-and-mathematics-careernetwork.oxfordjournals.org/jobseeker/search/results/?t730=&search=&t732=470054&t731=&t733=&t735=&t737=&max=25&site_id=20106" class="nav-link"> Journals Career Network </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700560"> <a href="/bib/pages/Editorial_Board" class="nav-link"> Editorial Board </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700561"> <a href="https://academic.oup.com/advertising-and-corporate-services/pages/bib-media-kit" class="nav-link"> Advertising and Corporate Services </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700562"> <a href="https://academic.oup.com/pages/self_archiving_policy_c" class="nav-link"> Self-Archiving Policy </a> </li> </ul> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700551"> <a href="javascript:;" class="nav-link js-nav-dropdown at-nav-dropdown" role="button" aria-expanded="false"> More Content <i class="desktop-nav-arrow icon-general-arrow-filled-down arrow-icon"></i> </a> <i class="mobile-nav-arrow icon-general_arrow-down"></i> <ul class="site-menu site-menu-lvl-1 at-site-menu"> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700563"> <a href="https://academic.oup.com/bib/pages/special-issues" class="nav-link"> Special Issues </a> </li> </ul> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-custom"> <a href="/journals" class="nav-link">Journals on Oxford Academic</a> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-custom"> <a href="/books" class="nav-link">Books on Oxford Academic</a> </li> </ul> </div> </div> <div class="journal-header journal-bg"> <div class="center-inner-row"> <a href="/bib" class="journal-logo-container"> <img id="logo-BriefingsinBioinformatics" class="journal-logo" src="//oup.silverchair-cdn.com/data/SiteBuilderAssets/Live/Images/bib/bib_title526563102.svg" alt="Briefings in Bioinformatics" /> </a> <div class="society-logo-block"> </div> </div> </div> <div class="navbar"> <div class="center-inner-row"> <nav class="navbar-menu"> <ul class="site-menu site-menu-lvl-0 at-site-menu"> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700552"> <a href="/bib/issue" class="nav-link"> Issues </a> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700549"> <a href="javascript:;" class="nav-link js-nav-dropdown at-nav-dropdown" role="button" aria-expanded="false"> Submit <i class="desktop-nav-arrow icon-general-arrow-filled-down arrow-icon"></i> </a> <i class="mobile-nav-arrow icon-general_arrow-down"></i> <ul class="site-menu site-menu-lvl-1 at-site-menu"> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700553"> <a href="/bib/pages/General_Instructions" class="nav-link"> Author Guidelines </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700554"> <a href="http://mc.manuscriptcentral.com/bib" class="nav-link"> Submission Site </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700555"> <a href="https://academic.oup.com/bib/pages/open-access" class="nav-link"> Open Access </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700556"> <a href="https://academic.oup.com/bib/pages/why-publish-with-briefings-in-bioinformatics" class="nav-link"> Reasons to publish with us </a> </li> </ul> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700557"> <a href="/my-account/email-alerts" class="nav-link"> Alerts </a> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700550"> <a href="javascript:;" class="nav-link js-nav-dropdown at-nav-dropdown" role="button" aria-expanded="false"> About <i class="desktop-nav-arrow icon-general-arrow-filled-down arrow-icon"></i> </a> <i class="mobile-nav-arrow icon-general_arrow-down"></i> <ul class="site-menu site-menu-lvl-1 at-site-menu"> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700558"> <a href="/bib/pages/About" class="nav-link"> About Briefings in Bioinformatics </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700559"> <a href="http://science-and-mathematics-careernetwork.oxfordjournals.org/jobseeker/search/results/?t730=&search=&t732=470054&t731=&t733=&t735=&t737=&max=25&site_id=20106" class="nav-link"> Journals Career Network </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700560"> <a href="/bib/pages/Editorial_Board" class="nav-link"> Editorial Board </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700561"> <a href="https://academic.oup.com/advertising-and-corporate-services/pages/bib-media-kit" class="nav-link"> Advertising and Corporate Services </a> </li> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700562"> <a href="https://academic.oup.com/pages/self_archiving_policy_c" class="nav-link"> Self-Archiving Policy </a> </li> </ul> </li> <li class="site-menu-item site-menu-lvl-0 at-site-menu-item" id="site-menu-item-1700551"> <a href="javascript:;" class="nav-link js-nav-dropdown at-nav-dropdown" role="button" aria-expanded="false"> More Content <i class="desktop-nav-arrow icon-general-arrow-filled-down arrow-icon"></i> </a> <i class="mobile-nav-arrow icon-general_arrow-down"></i> <ul class="site-menu site-menu-lvl-1 at-site-menu"> <li class="site-menu-item site-menu-lvl-1 at-site-menu-item" id="site-menu-item-1700563"> <a href="https://academic.oup.com/bib/pages/special-issues" class="nav-link"> Special Issues </a> </li> </ul> </li> </ul> </nav> <div class="navbar-search-container js-navbar-search-container"> <a href="javascript:;" class="navbar-search-close js_close-navsearch">Close</a> <div class="navbar-search"> <div class="microsite-search"> <label for="SitePageHeader-navbar-search-filter" class="screenreader-text js-navbar-search-filter-label"> Navbar Search Filter </label> <select class="navbar-search-filter js-navbar-search-filter at-navbar-search-filter" id="SitePageHeader-navbar-search-filter"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="">Briefings in Bioinformatics</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Issue">This issue</option> <optgroup class="navbar-search-optgroup" label="Search across Oxford Academic"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="AcademicSubjects/SCI01060">Bioinformatics and Computational Biology</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Books">Books</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Journals">Journals</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Umbrella">Oxford Academic</option> </optgroup> </select> <label for="SitePageHeader-microsite-search-term" class="screenreader-text js-microsite-search-term-label"> Enter search term </label> <input class="navbar-search-input microsite-search-term js-microsite-search-term at-microsite-search-term" type="text" maxlength="255" placeholder="Search" id="SitePageHeader-microsite-search-term"> <a href="javascript:;" class="microsite-search-icon navbar-search-submit icon-menu_search"> <span class="screenreader-text">Search</span> </a> </div> </div> <input id="hfCurrentBookSearch" name="hfCurrentBookSearch" type="hidden" value="" /><input id="hfCurrentBookScope" name="hfCurrentBookScope" type="hidden" value="CurrentBook" /><input id="hfBookSiteScope" name="hfBookSiteScope" type="hidden" value="Books" /><input id="hfSeriesScope" name="hfSeriesScope" type="hidden" value="taxWithOr" /><input id="hfParentSiteName" name="hfParentSiteName" type="hidden" value="Oxford Academic" /><input id="hfParentSiteUrl" name="hfParentSiteUrl" type="hidden" value="academic.oup.com" /><input id="hfSiteID" name="hfSiteID" type="hidden" value="5143" /><input id="hfParentSiteID" name="hfParentSiteID" type="hidden" value="191" /><input id="hfJournalSiteScope" name="hfJournalSiteScope" type="hidden" value="Journals" /><input id="hfParentSiteScope" name="hfParentSiteScope" type="hidden" value="Parent" /><input id="hfDefaultSearchURL" name="hfDefaultSearchURL" type="hidden" value="search-results?page=1&q=" /><input id="hfIssueSearch" name="hfIssueSearch" type="hidden" value="&fl_IssueID=9688" /><input id="hfIssueSiteScope" name="hfIssueSiteScope" type="hidden" value="Issue" /><input id="hfUmbrellaScope" name="hfUmbrellaScope" type="hidden" value="Umbrella" /><input id="hfUmbrellaSiteUrl" name="hfUmbrellaSiteUrl" type="hidden" value="academic.oup.com" /><input id="hfUmbrellaSiteId" name="hfUmbrellaSiteId" type="hidden" value="191" /><input id="hfDefaultAdvancedSearchUrl" name="hfDefaultAdvancedSearchUrl" type="hidden" value="advanced-search?page=1&q=" /><input id="hfTaggedCollectionScope" name="hfTaggedCollectionScope" type="hidden" value="" /> <div class="navbar-search-advanced"><a href="/bib/advanced-search" class="advanced-search js-advanced-search">Advanced Search</a></div> </div> <div class="navbar-search-collapsed"><a href="javascript:;" class="icon-menu_search js_expand-navsearch"><span class="screenreader-text">Search Menu</span></a></div> </div> </div> <input type="hidden" name="searchScope" id="hfSolrJournalID" value="" /> <input type="hidden" id="hfSolrJournalName" value="" /> <input type="hidden" id="hfSolrMaxAllowSearchChar" value="100" /> <input type="hidden" id="hfJournalShortName" value="" /> <input type="hidden" id="hfSearchPlaceholder" value="" /> <input type="hidden" name="hfGlobalSearchSiteURL" id="hfGlobalSearchSiteURL" value="" /> <input type="hidden" name="hfSearchSiteURL" id="hfSiteURL" value="academic.oup.com/bib" /> <input type="hidden" name="RedirectSiteUrl" id="RedirectSiteUrl" value="httpszazjzjacademiczwoupzwcom" /> <script type="text/javascript"> (function () { var hfSiteUrl = document.getElementById('hfSiteURL'); var siteUrl = hfSiteUrl.value; var subdomainIndex = siteUrl.indexOf('/'); hfSiteUrl.value = location.host + (subdomainIndex >= 0 ? siteUrl.substring(subdomainIndex) : ''); })(); </script> <input id="routename" name="RouteName" type="hidden" value="bib" /> </div> </section> <div class="widget widget-SitewideBanner widget-instance-"> </div> <div id="main" class="content-main js-main ui-base"> <section class="master-main row"> <div class="center-inner-row no-overflow"> <div id="skipNav" tabindex="-1"></div> <div class="page-column-wrap"> <div id="InfoColumn" class="page-column page-column--left js-left-nav-col"> <div class="mobile-content-topbar hide"> <button class="toggle-left-col toggle-left-col__article">Article Navigation</button> </div> <div class="info-inner-wrap js-left-nav"> <button class="toggle-left-col__close btn-as-icon icon-general-close"> <span class="screenreader-text">Close mobile search navigation</span> </button> <div class="responsive-nav-title">Article Navigation</div> <div class="info-widget-wrap"> <div class="widget widget-IssueInfo widget-instance-OUP_IssueInfo_Article"> <div id="issueInfo-OUP_IssueInfo_Article" class="article-info-wrap clearfix"> <i class="icon-general-close mobile-nav-btn nav-open"></i> <a class="article-issue-link" href="/bib/issue/12/5"> <div class="article-issue-img"> <img id="issueImage" class="fb-featured-image" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/Issue/12/5/0/m_bib12_5.cover.gif?Expires=1735504119&Signature=KCtyfOf7yZ3rmwQ6ofiiB-sK9dehWPbxMym6X04SFl~kjrnP0ZP0ePhMsvqEwcgMSjYnQAngqK-PvN0EvQOtmVCY5v2dkqJTw5jLPqvMVHmSQvkrQvuQkjWl391tmFmHM4w4ZzkJWBpFqJpw1xKwnv~gQbhjBXWIApYWW1zsIROmbAUQZVU-QeVsLOxLi8Dt31iE59ttXnp-m2Eg2UVnSl5mnnBM41emjM4RcyYAXvp3qpj~4hviIXDR4tWvPRTqg0m7YM5aEyrb3Rv2rgVfxY2TJC6wNc7~6YCaJZd-2fvfjdU70NGUv~gcvll8hkJv12tFIrOJJkk~CaaTJXZnsQ__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="Issue Cover" /> </div> <div class="article-issue-info"> <div class="volume-issue__wrap"> <div class="volume trailing-comma">Volume 12</div> <div class="issue">Issue 5</div> </div> <div class="ii-pub-date"> September 2011 </div> </div> </a> </div> </div> <div class="content-nav"> <div class="widget widget-ArticleJumpLinks widget-instance-OUP_ArticleJumpLinks_Widget"> <h3 class="contents-title" >Article Contents</h3> <ul class="jumplink-list js-jumplink-list"> <li class="section-jump-link head-1" link-destination="3262394"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262394">Abstract</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262396"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262396">INTRODUCTION</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262404"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262404">METHODS</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262421"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262421">RESULTS AND DISCUSSION</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262450"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262450">CONCLUSIONS</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262453"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262453">SUPPLEMENTARY DATA</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262457"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262457">FUNDING</a> </div> </li> <li class="section-jump-link head-1" link-destination="3262459"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262459">Acknowledgements</a> </div> </li> <li class="section-jump-link head-1 backReferenceLink" link-destination="3262461"> <div class="section-jump-link__link-wrap"> <a class="js-jumplink scrollTo" href="#3262461">References</a> </div> </li> </ul> </div> </div> <div class="widget widget-ArticleNavLinks widget-instance-OUP_ArticleNavLinks_Article"> <ul class="inline-list"> <li class="prev arrow"> <a href="/bib/article/12/5/413/270147">< Previous</a> </li> <li class="next arrow"> <a href="/bib/article/12/5/436/269969">Next ></a> </li> </ul> </div> </div> </div> </div> <div class="sticky-toolbar js-sticky-toolbar"></div> <div id="ContentColumn" class="page-column page-column--center"> <div class="article-browse-top article-browse-mobile-nav js-mobile-nav"> <div class="article-browse-mobile-nav-inner js-mobile-nav-inner"> <button class="toggle-left-col toggle-left-col__article btn-as-link"> Article Navigation </button> </div> </div> <div class="article-browse-top article-browse-mobile-nav mobile-sticky-toolbar js-mobile-nav-sticky"> <div class="article-browse-mobile-nav-inner"> <button class="toggle-left-col toggle-left-col__article btn-as-link"> Article Navigation </button> </div> </div> <div class="content-inner-wrap"> <div class="widget widget-ArticleTopInfo widget-instance-OUP_ArticleTop_Info_Widget"> <div class="module-widget article-top-widget"> <div class="access-state-logos all-viewports"> <span class="journal-info__format-label">Journal Article</span> </div> <div class="widget-items"> <div class="title-wrap"> <h1 class="wi-article-title article-title-main accessible-content-title at-articleTitle"> Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees <i class='icon-availability_open' title='Open Access' ></i> </h1> </div> <div class="wi-authors at-ArticleAuthors"> <div class="al-authors-list"> <span class="al-author-name-more js-flyout-wrap"> <button type="button" class="linked-name js-linked-name-trigger btn-as-link">Brigitte Boeckmann</button><span class='delimiter'>, </span> <span class="al-author-info-wrap arrow-up"> <div class="info-card-author authorInfo_OUP_ArticleTop_Info_Widget"> <div class="name-role-wrap"> <div class="info-card-name"> Brigitte Boeckmann </div> </div> <div class="info-card-note"> <p class="chapter-para"><strong>Brigitte Boeckmann</strong> is a researcher in the Swiss-Prot group at SIB Geneva. Her main interests focus on the evolution of proteins, proteomes and function.</p> </div> <div class="info-card-search-label"> Search for other works by this author on: </div> <div class="info-card-search info-card-search-internal"> <a href="/bib/search-results?f_Authors=Brigitte+Boeckmann" rel="nofollow">Oxford Academic</a> </div> <div class="info-card-search info-card-search-pubmed"> <a href="http://www.ncbi.nlm.nih.gov/pubmed?cmd=search&term=Boeckmann B">PubMed</a> </div> <div class="info-card-search info-card-search-google"> <a href="http://scholar.google.com/scholar?q=author:%22Boeckmann Brigitte%22">Google Scholar</a> </div> </div> </span> </span> <span class="al-author-name-more js-flyout-wrap"> <button type="button" class="linked-name js-linked-name-trigger btn-as-link">Marc Robinson-Rechavi</button><span class='delimiter'>, </span> <span class="al-author-info-wrap arrow-up"> <div class="info-card-author authorInfo_OUP_ArticleTop_Info_Widget"> <div class="name-role-wrap"> <div class="info-card-name"> Marc Robinson-Rechavi </div> </div> <div class="info-card-note"> <p class="chapter-para"><strong>Marc Robinson-Rechavi</strong> is associate professor in bioinformatics at the Department of Ecology and Evolution in the University of Lausanne, and Group Leader at the Swiss Institute of Bioinformatics. His main interest is in the evolution of animal genomes in the context of organismal function and development.</p> </div> <div class="info-card-search-label"> Search for other works by this author on: </div> <div class="info-card-search info-card-search-internal"> <a href="/bib/search-results?f_Authors=Marc+Robinson-Rechavi" rel="nofollow">Oxford Academic</a> </div> <div class="info-card-search info-card-search-pubmed"> <a href="http://www.ncbi.nlm.nih.gov/pubmed?cmd=search&term=Robinson-Rechavi M">PubMed</a> </div> <div class="info-card-search info-card-search-google"> <a href="http://scholar.google.com/scholar?q=author:%22Robinson-Rechavi Marc%22">Google Scholar</a> </div> </div> </span> </span> <span class="al-author-name-more js-flyout-wrap"> <button type="button" class="linked-name js-linked-name-trigger btn-as-link">Ioannis Xenarios</button><span class='delimiter'>, </span> <span class="al-author-info-wrap arrow-up"> <div class="info-card-author authorInfo_OUP_ArticleTop_Info_Widget"> <div class="name-role-wrap"> <div class="info-card-name"> Ioannis Xenarios </div> </div> <div class="info-card-note"> <p class="chapter-para"><strong>Ioannis Xenarios</strong> is a professor in computational biology at the University of Lausanne. He is also director of the Swiss-Prot group and Vital-IT group at the Swiss Institute of Bioinformatics.</p> </div> <div class="info-card-search-label"> Search for other works by this author on: </div> <div class="info-card-search info-card-search-internal"> <a href="/bib/search-results?f_Authors=Ioannis+Xenarios" rel="nofollow">Oxford Academic</a> </div> <div class="info-card-search info-card-search-pubmed"> <a href="http://www.ncbi.nlm.nih.gov/pubmed?cmd=search&term=Xenarios I">PubMed</a> </div> <div class="info-card-search info-card-search-google"> <a href="http://scholar.google.com/scholar?q=author:%22Xenarios Ioannis%22">Google Scholar</a> </div> </div> </span> </span> <span class="al-author-name-more js-flyout-wrap"> <button type="button" class="linked-name js-linked-name-trigger btn-as-link">Christophe Dessimoz</button><span class='delimiter'></span> <span class="al-author-info-wrap arrow-up"> <div class="info-card-author authorInfo_OUP_ArticleTop_Info_Widget"> <div class="name-role-wrap"> <div class="info-card-name"> Christophe Dessimoz </div> </div> <div class="info-card-note"> <p class="chapter-para"><strong>Christophe Dessimoz</strong> is senior post-doc and lecturer in the CBRG group, computer science, ETH Zurich. His interest lies in understanding the forces that shape genes, genomes and species by using computational and statistical methods.</p> </div> <div class="info-card-search-label"> Search for other works by this author on: </div> <div class="info-card-search info-card-search-internal"> <a href="/bib/search-results?f_Authors=Christophe+Dessimoz" rel="nofollow">Oxford Academic</a> </div> <div class="info-card-search info-card-search-pubmed"> <a href="http://www.ncbi.nlm.nih.gov/pubmed?cmd=search&term=Dessimoz C">PubMed</a> </div> <div class="info-card-search info-card-search-google"> <a href="http://scholar.google.com/scholar?q=author:%22Dessimoz Christophe%22">Google Scholar</a> </div> </div> </span> </span> </div> </div> <div class="pub-history-wrap clearfix js-history-dropdown-wrap"> <div class="pub-history-row clearfix"> <div class="ww-citation-primary"><em>Briefings in Bioinformatics</em>, Volume 12, Issue 5, September 2011, Pages 423–435, <a href='https://doi.org/10.1093/bib/bbr034'>https://doi.org/10.1093/bib/bbr034</a></div> </div> <div class="pub-history-row clearfix"> <div class="ww-citation-date-wrap"> <div class="citation-label">Published:</div> <div class="citation-date">07 July 2011</div> </div> <a href="javascript:;" class="history-label js-history-dropdown-trigger st-article-history at-ArticleHistory"> <span>Article history</span><i class="icon-general-arrow-filled-down arrow-icon"></i> </a> </div> <div class="ww-history js-history-entries-wrap at-history-entries-wrap"> <div class="history-entry at-history-entry"> <div class="wi-state">Received:</div> <div class="wi-date">17 February 2011</div> </div> <div class="history-entry at-history-entry"> <div class="wi-state">Revision received:</div> <div class="wi-date">17 May 2011</div> </div> <div class="history-entry at-history-entry"> <div class="wi-state">Published:</div> <div class="wi-date">07 July 2011</div> </div> </div> </div> </div> </div> <script> $(document).ready(function () { $('.article-top-widget').on('click', '.ati-toggle-trigger', function () { $(this).find('.icon-general-add, .icon-minus').toggleClass('icon-minus icon-general-add'); $(this).siblings('.ati-toggle-content').toggleClass('hide'); }); // In Chrome, an anchor tag with target="_blank" and a "mailto:" href opens a new tab/window as well as the email client // I suspect this behavior will be corrected in the future // Remove the target="_blank" $('ul.wi-affiliationList').find('a[href^="mailto:"]').each(function () { $(this).removeAttr('target'); }); }); </script> </div> <div class="widget widget-ArticleLinks widget-instance-OUP_Article_Links_Widget"> </div> <div class="article-body js-content-body"> <div class="toolbar-wrap js-toolbar-wrap"> <div class="toolbar-inner-wrap"> <ul id="Toolbar" role="navigation"> <li class="toolbar-item item-pdf js-item-pdf "> <a class="al-link pdf article-pdfLink" data-article-id="270085" href="/bib/article-pdf/12/5/423/753549/bbr034.pdf"> <img src=//oup.silverchair-cdn.com/UI/app/svg/pdf.svg alt="pdf" /><span class="pdf-link-text">PDF</span> </a> </li> <li class="toolbar-item item-link item-split-view"> <a href="javascript:;" class="split-view js-split-view st-split-view at-split-view" target=""> <i class="icon-menu-split"></i> Split View </a> </li> <li class="toolbar-item item-with-dropdown item-views"> <a class="at-views-dropdown drop-trigger" href="javascript:;" data-dropdown="FilterDrop" aria-haspopup="true"> <i class="icon-menu_views"></i> <div class="toolbar-label"> <div class="toolbar-text">Views</div> <i class="icon-general-arrow-filled-down arrow-icon"></i> </div> </a> <ul id="ViewsDrop" class="f-dropdown js-dropdown-content" data-dropdown-content aria-label="submenu"> <div class="arrow-up"></div> <li class="article-content-filter js-article-content-filter" data-content-filter="article-content"> <a href="javascript:;"><span>Article contents</span></a> </li> <li class="at-figures-tables article-content-filter js-article-content-filter" data-content-filter="figures-tables"> <a href="javascript:;"><span>Figures & tables</span></a> </li> <li class="article-content-filter js-article-content-filter" data-content-filter="video"> <a href="javascript:;"><span>Video</span></a> </li> <li class="article-content-filter js-article-content-filter" data-content-filter="audio"> <a href="javascript:;"><span>Audio</span></a> </li> <li class="article-content-filter js-article-content-filter" data-content-filter="supplementary-data"> <a href="javascript:;"><span>Supplementary Data</span></a> </li> </ul> </li> <li class="toolbar-item item-cite js-item-cite"> <div class="widget widget-ToolboxGetCitation widget-instance-OUP_Get_Citation"> <a href="#" class="js-cite-button at-CiteButton" data-reveal-id="getCitation" data-reveal> <i class="icon-read-more"></i> <span>Cite</span> </a> <div id="getCitation" class="reveal-modal js-citation-modal" data-reveal> <h3 class="modal-title">Cite</h3> <div class="oxford-citation-text"> <p>Brigitte Boeckmann, Marc Robinson-Rechavi, Ioannis Xenarios, Christophe Dessimoz, Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees, <em>Briefings in Bioinformatics</em>, Volume 12, Issue 5, September 2011, Pages 423–435, <a href="https://doi.org/10.1093/bib/bbr034">https://doi.org/10.1093/bib/bbr034</a></p> </div> <div class="citation-download-wrap"> <form action="/Citation/Download" method="get" id="citationModal"> <input type="hidden" name="resourceId" value="270085" /> <input type="hidden" name="resourceType" value="3" /> <label for="selectFormat" class="hide js-citation-format-label">Select Format</label> <select required name="citationFormat" class="citation-download-format js-citation-format" id="selectFormat"> <option selected disabled >Select format</option> <option value="0" >.ris (Mendeley, Papers, Zotero)</option> <option value="1" >.enw (EndNote)</option> <option value="2" >.bibtex (BibTex)</option> <option value="3" >.txt (Medlars, RefWorks)</option> </select> <button class="btn citation-download-link disabled" type="submit">Download citation</button> </form> </div> <a class="close-reveal-modal" href="javascript:;"><i class="icon-general-close"></i><span class="screenreader-text">Close</span></a> </div> </div> </li> <li class="toolbar-item item-tools"> <div class="widget widget-ToolboxPermissions widget-instance-OUP_Get_Permissions"> <div class="module-widget"> <a href="https://s100.copyright.com/AppDispatchServlet?publisherName=OUP&publication=1477-4054&title=Conceptual%20framework%20and%20pilot%20study%20to%20benchmark%20phylogenomic%20databases%20based%20on%20reference%20gene%20trees&publicationDate=2011-07-07&volumeNum=12&issueNum=5&author=Boeckmann%2C%20Brigitte%3B%20Robinson-Rechavi%2C%20Marc&startPage=423&endPage=435&contentId=10.1093%2Fbib%2Fbbr034&oa=CC%20BY-NC&copyright=%C2%A9%20The%20Author%28s%29%202011.%20Published%20by%20Oxford%20University%20Press.&orderBeanReset=True" id="PermissionsLink" class="" target="_blank"> <i class="icon-menu_permissions"> <span class="screenreader-text">Permissions Icon</span> </i> Permissions </a> </div> </div> </li> <li class="toolbar-item item-with-dropdown item-share"> <a href="javascript:;" class="drop-trigger js-toolbar-dropdown at-ShareButton" data-dropdown="ShareDrop"> <i class="icon-menu_share"><span class="screenreader-text">Share Icon</span></i> <span class="toolbar-label"> <span class="toolbar-text">Share</span> <i class="arrow-icon icon-general-arrow-filled-down js-toolbar-arrow-icon"></i> </span> </a> <ul id="ShareDrop" class="addthis_toolbox addthis_default_style addthis_20x20_style f-dropdown js-dropdown-content" data-dropdown-content> <li> <a class="st-custom-button addthis_button_facebook js-share-link" data-network="facebook" data-title="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" data-url="https://academic.oup.com/bib/article/12/5/423/270085" data-email-subject="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" href="javascript:;"><span>Facebook</span></a> </li> <li> <a class="st-custom-button addthis_button_twitter js-share-link" data-network="twitter" data-title="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" data-url="https://academic.oup.com/bib/article/12/5/423/270085" data-email-subject="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" href="javascript:;"><span>Twitter</span></a> </li> <li> <a class="st-custom-button addthis_button_linkedin js-share-link" data-network="linkedin" data-title="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" data-url="https://academic.oup.com/bib/article/12/5/423/270085" data-email-subject="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" href="javascript:;"><span>LinkedIn</span></a> </li> <li> <a class="st-custom-button addthis_button_email js-share-link" data-network="email" data-title="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" data-url="https://academic.oup.com/bib/article/12/5/423/270085" data-email-subject="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees" href="javascript:;"><span>Email</span></a> </li> </ul> </li> </ul> <div class="toolbar-search"> <div class="widget widget-SitePageHeader widget-instance-OUP_ArticleToolbarSearchBox"> <div class="dropdown-panel-wrap"> <div class="dropdown-panel mobile-search-dropdown"> <div class="mobile-search-inner-wrap"> <div class="navbar-search"> <div class="mobile-microsite-search"> <label for="OUP_ArticleToolbarSearchBox-mobile-navbar-search-filter" class="screenreader-text js-mobile-navbar-search-filter-label"> Navbar Search Filter </label> <select class="mobile-navbar-search-filter js-mobile-navbar-search-filter at-navbar-search-filter" id="OUP_ArticleToolbarSearchBox-mobile-navbar-search-filter"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="">Briefings in Bioinformatics</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Issue">This issue</option> <optgroup class="navbar-search-optgroup" label="Search across Oxford Academic"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="AcademicSubjects/SCI01060">Bioinformatics and Computational Biology</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Books">Books</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Journals">Journals</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Umbrella">Oxford Academic</option> </optgroup> </select> <label for="OUP_ArticleToolbarSearchBox-mobile-microsite-search-term" class="screenreader-text js-mobile-microsite-search-term-label"> Mobile Enter search term </label> <input class="mobile-search-input mobile-microsite-search-term js-mobile-microsite-search-term at-microsite-search-term" type="text" maxlength="255" placeholder="Search" id="OUP_ArticleToolbarSearchBox-mobile-microsite-search-term"> <a href="javascript:;" class="mobile-microsite-search-icon mobile-search-submit icon-menu_search"> <span class="screenreader-text">Search</span> </a> </div> </div> </div> </div> <div class="dropdown-panel mobile-nav-dropdown"> </div> </div> <div class="navbar"> <div class="center-inner-row"> <nav class="navbar-menu"> </nav> <div class="navbar-search-container js-navbar-search-container"> <a href="javascript:;" class="navbar-search-close js_close-navsearch">Close</a> <div class="navbar-search"> <div class="microsite-search"> <label for="OUP_ArticleToolbarSearchBox-navbar-search-filter" class="screenreader-text js-navbar-search-filter-label"> Navbar Search Filter </label> <select class="navbar-search-filter js-navbar-search-filter at-navbar-search-filter" id="OUP_ArticleToolbarSearchBox-navbar-search-filter"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="">Briefings in Bioinformatics</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Issue">This issue</option> <optgroup class="navbar-search-optgroup" label="Search across Oxford Academic"> <option class="navbar-search-filter-option at-navbar-search-filter-option" value="AcademicSubjects/SCI01060">Bioinformatics and Computational Biology</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Books">Books</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Journals">Journals</option><option class="navbar-search-filter-option at-navbar-search-filter-option" value="Umbrella">Oxford Academic</option> </optgroup> </select> <label for="OUP_ArticleToolbarSearchBox-microsite-search-term" class="screenreader-text js-microsite-search-term-label"> Enter search term </label> <input class="navbar-search-input microsite-search-term js-microsite-search-term at-microsite-search-term" type="text" maxlength="255" placeholder="Search" id="OUP_ArticleToolbarSearchBox-microsite-search-term"> <a href="javascript:;" class="microsite-search-icon navbar-search-submit icon-menu_search"> <span class="screenreader-text">Search</span> </a> </div> </div> <div class="navbar-search-advanced"><a href="/bib/advanced-search" class="advanced-search js-advanced-search">Advanced Search</a></div> </div> <div class="navbar-search-collapsed"><a href="javascript:;" class="icon-menu_search js_expand-navsearch"><span class="screenreader-text">Search Menu</span></a></div> </div> </div> <input id="routename" name="RouteName" type="hidden" value="bib" /> </div> </div> </div> </div> <div id="ContentTab" class="content active"> <div class="widget widget-ArticleFulltext widget-instance-OUP_Article_FullText_Widget"> <div class="module-widget"> <div class="widget-items" data-widgetname="ArticleFulltext"> <h2 scrollto-destination=3262394 id="3262394" class="abstract-title js-splitscreen-abstract-title" >Abstract</h2> <section class="abstract"><p class="chapter-para">Phylogenomic databases provide orthology predictions for species with fully sequenced genomes. Although the goal seems well-defined, the content of these databases differs greatly. Seven ortholog databases (Ensembl Compara, eggNOG, HOGENOM, InParanoid, OMA, OrthoDB, Panther) were compared on the basis of reference trees. For three well-conserved protein families, we observed a generally high specificity of orthology assignments for these databases. We show that differences in the completeness of predicted gene relationships and in the phylogenetic information are, for the great majority, not due to the methods used, but to differences in the underlying database concepts. According to our metrics, none of the databases provides a fully correct and comprehensive protein classification. Our results provide a framework for meaningful and systematic comparisons of phylogenomic databases. In the future, a sustainable set of ‘Gold standard’ phylogenetic trees could provide a robust method for phylogenomic databases to assess their current quality status, measure changes following new database releases and diagnose improvements subsequent to an upgrade of the analysis procedure.</p></section> <div class="article-metadata-panel clearfix at-ArticleMetadata"></div> <div class="kwd-group"><a class="kwd-part kwd-main" href="javascript:;" data-keyword=""conceptual comparison"">conceptual comparison</a>, <a class="kwd-part kwd-main" href="javascript:;" data-keyword=""phylogenomic databases"">phylogenomic databases</a>, <a class="kwd-part kwd-main" href="javascript:;" data-keyword=""quality assessment"">quality assessment</a>, <a class="kwd-part kwd-main" href="javascript:;" data-keyword=""reference gene trees"">reference gene trees</a></div> <h2 scrollto-destination=3262396 id="3262396" class="section-title js-splitscreen-section-title" >INTRODUCTION</h2> <p class="chapter-para">Phylogenomic databases provide predictions of evolutionary relationships, mostly for protein-coding genes of species with fully sequenced genomes. Such information is essential for comparative genomics as well as for the study of the divergence of individual gene families. The most common usage is function prediction for yet uncharacterized proteins. This approach is based on the commonly accepted assumption that orthologs—genes derived by speciation—are more likely to share a common function, in contrast to paralogs—genes derived by gene duplication—which are expected to diverge functionally over time [<span class="xrefLink" id="jumplink-B1"></span><a href="javascript:;" reveal-id="B1" data-open="B1" class="link link-ref link-reveal xref-bibr">1</a>, <span class="xrefLink" id="jumplink-B2"></span><a href="javascript:;" reveal-id="B2" data-open="B2" class="link link-ref link-reveal xref-bibr">2</a>].</p><p class="chapter-para">Several studies conducted in recent years have dealt with the comparison and quality assessment of orthology predictions [<span class="xrefLink" id="jumplink-B3 B4 B5 B6 B7 B8"></span><a href="javascript:;" reveal-id="B3 B4 B5 B6 B7 B8" data-open="B3 B4 B5 B6 B7 B8" class="link link-ref link-reveal xref-bibr">3–8</a>]. However, direct comparisons regarding the outcomes of these comparative analyses are not possible, as each study was based on a unique set of ortholog databases. The majority of these studies use consistency of functional annotation within ortholog groups as a measure for accurate orthology predictions. The application of such function-based measures is disputable for various reasons: (i) only few proteins have been characterized in depth; (ii) proteins can perform more than one function; (iii) proteins are frequently part of complexes and thus participate in different functions; (iv) paralogs can accomplish the same function; and (v) orthologs can diverge functionally [<span class="xrefLink" id="jumplink-B2"></span><a href="javascript:;" reveal-id="B2" data-open="B2" class="link link-ref link-reveal xref-bibr">2</a>]. For these reasons, most authors regret the lack of ‘Gold Standard’ phylogenetic trees for this quality assessment. Yet, the form this standard should take remains elusive.</p><p class="chapter-para">We present a comparison of databases with an emphasis on how different underlying concepts constrain the results obtained. These differences are illustrated by means of three gene histories, for which reliable reference trees have been reconstructed. Finally, a score-based quantitative comparison is proposed.</p> <h3 scrollto-destination=3262400 id="3262400" class="section-title js-splitscreen-section-title" >Phylogenomic databases under comparison</h3> <p class="chapter-para">A large number of valuable ortholog databases are made available to the scientific community. Criteria for the selection of the databases included the taxonomic range and sampling density, the applied methodology and the database concept, especially whether or not the concept is hierarchical. A special interest was furthermore the information provided by ortholog databases to which UniProtKB cross-links. Seven phylogenomic databases are compared in this study, namely Ensembl Compara (<a class="link link-uri openInAnotherWindow" href="http://www.ensembl.org/" target="_blank">http://www.ensembl.org/</a>) [<span class="xrefLink" id="jumplink-B9"></span><a href="javascript:;" reveal-id="B9" data-open="B9" class="link link-ref link-reveal xref-bibr">9</a>], eggNOG (<a class="link link-uri openInAnotherWindow" href="http://eggnog.embl.de/" target="_blank">http://eggnog.embl.de/</a>) [<span class="xrefLink" id="jumplink-B10"></span><a href="javascript:;" reveal-id="B10" data-open="B10" class="link link-ref link-reveal xref-bibr">10</a>], HOGENOM (<a class="link link-uri openInAnotherWindow" href="http://pbil.univ-lyon1.fr/databases/hogenom/" target="_blank">http://pbil.univ-lyon1.fr/databases/hogenom/</a>) [<span class="xrefLink" id="jumplink-B11"></span><a href="javascript:;" reveal-id="B11" data-open="B11" class="link link-ref link-reveal xref-bibr">11</a>], InParanoid (<a class="link link-uri openInAnotherWindow" href="http://inparanoid.sbc.su.se/" target="_blank">http://inparanoid.sbc.su.se/</a>) [<span class="xrefLink" id="jumplink-B12"></span><a href="javascript:;" reveal-id="B12" data-open="B12" class="link link-ref link-reveal xref-bibr">12</a>], OMA (<a class="link link-uri openInAnotherWindow" href="http://omabrowser.org/" target="_blank">http://omabrowser.org/</a>) [<span class="xrefLink" id="jumplink-B13"></span><a href="javascript:;" reveal-id="B13" data-open="B13" class="link link-ref link-reveal xref-bibr">13</a>], OrthoDB (<a class="link link-uri openInAnotherWindow" href="http://cegg.unige.ch/orthodb" target="_blank">http://cegg.unige.ch/orthodb</a>) [<span class="xrefLink" id="jumplink-B14"></span><a href="javascript:;" reveal-id="B14" data-open="B14" class="link link-ref link-reveal xref-bibr">14</a>] and Panther (<a class="link link-uri openInAnotherWindow" href="http://www.pantherdb.org/" target="_blank">http://www.pantherdb.org/</a>) [<span class="xrefLink" id="jumplink-B15"></span><a href="javascript:;" reveal-id="B15" data-open="B15" class="link link-ref link-reveal xref-bibr">15</a>]. Each of these databases represents a unique specialization (<span class="xrefLink" id="jumplink-T1"></span><a href="javascript:;" reveal-id="T1" data-open="T1" class="link link-reveal link-table xref-fig">Table 1</a>). Compara, HOGENOM and Panther reconstruct phylogenetic trees while the other databases provide ortholog groups. The number of analyzed proteomes varies between 23 and 1000, and the taxonomic range spans any cellular organism on the one hand or a single phylum on the other. HOGENOM, for instance, is devoted to microbial organisms (bacteria, archaea and unicellular eukaryotes) with completely sequenced genomes, and does not intend to be exhaustive for multicellular organisms. In contrast, Compara focuses on chordate genomes and proteomes, plus a few invertebrates and fungi as outgroups. Panther analyzes about the same number of proteomes as Compara, but these are from selected representatives of all three major kingdoms. A hierarchical protein classification is provided by eggNOG, OrthoDB and, most recently, OMA. eggNOG computes ortholog groups for up to six major taxonomic levels, while OMA does so for all taxonomic nodes. Both databases cover a large number of proteomes from all kingdoms. The most fine-grained hierarchical classification is given by OrthoDB, which seeks to identify all descendants of the common ancestral gene at each speciation node for vertebrates, arthropods, fungi and animal phylogenies. Yet another grouping strategy comprises non-hierarchical clusters of orthologs, including those which are the result of pairwise species comparisons; the most well-known representative is InParanoid. Finally, there are the pure orthologous groups of OMA, which only include genes that are orthologous to each other and do not involve pairs of inparalogs. In addition to providing ortholog groups, eggNOG and OMA use orthology assignments to construct a species tree. Noteworthy, Panther classifies families into subfamilies which are thought to capture groups that are similar in sequence or equivalent in function—but are not designed to define orthologous groups. </p> <a id="3262402" scrollto-destination="3262402"></a> <div content-id="T1" class="table-modal table-full-width-wrap"><div class="table-wrap table-wide standard-table"><div class="table-wrap-title" id="T1" data-id="T1"><span class="label title-label" id="label-58047">Table 1:</span><div class="
 graphic-wrap table-open-button-wrap
 "><a class="fig-view-orig at-tableViewLarge openInAnotherWindow btn js-view-large" role="button" target="_blank" href="
 /view-large/3262402" aria-describedby="label-58047"> Open in new tab </a></div><div class="caption caption-id-" id="caption-58047"><p class="chapter-para">Comparison of selected phylogenomic databases</p></div> </div><div class="table-overflow"><table role="table" aria-labelledby="
 label-58047" aria-describedby="
 caption-58047"><thead><tr><th>Database<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb. species and taxonomic range<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb databases inquired for input data<span aria-hidden="true" style="display: none;"> . </span></th><th>Homology detection and clustering<span aria-hidden="true" style="display: none;"> . </span></th><th>Multiple sequence alignment and tree-building<span aria-hidden="true" style="display: none;"> . </span></th><th>Grouping strategy<span aria-hidden="true" style="display: none;"> . </span></th><th>Goals include<span aria-hidden="true" style="display: none;"> . </span></th><th>Updates per year (estimations)<span aria-hidden="true" style="display: none;"> . </span></th></tr></thead><tbody><tr><td>Compara (Ensembl 58)</td><td>47 chordates and outgroups</td><td>1</td><td>BlastP Hcluster_sg</td><td>M-Coffee, TreeBeSt (NJtree, NJ and ML, species tree)</td><td>(i) Phylogenetic trees, (ii) Ortholog groups from species pairs</td><td>Gene phylogeny</td><td>6</td></tr><tr><td>eggNOG (release 2)</td><td>630 species</td><td>4</td><td>Blast RBH triangular linkage clustering</td><td>Muscle, MAFFT and filters PhyML</td><td>Hierarchical groups based on up to six taxonomic levels</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>HOGENOM (release 5)</td><td>964 species</td><td>12</td><td>BlastP2 (low complexity filters) single-linkage clustering ≥50% similarity, ≥80% overlap</td><td>Muscle, Gblocks BioNJ, PhyML, FASTTREE and TREEFINDER</td><td>Phylogenetic trees</td><td>Gene phylogeny</td><td>1</td></tr><tr><td>InParanoid (release 7)</td><td>99 eukaryotes and <em>E. coli</em></td><td>22</td><td>BLAST (compositional adjustment, SEG) ≥50% overlap</td><td>Kalign NJ (100 replicates)</td><td>Ortholog groups from species pairs</td><td>Comparison of species pairs</td><td>1</td></tr><tr><td>OMA (May-2010)</td><td>1000 species</td><td>12</td><td>Smith–Waterman with minimum length requirement</td><td>–</td><td>(i) Pure ortholog groups, (ii) Ortholog groups from species pairs and (iii) Hierarchical groups based on taxonomic nodes</td><td>Comparative genomics, phyletic profiles, species phylogeny</td><td>2</td></tr><tr><td>OrthoDB (release 3)</td><td>40 vertebrates 23 arthropods 32 fungi</td><td>8</td><td>Smith–Waterman, RBH, triangular linkage clustering</td><td>–</td><td>Hierarchical groups based on a species phylogeny</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>Panther (release 7)</td><td>48 species</td><td>13</td><td>BlastP, HSP, single-linkage clusters (SLC)</td><td>MAFFT GIGA</td><td>(i) Phylogenetic trees and (ii) Ortholog groups from species pairs</td><td>Gene phylogeny, Function prediction</td><td>1</td></tr></tbody></table></div><div class="table-modal"><table><thead><tr><th>Database<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb. species and taxonomic range<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb databases inquired for input data<span aria-hidden="true" style="display: none;"> . </span></th><th>Homology detection and clustering<span aria-hidden="true" style="display: none;"> . </span></th><th>Multiple sequence alignment and tree-building<span aria-hidden="true" style="display: none;"> . </span></th><th>Grouping strategy<span aria-hidden="true" style="display: none;"> . </span></th><th>Goals include<span aria-hidden="true" style="display: none;"> . </span></th><th>Updates per year (estimations)<span aria-hidden="true" style="display: none;"> . </span></th></tr></thead><tbody><tr><td>Compara (Ensembl 58)</td><td>47 chordates and outgroups</td><td>1</td><td>BlastP Hcluster_sg</td><td>M-Coffee, TreeBeSt (NJtree, NJ and ML, species tree)</td><td>(i) Phylogenetic trees, (ii) Ortholog groups from species pairs</td><td>Gene phylogeny</td><td>6</td></tr><tr><td>eggNOG (release 2)</td><td>630 species</td><td>4</td><td>Blast RBH triangular linkage clustering</td><td>Muscle, MAFFT and filters PhyML</td><td>Hierarchical groups based on up to six taxonomic levels</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>HOGENOM (release 5)</td><td>964 species</td><td>12</td><td>BlastP2 (low complexity filters) single-linkage clustering ≥50% similarity, ≥80% overlap</td><td>Muscle, Gblocks BioNJ, PhyML, FASTTREE and TREEFINDER</td><td>Phylogenetic trees</td><td>Gene phylogeny</td><td>1</td></tr><tr><td>InParanoid (release 7)</td><td>99 eukaryotes and <em>E. coli</em></td><td>22</td><td>BLAST (compositional adjustment, SEG) ≥50% overlap</td><td>Kalign NJ (100 replicates)</td><td>Ortholog groups from species pairs</td><td>Comparison of species pairs</td><td>1</td></tr><tr><td>OMA (May-2010)</td><td>1000 species</td><td>12</td><td>Smith–Waterman with minimum length requirement</td><td>–</td><td>(i) Pure ortholog groups, (ii) Ortholog groups from species pairs and (iii) Hierarchical groups based on taxonomic nodes</td><td>Comparative genomics, phyletic profiles, species phylogeny</td><td>2</td></tr><tr><td>OrthoDB (release 3)</td><td>40 vertebrates 23 arthropods 32 fungi</td><td>8</td><td>Smith–Waterman, RBH, triangular linkage clustering</td><td>–</td><td>Hierarchical groups based on a species phylogeny</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>Panther (release 7)</td><td>48 species</td><td>13</td><td>BlastP, HSP, single-linkage clusters (SLC)</td><td>MAFFT GIGA</td><td>(i) Phylogenetic trees and (ii) Ortholog groups from species pairs</td><td>Gene phylogeny, Function prediction</td><td>1</td></tr></tbody></table></div></div></div><div class="table-full-width-wrap"><div class="table-wrap table-wide standard-table"><div class="table-wrap-title" id="T1" data-id="T1"><span class="label title-label" id="label-58047">Table 1:</span><div class="
 graphic-wrap table-open-button-wrap
 "><a class="fig-view-orig at-tableViewLarge openInAnotherWindow btn js-view-large" role="button" target="_blank" href="
 /view-large/3262402" aria-describedby="label-58047"> Open in new tab </a></div><div class="caption caption-id-" id="caption-58047"><p class="chapter-para">Comparison of selected phylogenomic databases</p></div> </div><div class="table-overflow"><table role="table" aria-labelledby="
 label-58047" aria-describedby="
 caption-58047"><thead><tr><th>Database<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb. species and taxonomic range<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb databases inquired for input data<span aria-hidden="true" style="display: none;"> . </span></th><th>Homology detection and clustering<span aria-hidden="true" style="display: none;"> . </span></th><th>Multiple sequence alignment and tree-building<span aria-hidden="true" style="display: none;"> . </span></th><th>Grouping strategy<span aria-hidden="true" style="display: none;"> . </span></th><th>Goals include<span aria-hidden="true" style="display: none;"> . </span></th><th>Updates per year (estimations)<span aria-hidden="true" style="display: none;"> . </span></th></tr></thead><tbody><tr><td>Compara (Ensembl 58)</td><td>47 chordates and outgroups</td><td>1</td><td>BlastP Hcluster_sg</td><td>M-Coffee, TreeBeSt (NJtree, NJ and ML, species tree)</td><td>(i) Phylogenetic trees, (ii) Ortholog groups from species pairs</td><td>Gene phylogeny</td><td>6</td></tr><tr><td>eggNOG (release 2)</td><td>630 species</td><td>4</td><td>Blast RBH triangular linkage clustering</td><td>Muscle, MAFFT and filters PhyML</td><td>Hierarchical groups based on up to six taxonomic levels</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>HOGENOM (release 5)</td><td>964 species</td><td>12</td><td>BlastP2 (low complexity filters) single-linkage clustering ≥50% similarity, ≥80% overlap</td><td>Muscle, Gblocks BioNJ, PhyML, FASTTREE and TREEFINDER</td><td>Phylogenetic trees</td><td>Gene phylogeny</td><td>1</td></tr><tr><td>InParanoid (release 7)</td><td>99 eukaryotes and <em>E. coli</em></td><td>22</td><td>BLAST (compositional adjustment, SEG) ≥50% overlap</td><td>Kalign NJ (100 replicates)</td><td>Ortholog groups from species pairs</td><td>Comparison of species pairs</td><td>1</td></tr><tr><td>OMA (May-2010)</td><td>1000 species</td><td>12</td><td>Smith–Waterman with minimum length requirement</td><td>–</td><td>(i) Pure ortholog groups, (ii) Ortholog groups from species pairs and (iii) Hierarchical groups based on taxonomic nodes</td><td>Comparative genomics, phyletic profiles, species phylogeny</td><td>2</td></tr><tr><td>OrthoDB (release 3)</td><td>40 vertebrates 23 arthropods 32 fungi</td><td>8</td><td>Smith–Waterman, RBH, triangular linkage clustering</td><td>–</td><td>Hierarchical groups based on a species phylogeny</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>Panther (release 7)</td><td>48 species</td><td>13</td><td>BlastP, HSP, single-linkage clusters (SLC)</td><td>MAFFT GIGA</td><td>(i) Phylogenetic trees and (ii) Ortholog groups from species pairs</td><td>Gene phylogeny, Function prediction</td><td>1</td></tr></tbody></table></div><div class="table-modal"><table><thead><tr><th>Database<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb. species and taxonomic range<span aria-hidden="true" style="display: none;"> . </span></th><th>Nb databases inquired for input data<span aria-hidden="true" style="display: none;"> . </span></th><th>Homology detection and clustering<span aria-hidden="true" style="display: none;"> . </span></th><th>Multiple sequence alignment and tree-building<span aria-hidden="true" style="display: none;"> . </span></th><th>Grouping strategy<span aria-hidden="true" style="display: none;"> . </span></th><th>Goals include<span aria-hidden="true" style="display: none;"> . </span></th><th>Updates per year (estimations)<span aria-hidden="true" style="display: none;"> . </span></th></tr></thead><tbody><tr><td>Compara (Ensembl 58)</td><td>47 chordates and outgroups</td><td>1</td><td>BlastP Hcluster_sg</td><td>M-Coffee, TreeBeSt (NJtree, NJ and ML, species tree)</td><td>(i) Phylogenetic trees, (ii) Ortholog groups from species pairs</td><td>Gene phylogeny</td><td>6</td></tr><tr><td>eggNOG (release 2)</td><td>630 species</td><td>4</td><td>Blast RBH triangular linkage clustering</td><td>Muscle, MAFFT and filters PhyML</td><td>Hierarchical groups based on up to six taxonomic levels</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>HOGENOM (release 5)</td><td>964 species</td><td>12</td><td>BlastP2 (low complexity filters) single-linkage clustering ≥50% similarity, ≥80% overlap</td><td>Muscle, Gblocks BioNJ, PhyML, FASTTREE and TREEFINDER</td><td>Phylogenetic trees</td><td>Gene phylogeny</td><td>1</td></tr><tr><td>InParanoid (release 7)</td><td>99 eukaryotes and <em>E. coli</em></td><td>22</td><td>BLAST (compositional adjustment, SEG) ≥50% overlap</td><td>Kalign NJ (100 replicates)</td><td>Ortholog groups from species pairs</td><td>Comparison of species pairs</td><td>1</td></tr><tr><td>OMA (May-2010)</td><td>1000 species</td><td>12</td><td>Smith–Waterman with minimum length requirement</td><td>–</td><td>(i) Pure ortholog groups, (ii) Ortholog groups from species pairs and (iii) Hierarchical groups based on taxonomic nodes</td><td>Comparative genomics, phyletic profiles, species phylogeny</td><td>2</td></tr><tr><td>OrthoDB (release 3)</td><td>40 vertebrates 23 arthropods 32 fungi</td><td>8</td><td>Smith–Waterman, RBH, triangular linkage clustering</td><td>–</td><td>Hierarchical groups based on a species phylogeny</td><td>Comparative genomics, species phylogeny</td><td>1</td></tr><tr><td>Panther (release 7)</td><td>48 species</td><td>13</td><td>BlastP, HSP, single-linkage clusters (SLC)</td><td>MAFFT GIGA</td><td>(i) Phylogenetic trees and (ii) Ortholog groups from species pairs</td><td>Gene phylogeny, Function prediction</td><td>1</td></tr></tbody></table></div></div></div><p class="chapter-para">In summary, the phylogenomic databases investigated here differ substantially in goal, scope, methodology and output. And yet, all their results provide estimations of evolutionary relationships among genes and species. In order to compare them, we must first characterize the information they provide.</p> <h2 scrollto-destination=3262404 id="3262404" class="section-title js-splitscreen-section-title" >METHODS</h2> <h3 scrollto-destination=3262405 id="3262405" class="section-title js-splitscreen-section-title" >Sequence information</h3> <p class="chapter-para">Representative members of the Popeye domain family, the NOX family NADPH oxidases and the eukaryotic V-type ATP synthase beta subunit subfamily were obtained from the UniProtKB/Swiss-Prot release 57.13 and UniProtKB releases 15.14 and 2010_06 according to their annotation. Further homologs were predicted by similarity searches with BlastP on the Expasy Proteomics Server [<span class="xrefLink" id="jumplink-B16"></span><a href="javascript:;" reveal-id="B16" data-open="B16" class="link link-ref link-reveal xref-bibr">16</a>]. The preliminary datasets were complemented by data from UniProtKB/TrEMBL, Ensembl release 57, BeeBase (<a class="link link-uri openInAnotherWindow" href="http://genomes.arc.georgetown.edu/drupal/beebase/" target="_blank">http://genomes.arc.georgetown.edu/drupal/beebase/</a>) and WormBase (<a class="link link-uri openInAnotherWindow" href="http://www.wormbase.org/" target="_blank">http://www.wormbase.org/</a>). A list of sequence identifiers, species names and database identifiers is given in <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Table S1</a>; sequences are available in the <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Datasets S1–S3</a>.</p> <h3 scrollto-destination=3262407 id="3262407" class="section-title js-splitscreen-section-title" >Reference trees</h3> <p class="chapter-para">The methods used are summarized below, and a detailed description of each analysis is provided along with the individual phylogenetic trees in <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Figures S4–S6</a>. The sequence analysis was performed on local computers of the Swiss Institute of Bioinformatics, at phylogeny.fr [<span class="xrefLink" id="jumplink-B17"></span><a href="javascript:;" reveal-id="B17" data-open="B17" class="link link-ref link-reveal xref-bibr">17</a>] as well as at the high performance computing center Vital-IT (<a class="link link-uri openInAnotherWindow" href="http://www.vital-it.ch/" target="_blank">http://www.vital-it.ch/</a>). The sequences of the three data sets were aligned using MUSCLE [<span class="xrefLink" id="jumplink-B19"></span><a href="javascript:;" reveal-id="B19" data-open="B19" class="link link-ref link-reveal xref-bibr">19</a>]. Sequences with gaps within conserved regions were removed and short isoforms were replaced by appropriate ones if available. Gene models were corrected if possible, or otherwise excluded. A multiple sequence alignment (MSA) was constructed with ProbCons [<span class="xrefLink" id="jumplink-B19"></span><a href="javascript:;" reveal-id="B19" data-open="B19" class="link link-ref link-reveal xref-bibr">19</a>], and data models were built through gap removal, Gblocks (stringent and less stringent parameter settings), or manual selection of conserved regions. Phylogenies were inferred using maximum likelihood (ML), Bayesian Markov-Chain Monte Carlo (MCMC) and neighbor joining (NJ). ML-trees were calculated with PhyML [<span class="xrefLink" id="jumplink-B20"></span><a href="javascript:;" reveal-id="B20" data-open="B20" class="link link-ref link-reveal xref-bibr">20</a>] using the amino acid replacement models Jones, Taylor and Thornton (JTT) [<span class="xrefLink" id="jumplink-B21"></span><a href="javascript:;" reveal-id="B21" data-open="B21" class="link link-ref link-reveal xref-bibr">21</a>] or Whelan and Goldman (WAG) [<span class="xrefLink" id="jumplink-B22"></span><a href="javascript:;" reveal-id="B22" data-open="B22" class="link link-ref link-reveal xref-bibr">22</a>], accounting for rate heterogeneity across sites using an eight-category discrete gamma distribution and estimating the shape parameter, and in some analyses the number of invariant sites from the data. Branch support values were calculated with the approximate Likelihood Ratio Test (aLRT) based on a Shimodaira–Hasegawa-like or Chi<sup>2</sup>-based procedure [<span class="xrefLink" id="jumplink-B23"></span><a href="javascript:;" reveal-id="B23" data-open="B23" class="link link-ref link-reveal xref-bibr">23</a>]. Bayesian analyses were performed using MrBayes 3.1.2 [<span class="xrefLink" id="jumplink-B24"></span><a href="javascript:;" reveal-id="B24" data-open="B24" class="link link-ref link-reveal xref-bibr">24</a>]. Two independent runs of four chains and one million generations were run using fixed models that performed best when applying PhyML. To test the consistency and robustness of tree topologies, consensus trees were generated from 1000 bootstrap replicates using the BioNJ algorithm [<span class="xrefLink" id="jumplink-B25"></span><a href="javascript:;" reveal-id="B25" data-open="B25" class="link link-ref link-reveal xref-bibr">25</a>] and the JTT model of amino acid substitution. Finally, a consensus tree was constructed considering all the analysis results and species trees as used by TreeBeST (<a class="link link-uri openInAnotherWindow" href="http://treesoft.sourceforge.net" target="_blank">http://treesoft.sourceforge.net</a>) for chordates, and reconstructed by OrthoDB for arthropods and fungi. The user-defined tree was tested against the ML tree and alternative models using TREE-PUZZLE [<span class="xrefLink" id="jumplink-B26"></span><a href="javascript:;" reveal-id="B26" data-open="B26" class="link link-ref link-reveal xref-bibr">26</a>]. It is noted that even though sequence names used in the reference trees are in the format of UniProtKB/Swiss-Prot entry names, the identifiers are mostly not valid UniProtKB entry names.</p> <h3 scrollto-destination=3262409 id="3262409" class="section-title js-splitscreen-section-title" >Mapping of data from ortholog databases to the reference gene trees</h3> <p class="chapter-para">Data was mapped to ortholog groups of the following databases: Compara (Ensembl 56), eggNOG (2.0), HOGENOM (05), InParanoid (7.0), OMA (October 2009), OrthoDB (3); Panther (7.0 beta). Whenever possible, Swiss-Prot cross-references to the phylogenomic databases were used to identify the relevant ortholog groups. Sequence mapping can be hindered for two reasons: (i) UniProtKB frequently uses special taxonomic identifiers for bacterial strains, if the complete genome has been sequenced; and (ii) over 4% of the sequence data is updated during the annotation process, which can prevent the mapping of sequences. We verified such cases manually in order to maximize data matching, taking into account available identifiers for genes, transcripts, and proteins.</p><p class="chapter-para">For the examples shown here, the comparison between the reference tree and the databases was performed using the browser or the data sets. Here, the purpose was to obtain all relevant gene identifiers and to identify false positive hits for the selected species, which in some cases could not be obtained automatically based simply on the gene identifiers. Sequences of possible false positive hits were analyzed using MSA and tree reconstruction approaches. Consequently, a few more orthologs were identified and added to the reference dataset and tree. Blast services from phylogenomic databases were employed to search for genes that could not be mapped according to gene identifiers. For InParanoid, we obtained the relevant gene identifiers from the InParanoid browser, and extracted the corresponding ortholog information from the database.</p> <h3 scrollto-destination=3262412 id="3262412" class="section-title js-splitscreen-section-title" >Gene relationships</h3> <p class="chapter-para">For the quantitative analysis, we determined the number of predictions for three types of pairwise gene relationships: orthology, orthology/paralogy and ‘extended’ gene relationships. The latter take into account the number of gene duplications since the last common node of a gene pair. In this manner, a higher resolution for the topological correctness at internal nodes was obtained. We define the ‘extended’ relationships (<em>x</em>, <em>y</em>)-orthology and (<em>x</em>, <em>y</em>)-paralogy, where <em>x</em> and <em>y</em> specify how many duplications took place on the evolutionary path from the point where the two genes in question began diverging. For instance, a pair of orthologs with a single lineage-specific duplication resulting in genes A1, A2 and B are (1,0)-orthologs. Note that this concept is slightly different from the commonly used <em>n</em>:<em>m</em> orthology concept (where <em>n</em>, <em>m</em> is typically ‘1’ or ‘many’): <em>n</em> and <em>m</em> refer to the number of respective co-orthologs, while <em>x</em> and <em>y</em> in the extended gene relationships refer to the number of duplications on the respective paths of the relevant gene pairs since their common ancestry.</p> <h3 scrollto-destination=3262414 id="3262414" class="section-title js-splitscreen-section-title" >Metric and quantitative analysis</h3> <p class="chapter-para">Terms used in the context of scoring are defined as follows: ‘True positives’ are predicted gene relationships that coincide with those of the reference model. ‘False negatives’ are gene relationships failed to be predicted according to the reference model and the species list of a given phylogenomic database. The lack of predicted gene relationships can arise from a number of causes. For example, the gene may not be part of the input dataset, the gene model may be incorrect, the gene product may be an isoform, or an ortholog being wrongly predicted as paralog. As the content of databases is benchmarked here rather than the orthology prediction methods, we do not differentiate between these causes. The selection of up-to-date and complete input data is seen as one of the important tasks of phylogenomic databases. False positives are predicted gene relationships which do not correspond to those inferred from the reference tree and which are either outparalogs or not homologs at all. ‘True negatives’ are gene relationships, which are correctly predicted not to be the type of gene relationship in question. <em>‘</em>Expected OTUs<em>’</em> (Operational Taxonomic Units) are all relevant genes according to the reference tree and the species list of a database. <em>‘</em>Mapped OTUs<em>’</em> are all relevant genes according to the reference tree and the species list of a database. <em>‘</em>Supplementary gene list<em>’</em> specifies genes that have not been used in the analysis of the reference tree, e.g. due to incomplete or erroneous gene models. This list is thought to be helpful when automating the benchmarking procedure. Currently, these genes are not considered when calculating scores. However, it is conceivable to annotate some gene relationships based on gene synteny or analysis of small datasets of closely related genes.</p><p class="chapter-para">A list of all possible gene relationships with annotated orthology/paralogy was created for each reference tree, which was then used as a template to construct database-specific lists by removing genes from non-relevant species. The expected number of orthologous and paralogous relationships was obtained from these lists. The number of true positives, false positives and false negatives was determined from the database results. For pure orthologous groups, only the number of true positive and false positive ortholog predictions could be determined, as no paralogs are specified in this concept. For pairwise groups, the status of each orthologous and paralogous prediction was determined from the groups. For hierarchical groups, we calculated precision and sensitivity for the most specific groups and for trees that were reconstructed according to the hierarchy. Reconciled trees were benchmarked to the hierarchical reference groups.</p><p class="chapter-para">Extended orthology/paralogy relationships were obtained directly from the reconciled trees. For hierarchical groups, the unresolved trees were reconstructed according to <span class="xrefLink" id="jumplink-F1"></span><a href="javascript:;" data-modal-source-id="F1" class="link xref-fig">Figure 1</a>. Specified gene relationships were evaluated on the assumption that branches with non-overlapping taxonomic ranges (i.e. all different species) are orthologs and branches with overlapping taxonomic ranges (i.e. some common species) are paralogs. Unclear gene relationships at multifurcating nodes were set to ‘undefined’. For pairwise groups, the information was considered specified if there was no more than one gene duplication since the last common ancestor for each lineage; in all other cases, the gene relationships were considered ‘undefined’. In case of OMA pairwise groups, the branch of the reference gene was not considered. Extended gene relationships are not calculated from pure orthologous groups that conceptually contain no information on gene duplications. For plain trees, Robinson–Foulds distances were calculated. </p> <a id="3262418" scrollto-destination="3262418"></a> <div data-id="f1" data-content-id="f1" class="fig fig-section js-fig-section" swap-content-for-modal="true"><div class="graphic-wrap"><img class="content-image" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f1.jpeg?Expires=1734497296&Signature=geQIzf7KdH1bQY2vRrFdQZEFBwIYJzV8Y2h-lgfmk-ZtZkZYHMpMKoJj1-JMs4eKuzK0W~HpkIPcJEWirOxHkMRVUGM6a9YM5kPRC19RLw-eld5RGS7xqRlIgp7InAFnDcBoDnSQwo1LOIevvhOAE2pig9uvP-l0O2~4j6E2T9fMSzl8AlqkGFWS5fSOLcgzjNJ8z~5xk4D6P0x-pLlBjlO3mu2kfl4l4uL5RM~ZahkptdHPL-PkVWyoId0RaaQwlN-aqDLUl5D-DrfAQ~AtSAexhuAToPnR-qmQuQkQS8ee6gF4Ad5~DNXkJVQEiLWg6DOzI1nob0DSUT6Hx8Amdw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="Concepts of selected phylogenomic databases. Rows (from top to bottom) indicate the different database concepts, the structure of ortholog groups, the completeness of predicted gene relationships and the implied tree structures. Latter visualizes the captured phylogenetic information." data-path-from-xml="bbr034f1.jpeg" /><div class="graphic-bottom"><div class="label fig-label" id="label-3262418">Figure 1:</div><div class="caption fig-caption"><p class="chapter-para">Concepts of selected phylogenomic databases. Rows (from top to bottom) indicate the different database concepts, the structure of ortholog groups, the completeness of predicted gene relationships and the implied tree structures. Latter visualizes the captured phylogenetic information.</p></div><div class="ajax-articleAbstract-exclude-regex fig-orig original-slide figure-button-wrap"><a class="fig-view-orig js-view-large at-figureViewLarge openInAnotherWindow" role="button" aria-describedby="label-3262418" href="/view-large/figure/3262418/bbr034f1.jpeg" data-path-from-xml="bbr034f1.jpeg" target="_blank">Open in new tab</a><a class="download-slide" role="button" aria-describedby="label-3262418" data-section="3262418" href="/DownloadFile/DownloadImage.aspx?image=https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034f1.jpeg?Expires=1734497296&Signature=PqyLw1NAos7uuIsxbyYaYR9I6pTzAAmCHuXR4V5kJHmMfqHwKUMtPNnI2H476a6gnIo0-Nl4fINB6jitpfzZwLBy1U-0xd0Ps2PraXhAIK9zMlhCRuHfxnb-NqzGJFly7F5lm~mfWyvcRUWHf7ot-nQ5fUIPFySPoJFACzgHYOV0Cj2BHOpSFrMuresODOIUnFMM1FndVhtpNVFpXvCYoQjwJe~R~XnbR-fSIjJ2TXeCtNnrB9n0-UXHdqJ2oKzngYNI2vgLpdDKLvuIW3LM79p~rpZPKoB~iCbipBMrqmZIlNv9u3u1x4SEHQ9GQ5sEA08YNlHVrieD2HBDn6xKtg__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA&sec=3262418&ar=270085&xsltPath=~/UI/app/XSLT&imagename=&siteId=5143" data-path-from-xml="bbr034f1.jpeg">Download slide</a></div></div></div></div><p class="chapter-para">Precision and sensitivity were calculated for the three types of gene relationships. The Positive Predictive Value (PPV) is calculated as: <span class="inline-formula no-formula-id"><img class="contentFigures" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034i1.gif?Expires=1734497296&Signature=ggNqGA51xQP3X2YA00fMvAC9tN8QECVrc7kHK5JzMbbrFxwjYUY0D3gFsUNnT04tEJcMaQP573Ry5UshA8KEOqYsJhy~mvtlxWiptTzlt9JEfW~xIE0HE0U~rQdeaJbsNXUblHq9YBLNZwRQywv4cbMxQXB-EVN9bumD9I6QHjunmGcA40ZRKVIIjpml0FOLfLrnTwWWglrES4KOfS3NRbiW5gVSwkgENgs9IS7rhsFbvvzERmT98rHTj2NpXiyW8UcLVaCLnhyikPYJybyNg-MkAVGDqNhdETniH8CNp5Q7qBVDq6X1H-euC1GEU-Ov5ci3HtC6LiiHkeAdFaeuag__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="formula" data-path-from-xml="bbr034i1.gif" />⁠</span>. This score reflects the correctness of the predicted gene relationships, regardless of the size of an ortholog group, the number of family members or the existence of hierarchical levels. The True Positive Rate (TPR) complements the PPV by taking into account the number of false negative hits. TPR is calculated as <span class="inline-formula no-formula-id"><img class="contentFigures" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034i2.gif?Expires=1734497296&Signature=TKAgZ7qBOkkFqAI8xB4MzdZgEDtSG~wBLHPWwW1u2gX~tsUR9VErDGLIJsuRf8RFSG9Fwqc2xhB0jsK8NOPyIX0O-0eVz71sSN4P1VR8TxFUsib2CQy5UKeI7sbh-1q3jd4HM3meGEvBLg0bJYUI8r4hDbN-4l8be3EgYofPK4Y7CLT7UYeNs4S7HhBBG6LnPwU0E7z3I4IEjsJnD-Y7xiGYhFPrXi1Cxz4bX970y3g3m44F4Ll3BS5GLGi1xIGxr6hZqXsbuf4YPBe6U~Ln121NptdJeo~wsZMw1OcyYVegn7AKrH9it3-og8BfxaxNA4xIVuDSW4GlvCimOWo7zw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="formula" data-path-from-xml="bbr034i2.gif" />⁠</span>.</p><p class="chapter-para">All scores were normalized between 0 and 1, with higher values indicating a better fit to the reference tree. The distinction between the quality descriptors PPV and TPR is relevant in systems with a sensitivity-specificity trade-off, as it was observed in earlier benchmarking studies. Consequently, these ratios have not been combined into a single quality score.</p> <h2 scrollto-destination=3262421 id="3262421" class="section-title js-splitscreen-section-title" >RESULTS AND DISCUSSION</h2> <h3 scrollto-destination=3262422 id="3262422" class="section-title js-splitscreen-section-title" >Conceptual comparison of phylogenomic databases</h3> <p class="chapter-para">There are five main conceptual frameworks which emerge from the databases we compared: (i) pure orthologous groups; (ii) orthologs of species pairs; (iii) hierarchical ortholog groups; (iv) reconciled trees; and (v) trees with no annotation. In <span class="xrefLink" id="jumplink-F1"></span><a href="javascript:;" data-modal-source-id="F1" class="link xref-fig">Figure 1</a>, the different grouping strategies are presented in the form of annotated trees with resolved or unresolved nodes according to the information they capture.</p><p class="chapter-para">‘Pure orthologous groups’ consist of genes that all share orthologous relationships [<span class="xrefLink" id="jumplink-B16"></span><a href="javascript:;" reveal-id="B16" data-open="B16" class="link link-ref link-reveal xref-bibr">16</a>]. Hence, only a part of all possible orthologous—but no paralogous—gene relationships are captured. Accordingly, the phylogenetic information of such groups corresponds to unresolved trees with all nodes presenting speciation events. In general, pure orthologous groups are suitable when precision is of higher importance than sensitivity. OMA has chosen this gene classification as a basis for the reconstruction of the species tree.</p><p class="chapter-para">‘Ortholog clusters of species pairs’ include orthologs or co-orthologs from only two species per cluster, resulting in a large number of small groups. Expressed in terms of a tree, the root node is always a speciation event and all other internal nodes present gene duplications, which multifurcate if more than two gene copies exist in a species. In principle, this approach can comprise all orthologous gene pairs, but it captures only species-specific in paralogs; paralogs between different species are not captured at all. Orthology assignment for species pairs is the well-established strategy of InParanoid, but also provided by Compara, Panther and OMA. The concept for OMA ‘pairwise’ varies in that orthologous genes are given for each reference gene. Thus, lineage-specific gene duplications are provided for only one of the two branches.</p><p class="chapter-para">‘Hierarchical ortholog groups’, which are defined for particular taxonomic levels, consist of sequences that descend from a single ancestor in the taxonomic range in question. eggNOG provides hierarchical groups with respect to major taxonomic levels, while OrthoDB provides hierarchical groups with respect to any split in their species tree. In the latter, higher resolution between the more closely related species can be achieved. If all nodes are resolved, the hierarchical groups collectively imply the gene tree topology. Even if not explicitly indicated, a split of groups along a lineage indicates a gene duplication event. Evolutionary events are not defined at internal nodes except for the root nodes of eggNOG and OrthoDB, which are expected to be speciation events. Gene relationships can be inferred based on the assumption that groups with one gene per species are 1:1 orthologs, and groups with overlapping taxonomic ranges are paralogs [<span class="xrefLink" id="jumplink-B28"></span><a href="javascript:;" reveal-id="B28" data-open="B28" class="link link-ref link-reveal xref-bibr">28</a>]. Consequently, for gene families with multiple gene duplications, gene relationships are often only specified for the genes of more closely related species. In this case, all gene relationships within and between groups can be specified, even when speciation nodes are unresolved. Panther provides two hierarchical levels, namely families and mutually exclusive groups of subfamilies. As subfamilies are not intended to reflect gene phylogeny, this concept is not considered in our study.</p><p class="chapter-para">The most fine-grained classification is the gene tree. Unlabeled gene trees possess no orthology assignment <em>per se</em> and need further interpretation for the prediction of gene relationships. ‘Reconciled gene trees’ include details on evolutionary events, generally assigning speciation or gene duplication at each internal node. Hence, all possible orthologous and paralogous gene relationships can be directly derived from a resolved tree. Annotated gene trees are constructed by Compara, HOVERGEN and Panther; plain gene trees by HOGENOM. eggNOG and InParanoid also provide gene trees but they are not used to infer orthology.</p><p class="chapter-para">Thus, concepts differ in the extent to which they capture phylogenetic information, which may therefore only be partial, even for perfect results. In fact, only two of the discussed strategies—reconciled trees and hierarchical ortholog groups—have the potential to characterize all orthology/paralogy relationships of a homologous group. This aspect will be analyzed in more detail in the next section.</p> <h3 scrollto-destination=3262429 id="3262429" class="section-title js-splitscreen-section-title" >Qualitative and quantitative evaluation</h3> <h4 scrollto-destination=3262430 id="3262430" class="section-title js-splitscreen-section-title" >Reference trees</h4> <p class="chapter-para">High confidence gene trees are made available through scientific publications. But even for many apparently well-characterized gene families, the best estimation of the gene tree often includes ambiguous key nodes, which renders them difficult to utilize as reference trees. What is more, for the great majority, the data are no longer up-to-date, or trees include genes from not yet fully sequenced genomes, and which are therefore not present in phylogenomic databases. Because of this, we constructed reference trees for three gene families: the Popeye-domain containing family, the NOX ‘ancestral-type’ subfamily of NADPH oxidases (NOX1-4) and the V-type ATPase beta subunit. These gene families have been selected according to the following characteristics: (i) they contain one or more lineage-specific gene duplications, which we assume is a challenge for orthology prediction; (ii) they possess relatively simple gene phylogenies with no major changes in the domain architecture and no horizontal gene transfer (in contrast to more complex gene histories, simple ones are generally expected to be correctly resolved by orthology prediction methods); (iii) their sequences contain strong phylogenetic signal, which is important for the construction of the reference tree. It should be noted that each family was chosen prior to the database comparison.</p><p class="chapter-para">Minimal requirements for reference trees derived from phylogenetic analysis were defined as follows: </p><ul class="roman-lower"><li><p class="chapter-para">The reference tree can be a consensus tree derived from multiple analyses, differing for instance, in the type of input data, the species composition, or the analytic methods applied. A reference tree could even be a dendrogram, as only the tree topology is of importance for the prediction of gene relationships.</p></li><li><p class="chapter-para">All duplication nodes of a reference tree should be significantly supported by at least one state-of-the-art method, but not necessarily within a single gene tree. Therefore multiple analyses are performed for sub-datasets, until relevant nodes are resolved. Topological differences of close speciation nodes, found between the gene tree and the expected species tree, can be the result of incomplete lineage sorting [<span class="xrefLink" id="jumplink-B28"></span><a href="javascript:;" reveal-id="B28" data-open="B28" class="link link-ref link-reveal xref-bibr">28</a>]. Topological incongruence is acceptable if there is no evidence of either hidden paralogy or of horizontal gene transfer and, beyond that, if the constrained topology is not rejected by statistical tests. Orthology can also be supported by gene synteny.</p></li><li><p class="chapter-para">It is desirable to analyze all relevant gene copies predicted in the genomes of the selected species. Exceptions are sequences that might hinder the analysis, e.g. sequences derived from incomplete or erroneous gene models or events of gene conversion [<span class="xrefLink" id="jumplink-B29"></span><a href="javascript:;" reveal-id="B29" data-open="B29" class="link link-ref link-reveal xref-bibr">29</a>, <span class="xrefLink" id="jumplink-B30"></span><a href="javascript:;" reveal-id="B30" data-open="B30" class="link link-ref link-reveal xref-bibr">30</a>].</p></li><li><p class="chapter-para">The robustness of tree topologies can be further tested by adding sequences of species other than those selected for the reference tree.</p></li><li><p class="chapter-para">Finally, all available information and findings should be considered in total to confirm findings and, likewise, uncover inconsistencies.</p></li></ul><p class="chapter-para">Despite all efforts to improve phylogenetic inference, a reference tree still remains a tentative model of past history. Update and maintenance are essential when novel related sequences, improved tree-building approaches, or new knowledge on gene and genome evolution become available. In particular, the identification of new gene duplications within subtrees of apparent 1:1 orthologs will help to discriminate between true orthologs and pseudo-orthologs [<span class="xrefLink" id="jumplink-B31"></span><a href="javascript:;" reveal-id="B31" data-open="B31" class="link link-ref link-reveal xref-bibr">31</a>]. Additionally, a larger choice for the selection of suitable outgroups can improve the analysis. <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Text S1–S5</a> in ‘<a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Data</a>’ provides reference gene trees in extended Newick format (NHX) with annotated gene duplications, lists of gene pairs with annotated gene relationships and a list of genes that were excluded from the analysis, e.g. fragments.</p> <h4 scrollto-destination=3262435 id="3262435" class="section-title js-splitscreen-section-title" >Data mapping</h4> <p class="chapter-para">In principle, there are two strategies for the mapping of sequence data between a reference tree and the corresponding ortholog group from a phylogenomic database: mapping by sequence identity or mapping by gene identifiers. The advantage of the first solution is the standardization of parameters, which is of importance when benchmarking orthology prediction methods. This approach, however, fails to match a considerable number of genes due to differing sequence versions, gene models, natural variants and isoforms which are used for the orthology classification by the phylogenomic databases. Even minor differences in sequence can influence the outcome of an analysis. In contrast to previous studies, we have chosen to address here the typical user question regarding the existence of orthologs in two or more species. This question can best be answered via the mapping of gene identifiers, as mapping based on sequence identity will miss many correct orthology assignments. In order to provide a visual of the results, one of the reference trees is depicted along with the mapped ortholog predictions in <span class="xrefLink" id="jumplink-F2"></span><a href="javascript:;" data-modal-source-id="F2" class="link xref-fig">Figure 2</a>. All three reference trees are shown in <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Figures S1–S3</a>, together with relevant <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary information</a>. </p> <a id="3262437" scrollto-destination="3262437"></a> <div data-id="f2" data-content-id="f2" class="fig fig-section js-fig-section" swap-content-for-modal="true"><div class="graphic-wrap"><img class="content-image" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034f2.jpeg?Expires=1734497296&Signature=qg28u2~v51BSTs04A9A9IS8AXr22PmgOexswwZs9q81JYLU5VpI5spTlJ8d4DiTleSF6Xxwn1X2EwyaaG~cAt5eMEnLK2lVTJbWrj9wlt5hzQsDFXY1DFrU-lR2PoZggvvUluie~9nh1xUBZCc7OPxm6fztLrK~bEhnGWNz1-gyP~vyiAiZynGmBXsrYSe1vM9hRExNPzzxT-JtvSk6r0z0sWTIFZfbCdVanYwSptHkz3Zen-a6jJOkryCbKQmtwmonXZ~wn378t9oReKsTd1b-1j0TdsvUi-rfXJAhnkAtLUb2uaB0UE9deqgHlwOTQk6ahYY6sETendPP-E~2BAw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="Reference tree for the V-type ATPase β-subunit subfamily and corresponding ortholog predictions from seven phylogenomic databases. The different grouping strategies are clearly reflected: OMA, InParanoid and the unlabeled trees of HOGENOM occur as mutually exclusive groups, while all other databases possess hierarchical grouping strategies. Most orthology predictions coincide with those of the reference tree, but none of the phylogenomic databases is in full agreement with all of them: OMA groups are split into more groups than necessary, which results in less predicted gene relationships; InParanoid predicts the B2 subunit of Ornithorhynchus anatinus to be an ortholog of the human B1 subunit and lacks some of the arthropod orthologs; OrthoDB assigns corresponding 1:1 orthologs only for closely related species such as primates or rodents; eggNOG gives contradictory information on the B2 subunit of Xenopus tropicalis; the tree topology of Panther suggests lineage-specific duplications for the paralogs of X. tropicalis, Caenorhabditis elegans and C. briggsae; the tree of Compara includes an additional duplication event within the vertebrate B2 clade; HOGENOM differs from the reference tree only by the inversion of a speciation node (data not shwn) and lacks one of the expected orthologs in the data set. Missing orthologs are also observed for OMA, InParanoid and Panther. Explanation: the left block (headed ‘Ortholog hierarchies’) indicates the ortholog classification derived from the reference tree, with the largest homolog group given in the first column; different levels of orthologous hierarchies are shown as patterned cells in the right-handed columns. Corresponding groups defined by the phylogenomic databases are patterned accordingly, if relevant to the benchmarked ortholog classification. Triangle: gene duplication event. White cell: gene of species that are not covered by the database. Plain gray cell: gene assigned to an unexpected ortholog group. Descending diagonal: expected gene that was missing in an ortholog group. Ascending diagonal: false positive prediction. Black horizontal bar: groups of the same hierarchical level within the same column. For OrthoDB the black bar also separates the three taxonomic sections of the database (VeRTebrate, ARThropods, FUNgi). For more details, see Supplementary Figure S3." data-path-from-xml="bbr034f2.jpeg" /><div class="graphic-bottom"><div class="label fig-label" id="label-3262437">Figure 2:</div><div class="caption fig-caption"><p class="chapter-para">Reference tree for the V-type ATPase β-subunit subfamily and corresponding ortholog predictions from seven phylogenomic databases. The different grouping strategies are clearly reflected: OMA, InParanoid and the unlabeled trees of HOGENOM occur as mutually exclusive groups, while all other databases possess hierarchical grouping strategies. Most orthology predictions coincide with those of the reference tree, but none of the phylogenomic databases is in full agreement with all of them: OMA groups are split into more groups than necessary, which results in less predicted gene relationships; InParanoid predicts the B2 subunit of <em>Ornithorhynchus anatinus</em> to be an ortholog of the human B1 subunit and lacks some of the arthropod orthologs; OrthoDB assigns corresponding 1:1 orthologs only for closely related species such as primates or rodents; eggNOG gives contradictory information on the B2 subunit of <em>Xenopus tropicalis</em>; the tree topology of Panther suggests lineage-specific duplications for the paralogs of <em>X. tropicalis, Caenorhabditis elegans</em> and <em>C. briggsae</em>; the tree of Compara includes an additional duplication event within the vertebrate B2 clade; HOGENOM differs from the reference tree only by the inversion of a speciation node (data not shwn) and lacks one of the expected orthologs in the data set. Missing orthologs are also observed for OMA, InParanoid and Panther. Explanation: the left block (headed ‘Ortholog hierarchies’) indicates the ortholog classification derived from the reference tree, with the largest homolog group given in the first column; different levels of orthologous hierarchies are shown as patterned cells in the right-handed columns. Corresponding groups defined by the phylogenomic databases are patterned accordingly, if relevant to the benchmarked ortholog classification. Triangle: gene duplication event. White cell: gene of species that are not covered by the database. Plain gray cell: gene assigned to an unexpected ortholog group. Descending diagonal: expected gene that was missing in an ortholog group. Ascending diagonal: false positive prediction. Black horizontal bar: groups of the same hierarchical level within the same column. For OrthoDB the black bar also separates the three taxonomic sections of the database (VeRTebrate, ARThropods, FUNgi). For more details, see <a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary Figure S3</a>.</p></div><div class="ajax-articleAbstract-exclude-regex fig-orig original-slide figure-button-wrap"><a class="fig-view-orig js-view-large at-figureViewLarge openInAnotherWindow" role="button" aria-describedby="label-3262437" href="/view-large/figure/3262437/bbr034f2.jpeg" data-path-from-xml="bbr034f2.jpeg" target="_blank">Open in new tab</a><a class="download-slide" role="button" aria-describedby="label-3262437" data-section="3262437" href="/DownloadFile/DownloadImage.aspx?image=https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034f2.jpeg?Expires=1734497296&Signature=l0u4UsYwwU~R8KlRyWg28gczCfGtRTIc6tFb9NxTnG4V5jN9Fue5Mmm0-pVWZY-Q~o6hoqk7J-OJjL5lUqpWBbtLwI249r~hY5WFzdpLaXn1nA6JlqOQAsOE5aZYblKbiSw1IvSMJoezpT4J2jJmi6PpMpt-z5te3pEjRZeNGDUwLXQu4u9Ei1QV7U2ut7zeogBEPBbXdQpvvN-sqmLWDMp5bx4LgEHN-9vSJhIXkWltks-15iiRbHO48HPtCD43MR6X8TEHlW7GQs2k3KXRLBMi-WS1JaxFv0ususii~h7vylPowef8bi~SA-S6bFQ5T~DETPnXW8gYNCYCSoEgBQ__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA&sec=3262437&ar=270085&xsltPath=~/UI/app/XSLT&imagename=&siteId=5143" data-path-from-xml="bbr034f2.jpeg">Download slide</a></div></div></div></div> <h4 scrollto-destination=3262438 id="3262438" class="section-title js-splitscreen-section-title" >Gene relationships to be evaluated</h4> <p class="chapter-para">As the conceptual discussion above has demonstrated, the various grouping strategies provide unequal degrees of phylogenetic information. To be able to compare the databases quantitatively, we chose to reduce their predictions to three categories of pairwise gene relationships: (i) orthology, (ii) orthology and paralogy and (iii) ‘extended’ orthology/paralogy. The last type represents an attempt to capture more phylogenetic information than provided by simple orthology/paralogy. This is accomplished by taking into account the number of gene duplications for each lineage since the last common node for the compared genes (see Methods section).</p> <h4 scrollto-destination=3262440 id="3262440" class="section-title js-splitscreen-section-title" >Measures</h4> <p class="chapter-para">We have developed simple and intuitive measures in order to answer two typical user questions: </p><ul class="roman-lower"><li><p class="chapter-para">‘Are the predicted relationships correct?’ This question deals with the number of false positive hits, and we calculate for this purpose the positive predictive value from the number of true positives and false positives.</p></li><li><p class="chapter-para">‘Are the predicted relationships complete?’ This question concerns the fraction of false negative hits, which can be expressed via the true positive rate.</p></li></ul><p class="chapter-para">Both scores are calculated according to the three aforementioned gene relationships assigned or implied by each database. Unlabeled trees capture considerable phylogenetic signals, but provide no information regarding the three types of gene relationships considered here. As an alternative evaluation approach for unlabeled trees, we quantified ‘correctness’ in terms of the agreement between the topologies of plain trees and reference trees (pruned to a common set of leaves) in terms of the Robinson–Foulds distance [<span class="xrefLink" id="jumplink-B32"></span><a href="javascript:;" reveal-id="B32" data-open="B32" class="link link-ref link-reveal xref-bibr">32</a>]. All scores were normalized between 0 and 1, whereby values of 1 correspond to a perfect match with the reference tree. Neither the number of species nor the taxonomic range has any impact on the scoring.</p> <h4 scrollto-destination=3262444 id="3262444" class="section-title js-splitscreen-section-title" >Score-based quantitative analysis</h4> <p class="chapter-para">Scores calculated for each database and each gene family are presented in <span class="xrefLink" id="jumplink-T2"></span><a href="javascript:;" reveal-id="T2" data-open="T2" class="link link-reveal link-table xref-fig">Table 2</a>. The authors stress that values are based on only three gene families (3783 gene relationships) and that the results can, therefore, only be indicative. Most databases achieve high score values for correct orthology predictions. Maximum values for specificity are obtained by OMA groups, OrthoDB groups and Compara trees, which are each based on a different concept. Tree topologies from Panther differ slightly from the reference trees, resulting in the assignment of wrong gene relationships in the reconciled tree. For databases with hierarchical group concepts, scores were calculated from groups and by considering the hierarchical topology. In the first case, gene relationships were mostly specified at high resolution, while gene relationships at other levels were considered undefined—hence the high precision and the low sensitivity. When gene relationships are derived from reconstructed trees, many more gene relationships can be evaluated. The precision scores of the two measures differ most for OrthoDB, as groups seem to be split according to speciation prior to duplication. In this manner, high precision is achieved between closely related species. But the hierarchy at early vertebrate radiation nodes is not consistent with the gene phylogeny, e.g. teleostei and tetrapods in the POP and NOX families. Similar trends are observed when considering the precision of both, orthologous and paralogous gene relationships (<span class="xrefLink" id="jumplink-T2"></span><a href="javascript:;" reveal-id="T2" data-open="T2" class="link link-reveal link-table xref-fig">Table 2</a>). </p> <a id="3262446" scrollto-destination="3262446"></a> <div content-id="T2" class="table-modal table-full-width-wrap"><div class="table-wrap table-wide standard-table"><div class="table-wrap-title" id="T2" data-id="T2"><span class="label title-label" id="label-93928">Table 2:</span><div class="
 graphic-wrap table-open-button-wrap
 "><a class="fig-view-orig at-tableViewLarge openInAnotherWindow btn js-view-large" role="button" target="_blank" href="
 /view-large/3262446" aria-describedby="label-93928"> Open in new tab </a></div><div class="caption caption-id-" id="caption-93928"><p class="chapter-para">Benchmarking results based on three reference trees</p></div> </div><div class="table-overflow"><table role="presentation" aria-labelledby="
 label-93928" aria-describedby="
 caption-93928"><tbody><tr><td><img class="contentFigures" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034i3.jpeg?Expires=1734497296&Signature=0zzJ0sWdtFUdwe7ZFjVVsropjqLMTw2CJT3BoEZHH0eAIOw4o2qS~-rFjdiidHqsEe7wgK8Wvzsu5rAcGIreOEE5Nh~3I6nXmSPlx60A-Q5Jvu3xzDPSf71ArsvXsIfb7c3exDAsZHXnWIce6hjEEu7TpokG50pWhlQbi7NnOI06aGtOTknYNBWHOU4f4dqoXe8ugAX3VDt1H33cyArVruJMlQRoWInTHAZyiUeS7K4UMy3-vEYWnQd3EkAHMJ4scylrjIl8GC7IfDkySoAxJPTMHC4fzbY1MIE9nTyXqB9boKdxSMpfFtIkgfW4ZWU-HL034EWU3AfPR7DxlZ~EfA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="graphic" data-path-from-xml="bbr034i3.jpeg" /></td></tr></tbody></table></div><div class="table-modal"><table><tbody><tr><td><img class="contentFigures" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034i3.jpeg?Expires=1734497296&Signature=0zzJ0sWdtFUdwe7ZFjVVsropjqLMTw2CJT3BoEZHH0eAIOw4o2qS~-rFjdiidHqsEe7wgK8Wvzsu5rAcGIreOEE5Nh~3I6nXmSPlx60A-Q5Jvu3xzDPSf71ArsvXsIfb7c3exDAsZHXnWIce6hjEEu7TpokG50pWhlQbi7NnOI06aGtOTknYNBWHOU4f4dqoXe8ugAX3VDt1H33cyArVruJMlQRoWInTHAZyiUeS7K4UMy3-vEYWnQd3EkAHMJ4scylrjIl8GC7IfDkySoAxJPTMHC4fzbY1MIE9nTyXqB9boKdxSMpfFtIkgfW4ZWU-HL034EWU3AfPR7DxlZ~EfA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="graphic" data-path-from-xml="bbr034i3.jpeg" /></td></tr></tbody></table></div><div class="table-wrap-foot"><span id="fn-TF1"></span><div content-id="TF1" class="footnote"><span class="fn"><p class="chapter-para">The analyzed databases are OMA pure orthologous groups and pairwise groups, InParanoid, OrthoDB, eggNOG, Panther trees and HOGENOM. Databases with a hierarchical grouping concept are scored in two ways, based on the ortholog groups and based on the implied trees. For HOGENOM, the calculation is based on Robinson Foulds distances. Columns: ‘Expected OTUs’: number of genes expected to be present in an ortholog group according to the species list of the phylogenomic database. ‘Mapped OTUs’: number of genes of the reference tree that are mapped to the ortholog groups; ‘Number groups’: number of groups relevant to the reference tree. Scores are calculated for the three types of gene relationships: orthology, orthology/paralogy and ‘extended’ gene relationships. The weighted average is shown bottom left of the table. For each column, the best achieved values are shaded dark gray, the second-best light gray. ‘Coverage’ indicates the weighted average of mapped genes, in percent. For each family, the number of genes and the number of relevant gene relationships are indicated within the gray header row.</p></span></div></div></div></div><div class="table-full-width-wrap"><div class="table-wrap table-wide standard-table"><div class="table-wrap-title" id="T2" data-id="T2"><span class="label title-label" id="label-93928">Table 2:</span><div class="
 graphic-wrap table-open-button-wrap
 "><a class="fig-view-orig at-tableViewLarge openInAnotherWindow btn js-view-large" role="button" target="_blank" href="
 /view-large/3262446" aria-describedby="label-93928"> Open in new tab </a></div><div class="caption caption-id-" id="caption-93928"><p class="chapter-para">Benchmarking results based on three reference trees</p></div> </div><div class="table-overflow"><table role="presentation" aria-labelledby="
 label-93928" aria-describedby="
 caption-93928"><tbody><tr><td><img class="contentFigures" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034i3.jpeg?Expires=1734497296&Signature=0zzJ0sWdtFUdwe7ZFjVVsropjqLMTw2CJT3BoEZHH0eAIOw4o2qS~-rFjdiidHqsEe7wgK8Wvzsu5rAcGIreOEE5Nh~3I6nXmSPlx60A-Q5Jvu3xzDPSf71ArsvXsIfb7c3exDAsZHXnWIce6hjEEu7TpokG50pWhlQbi7NnOI06aGtOTknYNBWHOU4f4dqoXe8ugAX3VDt1H33cyArVruJMlQRoWInTHAZyiUeS7K4UMy3-vEYWnQd3EkAHMJ4scylrjIl8GC7IfDkySoAxJPTMHC4fzbY1MIE9nTyXqB9boKdxSMpfFtIkgfW4ZWU-HL034EWU3AfPR7DxlZ~EfA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="graphic" data-path-from-xml="bbr034i3.jpeg" /></td></tr></tbody></table></div><div class="table-modal"><table><tbody><tr><td><img class="contentFigures" src="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/m_bbr034i3.jpeg?Expires=1734497296&Signature=0zzJ0sWdtFUdwe7ZFjVVsropjqLMTw2CJT3BoEZHH0eAIOw4o2qS~-rFjdiidHqsEe7wgK8Wvzsu5rAcGIreOEE5Nh~3I6nXmSPlx60A-Q5Jvu3xzDPSf71ArsvXsIfb7c3exDAsZHXnWIce6hjEEu7TpokG50pWhlQbi7NnOI06aGtOTknYNBWHOU4f4dqoXe8ugAX3VDt1H33cyArVruJMlQRoWInTHAZyiUeS7K4UMy3-vEYWnQd3EkAHMJ4scylrjIl8GC7IfDkySoAxJPTMHC4fzbY1MIE9nTyXqB9boKdxSMpfFtIkgfW4ZWU-HL034EWU3AfPR7DxlZ~EfA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA" alt="graphic" data-path-from-xml="bbr034i3.jpeg" /></td></tr></tbody></table></div><div class="table-wrap-foot"><span id="fn-TF1"></span><div content-id="TF1" class="footnote"><span class="fn"><p class="chapter-para">The analyzed databases are OMA pure orthologous groups and pairwise groups, InParanoid, OrthoDB, eggNOG, Panther trees and HOGENOM. Databases with a hierarchical grouping concept are scored in two ways, based on the ortholog groups and based on the implied trees. For HOGENOM, the calculation is based on Robinson Foulds distances. Columns: ‘Expected OTUs’: number of genes expected to be present in an ortholog group according to the species list of the phylogenomic database. ‘Mapped OTUs’: number of genes of the reference tree that are mapped to the ortholog groups; ‘Number groups’: number of groups relevant to the reference tree. Scores are calculated for the three types of gene relationships: orthology, orthology/paralogy and ‘extended’ gene relationships. The weighted average is shown bottom left of the table. For each column, the best achieved values are shaded dark gray, the second-best light gray. ‘Coverage’ indicates the weighted average of mapped genes, in percent. For each family, the number of genes and the number of relevant gene relationships are indicated within the gray header row.</p></span></div></div></div></div><p class="chapter-para">There is a strong variability in the recall of predicted gene relationships. The concept of pure orthologous groups does not allow a comprehensive coverage: the sensitivity score drops with an increase in the number of OMA groups for a family. As no paralogous gene relationships are predicted, the sensitivity score for all gene relationships—orthologs and paralogs—decreases along with the number of paralogs in a family. For pairwise group concepts, the recall is significantly higher for orthologous relationships than for all gene relationships, an observation that can, at least in part, be explained by the database concept. The sensitivity scores for databases with reconciled trees are among the highest, but less than 1.0 for differing reasons. False negatives identified for Compara can primarily be ascribed to the underlying sequence input data. Panther complements the Ensembl proteomes with UniProtKB [<span class="xrefLink" id="jumplink-B33"></span><a href="javascript:;" reveal-id="B33" data-open="B33" class="link link-ref link-reveal xref-bibr">33</a>] sequences and profits from a nearly complete input dataset for the three gene families; false negatives are mostly a result of tree topologies that differ from that of the reference tree.</p><p class="chapter-para">The precision score for ‘gene phylogeny’ is generally lower than the one calculated for all gene relationships, but it can also increase when many gene relationships are no longer defined, in which case the sensitivity score decreases (<span class="xrefLink" id="jumplink-T2"></span><a href="javascript:;" reveal-id="T2" data-open="T2" class="link link-reveal link-table xref-fig">Table 2</a>, right column). Non-hierarchical methodologies can only compete in this measure if a family includes no more than one duplication per lineage. Databases with hierarchical grouping strategies have the potential to perform well, but the scores indicate inconsistencies, because the measure applied here takes into account internal node topologies that differ from those of the reference tree. This can be observed for the NOX family, where precision scores decrease significantly for OrthoDB and eggNOG. The highest overall scores for precision and sensitivity are achieved by tree-based methods, namely Compara and HOGENOM. Panther trees show lower score values due to various inconsistencies in tree topologies. It should be noted that our set of well-conserved proteins might be biased in favor of tree-based strategies.</p><p class="chapter-para">In summary, our scoring schemes are consistent with both the quality of predicted gene relationships and the concepts underlying the databases. For the three examples, we observe a generally high specificity of orthology predictions regarding the phylogenomic databases examined in this study. However, the results largely differ with respect to sensitivity and gene phylogeny.</p> <h2 scrollto-destination=3262450 id="3262450" class="section-title js-splitscreen-section-title" >CONCLUSIONS</h2> <p class="chapter-para">For three rather simple gene histories, none of the phylogenomic databases was in perfect agreement with the reference trees. Preliminary results suggest that there is generally high precision in orthology predictions. Most of the variation in sensitivity of orthology predictions can be explained by conceptual differences and incomplete datasets. Gene phylogenies can qualitatively and quantitatively be best resolved by databases utilizing a tree concept.</p><p class="chapter-para">Reference trees constitute a robust benchmark for measuring precision and sensitivity of phylogenetic information provided by databases. Towards the end of this study, we shared the results with groups that provide phylogenomic databases. In response, the information was used by the authors of the Panther database to identify and fix a bug in their tree reconstruction software. The reference trees were also used to verify the correctness of the latest OrthoDB release after an update of the analysis procedure. This positive feedback drives home the point that, in the future, the maintenance of ‘gold standard’ phylogenetic trees represents a highly desirable and profitable undertaking.</p> <h2 scrollto-destination=3262453 id="3262453" class="section-title js-splitscreen-section-title" >SUPPLEMENTARY DATA</h2> <p class="chapter-para"><a class="supplementary-data tab-trigger jumplink scrollTo" target="SupplementalTab" href="#supplementary-data" data-tab="#supplementary-data">Supplementary data</a> are available online at <a class="link link-uri openInAnotherWindow" href="http://bib.oxfordjournals.org/" target="_blank">http://bib.oxfordjournals.org/</a>.</p><p class="chapter-para"></p><div id="BOX1" class="boxed-text boxed-matter"><div class="caption caption-id-"><div class="title">Key Points</div></div><div class="clearfix"></div><p class="chapter-para"></p><ul class="bullet"><li><p class="chapter-para">Phylogenomic databases differ substantially in concept. Reconciled trees represent the most informative grouping strategy.</p></li><li><p class="chapter-para">None of the phylogenomic databases agrees perfectly with our reference gene trees.</p></li><li><p class="chapter-para">Orthology predictions, as provided by the databases, are generally correct—at least for simple gene trees.</p></li><li><p class="chapter-para">Most of the variation in sensitivity of orthology predictions can be explained by conceptual differences and incomplete data sets.</p></li><li><p class="chapter-para">Reference gene trees provide a robust way for the quality assessment of orthology predictions.</p></li></ul></div> <h2 scrollto-destination=3262457 id="3262457" class="section-title js-splitscreen-section-title" >FUNDING</h2> <p class="chapter-para">The Swiss Federal Government through the Federal Office of Education and Science (B.B.), by the Etat de Vaud and the Swiss National Science Foundation (M.R.R.). Funding for open access charge: Swiss Institute of Bioinformatics.</p> <h2 scrollto-destination=3262459 id="3262459" class="backacknowledgements-title js-splitscreen-backacknowledgements-title" >Acknowledgements</h2> <p class="chapter-para">The authors wish to thank all databases for providing their resources to the scientific communities. A special thanks for helpful discussions and feedback to Adrian M. Altenhoff, Peer Bork, Laurent Duret, Evgenia V. Kriventseva and Robert M. Waterhouse, Paul Thomas, Albert J. Vilella, Arnold Kuzniar and Alan Bridge, Vivienne Baillie Gerritsen and Dwight Klett for correcting the manuscript and three anonymous reviewers for helpful comments. Conceived by I.X., designed by B.B. with contributions from C.D., analyzed and interpreted by B.B., C.D., M.R.R. and I.X., written by B.B. with contributions from all authors. All authors read and approved the manuscript.</p> <h2 scrollto-destination=3262461 id="3262461" class="backreferences-title js-splitscreen-backreferences-title" >References</h2> <div class="ref-list js-splitview-ref-list"><div content-id="B1" class="js-splitview-ref-item" data-legacy-id="B1"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B1" href="javascript:;" aria-label="jumplink-B1" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B1" class="ref-content " data-id="B1"><span class="label title-label">1</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Fitch</div> <div class="given-names">WM</div></div></span><div class="article-title">Distinguishing homologous from analogous proteins</div>, <div class="source ">Syst Zool</div>, <div class="year">1970</div>, vol. <div class="volume">19</div> (pg. <div class="fpage">99</div>-<div class="lpage">113</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Distinguishing%20homologous%20from%20analogous%20proteins&author=WM%20Fitch&publication_year=1970&journal=Syst%20Zool&volume=19&pages=99-113" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.2307/2412448" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.2307%2F2412448" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.2307%2F2412448"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/5449325" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Distinguishing%20homologous%20from%20analogous%20proteins&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B2" class="js-splitview-ref-item" data-legacy-id="B2"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B2" href="javascript:;" aria-label="jumplink-B2" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B2" class="ref-content " data-id="B2"><span class="label title-label">2</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Studer</div> <div class="given-names">RA</div></div> <div class="name"><div class="surname">Robinson-Rechavi</div> <div class="given-names">M</div></div></span><div class="article-title">How confident can we be that orthologs are similar, but paralogs differ?</div>, <div class="source ">Trends Genet</div>, <div class="year">2009</div>, vol. <div class="volume">25</div> (pg. <div class="fpage">210</div>-<div class="lpage">6</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=How%20confident%20can%20we%20be%20that%20orthologs%20are%20similar%2C%20but%20paralogs%20differ%3F&author=RA%20Studer&author=M%20Robinson-Rechavi&publication_year=2009&journal=Trends%20Genet&volume=25&pages=210-6" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1016/j.tig.2009.03.004" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1016%2Fj.tig.2009.03.004" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1016%2Fj.tig.2009.03.004"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19368988" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:How%20confident%20can%20we%20be%20that%20orthologs%20are%20similar%2C%20but%20paralogs%20differ%3F&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B3" class="js-splitview-ref-item" data-legacy-id="B3"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B3" href="javascript:;" aria-label="jumplink-B3" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B3" class="ref-content " data-id="B3"><span class="label title-label">3</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Alexeyenko</div> <div class="given-names">A</div></div> <div class="name"><div class="surname">Lindberg</div> <div class="given-names">J</div></div> <div class="name"><div class="surname">Pérez-Bercoff</div> <div class="given-names">A</div></div>et al. </span><div class="article-title">Overview and comparison of ortholog databases</div>, <div class="source ">Drug Discov Today: Technol</div>, <div class="year">2006</div>, vol. <div class="volume">3</div> (pg. <div class="fpage">137</div>-<div class="lpage">43</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Overview%20and%20comparison%20of%20ortholog%20databases&author=A%20Alexeyenko&author=J%20Lindberg&author=A%20P%C3%A9rez-Bercoff&publication_year=2006&journal=Drug%20Discov%20Today%3A%20Technol&volume=3&pages=137-43" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1016/j.ddtec.2006.06.002" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1016%2Fj.ddtec.2006.06.002" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1016%2Fj.ddtec.2006.06.002"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/24980400" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Overview%20and%20comparison%20of%20ortholog%20databases&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B4" class="js-splitview-ref-item" data-legacy-id="B4"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B4" href="javascript:;" aria-label="jumplink-B4" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B4" class="ref-content " data-id="B4"><span class="label title-label">4</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Chen</div> <div class="given-names">F</div></div> <div class="name"><div class="surname">Mackey</div> <div class="given-names">AJ</div></div> <div class="name"><div class="surname">Vermunt</div> <div class="given-names">JK</div></div>et al. </span><div class="article-title">Assessing performance of orthology detection strategies applied to eukaryotic genomes</div>, <div class="source ">PLoS One</div>, <div class="year">2007</div>, vol. <div class="volume">2</div> pg. <div class="fpage">e383</div> <div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Assessing%20performance%20of%20orthology%20detection%20strategies%20applied%20to%20eukaryotic%20genomes&author=F%20Chen&author=AJ%20Mackey&author=JK%20Vermunt&publication_year=2007&journal=PLoS%20One&volume=2&pages=e383" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1371/journal.pone.0000383" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1371%2Fjournal.pone.0000383" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1371%2Fjournal.pone.0000383"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/17440619" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Assessing%20performance%20of%20orthology%20detection%20strategies%20applied%20to%20eukaryotic%20genomes&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B5" class="js-splitview-ref-item" data-legacy-id="B5"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B5" href="javascript:;" aria-label="jumplink-B5" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B5" class="ref-content " data-id="B5"><span class="label title-label">5</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Hulsen</div> <div class="given-names">T</div></div> <div class="name"><div class="surname">Huynen</div> <div class="given-names">MA</div></div> <div class="name"><div class="surname">de Vlieg</div> <div class="given-names">J</div></div>et al. </span><div class="article-title">Benchmarking ortholog identification methods using functional genomics data</div>, <div class="source ">Genome Biol</div>, <div class="year">2006</div>, vol. <div class="volume">7</div> pg. <div class="fpage">R31</div> <div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Benchmarking%20ortholog%20identification%20methods%20using%20functional%20genomics%20data&author=T%20Hulsen&author=MA%20Huynen&author=J%20de%20Vlieg&publication_year=2006&journal=Genome%20Biol&volume=7&pages=R31" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1186/gb-2006-7-4-r31" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1186%2Fgb-2006-7-4-r31" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1186%2Fgb-2006-7-4-r31"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/16613613" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Benchmarking%20ortholog%20identification%20methods%20using%20functional%20genomics%20data&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B6" class="js-splitview-ref-item" data-legacy-id="B6"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B6" href="javascript:;" aria-label="jumplink-B6" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B6" class="ref-content " data-id="B6"><span class="label title-label">6</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Altenhoff</div> <div class="given-names">AM</div></div> <div class="name"><div class="surname">Dessimoz</div> <div class="given-names">C</div></div></span><div class="article-title">Phylogenetic and functional assessment of orthologs inference projects and methods</div>, <div class="source ">PLoS Comput Biol</div>, <div class="year">2009</div>, vol. <div class="volume">5</div> pg. <div class="fpage">e1000262</div> <div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Phylogenetic%20and%20functional%20assessment%20of%20orthologs%20inference%20projects%20and%20methods&author=AM%20Altenhoff&author=C%20Dessimoz&publication_year=2009&journal=PLoS%20Comput%20Biol&volume=5&pages=e1000262" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1371/journal.pcbi.1000262" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1371%2Fjournal.pcbi.1000262" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1371%2Fjournal.pcbi.1000262"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19148271" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Phylogenetic%20and%20functional%20assessment%20of%20orthologs%20inference%20projects%20and%20methods&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B7" class="js-splitview-ref-item" data-legacy-id="B7"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B7" href="javascript:;" aria-label="jumplink-B7" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B7" class="ref-content " data-id="B7"><span class="label title-label">7</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Vilella</div> <div class="given-names">AJ</div></div> <div class="name"><div class="surname">Severin</div> <div class="given-names">J</div></div> <div class="name"><div class="surname">Ureta-Vidal</div> <div class="given-names">A</div></div>et al. </span><div class="article-title">EnsemblCompara GeneTrees: Complete, duplication-aware phylogenetic trees in vertebrates</div>, <div class="source ">Genome Res</div>, <div class="year">2009</div>, vol. <div class="volume">19</div> (pg. <div class="fpage">327</div>-<div class="lpage">35</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=EnsemblCompara%20GeneTrees%3A%20Complete%2C%20duplication-aware%20phylogenetic%20trees%20in%20vertebrates&author=AJ%20Vilella&author=J%20Severin&author=A%20Ureta-Vidal&publication_year=2009&journal=Genome%20Res&volume=19&pages=327-35" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1101/gr.073585.107" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1101%2Fgr.073585.107" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1101%2Fgr.073585.107"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19029536" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:EnsemblCompara%20GeneTrees%3A%20Complete%2C%20duplication-aware%20phylogenetic%20trees%20in%20vertebrates&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B8" class="js-splitview-ref-item" data-legacy-id="B8"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B8" href="javascript:;" aria-label="jumplink-B8" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B8" class="ref-content " data-id="B8"><span class="label title-label">8</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Kuzniar</div> <div class="given-names">A</div></div> <div class="name"><div class="surname">van Ham</div> <div class="given-names">RC</div></div> <div class="name"><div class="surname">Pongor</div> <div class="given-names">S</div></div>et al. </span><div class="article-title">The quest for orthologs: finding the corresponding gene across genomes</div>, <div class="source ">Trends Genet</div>, <div class="year">2008</div>, vol. <div class="volume">24</div> (pg. <div class="fpage">539</div>-<div class="lpage">51</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=The%20quest%20for%20orthologs%3A%20finding%20the%20corresponding%20gene%20across%20genomes&author=A%20Kuzniar&author=RC%20van%20Ham&author=S%20Pongor&publication_year=2008&journal=Trends%20Genet&volume=24&pages=539-51" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1016/j.tig.2008.08.009" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1016%2Fj.tig.2008.08.009" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1016%2Fj.tig.2008.08.009"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/18819722" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:The%20quest%20for%20orthologs%3A%20finding%20the%20corresponding%20gene%20across%20genomes&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B9" class="js-splitview-ref-item" data-legacy-id="B9"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B9" href="javascript:;" aria-label="jumplink-B9" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B9" class="ref-content " data-id="B9"><span class="label title-label">9</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Flicek</div> <div class="given-names">P</div></div> <div class="name"><div class="surname">Aken</div> <div class="given-names">BL</div></div> <div class="name"><div class="surname">Ballester</div> <div class="given-names">B</div></div>et al. </span><div class="article-title">Ensembl's 10th year</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2010</div>, vol. <div class="volume">38</div> (pg. <div class="fpage">D557</div>-<div class="lpage">62</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Ensembl%27s%2010th%20year&author=P%20Flicek&author=BL%20Aken&author=B%20Ballester&publication_year=2010&journal=Nucleic%20Acids%20Res&volume=38&pages=D557-62" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkp972" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkp972" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkp972"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19906699" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Ensembl%27s%2010th%20year&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B10" class="js-splitview-ref-item" data-legacy-id="B10"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B10" href="javascript:;" aria-label="jumplink-B10" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B10" class="ref-content " data-id="B10"><span class="label title-label">10</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Muller</div> <div class="given-names">J</div></div> <div class="name"><div class="surname">Szklarczyk</div> <div class="given-names">D</div></div> <div class="name"><div class="surname">Julien</div> <div class="given-names">P</div></div>et al. </span><div class="article-title">eggNOG v2.0: extending the evolutionary genealogy of genes with enhanced non-supervised orthologous groups, species and functional annotations</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2010</div>, vol. <div class="volume">38</div> (pg. <div class="fpage">D190</div>-<div class="lpage">5</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=eggNOG%20v2.0%3A%20extending%20the%20evolutionary%20genealogy%20of%20genes%20with%20enhanced%20non-supervised%20orthologous%20groups%2C%20species%20and%20functional%20annotations&author=J%20Muller&author=D%20Szklarczyk&author=P%20Julien&publication_year=2010&journal=Nucleic%20Acids%20Res&volume=38&pages=D190-5" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkp951" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkp951" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkp951"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19900971" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:eggNOG%20v2.0%3A%20extending%20the%20evolutionary%20genealogy%20of%20genes%20with%20enhanced%20non-supervised%20orthologous%20groups%2C%20species%20and%20functional%20annotations&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B11" class="js-splitview-ref-item" data-legacy-id="B11"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B11" href="javascript:;" aria-label="jumplink-B11" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B11" class="ref-content " data-id="B11"><span class="label title-label">11</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Penel</div> <div class="given-names">S</div></div> <div class="name"><div class="surname">Arigon</div> <div class="given-names">AM</div></div> <div class="name"><div class="surname">Dufayard</div> <div class="given-names">JF</div></div>et al. </span><div class="article-title">Databases of homologous gene families for comparative genomics</div>, <div class="source ">BMC Bioinformatics</div>, <div class="year">2009</div>, vol. <div class="volume">10</div> <div class="supplement">Suppl 6</div>pg. <div class="fpage">S3</div> <div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Databases%20of%20homologous%20gene%20families%20for%20comparative%20genomics&author=S%20Penel&author=AM%20Arigon&author=JF%20Dufayard&publication_year=2009&journal=BMC%20Bioinformatics&volume=10&pages=S3" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1186/1471-2105-10-S6-S3" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1186%2F1471-2105-10-S6-S3" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1186%2F1471-2105-10-S6-S3"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19534752" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Databases%20of%20homologous%20gene%20families%20for%20comparative%20genomics&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B12" class="js-splitview-ref-item" data-legacy-id="B12"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B12" href="javascript:;" aria-label="jumplink-B12" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B12" class="ref-content " data-id="B12"><span class="label title-label">12</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Ostlund</div> <div class="given-names">G</div></div> <div class="name"><div class="surname">Schmitt</div> <div class="given-names">T</div></div> <div class="name"><div class="surname">Forslund</div> <div class="given-names">K</div></div>et al. </span><div class="article-title">InParanoid 7: new algorithms and tools for eukaryotic orthology analysis</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2010</div>, vol. <div class="volume">38</div> (pg. <div class="fpage">D196</div>-<div class="lpage">203</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=InParanoid%207%3A%20new%20algorithms%20and%20tools%20for%20eukaryotic%20orthology%20analysis&author=G%20Ostlund&author=T%20Schmitt&author=K%20Forslund&publication_year=2010&journal=Nucleic%20Acids%20Res&volume=38&pages=D196-203" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkp931" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkp931" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkp931"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19892828" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:InParanoid%207%3A%20new%20algorithms%20and%20tools%20for%20eukaryotic%20orthology%20analysis&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B13" class="js-splitview-ref-item" data-legacy-id="B13"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B13" href="javascript:;" aria-label="jumplink-B13" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B13" class="ref-content " data-id="B13"><span class="label title-label">13</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Altenhoff</div> <div class="given-names">AM</div></div> <div class="name"><div class="surname">Schneider</div> <div class="given-names">A</div></div> <div class="name"><div class="surname">Gonnet</div> <div class="given-names">GH</div></div>et al. </span><div class="article-title">OMA 2011: orthology inference among 1000 complete genomes</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2011</div>, vol. <div class="volume">39</div> (pg. <div class="fpage">D289</div>-<div class="lpage">94</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=OMA%202011%3A%20orthology%20inference%20among%201000%20complete%20genomes&author=AM%20Altenhoff&author=A%20Schneider&author=GH%20Gonnet&publication_year=2011&journal=Nucleic%20Acids%20Res&volume=39&pages=D289-94" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkq1238" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkq1238" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkq1238"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/21113020" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:OMA%202011%3A%20orthology%20inference%20among%201000%20complete%20genomes&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B14" class="js-splitview-ref-item" data-legacy-id="B14"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B14" href="javascript:;" aria-label="jumplink-B14" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B14" class="ref-content " data-id="B14"><span class="label title-label">14</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Waterhouse</div> <div class="given-names">RM</div></div> <div class="name"><div class="surname">Zdobnov</div> <div class="given-names">EM</div></div> <div class="name"><div class="surname">Tegenfeldt</div> <div class="given-names">F</div></div>et al. </span><div class="article-title">OrthoDB: the hierarchical catalog of eukaryotic orthologs in 2011</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2011</div>, vol. <div class="volume">39</div> (pg. <div class="fpage">D283</div>-<div class="lpage">8</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=OrthoDB%3A%20the%20hierarchical%20catalog%20of%20eukaryotic%20orthologs%20in%202011&author=RM%20Waterhouse&author=EM%20Zdobnov&author=F%20Tegenfeldt&publication_year=2011&journal=Nucleic%20Acids%20Res&volume=39&pages=D283-8" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkq930" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkq930" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkq930"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/20972218" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:OrthoDB%3A%20the%20hierarchical%20catalog%20of%20eukaryotic%20orthologs%20in%202011&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B15" class="js-splitview-ref-item" data-legacy-id="B15"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B15" href="javascript:;" aria-label="jumplink-B15" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B15" class="ref-content " data-id="B15"><span class="label title-label">15</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Mi</div> <div class="given-names">H</div></div> <div class="name"><div class="surname">Dong</div> <div class="given-names">Q</div></div> <div class="name"><div class="surname">Muruganujan</div> <div class="given-names">A</div></div>et al. </span><div class="article-title">PANTHER version 7: improved phylogenetic trees, orthologs and collaboration with the Gene Ontology Consortium</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2010</div>, vol. <div class="volume">38</div> (pg. <div class="fpage">D204</div>-<div class="lpage">10</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=PANTHER%20version%207%3A%20improved%20phylogenetic%20trees%2C%20orthologs%20and%20collaboration%20with%20the%20Gene%20Ontology%20Consortium&author=H%20Mi&author=Q%20Dong&author=A%20Muruganujan&publication_year=2010&journal=Nucleic%20Acids%20Res&volume=38&pages=D204-10" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkp1019" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkp1019" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkp1019"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/20015972" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:PANTHER%20version%207%3A%20improved%20phylogenetic%20trees%2C%20orthologs%20and%20collaboration%20with%20the%20Gene%20Ontology%20Consortium&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B16" class="js-splitview-ref-item" data-legacy-id="B16"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B16" href="javascript:;" aria-label="jumplink-B16" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B16" class="ref-content " data-id="B16"><span class="label title-label">16</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Gasteiger</div> <div class="given-names">E</div></div> <div class="name"><div class="surname">Gattiker</div> <div class="given-names">A</div></div> <div class="name"><div class="surname">Hoogland</div> <div class="given-names">C</div></div>et al. </span><div class="article-title">ExPASy: The proteomics server for in-depth protein knowledge and analysis</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2003</div>, vol. <div class="volume">31</div> (pg. <div class="fpage">3784</div>-<div class="lpage">8</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=ExPASy%3A%20The%20proteomics%20server%20for%20in-depth%20protein%20knowledge%20and%20analysis&author=E%20Gasteiger&author=A%20Gattiker&author=C%20Hoogland&publication_year=2003&journal=Nucleic%20Acids%20Res&volume=31&pages=3784-8" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkg563" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkg563" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkg563"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/12824418" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:ExPASy%3A%20The%20proteomics%20server%20for%20in-depth%20protein%20knowledge%20and%20analysis&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B17" class="js-splitview-ref-item" data-legacy-id="B17"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B17" href="javascript:;" aria-label="jumplink-B17" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B17" class="ref-content " data-id="B17"><span class="label title-label">17</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Dereeper</div> <div class="given-names">A</div></div> <div class="name"><div class="surname">Guignon</div> <div class="given-names">V</div></div> <div class="name"><div class="surname">Blanc</div> <div class="given-names">G</div></div>et al. </span><div class="article-title">Phylogeny.fr: robust phylogenetic analysis for the non-specialist</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2008</div>, vol. <div class="volume">36</div> (pg. <div class="fpage">W465</div>-<div class="lpage">69</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Phylogeny.fr%3A%20robust%20phylogenetic%20analysis%20for%20the%20non-specialist&author=A%20Dereeper&author=V%20Guignon&author=G%20Blanc&publication_year=2008&journal=Nucleic%20Acids%20Res&volume=36&pages=W465-69" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkn180" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkn180" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkn180"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/18424797" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Phylogeny.fr%3A%20robust%20phylogenetic%20analysis%20for%20the%20non-specialist&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B18" class="js-splitview-ref-item" data-legacy-id="B18"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B18" href="javascript:;" aria-label="jumplink-B18" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B18" class="ref-content " data-id="B18"><span class="label title-label">18</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Edgar</div> <div class="given-names">RC</div></div></span><div class="article-title">MUSCLE: multiple sequence alignment with high accuracy and high throughput</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2004</div>, vol. <div class="volume">32</div> (pg. <div class="fpage">1792</div>-<div class="lpage">7</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=MUSCLE%3A%20multiple%20sequence%20alignment%20with%20high%20accuracy%20and%20high%20throughput&author=RC%20Edgar&publication_year=2004&journal=Nucleic%20Acids%20Res&volume=32&pages=1792-7" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkh340" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkh340" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkh340"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/15034147" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:MUSCLE%3A%20multiple%20sequence%20alignment%20with%20high%20accuracy%20and%20high%20throughput&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B19" class="js-splitview-ref-item" data-legacy-id="B19"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B19" href="javascript:;" aria-label="jumplink-B19" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B19" class="ref-content " data-id="B19"><span class="label title-label">19</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Do</div> <div class="given-names">CB</div></div> <div class="name"><div class="surname">Mahabhashyam</div> <div class="given-names">MS</div></div> <div class="name"><div class="surname">Brudno</div> <div class="given-names">M</div></div>et al. </span><div class="article-title">ProbCons: Probabilistic consistency-based multiple sequence alignment</div>, <div class="source ">Genome Res</div>, <div class="year">2005</div>, vol. <div class="volume">15</div> (pg. <div class="fpage">330</div>-<div class="lpage">40</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=ProbCons%3A%20Probabilistic%20consistency-based%20multiple%20sequence%20alignment&author=CB%20Do&author=MS%20Mahabhashyam&author=M%20Brudno&publication_year=2005&journal=Genome%20Res&volume=15&pages=330-40" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1101/gr.2821705" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1101%2Fgr.2821705" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1101%2Fgr.2821705"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/15687296" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:ProbCons%3A%20Probabilistic%20consistency-based%20multiple%20sequence%20alignment&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B20" class="js-splitview-ref-item" data-legacy-id="B20"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B20" href="javascript:;" aria-label="jumplink-B20" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B20" class="ref-content " data-id="B20"><span class="label title-label">20</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Guindon</div> <div class="given-names">S</div></div> <div class="name"><div class="surname">Dufayard</div> <div class="given-names">JF</div></div> <div class="name"><div class="surname">Lefort</div> <div class="given-names">V</div></div>et al. </span><div class="article-title">New algorithms and methods to estimate maximum-likelihood phylogenies: assessing the performance of PhyML 3.0</div>, <div class="source ">Syst Biol</div>, <div class="year">2010</div>, vol. <div class="volume">59</div> (pg. <div class="fpage">307</div>-<div class="lpage">21</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=New%20algorithms%20and%20methods%20to%20estimate%20maximum-likelihood%20phylogenies%3A%20assessing%20the%20performance%20of%20PhyML%203.0&author=S%20Guindon&author=JF%20Dufayard&author=V%20Lefort&publication_year=2010&journal=Syst%20Biol&volume=59&pages=307-21" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/sysbio/syq010" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fsysbio%2Fsyq010" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fsysbio%2Fsyq010"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/20525638" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:New%20algorithms%20and%20methods%20to%20estimate%20maximum-likelihood%20phylogenies%3A%20assessing%20the%20performance%20of%20PhyML%203.0&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B21" class="js-splitview-ref-item" data-legacy-id="B21"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B21" href="javascript:;" aria-label="jumplink-B21" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B21" class="ref-content " data-id="B21"><span class="label title-label">21</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Jones</div> <div class="given-names">DT</div></div> <div class="name"><div class="surname">Taylor</div> <div class="given-names">WR</div></div> <div class="name"><div class="surname">Thornton</div> <div class="given-names">JM</div></div></span><div class="article-title">The rapid generation of mutation data matrices from protein sequences</div>, <div class="source ">Comput Appl Biosci</div>, <div class="year">1992</div>, vol. <div class="volume">8</div> (pg. <div class="fpage">275</div>-<div class="lpage">82</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=The%20rapid%20generation%20of%20mutation%20data%20matrices%20from%20protein%20sequences&author=DT%20Jones&author=WR%20Taylor&author=JM%20Thornton&publication_year=1992&journal=Comput%20Appl%20Biosci&volume=8&pages=275-82" target="_blank">Google Scholar</a></span></p><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/1633570" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><div class="xslopenurl empty-target"><span class="js-inst-open-url-holders-nodoi"><a class="js-open-url-link" data-href-template="{targetURL}?sid=oup:orr&genre=article&atitle=The+rapid+generation+of+mutation+data+matrices+from+protein+sequences&aulast=Jones&title=Comput+Appl+Biosci&date=1992&spage=275&epage=82&volume=8" href="javascript:;"><span class="screenreader-text">OpenURL Placeholder Text</span></a></span></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:The%20rapid%20generation%20of%20mutation%20data%20matrices%20from%20protein%20sequences&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B22" class="js-splitview-ref-item" data-legacy-id="B22"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B22" href="javascript:;" aria-label="jumplink-B22" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B22" class="ref-content " data-id="B22"><span class="label title-label">22</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Whelan</div> <div class="given-names">S</div></div> <div class="name"><div class="surname">Goldman</div> <div class="given-names">N</div></div></span><div class="article-title">A general empirical model of protein evolution derived from multiple protein families using a maximum-likelihood approach</div>, <div class="source ">Mol Biol Evol</div>, <div class="year">2001</div>, vol. <div class="volume">18</div> (pg. <div class="fpage">691</div>-<div class="lpage">9</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=A%20general%20empirical%20model%20of%20protein%20evolution%20derived%20from%20multiple%20protein%20families%20using%20a%20maximum-likelihood%20approach&author=S%20Whelan&author=N%20Goldman&publication_year=2001&journal=Mol%20Biol%20Evol&volume=18&pages=691-9" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/oxfordjournals.molbev.a003851" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Foxfordjournals.molbev.a003851" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Foxfordjournals.molbev.a003851"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/11319253" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:A%20general%20empirical%20model%20of%20protein%20evolution%20derived%20from%20multiple%20protein%20families%20using%20a%20maximum-likelihood%20approach&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B23" class="js-splitview-ref-item" data-legacy-id="B23"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B23" href="javascript:;" aria-label="jumplink-B23" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B23" class="ref-content " data-id="B23"><span class="label title-label">23</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Anisimova</div> <div class="given-names">M</div></div> <div class="name"><div class="surname">Gascuel</div> <div class="given-names">O</div></div></span><div class="article-title">Approximate likelihood-ratio test for branches: a fast, accurate, and powerful alternative</div>, <div class="source ">Syst Biol</div>, <div class="year">2006</div>, vol. <div class="volume">55</div> (pg. <div class="fpage">539</div>-<div class="lpage">52</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Approximate%20likelihood-ratio%20test%20for%20branches%3A%20a%20fast%2C%20accurate%2C%20and%20powerful%20alternative&author=M%20Anisimova&author=O%20Gascuel&publication_year=2006&journal=Syst%20Biol&volume=55&pages=539-52" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1080/10635150600755453" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1080%2F10635150600755453" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1080%2F10635150600755453"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/16785212" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Approximate%20likelihood-ratio%20test%20for%20branches%3A%20a%20fast%2C%20accurate%2C%20and%20powerful%20alternative&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B24" class="js-splitview-ref-item" data-legacy-id="B24"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B24" href="javascript:;" aria-label="jumplink-B24" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B24" class="ref-content " data-id="B24"><span class="label title-label">24</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Ronquist</div> <div class="given-names">F</div></div> <div class="name"><div class="surname">Huelsenbeck</div> <div class="given-names">JP</div></div></span><div class="article-title">MrBayes 3: Bayesian phylogenetic inference under mixed models</div>, <div class="source ">Bioinformatics</div>, <div class="year">2003</div>, vol. <div class="volume">19</div> (pg. <div class="fpage">1572</div>-<div class="lpage">4</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=MrBayes%203%3A%20Bayesian%20phylogenetic%20inference%20under%20mixed%20models&author=F%20Ronquist&author=JP%20Huelsenbeck&publication_year=2003&journal=Bioinformatics&volume=19&pages=1572-4" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/bioinformatics/btg180" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fbioinformatics%2Fbtg180" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fbioinformatics%2Fbtg180"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/12912839" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:MrBayes%203%3A%20Bayesian%20phylogenetic%20inference%20under%20mixed%20models&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B25" class="js-splitview-ref-item" data-legacy-id="B25"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B25" href="javascript:;" aria-label="jumplink-B25" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B25" class="ref-content " data-id="B25"><span class="label title-label">25</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Gascuel</div> <div class="given-names">O</div></div></span><div class="article-title">BIONJ: an improved version of the NJ algorithm based on a simple model of sequence data</div>, <div class="source ">Mol Biol Evol</div>, <div class="year">1997</div>, vol. <div class="volume">14</div> (pg. <div class="fpage">685</div>-<div class="lpage">95</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=BIONJ%3A%20an%20improved%20version%20of%20the%20NJ%20algorithm%20based%20on%20a%20simple%20model%20of%20sequence%20data&author=O%20Gascuel&publication_year=1997&journal=Mol%20Biol%20Evol&volume=14&pages=685-95" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/oxfordjournals.molbev.a025808" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Foxfordjournals.molbev.a025808" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Foxfordjournals.molbev.a025808"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/9254330" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:BIONJ%3A%20an%20improved%20version%20of%20the%20NJ%20algorithm%20based%20on%20a%20simple%20model%20of%20sequence%20data&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B26" class="js-splitview-ref-item" data-legacy-id="B26"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B26" href="javascript:;" aria-label="jumplink-B26" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B26" class="ref-content " data-id="B26"><span class="label title-label">26</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Schmidt</div> <div class="given-names">HA</div></div> <div class="name"><div class="surname">von Haeseler</div> <div class="given-names">A</div></div></span><div class="article-title">Maximum-likelihood analysis using TREE-PUZZLE</div>, <div class="source ">Curr Protoc Bioinformatics</div>, <div class="year">2007</div> <div class="comment">Chapter 6:Unit 6 6</div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Maximum-likelihood%20analysis%20using%20TREE-PUZZLE&author=HA%20Schmidt&author=A%20von%20Haeseler&publication_year=2007&journal=Curr%20Protoc%20Bioinformatics&volume=&pages=" target="_blank">Google Scholar</a></span></p><div class="xslopenurl empty-target"><span class="js-inst-open-url-holders-nodoi"><a class="js-open-url-link" data-href-template="{targetURL}?sid=oup:orr&genre=article&atitle=Maximum-likelihood+analysis+using+TREE-PUZZLE&aulast=Schmidt&title=Curr+Protoc+Bioinformatics&date=2007" href="javascript:;"><span class="screenreader-text">OpenURL Placeholder Text</span></a></span></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Maximum-likelihood%20analysis%20using%20TREE-PUZZLE&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B27" class="js-splitview-ref-item" data-legacy-id="B27"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B27" href="javascript:;" aria-label="jumplink-B27" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B27" class="ref-content " data-id="B27"><span class="label title-label">27</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">van der Heijden</div> <div class="given-names">RT</div></div> <div class="name"><div class="surname">Snel</div> <div class="given-names">B</div></div> <div class="name"><div class="surname">van Noort</div> <div class="given-names">V</div></div>et al. </span><div class="article-title">Orthology prediction at scalable resolution by phylogenetic tree analysis</div>, <div class="source ">BMC Bioinformatics</div>, <div class="year">2007</div>, vol. <div class="volume">8</div> pg. <div class="fpage">83</div> <div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Orthology%20prediction%20at%20scalable%20resolution%20by%20phylogenetic%20tree%20analysis&author=RT%20van%20der%20Heijden&author=B%20Snel&author=V%20van%20Noort&publication_year=2007&journal=BMC%20Bioinformatics&volume=8&pages=83" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1186/1471-2105-8-83" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1186%2F1471-2105-8-83" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1186%2F1471-2105-8-83"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/17346331" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Orthology%20prediction%20at%20scalable%20resolution%20by%20phylogenetic%20tree%20analysis&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B28" class="js-splitview-ref-item" data-legacy-id="B28"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B28" href="javascript:;" aria-label="jumplink-B28" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B28" class="ref-content " data-id="B28"><span class="label title-label">28</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Galtier</div> <div class="given-names">N</div></div> <div class="name"><div class="surname">Daubin</div> <div class="given-names">V</div></div></span><div class="article-title">Dealing with incongruence in phylogenomic analyses</div>, <div class="source ">Philos Trans R Soc Lond B Biol Sci</div>, <div class="year">2008</div>, vol. <div class="volume">363</div> (pg. <div class="fpage">4023</div>-<div class="lpage">9</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Dealing%20with%20incongruence%20in%20phylogenomic%20analyses&author=N%20Galtier&author=V%20Daubin&publication_year=2008&journal=Philos%20Trans%20R%20Soc%20Lond%20B%20Biol%20Sci&volume=363&pages=4023-9" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1098/rstb.2008.0144" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1098%2Frstb.2008.0144" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1098%2Frstb.2008.0144"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/18852109" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Dealing%20with%20incongruence%20in%20phylogenomic%20analyses&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B29" class="js-splitview-ref-item" data-legacy-id="B29"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B29" href="javascript:;" aria-label="jumplink-B29" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B29" class="ref-content " data-id="B29"><span class="label title-label">29</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Chen</div> <div class="given-names">JM</div></div> <div class="name"><div class="surname">Cooper</div> <div class="given-names">DN</div></div> <div class="name"><div class="surname">Chuzhanova</div> <div class="given-names">N</div></div>et al. </span><div class="article-title">Gene conversion: mechanisms, evolution and human disease</div>, <div class="source ">Nat Rev Genet</div>, <div class="year">2007</div>, vol. <div class="volume">8</div> (pg. <div class="fpage">762</div>-<div class="lpage">75</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Gene%20conversion%3A%20mechanisms%2C%20evolution%20and%20human%20disease&author=JM%20Chen&author=DN%20Cooper&author=N%20Chuzhanova&publication_year=2007&journal=Nat%20Rev%20Genet&volume=8&pages=762-75" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1038/nrg2193" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1038%2Fnrg2193" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1038%2Fnrg2193"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/17846636" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Gene%20conversion%3A%20mechanisms%2C%20evolution%20and%20human%20disease&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B30" class="js-splitview-ref-item" data-legacy-id="B30"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B30" href="javascript:;" aria-label="jumplink-B30" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B30" class="ref-content " data-id="B30"><span class="label title-label">30</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Duret</div> <div class="given-names">L</div></div> <div class="name"><div class="surname">Galtier</div> <div class="given-names">N</div></div></span><div class="article-title">Biased gene conversion and the evolution of mammalian genomic landscapes</div>, <div class="source ">Annu Rev Genomics Hum Genet</div>, <div class="year">2009</div>, vol. <div class="volume">10</div> (pg. <div class="fpage">285</div>-<div class="lpage">311</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Biased%20gene%20conversion%20and%20the%20evolution%20of%20mammalian%20genomic%20landscapes&author=L%20Duret&author=N%20Galtier&publication_year=2009&journal=Annu%20Rev%20Genomics%20Hum%20Genet&volume=10&pages=285-311" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1146/annurev-genom-082908-150001" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1146%2Fannurev-genom-082908-150001" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1146%2Fannurev-genom-082908-150001"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19630562" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Biased%20gene%20conversion%20and%20the%20evolution%20of%20mammalian%20genomic%20landscapes&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B31" class="js-splitview-ref-item" data-legacy-id="B31"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B31" href="javascript:;" aria-label="jumplink-B31" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B31" class="ref-content " data-id="B31"><span class="label title-label">31</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Dessimoz</div> <div class="given-names">C</div></div> <div class="name"><div class="surname">Boeckmann</div> <div class="given-names">B</div></div> <div class="name"><div class="surname">Roth</div> <div class="given-names">AC</div></div>et al. </span><div class="article-title">Detecting non-orthology in the COGs database and other approaches grouping orthologs using genome-specific best hits</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2006</div>, vol. <div class="volume">34</div> (pg. <div class="fpage">3309</div>-<div class="lpage">16</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Detecting%20non-orthology%20in%20the%20COGs%20database%20and%20other%20approaches%20grouping%20orthologs%20using%20genome-specific%20best%20hits&author=C%20Dessimoz&author=B%20Boeckmann&author=AC%20Roth&publication_year=2006&journal=Nucleic%20Acids%20Res&volume=34&pages=3309-16" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkl433" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkl433" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkl433"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/16835308" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Detecting%20non-orthology%20in%20the%20COGs%20database%20and%20other%20approaches%20grouping%20orthologs%20using%20genome-specific%20best%20hits&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B32" class="js-splitview-ref-item" data-legacy-id="B32"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B32" href="javascript:;" aria-label="jumplink-B32" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B32" class="ref-content " data-id="B32"><span class="label title-label">32</span><div class="citation element-citation"><span class="person-group"><div class="name"><div class="surname">Robinson</div> <div class="given-names">DF</div></div> <div class="name"><div class="surname">Foulds</div> <div class="given-names">LR</div></div></span><div class="article-title">Comparison of phylogenetic trees</div>, <div class="source ">Math Biosci</div>, <div class="year">1981</div>, vol. <div class="volume">53</div> (pg. <div class="fpage">131</div>-<div class="lpage">47</div>)<div class="citation-links"></div><div class="citation-links"><p class="citation-links-compatibility"><span class="google-scholar-ref-link"><a class="openInAnotherWindow" href="https://scholar.google.com/scholar_lookup?title=Comparison%20of%20phylogenetic%20trees&author=DF%20Robinson&author=LR%20Foulds&publication_year=1981&journal=Math%20Biosci&volume=53&pages=131-47" target="_blank">Google Scholar</a></span></p><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1016/0025-5564(81)90043-2" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1016%2F0025-5564(81)90043-2" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1016%2F0025-5564(81)90043-2"> </span></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:Comparison%20of%20phylogenetic%20trees&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div><div content-id="B33" class="js-splitview-ref-item" data-legacy-id="B33"><div class="refLink-parent"><span class="refLink"><a name="jumplink-B33" href="javascript:;" aria-label="jumplink-B33" data-id=""></a></span></div><div class="ref false"><div id="ref-auto-B33" class="ref-content " data-id="B33"><span class="label title-label">33</span><div class="citation element-citation"><div class="article-title">The Universal Protein Resource (UniProt) in 2010</div>, <div class="source ">Nucleic Acids Res</div>, <div class="year">2010</div>, vol. <div class="volume">38</div> (pg. <div class="fpage">D142</div>-<div class="lpage">48</div>)<div class="citation-links"></div><div class="citation-links"><div class="crossref-doi js-ref-link"><a class="openInAnotherWindow" href="http://dx.doi.org/10.1093/nar/gkp846" target="_blank">Crossref</a></div><div class="adsDoiReference hide"><a class="openInAnotherWindow" href="http://adsabs.harvard.edu/cgi-bin/basic_connect?qsearch=10.1093%2Fnar%2Fgkp846" target="_blank">Search ADS</a></div><div class="xslopenurl empty-target"><span class="inst-open-url-holders" data-targetId="10.1093%2Fnar%2Fgkp846"> </span></div><div class="pub-id"><a href="http://www.ncbi.nlm.nih.gov/pubmed/19843607" class="link link-pub-id openInAnotherWindow" target="_blank">PubMed</a></div><p class="citation-links-compatibility"><span class="worldcat-reference-ref-link js-worldcat-preview-ref-link" style="display:none"><a class="openInAnotherWindow" href="https://www.worldcat.org/search?q=ti:The%20Universal%20Protein%20Resource%20%28UniProt%29%20in%202010&qt=advanced&dblist=638" target="_blank">WorldCat</a></span></p> </div></div></div></div></div></div>  <div class="widget widget-ArticlePubStateInfo widget-instance-OUP_ArticlePubStateInfo"> </div> <div class="article-metadata-standalone-panel clearfix"></div> <div class="copyright copyright-statement">© The Author(s) 2011. Published by Oxford University Press.</div><div class="license"><div class="license-p">This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.</div></div> <span id="UserHasAccess" data-userHasAccess="True"></span> </div> </div> </div> <div class="widget widget-SolrResourceMetadata widget-instance-OUP_Article_ResourceMetadata_Widget"> <div class="article-metadata-panel solr-resource-metadata js-metadata-panel at-ContentMetadata"> <div class="article-metadata-tocSections"> <div class="article-metadata-tocSections-title">Issue Section:</div> <a href="/bib/search-results?f_TocHeadingTitleList=Special+Issue+Papers">Special Issue Papers</a> </div> </div> </div> <div class="widget widget-EditorInformation widget-instance-OUP_Article_EditorInformation_Widget"> </div> <div id="ContentTabFilteredView"></div> <div class="downloadImagesppt js-download-images-ppt st-download-images-ppt"> <a id="lnkDownloadAllImages" class="js-download-all-images-link btn" href="/DownloadFile/DownloadImage.aspx?image=&PPTtype=SlideSet&ar=270085&xsltPath=~/UI/app/XSLT&siteId=5143">Download all slides</a> </div> <div class="widget widget-ArticleDataSupplements widget-instance-OUP_Data_Supplements_Tab"> <a name="SupplementalTab" id="SupplementalTab"></a> <li class="section-jump-link head-1 dataSupplements-jumplink"> <div class="section-jump-link__link-wrap"> <a class="jumplink js-jumplink scrollTo" href="#supplementary-data">Supplementary data</a> </div> </li> <h2 scrollto-destination="supplementary-data" id="supplementary-data" class="section-title">Supplementary data</h2> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Text_S5.doc?Expires=1735504119&Signature=KWOfwRgwy5Va~d~4w182KVkDntnXg6uGtSBA4h~z1gQ8hZre7p-VNy90MFWZUG5BfEPp~Oa0ASjW7ECf0KtMEZYZOR2Lvu5VvHFpNu2uyFRigCoO7RqwcW4N3vDfcJ0wdaLxEugw0Mpq-TE9t3G~5PKAOmfP6kI3vCoxUC0mjhzCor8KkR6ubFz-9iNgiLOUya13KdIb44kb0yKLBHiIo-XZXI4f1HSMOJ8GJH4zuuEmTYh8Sv9NGb3q6BF8H5btrM058fUzSKXBDKq31-b2nJNCqtIiXRLlzYTx8VgQtC2ES08KtUkZOyBF8QfSxF2PCN2LzORXatbLj1QwIvfP~A__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-15</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Text_S4.doc?Expires=1735504119&Signature=rdRxoNKiIFgbuzB75hKdP2X4MTeI-z863xOFU4gi8goMgLqyStV3ihpnyIFDjMSMAb7nKHFHSiRsRmeimGCSHj-14y7inabihhPcCKxGFbSEFlHPsPL~D~eTlj8MoetychaRRdbZiDGkoj7e1qZUuo532Chr7lOwuGj5EnhSBR4h9Gmfn5G7USneE4hqckxXMbAIc5lj3QjObpiQ54acpgzzp2idsEJGnHUKUb95XVGKeYM52ZCYGGkjKRxbYkfEhng2KyDN2NC-t4k6r2eblnGj4mTyipvSUJWmtg5O7tOXPZwH4M9DiJThVc5gJy6Runu6yWCdky26u-6kRMNYMQ__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-14</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Text_S3.doc?Expires=1735504119&Signature=KK44JXdxtcH6LvkqwQY-hcq-Evm-fIUUEW2DG5hAMdP2j8ZAXA9lu0ShWtZSiqRu2eoPSivfcX2oA-zQCIgdwLpYxyAxCMMl4TwRxouWho6DRIyke~czYkMZSOMAK5-KIE7PCsdjVw9A4oQNq-tq5mLWPZHkiOAm4mcCU1FoebB0cVVOjNOMTE1AzJIPh0sq8clCW23yTq53WeFhKYS2kVG1wCmkPXPcJjSg2Ih8zWKkuBCQJINebaNvYBHKT3~nbOqhzewmnr7gPvQWQyusMFV~JPNs9fyPhk-CObJMOXjmv250SZzvBzH-~CrZZvwEMIWhoZj84IdxX00jpftTDw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-13</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Text_S2.doc?Expires=1735504119&Signature=4iXwe1HsToE6-5zJS-xOywAQy4E3M9Atn-A0qaEj8X~q4wHnzvEFsinIZcCos9WW6uphGJnJjRbXHYNhRjTab4UbSW1LsR5c-YPI~K5P-JgKuV~ct7v8p794cLv0PjDiEqeuUD~7ZbV1MAXp~Bcr0DU3sEeWRCquhR6EEP4Zhq2A-MTricRsU2t6X3U0wVHpZNc7y0TDgbqBph3vfcqm0uMXVOjD27O9vm663Pll9~Qt6t-GqkxJP4cckLDev1FwuaNu-vGalrPVE-rBV8s4dcKcgUIpOUrAziBhM2NlCAlRSAddHJ2aQ4qm53i703agy7rhyfTpjloQIqPY44s3FQ__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-12</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Text_S1.doc?Expires=1735504119&Signature=Mo8Xn4ZQqh2Q739u-AOSBDFkZLQmMhLWPt4oyN152SQhObcTE-J1Pkc2IM-nopKX8SRQdV3prF7sJPulGMUGgZkxvpXU9nrg7b93s~3C8TnefyzMYbtDUWrm5rGzJUpfW~khA9GK0t4Cjusht2ST0qmqxAY2iafEglyjMESF~PRoybX1zNOgEhfMoPyPbO~CaMB4WYXq56MzTyPJrIHPrgxBOyA0fk59kd4GtgkcXWP2sPa7JKY5utv~Fu6zy~aOs2v0SaAB-Ys5J25~dcqPlFErasXUWz3k8l~-3oR4o3PzKLAmJ0Jq6nBKmRrORHfnxLgCBwGg647vhKcwsnlLkQ__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-11</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Table_S1.doc?Expires=1735504119&Signature=ryQrI3lhP16CzZLHOTdccehSzmbdTeOFCFDnQfCWQ-c5VTRuLzq3F5jSKwfRRvTIpCcZcu0hlGi6K53pW2H45LByLNMqbBQOKI4tgp3sQ4TrLYL2oDQUBJvtt2Y3FsGrS5AUI7KoL9BEbtWhRmQhF-Zj0tS47eiZAZkQSnkE83vpQbmFhDSzcX8HHo2Zipw206Xk-wd~2-m12tO2u~L5yW5X86Jd2gIQJeTXC8EtTxavu6PlXRgecxMZEPV2S-Ba8UmYlU1FGbLAbHCsu2gEky0~Lja~1KFB85lus8OIcBiXyAkZrvfiuat3h0eBX4uBapNfPmECS~BATQqXN6Nqrw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-10</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Figure_S6.doc?Expires=1735504119&Signature=xO~2VPY191lWe5RLm2oa9H029anb1E3Xyts0adppxc8bgORd8t8CcWPTnDJhTbbT1ccPFpAEc~lDr3YcC3dKUs2nllGVYajeNMjAQTjE867rZxQ8q-54ey6uBkoHQb2ZNweoDy4tQYMEObZXk9yqO1QVFhgU3dL9uCCEWE6vpM2sZse-vpWKZQDZbCm6oaQ5BJOiWkrAuc6jC1vyE8HQiau2ffOwS9wrIfoZAaG1vwBUnXVAtj2TvSrcnYOY9exTWni6tJs2p4CLGHtVEDaqU56pDoMedXmQIj8xXPGGzYCxxGB1CB6RCR2pbpeqIu11lFKJPGZmmb5jnCMYad-QXw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-9</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Figure_S5.doc?Expires=1735504119&Signature=OeeLgg5Z3gL3QEixkMVH6a2XHZlTC4uc-g7xm4fpuOokv7GvYv67760fcI42tSqFdJ81tl17zi6EMZ2NF63qIzkWT~w3hPKRXi-Kc~1G6VpONsQngTva6T3X7K0-8Z83Vpc6yyBQYpmw~p2ooLBySm1eILwam2A147bl3n-Lt6ersr5tlujaQxhGqJGEJBe5DWEMMki1X6A3rRou-01wJHI-GVpizuh42fI-MR~7EPnoiBebd4xJjM6VdV5rGqw~540HXByXp14Y0PFxonv2InK7u4WkgaODPDn3TSD6TGDPImw6enJh-b10AQ9-48dKS-wEMhY4N-X3ra549ekLJQ__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-8</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Figure_S4.doc?Expires=1735504119&Signature=vB8oYa3efSBM9KXQTFvp23SnCAbLKTvsdOMYf3rwCI4ixrpObYj6KHY8Txc2VLw4-1CFRJ2YOX0qIAkpY7hiEt-viNCySDll2YiSoPYtFWGLo02JcXPkbDVWRdY57asPLvo~S5PvwmymutRqQj0lltzPnv6JlGoUfq7GQeKtsi4dx~xdv~fyVdLO0JfXtuNGeFsCXT9BA0CFz4~HqA4hHRZhIs99WvmqDHo2CvjKG9KDPWfj3hDo5RpOKul2SgWcWAllQHWlGX8MDMYvvVsAY7pUjvAuHnJB-AttNN6w0h3iPI3CgvxhnPILNx1nuVs4UzFX2dDLECulSIIEts8YPA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-7</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Figure_S3_revised-2.doc?Expires=1735504119&Signature=aAMdUxIJMvBsLX4U9weDuZJFmKwhPQKvFk2Nn0fOOzE9mQQKQcwNIDmfauf6COAD2S51m1-d69AtD6OyBe5HynjrF7LTmMu8hJH1shSdug~eGZjQhX5Li0-UsLMnxiPxhAgfLPOo-T3ndWBEJuSzMakLQtlUtbWmzSCjn98hBUVHneTv~Pb18R7PzbvJDOKaJyIGM-7bFADHReTzJ~XlaR9To2FDhziOYYoos4HlcIJMZmN4yTz~D-dYSMGTb3ZLlAc5fJpnC-fXrxnoc-wxm7kB7wneKJDOICAwMQTQOZWu~Arq7dc7dziRp6ne6ksXwIsW4FZU81Du-IlIAk0Anw__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-6</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Figure_S2_revised-2.doc?Expires=1735504119&Signature=dR~Mn5jWEq73newy4sQo4oxa9bV1uE7q0TDKgfRzZcmOZyeFnyMVBns3qClzguNVU7vafZ4AiaQAFSa0x1TGF2FvFdieSkpW5cJV2awgBEBAEEYIIZINtiNLEQ2WnM7a~hzrQBK8E2BLUEDAeh3FPsM-gPpiYNg5hyH-h7iqjn7xgG3QS7uOYFX9XCobCKJeIyU7~SsrwcQphqslmSIJanNelYpoIp2wMyodolVNdY-AGTO1NAo5NqXqowwgrUtzInu~UsXAlfsEV1DIf2ZzihuZwnhP~RNj3z023X0TPBtb5hU0RGLBL8VDxyZ20vvcIi4NSEoVTo-Qg5CLjHKwCA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-5</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Figure_S1_revised-2.doc?Expires=1735504119&Signature=V598AYBKzwxrFYhnkaDkrGp0qDAPnrnHP5TUOeNxuf~2v6AB8d2RGxPepCWPUgL5TVsEV1WP4j7LpJk1UceV8fArMY6NA-GKK1CiBFMwetuJqedKH9tf3tN0whc3-YMw7WvMGDvup3wrZZhMEyJA4L~r4gmm6aiekUBHOtWjy9XMVebUXoz4QpcRN~IWBDK9n7hqSFqb9dKPtQlsNHsUlytPp0gTKbuZB~ZgcvgsytZs8aZsPFr9I1IMj33qbTvuMlanejb1ZYhP0sHaGtdBeQMEqNHwXM3MHwdrYwPU5VQO97HY6Izgil0YkoxrQkAoWjKn4ancnG0PhPk3xw20UA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-4</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Dataset_S3.doc?Expires=1735504119&Signature=g8z3USh0oQQMbFH~roiY4w7wr8yhdzStkI1Dnqw15Gcb2L6ykcAyKZg7e2LGlSVj4Y4cuxdgpj1tewwShHkDhl86EGKqDJuVFAZua1pPIN8sfqs3umCKWRxTo1DNQzo9uPbwW9IQREig4m1MUXuqjl1UeWQkTO42aDCpPXeL5hBMsr~TuHMVds3g0xBjSfIPGeGuHjg5M9aqyt7aBIqPJiAuN0a3Kz3OzobbFbOpu4sf0s2uESNDn2mUHxJTQYJciT3JK3zPZ3jNEtkTrnBwWYPbRrvN4LhEvUvr0GcaIdJhP9YmHgmbqUPyusdxIGtmBeqdTXFxkLQQJd7QW845FA__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-3</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Dataset_S2.doc?Expires=1735504119&Signature=PxgN8HZZdrsWKlU6MOP6t2rEnpcAnIaWYQCGA5pkNX~VKc6AxcG-x~N~vJ2lesP5mOAydt4wDYhXIyGXukJl8udz8hA4omJa1WNTSg1bnL8ETJvaFhrkvznF5pldLCR3axZDBInGNpSCOg9eu2bws~5eqfUHSdMFFAZvllYJtzzp3Xq1GdVnNkH3fySfqk-0yjnvupbbq02X4tWsZHqlpW29NQfu6EWN3m72DqH-x1Oblx6fXvn~wC1WHdwkQrTARIHFR8L8hMs1UAG66TqFDHLDLciz7h9nwlRr~Ncz4PD7Zyh3x0QPlM~C5f7GUxt2dplBCJ2oM9fbhUDQbqLFmg__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-2</a> - doc file</div> <div class="dataSuppLink"><a href="https://oup.silverchair-cdn.com/oup/backfile/Content_public/Journal/bib/12/5/10.1093/bib/bbr034/2/bbr034-Dataset_S1.doc?Expires=1735504119&Signature=ZLWpBAd8-SHamATYXE95QMtg7FZ619cEKqcuREcgssBcl6Nr1em2I5LMdu~YKn-4TY2JEIolq8ayHlhfxdaYH2rrwgqb5bXj22-gK4-ZtgrymJimlYMDnH4IcUBcYqUs4vjxAVTKBBxpMCRa5S5J~cwUQ6~3KDsmrdJDgVLV67mwJ-eBbj0K-~aKkkHtPyn54bZJ6ieTeBQadYuVF0XqeF8neFMxJzc54EEVeijgC93e7rbwAzvC4ccNJ30hGr5x1LodysTvvJVYPrmvl3jGLvZ-wCg08VxKNgFfB4-SxGazWSGYWSOqaGAQzm6ix0XC61xTyWh~4zfRRG8J~y~o3w__&Key-Pair-Id=APKAIE5G5CRDK6RD3PGA">AddSuppFiles-1</a> - doc file</div> </div> <div class="widget widget-ArticleDataRepositories widget-instance-Article_DryadLink"> </div> <div class="comments"> <div class="widget widget-UserCommentBody widget-instance-UserCommentBody_Article"> </div> <div class="widget widget-UserComment widget-instance-OUP_UserComment_Article"> </div> </div> </div> </div> </div> </div> <div id="Sidebar" class="page-column page-column--right"> <div class="widget widget-AdBlock widget-instance-ArticlePageTopSidebar"> <div class="js-adBlock-parent-wrap adblock-parent-wrap"> <div class="adBlockMainBodyTop-wrap js-adBlockMainBodyTop hide"> <div id="adBlockMainBodyTop" class="js-adblock at-adblock" data-lazy-load-margin="150"> <script> googletag.cmd.push(function () { googletag.display('adBlockMainBodyTop'); }); </script> </div> <div class="advertisement-text at-adblock js-adblock-advertisement-text hide">Advertisement</div> </div> </div> </div> <div class="widget widget-dynamic " data-count="1"> <div class="widget-dynamic-inner-wrap"> <div class="widget widget-dynamic " data-count="8"> <div class="widget-dynamic-inner-wrap"> <div class="widget widget-ArticleLevelMetrics widget-instance-Article_RightRailB0Article_RightRail_ArticleLevelMetrics"> <div class="artmet-wrapper horizontal-artmet"> <div class="contentmet-border"> <div class="contentmet-wrapper horizontal-contentmet"> <div class="contentmet-citations contentmet-badges-wrap js-contentmet-citations hide"> <h3 class="contentmet-text">Citations</h3> <div class="contentmet-item contentmet-dimensions"> <div class="widget widget-DimensionsBadge widget-instance-ArticleLevelMetrics_DimensionsBadge"> <span class="__dimensions_badge_embed__" data-doi="10.1093/bib/bbr034" data-legend="never" data-style="small_circle" data-hide-zero-citations="false"></span> <script async src="https://badge.dimensions.ai/badge.js" charset="utf-8"></script> </div> </div> </div> <div class="contentmet-views contentmet-badges-wrap js-contentmet-views"> <h3 class="contentmet-text">Views</h3> <div class="contentmet-item circle-text circle-text-views"> <div class="contentmet-number">1,582</div> </div> </div> <div class="contentmet-item contentmet-badges-wrap"> <h3 class="contentmet-text">Altmetric</h3> <div class="contentmet-item contentmet-altmetric"> <div class="widget widget-AltmetricLink widget-instance-ArticleLevelMetrics_AltmetricLinkSummary">  <div id="altmetricEmbedId" runat="server" class='altmetric-embed' data-badge-type="donut" data-hide-no-mentions="false" data-doi="10.1093/bib/bbr034" ></div> <script type='text/javascript' src='https://d1bxh8uas1mnw7.cloudfront.net/assets/embed.js'></script> </div> </div> </div> <div class="contentmet-modal-trigger-wrap clearfix"> <a href="javascript:;" class="artmet-modal-trigger js-artmet-modal-trigger at-alm-metrics-modal-trigger" data-resource-id="270085" data-resource-type="3"> <img class="contentmet-info-icon" src="//oup.silverchair-cdn.com/UI/app/svg/i.svg" alt="Information"> <span class="contentmet-more-info">More metrics information</span> </a> </div> </div> </div> <div class="artmet-modal js-artmet-modal" id="MetricsModal"> <div class="artmet-modal-contents js-metric-modal-contents at-alm-modal-contents"> <div class="artmet-full-wrap clearfix js-metric-full-wrap hide"> <div class="widget-title-1 artmet-widget-title-1">Metrics</div> <div class="artmet-item artmet-views-wrap"> <div class="artmet-views clearfix"> <div class="artmet-total-views"> <span class="artmet-text">Total Views</span> <span class="artmet-number">1,582</span> </div> <div class="artmet-breakdown-views-wrap"> <div class="artmet-breakdown-view breakdown-border"> <span class="artmet-number">1,187</span> <span class="artmet-text">Pageviews</span> </div> <div class="artmet-breakdown-view"> <span class="artmet-number">395</span> <span class="artmet-text">PDF Downloads</span> </div> </div> </div> <div class="artmet-views-since">Since 12/1/2016</div> </div> <script> var ChartistData = ChartistData || {}; ChartistData.data = { labels: ['Dec 2016', 'Jan 2017', 'Feb 2017', 'Mar 2017', 'Apr 2017', 'May 2017', 'Jun 2017', 'Jul 2017', 'Aug 2017', 'Sep 2017', 'Oct 2017', 'Dec 2017', 'Jan 2018', 'Feb 2018', 'Mar 2018', 'Apr 2018', 'May 2018', 'Jun 2018', 'Jul 2018', 'Aug 2018', 'Sep 2018', 'Oct 2018', 'Nov 2018', 'Dec 2018', 'Jan 2019', 'Feb 2019', 'Mar 2019', 'Apr 2019', 'May 2019', 'Jun 2019', 'Jul 2019', 'Aug 2019', 'Sep 2019', 'Oct 2019', 'Nov 2019', 'Dec 2019', 'Jan 2020', 'Feb 2020', 'Mar 2020', 'Apr 2020', 'May 2020', 'Jun 2020', 'Jul 2020', 'Aug 2020', 'Sep 2020', 'Oct 2020', 'Nov 2020', 'Dec 2020', 'Jan 2021', 'Feb 2021', 'Mar 2021', 'Apr 2021', 'May 2021', 'Jun 2021', 'Jul 2021', 'Aug 2021', 'Sep 2021', 'Oct 2021', 'Nov 2021', 'Dec 2021', 'Jan 2022', 'Feb 2022', 'Mar 2022', 'Apr 2022', 'May 2022', 'Jun 2022', 'Jul 2022', 'Aug 2022', 'Sep 2022', 'Oct 2022', 'Nov 2022', 'Dec 2022', 'Jan 2023', 'Feb 2023', 'Mar 2023', 'Apr 2023', 'May 2023', 'Jun 2023', 'Jul 2023', 'Aug 2023', 'Sep 2023', 'Oct 2023', 'Nov 2023', 'Dec 2023', 'Jan 2024', 'Feb 2024', 'Mar 2024', 'Apr 2024', 'May 2024', 'Jun 2024', 'Jul 2024', 'Aug 2024', 'Sep 2024', 'Oct 2024', 'Nov 2024'], series: [[3, 3, 12, 2, 12, 9, 6, 12, 8, 3, 8, 27, 17, 36, 47, 15, 22, 33, 49, 16, 23, 33, 21, 13, 29, 27, 23, 28, 30, 24, 21, 32, 25, 18, 18, 13, 17, 16, 14, 7, 18, 24, 5, 14, 16, 9, 12, 16, 9, 10, 10, 14, 11, 13, 17, 5, 7, 15, 22, 10, 9, 11, 9, 14, 7, 14, 19, 25, 58, 35, 22, 16, 14, 7, 6, 8, 11, 12, 6, 22, 13, 13, 10, 11, 22, 14, 5, 15, 12, 16, 23, 25, 22, 14, 13]] }; </script> <div class="artmet-item artmet-chart"> <div class="ct-chart ct-octave js-ct-chart"></div> <div class="artmet-table"> <table> <thead> <tr> <th>Month:</th> <th>Total Views:</th> </tr> </thead> <tbody> <tr> <td>December 2016</td> <td>3</td> </tr> <tr> <td>January 2017</td> <td>3</td> </tr> <tr> <td>February 2017</td> <td>12</td> </tr> <tr> <td>March 2017</td> <td>2</td> </tr> <tr> <td>April 2017</td> <td>12</td> </tr> <tr> <td>May 2017</td> <td>9</td> </tr> <tr> <td>June 2017</td> <td>6</td> </tr> <tr> <td>July 2017</td> <td>12</td> </tr> <tr> <td>August 2017</td> <td>8</td> </tr> <tr> <td>September 2017</td> <td>3</td> </tr> <tr> <td>October 2017</td> <td>8</td> </tr> <tr> <td>December 2017</td> <td>27</td> </tr> <tr> <td>January 2018</td> <td>17</td> </tr> <tr> <td>February 2018</td> <td>36</td> </tr> <tr> <td>March 2018</td> <td>47</td> </tr> <tr> <td>April 2018</td> <td>15</td> </tr> <tr> <td>May 2018</td> <td>22</td> </tr> <tr> <td>June 2018</td> <td>33</td> </tr> <tr> <td>July 2018</td> <td>49</td> </tr> <tr> <td>August 2018</td> <td>16</td> </tr> <tr> <td>September 2018</td> <td>23</td> </tr> <tr> <td>October 2018</td> <td>33</td> </tr> <tr> <td>November 2018</td> <td>21</td> </tr> <tr> <td>December 2018</td> <td>13</td> </tr> <tr> <td>January 2019</td> <td>29</td> </tr> <tr> <td>February 2019</td> <td>27</td> </tr> <tr> <td>March 2019</td> <td>23</td> </tr> <tr> <td>April 2019</td> <td>28</td> </tr> <tr> <td>May 2019</td> <td>30</td> </tr> <tr> <td>June 2019</td> <td>24</td> </tr> <tr> <td>July 2019</td> <td>21</td> </tr> <tr> <td>August 2019</td> <td>32</td> </tr> <tr> <td>September 2019</td> <td>25</td> </tr> <tr> <td>October 2019</td> <td>18</td> </tr> <tr> <td>November 2019</td> <td>18</td> </tr> <tr> <td>December 2019</td> <td>13</td> </tr> <tr> <td>January 2020</td> <td>17</td> </tr> <tr> <td>February 2020</td> <td>16</td> </tr> <tr> <td>March 2020</td> <td>14</td> </tr> <tr> <td>April 2020</td> <td>7</td> </tr> <tr> <td>May 2020</td> <td>18</td> </tr> <tr> <td>June 2020</td> <td>24</td> </tr> <tr> <td>July 2020</td> <td>5</td> </tr> <tr> <td>August 2020</td> <td>14</td> </tr> <tr> <td>September 2020</td> <td>16</td> </tr> <tr> <td>October 2020</td> <td>9</td> </tr> <tr> <td>November 2020</td> <td>12</td> </tr> <tr> <td>December 2020</td> <td>16</td> </tr> <tr> <td>January 2021</td> <td>9</td> </tr> <tr> <td>February 2021</td> <td>10</td> </tr> <tr> <td>March 2021</td> <td>10</td> </tr> <tr> <td>April 2021</td> <td>14</td> </tr> <tr> <td>May 2021</td> <td>11</td> </tr> <tr> <td>June 2021</td> <td>13</td> </tr> <tr> <td>July 2021</td> <td>17</td> </tr> <tr> <td>August 2021</td> <td>5</td> </tr> <tr> <td>September 2021</td> <td>7</td> </tr> <tr> <td>October 2021</td> <td>15</td> </tr> <tr> <td>November 2021</td> <td>22</td> </tr> <tr> <td>December 2021</td> <td>10</td> </tr> <tr> <td>January 2022</td> <td>9</td> </tr> <tr> <td>February 2022</td> <td>11</td> </tr> <tr> <td>March 2022</td> <td>9</td> </tr> <tr> <td>April 2022</td> <td>14</td> </tr> <tr> <td>May 2022</td> <td>7</td> </tr> <tr> <td>June 2022</td> <td>14</td> </tr> <tr> <td>July 2022</td> <td>19</td> </tr> <tr> <td>August 2022</td> <td>25</td> </tr> <tr> <td>September 2022</td> <td>58</td> </tr> <tr> <td>October 2022</td> <td>35</td> </tr> <tr> <td>November 2022</td> <td>22</td> </tr> <tr> <td>December 2022</td> <td>16</td> </tr> <tr> <td>January 2023</td> <td>14</td> </tr> <tr> <td>February 2023</td> <td>7</td> </tr> <tr> <td>March 2023</td> <td>6</td> </tr> <tr> <td>April 2023</td> <td>8</td> </tr> <tr> <td>May 2023</td> <td>11</td> </tr> <tr> <td>June 2023</td> <td>12</td> </tr> <tr> <td>July 2023</td> <td>6</td> </tr> <tr> <td>August 2023</td> <td>22</td> </tr> <tr> <td>September 2023</td> <td>13</td> </tr> <tr> <td>October 2023</td> <td>13</td> </tr> <tr> <td>November 2023</td> <td>10</td> </tr> <tr> <td>December 2023</td> <td>11</td> </tr> <tr> <td>January 2024</td> <td>22</td> </tr> <tr> <td>February 2024</td> <td>14</td> </tr> <tr> <td>March 2024</td> <td>5</td> </tr> <tr> <td>April 2024</td> <td>15</td> </tr> <tr> <td>May 2024</td> <td>12</td> </tr> <tr> <td>June 2024</td> <td>16</td> </tr> <tr> <td>July 2024</td> <td>23</td> </tr> <tr> <td>August 2024</td> <td>25</td> </tr> <tr> <td>September 2024</td> <td>22</td> </tr> <tr> <td>October 2024</td> <td>14</td> </tr> <tr> <td>November 2024</td> <td>13</td> </tr> </tbody> </table> </div> </div> <div class="artmet-stats-wrap clearfix"> <div class="artmet-item artmet-citations hide"> <div class="widget-title-2 artmet-widget-title-2">Citations</div> <div class="artmet-badges-wrap artmet-dimensions"> <div class="widget widget-DimensionsBadge widget-instance-ArticleLevelMetrics_DimensionsBadgeDetails"> <span class="__dimensions_badge_embed__" data-doi="10.1093/bib/bbr034" data-legend="always" data-style="" data-hide-zero-citations="false"></span> <script async src="https://badge.dimensions.ai/badge.js" charset="utf-8"></script> </div> <span class="artmet-dimensions-text">Powered by Dimensions</span> </div> <div class="artmet-wos"> <span class="artmet-number"> <a href="https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=silverchair&SrcAuth=WosAPI&KeyUT=WOS:000295171700007&DestLinkType=CitingArticles&DestApp=WOS_CPL" target="_blank">26</a> </span> <span class="artmet-text">Web of Science</span> </div> </div> <div class="artmet-item artmet-altmetric js-show-if-unknown"> <div class="widget-title-2 artmet-widget-title-2">Altmetrics</div> <div class="artmet-badges-wrap js-artmet-badges"> <div class="widget widget-AltmetricLink widget-instance-ArticleLevelMetrics_AltmetricLinkDetails">  <div id="altmetricEmbedId" runat="server" class='altmetric-embed' data-badge-type="donut" data-hide-no-mentions="false" data-doi="10.1093/bib/bbr034" data-badge-details = "right" ></div> <script type='text/javascript' src='https://d1bxh8uas1mnw7.cloudfront.net/assets/embed.js'></script> </div> </div> </div> </div> </div> <a class="artmet-close-modal js-artmet-close-modal">×</a> </div> </div> </div> </div> <div class="widget widget-Alerts widget-instance-Article_RightRailB0Article_RightRail_Alerts"> <div class="alertsWidget"> <h3>Email alerts</h3> <div class="userAlert alertType-1"> <a href="javascript:;" class="js-user-alert" role="button" data-userLoggedIn="False" data-alertType="1" href="javascript:;">Article activity alert</a> </div> <div class="userAlert alertType-3"> <a href="javascript:;" class="js-user-alert" role="button" data-userLoggedIn="False" data-alertType="3" href="javascript:;">Advance article alerts</a> </div> <div class="userAlert alertType-5"> <a href="javascript:;" class="js-user-alert" role="button" data-userLoggedIn="False" data-alertType="5" href="javascript:;">New issue alert</a> </div> <div class="userAlert alertType-30"> <a href="javascript:;" class="js-user-alert" role="button" data-userLoggedIn="False" data-alertType="30" href="javascript:;">In progress issue alert</a> </div> <div class="userAlert alertType-MarketingLink"> <a href="javascript:;" class="js-user-alert" role="button" data-userLoggedIn="False" data-additionalUrl="/my-account/communication-preferences" href="javascript:;">Receive exclusive offers and updates from Oxford Academic</a> </div> <div class="userAlertSignUpModal reveal-modal small" data-reveal> <div class="userAlertSignUp at-userAlertSignUp"></div> <a href="javascript:;" role="button" aria-label="Close" class="close-reveal-modal" href="javascript:;"> <i class="icon-general-close"></i> </a> </div> </div> </div> <div class="widget widget-TrendMD widget-instance-Article_RightRailB0trendmd"> <div id="trendmd-suggestions"></div> <div class="options" data-suppress-if-hum-is-present="True"></div> </div> <div class="widget widget-ArticleCitedBy widget-instance-Article_RightRailB0Article_RightRail_ArticleCitedBy"> <div class="rail-widget_wrap vt-articles-cited-by"> <h3 class="article-cited-title">Citing articles via</h3> <div class="widget-links_wrap"> <div class="article-cited-link-wrap web-of-science"> <a href="https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=silverchair&SrcAuth=WosAPI&KeyUT=WOS:000295171700007&DestLinkType=CitingArticles&DestApp=WOS_CPL" target="_blank">Web of Science (26)</a> </div> <div class="article-cited-link-wrap google-scholar-url"> <a href="http://scholar.google.com/scholar?q=link:https%3A%2F%2Facademic.oup.com%2Fbib%2Farticle%2F12%2F5%2F423%2F270085" target="_blank">Google Scholar</a> </div> </div> </div> </div> <div class="widget widget-ArticleListNewAndPopular widget-instance-Article_RightRailB0Article_RightRail_ArticleNewPopularCombined"> <ul class="articleListNewAndPopularCombinedView"> <li> <h3> <a href="javascript:;" class="articleListNewAndPopular-mode active" data-mode="MostRecent">Latest</a> </h3> </li> <li> <h3> <a href="javascript:;" class="articleListNewAndPopular-mode " data-mode="MostRead">Most Read</a> </h3> </li> <li> <h3> <a href="javascript:;" class="articleListNewAndPopular-mode " data-mode="MostCited">Most Cited</a> </h3> </li> </ul> <section class="articleListNewPopContent articleListNewAndPopular-ContentView-MostRecent hasContent"> <div id="newPopularList-Article_RightRailB0Article_RightRail_ArticleNewPopularCombined" class="fb"> <div class="widget-layout widget-layout--vert "> <div class="widget-columns widget-col-1"> <div class="col"> <div class="widget-dynamic-entry journalArticleItem at-widget-entry-SCL"> <span class="hfDoi" data-attribute="10.1093/bib/bbae608" aria-hidden="true"></span> <a class="journal-link" href="/bib/article/26/1/bbae608/7906918?searchresult=1"> <div class="widget-dynamic-journal-title"> MCGAE: unraveling tumor invasion through integrated multimodal spatial transcriptomics </div> </a> <div class="widget-dynamic-journal-image-synopsis"> <div class="widget-dynamic-journal-synopsis"> </div> </div> </div> <div class="widget-dynamic-entry journalArticleItem at-widget-entry-SCL"> <span class="hfDoi" data-attribute="10.1093/bib/bbae602" aria-hidden="true"></span> <a class="journal-link" href="/bib/article/26/1/bbae602/7906917?searchresult=1"> <div class="widget-dynamic-journal-title"> tcrBLOSUM: an amino acid substitution matrix for sensitive alignment of distant epitope-specific TCRs </div> </a> <div class="widget-dynamic-journal-image-synopsis"> <div class="widget-dynamic-journal-synopsis"> </div> </div> </div> <div class="widget-dynamic-entry journalArticleItem at-widget-entry-SCL"> <span class="hfDoi" data-attribute="10.1093/bib/bbae593" aria-hidden="true"></span> <a class="journal-link" href="/bib/article/26/1/bbae593/7906915?searchresult=1"> <div class="widget-dynamic-journal-title"> AutoXAI4Omics: an automated explainable AI tool for omics and tabular data </div> </a> <div class="widget-dynamic-journal-image-synopsis"> <div class="widget-dynamic-journal-synopsis"> </div> </div> </div> <div class="widget-dynamic-entry journalArticleItem at-widget-entry-SCL"> <span class="hfDoi" data-attribute="10.1093/bib/bbae561" aria-hidden="true"></span> <a class="journal-link" href="/bib/article/25/6/bbae561/7905378?searchresult=1"> <div class="widget-dynamic-journal-title"> Graph databases in systems biology: a systematic review </div> </a> <div class="widget-dynamic-journal-image-synopsis"> <div class="widget-dynamic-journal-synopsis"> </div> </div> </div> <div class="widget-dynamic-entry journalArticleItem at-widget-entry-SCL"> <span class="hfDoi" data-attribute="10.1093/bib/bbae606" aria-hidden="true"></span> <a class="journal-link" href="/bib/article/25/6/bbae606/7904845?searchresult=1"> <div class="widget-dynamic-journal-title"> A metagene based similarity network fusion approach for multi-omics data integration identified novel subtypes in renal cell carcinoma </div> </a> <div class="widget-dynamic-journal-image-synopsis"> <div class="widget-dynamic-journal-synopsis"> </div> </div> </div> </div> </div> </div></div> </section> <section class="articleListNewPopContent articleListNewAndPopular-ContentView-MostRead hide"> </section> <section class="articleListNewPopContent articleListNewAndPopular-ContentView-MostCited hide"> </section> </div> <div class="widget widget-RelatedTaxonomies widget-instance-Article_RightRailB0Article_RightRail_RelatedTaxonomies"> <div class="widget-related-taxonomies-wrap vt-related-taxonomies"> <div class="widget-related-taxonomies_title">More from Oxford Academic</div> <div class="widget-related-taxonomies"> <a id="more-from-oa-AcademicSubjects_SCI01060" class="related-taxonomies-link" href="/search-results?tax=AcademicSubjects/SCI01060">Bioinformatics and Computational Biology</a> </div> <div class="widget-related-taxonomies"> <a id="more-from-oa-AcademicSubjects_SCI00960" class="related-taxonomies-link" href="/search-results?tax=AcademicSubjects/SCI00960">Biological Sciences</a> </div> <div class="widget-related-taxonomies"> <a id="more-from-oa-AcademicSubjects_SCI00010" class="related-taxonomies-link" href="/search-results?tax=AcademicSubjects/SCI00010">Science and Mathematics</a> </div> <div class="widget-related-taxonomies"> <a id="more-from-oa-format-Books" class="related-taxonomies-link" href="/books">Books</a> </div> <div class="widget-related-taxonomies"> <a id="more-from-oa-format-Journals" class="related-taxonomies-link" href="/journals">Journals</a> </div> </div> </div> </div> </div> </div> </div> <div class="widget widget-AdBlock widget-instance-ArticlePageTopMainBodyBottom"> <div class="js-adBlock-parent-wrap adblock-parent-wrap"> <div class="adBlockMainBodyBottom-wrap js-adBlockMainBodyBottom hide"> <div id="adBlockMainBodyBottom" class="js-adblock at-adblock js-adblock-lazy-loading" data-lazy-load-margin="150"> <script> googletag.cmd.push(function () { googletag.display('adBlockMainBodyBottom'); }); </script> </div> <div class="advertisement-text at-adblock js-adblock-advertisement-text hide">Advertisement</div> </div> </div> </div> </div> </div> <input id="hfArticleTitle" name="hfArticleTitle" type="hidden" value="Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees | Briefings in Bioinformatics | Oxford Academic" /> <input id="hfLeftNavStickyOffset" name="hfLeftNavStickyOffset" type="hidden" value="29" /> </div> </section> </div> <div class="mobile-mask"> </div> <section class="footer_wrap vt-site-footer"> <div class="ad-banner-footer sticky-footer-ad js-sticky-footer-ad"> <div class="widget widget-AdBlock widget-instance-StickyFooterAd"> <div class="js-adBlock-parent-wrap adblock-parent-wrap"> <div class="adBlockStickyFooter-wrap js-adBlockStickyFooter hide"> <div id="adBlockStickyFooter" class="js-adblock at-adblock" data-lazy-load-margin="150"> <script> googletag.cmd.push(function () { googletag.display('adBlockStickyFooter'); }); </script> </div> <div class="advertisement-text at-adblock js-adblock-advertisement-text hide">Advertisement</div> <button type="button" class="close-footer-ad js-close-footer-ad"> <span class="screenreader-text">close advertisement</span> </button> </div> </div> </div> </div> <div class="widget widget-SitePageFooter widget-instance-SitePageFooter"> <div class="ad-banner ad-banner-footer"> <div class="widget widget-AdBlock widget-instance-FooterAd"> <div class="js-adBlock-parent-wrap adblock-parent-wrap"> <div class="adBlockFooter-wrap js-adBlockFooter hide"> <div id="adBlockFooter" class="js-adblock at-adblock js-adblock-lazy-loading" data-lazy-load-margin="150"> <script> googletag.cmd.push(function () { googletag.display('adBlockFooter'); }); </script> </div> <div class="advertisement-text at-adblock js-adblock-advertisement-text hide">Advertisement</div> </div> </div> </div> </div> <div class="journal-footer journal-bg"> <div class="center-inner-row"> <div class="journal-footer-menu"> <ul> <li class="link-1"> <a href="/bib/pages/About">About Briefings in Bioinformatics</a> </li> <li class="link-2"> <a href="/bib/pages/Editorial_Board">Editorial Board</a> </li> <li class="link-3"> <a href="/bib/pages/General_Instructions">Author Guidelines</a> </li> <li class="link-4"> <a href="https://www.facebook.com/OUPAcademic">Facebook</a> </li> <li class="link-5"> <a href="https://twitter.com/oxfordjournals">X (formerly Twitter)</a> </li> </ul><ul><li class="link-1"> <a href="/bib/subscribe">Purchase</a> </li> <li class="link-2"> <a href="http://www.oxfordjournals.org/en/library-recommendation-form.html">Recommend to your Library</a> </li> <li class="link-3"> <a href="https://academic.oup.com/advertising-and-corporate-services/pages/bib-media-kit">Advertising and Corporate Services</a> </li> <li class="link-4"> <a href="http://science-and-mathematics-careernetwork.oxfordjournals.org/jobseeker/search/results/?t730=&search=&t732=470054&t731=&t733=&t735=&t737=&max=25&site_id=20106">Journals Career Network</a> </li> </ul> </div> <div class="journal-footer-affiliations">  <a href="" target=""> <img id="footer-logo-BriefingsinBioinformatics" class="journal-footer-affiliations-logo" src="//oup.silverchair-cdn.com/data/SiteBuilderAssets/Live/Images/bib/bib_f1526563102.svg" alt="Briefings in Bioinformatics" /> </a> </div> <div class="journal-footer-colophon"> <ul> <li>Online ISSN 1477-4054</li> <li>Copyright © 2024 Oxford University Press</li> </ul> </div> </div> </div> </div> <div class="oup-footer"> <div class="center-inner-row"> <div class="widget widget-SelfServeContent widget-instance-OupUmbrellaFooterSelfServe"> <input type="hidden" class="SelfServeContentId" value="GlobalFooter_Links" /> <input type="hidden" class="SelfServeVersionId" value="0" /> <div class="oup-footer-row journal-links"> <div class="global-footer selfservelinks"> <ul> <li><a href="/pages/about-oxford-academic">About Oxford Academic</a></li> <li><a href="/pages/about-oxford-academic/publish-journals-with-us">Publish journals with us</a></li> <li><a href="/pages/about-oxford-academic/our-university-press-partners">University press partners</a></li> <li><a href="/pages/what-we-publish">What we publish</a></li> <li><a href="/pages/new-features">New features</a> </li> </ul> </div> <div class="global-footer selfservelinks"> <ul> <li><a href="/pages/authoring">Authoring</a></li> <li><a href="/pages/open-research/open-access">Open access</a></li> <li><a href="/pages/purchasing">Purchasing</a></li> <li><a href="/pages/institutional-account-management">Institutional account management</a></li> <li><a href="https://academic.oup.com/pages/purchasing/rights-and-permissions">Rights and permissions</a></li> </ul> </div> <div class="global-footer selfservelinks"> <ul> <li><a href="/pages/get-help-with-access">Get help with access</a></li> <li><a href="/pages/about-oxford-academic/accessibility">Accessibility</a></li> <li><a href="/pages/contact-us">Contact us</a></li> <li><a href="/pages/advertising">Advertising</a></li> <li><a href="/pages/media-enquiries">Media enquiries</a></li> </ul> </div> <div class="global-footer selfservelinks global-footer-external"> <ul> <li><a href="https://global.oup.com/">Oxford University Press</a></li> <li><a href="https://www.mynewsdesk.com/uk/oxford-university-press">News</a></li> <li><a href="https://languages.oup.com/">Oxford Languages</a></li> <li><a href="https://www.ox.ac.uk/">University of Oxford</a></li> </ul> </div> <div class="OUP-mission"> <p>Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide</p> <img class="journal-footer-logo" src="//oup.silverchair-cdn.com/UI/app/svg/umbrella/oup-logo.svg" alt="Oxford University Press" width="150" height="42" /> </div> </div> <div class="oup-footer-row"> <div class="oup-footer-row-links"> <ul> <li>Copyright © 2024 Oxford University Press</li> <li><button id="Change-Preferences" type="button" onclick="window.top.document.dispatchEvent(new Event('changeConsent'))">Cookie settings</button></li> <li><a href="https://global.oup.com/cookiepolicy">Cookie policy</a></li> <li><a href="https://global.oup.com/privacy">Privacy policy</a></li> <li><a href="/pages/legal-and-policy/legal-notice">Legal notice</a></li> </ul> </div> </div> <style type="text/css"> /* Issue right column fix for tablet/mobile */ @media (max-width: 1200px) { .pg_issue .widget-instance-OUP_Issue { width: 100%; } } .sf-facet-list .sf-facet label, .sf-facet-list .taxonomy-label-wrap label { font-size: 0.9375rem; } .issue-pagination-wrap .pagination-container { float: right; } </style> </div> </div> </div> <div class="ss-ui-only"> </div> </section> </div> <div class="widget widget-SiteWideModals widget-instance-SiteWideModals"> <div id="revealModal" class="reveal-modal" data-reveal> <div id="revealContent"></div> <a class="close-reveal-modal" href="javascript:;"><i class="icon-general-close"></i><span class="screenreader-text">Close</span></a> </div> <div id="globalModalContainer" class="modal-global-container"> <div id="globalModalContent"> <div class="js-globalModalPlaceholder"></div> </div> <a class="close-modal js-close-modal" href="javascript:;"><i class="icon-general-close"><span class="screenreader-text">Close</span></i></a> </div> <div id="globalModalOverlay" class="modal-overlay js-modal-overlay"></div> <div id="NeedSubscription" class="reveal-modal small" data-reveal> <div class="subscription-needed"> <h5>This Feature Is Available To Subscribers Only</h5> <p><a href="/sign-in">Sign In</a> or <a href="/my-account/register?siteId=5143&returnUrl=%2fbib%2farticle%2f12%2f5%2f423%2f270085">Create an Account</a></p> </div> <a class="close-reveal-modal" href="javascript:;"><i class="icon-general-close"></i><span class="screenreader-text">Close</span></a> </div> <div id="noAccessReveal" class="reveal-modal tiny" data-reveal> <p>This PDF is available to Subscribers Only</p> <a class="hide-for-article-page" id="articleLinkToPurchase" data-reveal><span>View Article Abstract & Purchase Options</span></a> <div class="issue-purchase-modal"> <p>For full access to this pdf, sign in to an existing account, or purchase an annual subscription.</p> </div> <a class="close-reveal-modal" href="javascript:;"><i class="icon-general-close"></i><span class="screenreader-text">Close</span></a> </div> </div> <script type="text/javascript"> MathJax = { tex: { inlineMath: [['|$', '$|'], ['\$', '\$']] } }; </script> <script id="MathJax-script" async src="//cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js"></script>   <script> var NTPT_PGEXTRA = 'event_type=full-text\u0026supplier_tag=SC_Journals\u0026object_type=Article\u0026taxonomy=taxId%3a39%7ctaxLabel%3aAcademicSubjects%7cnodeId%3aSCI01060%7cnodeLabel%3aBioinformatics+and+Computational+Biology%7cnodeLevel%3a3\u0026siteid=bib\u0026authzrequired=false\u0026doi=10.1093/bib/bbr034'; </script>  <script type="text/javascript" src="//ouptag.scholarlyiq.com/ntpagetag.js" class="optanon-category-C0002"></script> <noscript> <img src="//ouptag.scholarlyiq.com/ntpagetag.gif?js=0" height="1" width="1" border="0" hspace="0" vspace="0" alt="Scholarly IQ" /> </noscript> <script type="text/javascript" src="//oup.silverchair-cdn.com/Themes/Client/app/jsdist/v-638669719712896271/site.min.js"></script> <script type="text/javascript" src="https://cdn.jsdelivr.net/chartist.js/latest/chartist.min.js"></script> <script type="text/javascript" src="//oup.silverchair-cdn.com/Themes/Client/app/jsdist/v-638669719629345371/article-page.min.js"></script> <div class="ad-banner js-ad-riser ad-banner-riser"> <div class="widget widget-AdBlock widget-instance-RiserAd"> </div> </div> <script src="//oup.silverchair-cdn.com/oup/scm.proxylogging.js"></script> <div class="end-of-page-js"></div> </body> </html>

CINXE.COM

Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees | Briefings in Bioinformatics | Oxford Academic