CINXE.COM

<?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en-US" lang="en-US"><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"/><title>Internationalization Tag Set (ITS) Version 2.0</title><style type="text/css"> </style><link rel="stylesheet" href="local.css" type="text/css"/><link rel="stylesheet" type="text/css" href="https://www.w3.org/StyleSheets/TR/W3C-REC.css" /></head><body><div class="head"><a href="https://www.w3.org/"><img src="https://www.w3.org/Icons/w3c_home" alt="W3C" height="48" width="72" /></a> <h1><a name="title" id="title"></a>Internationalization Tag Set (ITS) Version 2.0</h1> <h2><a name="w3c-doctype" id="w3c-doctype"></a>W3C Recommendation 29 October 2013</h2><dl><dt>This version:</dt><dd> <a href="https://www.w3.org/TR/2013/REC-its20-20131029/"> http://www.w3.org/TR/2013/REC-its20-20131029/</a> </dd><dt>Latest version:</dt><dd> <a href="https://www.w3.org/TR/its20/">http://www.w3.org/TR/its20/</a> </dd><dt>Previous version:</dt><dd><a href="https://www.w3.org/TR/2013/PR-its20-20130924/"> http://www.w3.org/TR/2013/PR-its20-20130924/</a></dd><dt>Editors:</dt><dd>David Filip, University of Limerick</dd><dd>Shaun McCance, Invited Expert</dd><dd>Dave Lewis, TCD</dd><dd>Christian Lieske, SAP AG</dd><dd>Arle Lommel, DFKI</dd><dd>Jirka Kosek, UEP</dd><dd>Felix Sasaki, DFKI / W3C Fellow</dd><dd>Yves Savourel, ENLASO</dd></dl>Please refer to the <a href="https://www.w3.org/International/its/ig/its20-errata.html">errata</a> for this document, which may include some normative corrections.See also <a href="https://www.w3.org/2003/03/Translations/byTechnology?technology=its">translations</a>.This document is also available in these non-normative formats: <a href="its20.odd">ODD/XML document</a>, <a href="itstagset20.zip">self-contained zipped archive</a>, and <a href="diffs/diff-rec20131029-wd20130924.html">XHTML Diff markup to previous publication 2013-09-24</a>.<a href="https://www.w3.org/Consortium/Legal/ipr-notice#Copyright">Copyright</a> © 2013 <a href="https://www.w3.org/"><acronym title="World Wide Web Consortium">W3C</acronym></a>® (<a href="http://www.csail.mit.edu/"><acronym title="Massachusetts Institute of Technology">MIT</acronym></a>, <a href="http://www.ercim.eu/"><acronym title="European Research Consortium for Informatics and Mathematics">ERCIM</acronym></a>, <a href="http://www.keio.ac.jp/">Keio</a>, <a href="http://ev.buaa.edu.cn/">Beihang</a>), All Rights Reserved. W3C <a href="https://www.w3.org/Consortium/Legal/ipr-notice#Legal_Disclaimer">liability</a>, <a href="https://www.w3.org/Consortium/Legal/ipr-notice#W3C_Trademarks">trademark</a> and <a href="https://www.w3.org/Consortium/Legal/copyright-documents">document use</a> rules apply.</div><hr/><div> <h2><a name="abstract" id="abstract"></a>Abstract</h2>The technology described in this document “Internationalization Tag Set (ITS) 2.0“ enhances the foundation to integrate automated processing of human language into core Web technologies. ITS 2.0 bears many commonalities with its predecessor, <a href="https://www.w3.org/TR/2007/REC-its-20070403/">ITS 1.0</a> but provides additional concepts that are designed to foster the automated creation and processing of multilingual Web content. ITS 2.0 focuses on HTML, XML-based formats in general, and can leverage processing based on the XML Localization Interchange File Format (XLIFF), as well as the Natural Language Processing Interchange Format (NIF).</div><div> <h2><a name="status" id="status"></a>Status of this Document</h2> This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the <a href="https://www.w3.org/TR/">W3C technical reports index</a> at http://www.w3.org/TR/. The technology described in this document “Internationalization Tag Set (ITS) 2.0“ enhances the foundation to integrate automated processing of human language into core Web technologies. ITS 2.0 bears many commonalities with is predecessor, <a href="https://www.w3.org/TR/2007/REC-its-20070403/">ITS 1.0</a> but provides additional concepts that are designed to foster the automated creation and processing of multilingual Web content. ITS 2.0 focuses on HTML, XML-based formats in general, and can leverage processing based on the XML Localization Interchange File Format (XLIFF), as well as the Natural Language Processing Interchange Format (NIF).This document was published by the <a href="https://www.w3.org/International/multilingualweb/lt/">MultilingualWeb-LT Working Group</a> as a W3C Recommendation (see <a href="https://www.w3.org/2004/02/Process-20040205/tr.html#maturity-levels">W3C document maturity levels</a>). The Working Group has completed and approved this specification's <a href="https://github.com/w3c/its-2.0-testsuite/">Test Suite</a> and created an <a href="https://www.w3.org/International/multilingualweb/lt/drafts/its20/its20-implementation-report.html">Implementation Report</a> that shows that two or more independent implementations pass each test.This document has been reviewed by W3C Members, by software developers, and by other W3C groups and interested parties, and is endorsed by the Director as a W3C Recommendation. It is a stable document and may be used as reference material or cited from another document. W3C's role in making the Recommendation is to draw attention to the specification and to promote its widespread deployment. This enhances the functionality and interoperability of the Web.The ITS 2.0 specification has a normative dependency on the HTML5 specification: it relies on the <a href="https://www.w3.org/TR/2013/CR-html5-20130806/dom.html#the-translate-attribute">HTML5 Translate attribute</a>. By publishing this Recommendation, W3C expects that the functionality specified in this ITS 2.0 Recommendation will not be affected by changes to HTML5 as that specification proceeds to Recommendation.If you wish to make comments, please send them to <a href="mailto:public-i18n-its-ig@w3.org">public-i18n-its-ig@w3.org</a>. The <a href="http://lists.w3.org/Archives/Public/public-i18n-its-ig/">archives for this list</a> are publicly available. See also issues discussed within the <a href="https://www.w3.org/International/multilingualweb/lt/">MultilingualWeb-LT Working Group</a> and the <a href="#changelog-since-20130924">list of changes</a> since the previous publication.This document was produced by a group operating under the <a href="https://www.w3.org/Consortium/Patent-Policy-20040205/">5 February 2004 W3C Patent Policy</a>. W3C maintains a <a href="https://www.w3.org/2004/01/pp-impl/53116/status">public list of any patent disclosures</a> made in connection with the deliverables of the group; that page also includes instructions for disclosing a patent. An individual who has actual knowledge of a patent which the individual believes contains <a href="https://www.w3.org/Consortium/Patent-Policy-20040205/#def-essential">Essential Claim(s)</a> must disclose the information in accordance with <a href="https://www.w3.org/Consortium/Patent-Policy-20040205/#sec-Disclosure">section 6 of the W3C Patent Policy</a>. </div><div class="toc"> <h2><a name="contents" id="contents"></a>Table of Contents</h2><div class="toc"><div class="toc1">1 <a href="#introduction">Introduction</a><div class="toc2">1.1 <a href="#overview">Overview</a></div> <div class="toc2">1.2 <a href="#general-motiviation-for-ITS2.0">General motivation for going beyond ITS 1.0</a></div> <div class="toc2">1.3 <a href="#usage-scenarios">Usage Scenarios</a></div> <div class="toc2">1.4 <a href="#high-level-differences-between-1.0-and-2.0">High-level differences between ITS 1.0 and ITS 2.0</a></div> <div class="toc2">1.5 <a href="#extended-implementation-hints">Extended implementation hints</a></div> </div> <div class="toc1">2 <a href="#basic-concepts">Basic Concepts</a><div class="toc2">2.1 <a href="#basic-concepts-datacategories">Data Categories</a></div> <div class="toc2">2.2 <a href="#basic-concepts-selection">Selection</a><div class="toc3">2.2.1 <a href="#basic-concepts-selection-local">Local Approach</a></div> <div class="toc3">2.2.2 <a href="#basic-concepts-selection-global">Global Approach</a></div> </div> <div class="toc2">2.3 <a href="#basic-concepts-overinher">Overriding, Inheritance and Defaults</a></div> <div class="toc2">2.4 <a href="#basic-concepts-addingpointing">Adding Information or Pointing to Existing Information</a></div> <div class="toc2">2.5 <a href="#specific-HTML-support">Specific HTML support</a><div class="toc3">2.5.1 <a href="#html5-global-approach">Global approach in HTML5</a></div> <div class="toc3">2.5.2 <a href="#html5-its-local-markup">Local approach</a></div> <div class="toc3">2.5.3 <a href="#html5-existing-markup-versus-its">HTML markup with ITS 2.0 counterparts</a></div> <div class="toc3">2.5.4 <a href="#html5-standoff-markup-explanation">Standoff markup in HTML5</a></div> <div class="toc3">2.5.5 <a href="#usage-in-legacy-html">Version of HTML</a></div> </div> <div class="toc2">2.6 <a href="#traceability">Traceability</a></div> <div class="toc2">2.7 <a href="#mapping-conversion">Mapping and conversion</a><div class="toc3">2.7.1 <a href="#mapping-NIF">ITS and RDF/NIF</a></div> <div class="toc3">2.7.2 <a href="#mapping-XLIFF">ITS and XLIFF</a></div> </div> <div class="toc2">2.8 <a href="#implementing-its20">ITS 2.0 Implementations and Conformance</a></div> </div> <div class="toc1">3 <a href="#notation-terminology">Notation and Terminology</a><div class="toc2">3.1 <a href="#notation">Notation</a></div> <div class="toc2">3.2 <a href="#def-datacat">Data category</a></div> <div class="toc2">3.3 <a href="#def-selection">Selection</a></div> <div class="toc2">3.4 <a href="#def-local-attributes">ITS Local Attributes</a></div> <div class="toc2">3.5 <a href="#def-rule-elements">Rule Elements</a></div> <div class="toc2">3.6 <a href="#iri-usage">Usage of Internationalized Resource Identifiers in ITS</a></div> <div class="toc2">3.7 <a href="#def-html">The Term HTML</a></div> <div class="toc2">3.8 <a href="#def-css-selector">The Term CSS Selectors</a></div> </div> <div class="toc1">4 <a href="#conformance">Conformance</a><div class="toc2">4.1 <a href="#conformance-product-schema">Conformance Type 1: ITS Markup Declarations</a></div> <div class="toc2">4.2 <a href="#conformance-product-processing-expectations">Conformance Type 2: The Processing Expectations for ITS Markup</a></div> <div class="toc2">4.3 <a href="#conformance-product-html-processing-expectations">Conformance Type 3: Processing Expectations for ITS Markup in HTML</a></div> <div class="toc2">4.4 <a href="#conformance-product-html5-its">Conformance Type 4: Markup conformance for HTML5+ITS documents</a></div> </div> <div class="toc1">5 <a href="#its-processing">Processing of ITS information</a><div class="toc2">5.1 <a href="#its-version-attribute">Indicating the Version of ITS</a></div> <div class="toc2">5.2 <a href="#datacategory-locations">Locations of Data Categories</a><div class="toc3">5.2.1 <a href="#selection-global">Global, Rule-based Selection</a></div> <div class="toc3">5.2.2 <a href="#selection-local">Local Selection in an XML Document</a></div> </div> <div class="toc2">5.3 <a href="#selectors">Query Language of Selectors</a><div class="toc3">5.3.1 <a href="#queryLanguage">Choosing Query Language</a></div> <div class="toc3">5.3.2 <a href="#d0e2513">XPath 1.0</a></div> <div class="toc3">5.3.3 <a href="#css-selectors">CSS Selectors</a></div> <div class="toc3">5.3.4 <a href="#d0e2761">Additional query languages</a></div> <div class="toc3">5.3.5 <a href="#its-param">Variables in selectors</a></div> </div> <div class="toc2">5.4 <a href="#link-external-rules">Link to External Rules</a></div> <div class="toc2">5.5 <a href="#selection-precedence">Precedence between Selections</a></div> <div class="toc2">5.6 <a href="#associating-its-with-existing-markup">Associating ITS Data Categories with Existing Markup</a></div> <div class="toc2">5.7 <a href="#its-tool-annotation">ITS Tools Annotation</a></div> </div> <div class="toc1">6 <a href="#html5-markup">Using ITS Markup in HTML</a><div class="toc2">6.1 <a href="#html5-local-attributes">Mapping of Local Data Categories to HTML</a></div> <div class="toc2">6.2 <a href="#html5-global-rules">Global rules</a></div> <div class="toc2">6.3 <a href="#html5-standoff-markup">Standoff Markup in HTML</a></div> <div class="toc2">6.4 <a href="#html5-selection-precedence">Precedence between Selections</a></div> </div> <div class="toc1">7 <a href="#xhtml5-markup">Using ITS Markup in XHTML</a></div> <div class="toc1">8 <a href="#datacategory-description">Description of Data Categories</a><div class="toc2">8.1 <a href="#datacategories-defaults-etc">Position, Defaults, Inheritance, and Overriding of Data Categories</a></div> <div class="toc2">8.2 <a href="#trans-datacat">Translate</a><div class="toc3">8.2.1 <a href="#translatability-definition">Definition</a></div> <div class="toc3">8.2.2 <a href="#translatability-implementation">Implementation</a></div> </div> <div class="toc2">8.3 <a href="#locNote-datacat">Localization Note</a><div class="toc3">8.3.1 <a href="#locNote-definition">Definition</a></div> <div class="toc3">8.3.2 <a href="#locNote-implementation">Implementation</a></div> </div> <div class="toc2">8.4 <a href="#terminology">Terminology</a><div class="toc3">8.4.1 <a href="#terminology-definition">Definition</a></div> <div class="toc3">8.4.2 <a href="#terminology-implementation">Implementation</a></div> </div> <div class="toc2">8.5 <a href="#directionality">Directionality</a><div class="toc3">8.5.1 <a href="#directionality-definition">Definition</a></div> <div class="toc3">8.5.2 <a href="#directionality-implementation">Implementation</a></div> </div> <div class="toc2">8.6 <a href="#language-information">Language Information</a><div class="toc3">8.6.1 <a href="#langinfo-definition">Definition</a></div> <div class="toc3">8.6.2 <a href="#langinfo-implementation">Implementation</a></div> </div> <div class="toc2">8.7 <a href="#elements-within-text">Elements Within Text</a><div class="toc3">8.7.1 <a href="#within-text-definition">Definition</a></div> <div class="toc3">8.7.2 <a href="#within-text-implementation">Implementation</a></div> </div> <div class="toc2">8.8 <a href="#domain">Domain</a><div class="toc3">8.8.1 <a href="#domain-definition">Definition</a></div> <div class="toc3">8.8.2 <a href="#domain-implementation">Implementation</a></div> </div> <div class="toc2">8.9 <a href="#textanalysis">Text Analysis</a><div class="toc3">8.9.1 <a href="#textanalysis-definition">Definition</a></div> <div class="toc3">8.9.2 <a href="#textanalysis-implementation">Implementation</a></div> </div> <div class="toc2">8.10 <a href="#LocaleFilter">Locale Filter</a><div class="toc3">8.10.1 <a href="#LocaleFilter-definition">Definition</a></div> <div class="toc3">8.10.2 <a href="#LocaleFilter-implementation">Implementation</a></div> </div> <div class="toc2">8.11 <a href="#provenance">Provenance</a><div class="toc3">8.11.1 <a href="#provenance-definition">Definition</a></div> <div class="toc3">8.11.2 <a href="#provenance-implementation">Implementation</a></div> </div> <div class="toc2">8.12 <a href="#externalresource">External Resource</a><div class="toc3">8.12.1 <a href="#externalresource-definition">Definition</a></div> <div class="toc3">8.12.2 <a href="#externalresource-implementation">Implementation</a></div> </div> <div class="toc2">8.13 <a href="#target-pointer">Target Pointer</a><div class="toc3">8.13.1 <a href="#target-pointer-definition">Definition</a></div> <div class="toc3">8.13.2 <a href="#target-pointer-implementation">Implementation</a></div> </div> <div class="toc2">8.14 <a href="#idvalue">ID Value</a><div class="toc3">8.14.1 <a href="#idvalue-definition">Definition</a></div> <div class="toc3">8.14.2 <a href="#idvalue-implementation">Implementation</a></div> </div> <div class="toc2">8.15 <a href="#preservespace">Preserve Space</a><div class="toc3">8.15.1 <a href="#preservespace-definition">Definition</a></div> <div class="toc3">8.15.2 <a href="#preservespace-implementation">Implementation</a></div> </div> <div class="toc2">8.16 <a href="#lqissue">Localization Quality Issue</a><div class="toc3">8.16.1 <a href="#lqissue-definition">Definition</a></div> <div class="toc3">8.16.2 <a href="#lqissue-implementation">Implementation</a></div> </div> <div class="toc2">8.17 <a href="#lqrating">Localization Quality Rating</a><div class="toc3">8.17.1 <a href="#lqrating-definition">Definition</a></div> <div class="toc3">8.17.2 <a href="#lqrating-implementation">Implementation</a></div> </div> <div class="toc2">8.18 <a href="#mtconfidence">MT Confidence</a><div class="toc3">8.18.1 <a href="#mtconfidence-definition">Definition</a></div> <div class="toc3">8.18.2 <a href="#mtconfidence-implementation">Implementation</a></div> </div> <div class="toc2">8.19 <a href="#allowedchars">Allowed Characters</a><div class="toc3">8.19.1 <a href="#allowedchars-definition">Definition</a></div> <div class="toc3">8.19.2 <a href="#allowedchars-implementation">Implementation</a></div> </div> <div class="toc2">8.20 <a href="#storagesize">Storage Size</a><div class="toc3">8.20.1 <a href="#storagesize-definition">Definition</a></div> <div class="toc3">8.20.2 <a href="#storagesize-implementation">Implementation</a></div> </div> </div> </div> <h3><a name="appendices" id="appendices"></a>Appendices</h3><div class="toc1">A <a href="#normative-references">References</a></div> <div class="toc1">B <a href="#its-mime-type">Internationalization Tag Set (ITS) MIME Type</a></div> <div class="toc1">C <a href="#lqissue-typevalues">Values for the Localization Quality Issue Type</a></div> <div class="toc1">D <a href="#its-schemas">Schemas for ITS</a></div> <div class="toc1">E <a href="#informative-references">Informative References</a></div> <div class="toc1">F <a href="#conversion-to-nif">Conversion to NIF</a></div> <div class="toc1">G <a href="#nif-backconversion">Conversion NIF2ITS</a></div> <div class="toc1">H <a href="#localization-quality-guidance">Localization Quality Guidance</a></div> <div class="toc1">I <a href="#list-of-elements-and-attributes">List of ITS 2.0 Global Elements and Local Attributes</a></div> <div class="toc1">J <a href="#revisionlog">Revision Log</a></div> <div class="toc1">K <a href="#acknowledgements">Acknowledgements</a></div> </div><hr/><div class="body"><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="introduction" id="introduction"></a>1 Introduction</h2> This section is informative. <div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="overview" id="overview"></a>1.1 Overview</h3> Content or software that is authored in one language (so-called source language) for one locale (e.g. the French-speaking part of Canada) is often made available in additional languages or adapted with regard to other cultural aspects. A prevailing paradigm for multilingual production in many cases encompasses three phases: internationalization, translation, and localization (see the <a href="https://www.w3.org/International/questions/qa-i18n/"> W3C's Internationalization Q&A</a> for more information related to these concepts). From the viewpoints of feasibility, cost, and efficiency, it is important that the original material is suitable for downstream phases such as translation. This is achieved by appropriate design and development. The corresponding phase is referred to as internationalization. A proprietary XML vocabulary may be internationalized by defining special markup to specify directionality in mixed direction text. During the translation phase, the meaning of a source language text is analyzed, and a target language text that is equivalent in meaning is determined. For example national or international laws may regulate linguistic dimensions like mandatory terminology or standard phrases in order to promote or ensure a translation's fidelity.Although an agreed-upon definition of the localization phase is missing, this phase is usually seen as encompassing activities such as creating locale-specific content (e.g. adding a link for a country-specific reseller), or modifying functionality (e.g. to establish a fit with country-specific regulations for financial reporting). Sometimes, the insertion of special markup to support a local language or script is also subsumed under the localization phase. For example, people authoring in languages such as Arabic, Hebrew, Persian or Urdu need special markup to specify directionality in mixed direction text. The technology described in this document – the Internationalization Tag Set (ITS) 2.0 addresses some of the challenges and opportunities related to internationalization, translation, and localization. ITS 2.0 in particular contributes to concepts in the realm of metadata for internationalization, translation, and localization related to core Web technologies such as XML. ITS does for example assist in production scenarios, in which parts of an XML-based document are to be excluded from translation. ITS 2.0 bears many commonalities with its predecessor, <a href="https://www.w3.org/TR/2007/REC-its-20070403/">ITS 1.0</a> but provides additional concepts that are designed to foster enhanced automated processing – e.g. based on language technology such as entity recognition – related to multilingual Web content. Like ITS 1.0, ITS 2.0 both identifies concepts (such as “Translate” ), and defines implementations of these concepts (termed “ITS data categories”) as a set of elements and attributes called the Internationalization Tag Set (ITS). The definitions of ITS elements and attributes are provided in the form of RELAX NG <a title="Regular-grammar-based validation – RELAX NG" href="#relaxng">[RELAX NG]</a> (normative). Since one major step from ITS 1.0 to ITS 2.0 relates to coverage for HTML, ITS 2.0 also establishes a relationship between ITS markup and the various HTML flavors. Furthermore, ITS 2.0 suggests when and how to leverage processing based on the XML Localization Interchange File Format (<a title="XLIFF Version 1.2" href="#xliff1.2">[XLIFF 1.2]</a> and <a title="XLIFF Version 2.0" href="#xliff2.0">[XLIFF 2.0]</a>), as well as the Natural Language Processing Interchange Format <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a>.For the purpose of an introductory illustration, here is a series of examples related to the question, how ITS can indicate that certain parts of a document are not intended for translation.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-motivation-its-1" id="EX-motivation-its-1"></a>Example 1: Document in which some content has to be left untranslated</div>In this document it is difficult to distinguish between those <code>string</code> elements that are intended for translation and those that are not to be translated. Explicit metadata is needed to resolve the issue.<div class="exampleInner"><pre><resources> <section id="Homepage"> <arguments> <string>page</string> <string>childlist</string> </arguments> <variables> <string>POLICY</string> <string>Corporate Policy</string> </variables> <keyvalue_pairs> <string>Page</string> <string>ABC Corporation - Policy Repository</string> <string>Footer_Last</string> <string>Pages</string> <string>bgColor</string> <string>NavajoWhite</string> <string>title</string> <string>List of Available Policies</string> </keyvalue_pairs> </section> </resources> </pre></div>[Source file: <a href="examples/xml/EX-motivation-its-1.xml">examples/xml/EX-motivation-its-1.xml</a>]</div>ITS proposes several mechanisms, which differ among others in terms of the usage scenario/user types for which the mechanism is most suitable.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-motivation-its-2" id="EX-motivation-its-2"></a>Example 2: Document that uses two different ITS mechanisms to indicate that some parts have to be left untranslated.</div>ITS provides two mechanisms to explicitly associate metadata with one or more pieces of content (e.g. XML nodes): a <a href="#basic-concepts-selection-global">global</a>, rule-based approach as well as a <a href="#basic-concepts-selection-local">local</a>, attribute-based approached. Here, for instance, a <code class="its-elem-markup">translateRule</code> first specifies that only every second element inside <code>keyvalue_pairs</code> is intended for translation; later, an ITS <code class="its-attr-markup">translate</code> attribute specifies that one of these elements is not to be translated.<div class="exampleInner"><pre><resources xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <its:rules version="2.0"> <its:translateRule selector="//arguments" translate="no"/> <its:translateRule selector="//keyvalue_pairs/string[(position() mod 2)=1]" translate="no"/> </its:rules> <section id="Homepage"> <arguments> <string>page</string> <string>childlist</string> </arguments> <variables> <string its:translate="no">POLICY</string> <string>Corporate Policy</string> </variables> <keyvalue_pairs> <string>Page</string> <string>ABC Corporation - Policy Repository</string> <string>Footer_Last</string> <string>Pages</string> <string>bgColor</string> <string its:translate='no'>NavajoWhite</string> <string>title</string> <string>List of Available Policies</string> </keyvalue_pairs> </section> </resources> </pre></div>[Source file: <a href="examples/xml/EX-motivation-its-2.xml">examples/xml/EX-motivation-its-2.xml</a>]</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="general-motiviation-for-ITS2.0" id="general-motiviation-for-ITS2.0"></a>1.2 General motivation for going beyond ITS 1.0</h3>The basics of ITS 1.0 are simple:<ol class="depth1"><li>Provide metadata (e.g. “Do not translate”) to assist internationalization-related processes</li><li>Use XPath (so-called <a href="#selection-global">global approach</a>) to associate metadata with specific XML nodes (e.g. all elements named <code>uitext</code>) or put the metadata straight onto the XML nodes themselves (so-called <a href="#def-local-attributes">local approach</a>)</li><li>Work with a well-defined set of metadata categories or values (e.g. only the values "yes" and "no" for certain data categories)</li><li>Take advantage of existing metadata (e.g. terms already marked up with HTML markup such as <code>dt</code>)</li></ol>This conciseness made real-world deployment of ITS 1.0 easy. The deployments helped to identify additional metadata categories for internationalization-related processes. The <a href="https://www.w3.org/International/its/ig/">ITS Interest Group</a> for example compiled a list of additional data categories (see this <a href="https://www.w3.org/International/multilingualweb/limerick/slides/lieske.pdf">related summary</a>). Some of these were then defined in ITS 2.0: <a href="#idvalue">ID Value</a>, local <a href="#elements-within-text">Elements Within Text</a>, <a href="#preservespace">Preserve Space</a>, and <a href="#LocaleFilter">Locale Filter</a>. Others are still discussed as requirements for possible future versions of ITS:<ol class="depth1"><li>“Context” = What specific related information might be helpful?</li><li>“Automated Language” = Does this content lend itself to automatic processing?</li></ol>The real-world deployments also helped to understand that for the <a href="http://www.webplatform.org/">Open Web Platform</a> – the ITS 1.0 restriction to XML was an obstacle for quite a number of environments. What was missing was, for example, the following:<ol class="depth1"><li>Applicability of ITS to formats such as HTML in general, and HTML5 in particular</li><li>Easy use of ITS in various Web-exposed (multilingual) Natural Language Processing contexts</li><li>Computer-supported linguistic quality assurance</li><li>Content Management and translation platforms</li><li>Cross-language scenarios</li><li>Content enrichment</li><li>Support for W3C provenance <a title="Provenance data model" href="#prov-dm">[PROV-DM]</a>, “information about entities, activities, and people involved in producing a piece of data or thing, which can be used to form assessments about its quality, reliability or trustworthiness”</li><li>Provisions for extended deployment in Semantic Web/Linked Open Data scenarios</li></ol>ITS 2.0 was created by an alliance of stakeholders who are involved in content for global use. Thus, ITS 2.0 was developed with input from/with a view towards the following:<ul><li>Providers of content management and machine translation solutions who want to easily integrate for efficient content updates in multilingual production chains</li><li>Language technology providers who want to automatically enrich content (e.g. via term candidate generation, entity recognition or disambiguation) in order to facilitate human translation</li><li>Open standards endeavours (e.g. related to <a title="XLIFF Version 1.2" href="#xliff1.2">[XLIFF 1.2]</a>, <a title="XLIFF Version 2.0" href="#xliff2.0">[XLIFF 2.0]</a> and <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a>) that are interested for example in information sharing, and lossless roundtrip of metadata in localization workflows</li></ul>One example outcome of the resulting synergies is the <a href="#its-tool-annotation">ITS Tool Annotation</a> mechanism. It addresses the provenance-related requirement by allowing ITS processors to leave a trace: ITS processors can basically say “It is me that generated this bit of information”. Another example are the <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a> related details of ITS 2.0, which provide a non-normative approach to couple Natural Language Processing with concepts of the Semantic Web.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="usage-scenarios" id="usage-scenarios"></a>1.3 Usage Scenarios</h3>The <a title=" Internationalization Tag Set (ITS) Version 1.0 " href="#its10">[ITS 1.0]</a> <a href="https://www.w3.org/TR/2007/REC-its-20070403/#introduction">introduction</a> states: “ITS is a technology to easily create XML, which is internationalized and can be localized effectively”. In order to make this tangible, ITS 1.0 provided examples for <a href="https://www.w3.org/TR/2007/REC-its-20070403/#users-usage">users and usages</a>. Implicitly, these examples carried the information that ITS covers two areas: one that is related to the static dimension of mono-lingual content, and one that is related to the dynamic dimension of multilingual production.<ul><li>Static mono-lingual (for example, the area of content authors): This part of the content has the directionality “right-to-left”.</li><li>Dynamic multilingual: (for example, the area of machine translation systems): This part of the content has to be left untranslated.</li></ul>Although ITS 1.0 made no assumptions about possible phases in a multilingual production process chain, it was slanted towards a simple three phase “write→internationalize→translate” model. Even a birds-eye-view at ITS 2.0 shows that ITS 2.0 explicitly targets a much more comprehensive model for multilingual content production. The model comprises support for multilingual content production phases such as:<ul><li>Internationalization</li><li>Pre-production (e.g. related to marking terminology)</li><li>Automated content enrichment (e.g. automatic hyperlinking for entities)</li><li>Extraction/filtering of translation-relevant content</li><li>Segmentation</li><li>Leveraging (e.g. of existing translation-related assets such as translation memories)</li><li>Machine Translation (e.g. geared towards a specific domain)</li><li>Quality assessment or control of source language or target language content</li><li>Generation of translation kits (e.g. packages based on XLIFF)</li><li>Post-production</li><li>Publishing</li></ul>The document <a title="Metadata for the Multilingual Web - Usage Scenarios and Implementations " href="#mlw-metadata-us-impl">[MLW US IMPL]</a> lists a large variety of usage scenarios for ITS 2.0. Most of them are composed from the aforementioned phases.In a similar vein, ITS 2.0 takes a much more comprehensive view on the actors that may participate in a multilingual content production process. ITS 1.0 annotations (e.g. local markup for the <a href="#terminology">Terminology</a> data category) most of the time were conceived as being closely tied to human actors such as content authors or information architects. ITS 2.0 raises non-human actors such as word processors/editors, content management systems, machine translation systems, term candidate generators, entity identifiers/disambiguators to the same level. This change among others is reflected by the ITS 2.0 <a href="#its-tool-annotation">Tool Annotation</a>, which allows systems to record that they have processed a certain part of content.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="high-level-differences-between-1.0-and-2.0" id="high-level-differences-between-1.0-and-2.0"></a>1.4 High-level differences between ITS 1.0 and ITS 2.0</h3>The differences between ITS 1.0 and ITS 2.0 can be summarized as follows. Coverage of <a title="HTML5" href="#html5">[HTML5]</a>: ITS 1.0 can be applied to XML content. ITS 2.0 extends the coverage to <a title="HTML5" href="#html5">[HTML5]</a>. Explanatory details about ITS 2.0 and <a title="HTML5" href="#html5">[HTML5]</a> are given in <a class="section-ref" href="#specific-HTML-support">Section 2.5: Specific HTML support</a>. Addition of data categories: ITS 2.0 provides additional data categories and modifies existing ones. A summary of all ITS 2.0 data categories is given in <a class="section-ref" href="#basic-concepts-datacategories">Section 2.1: Data Categories</a>. Modification of data categories:<ul><li>ITS 1.0 provided the <a href="https://www.w3.org/TR/2007/REC-its-20070403/#ruby-annotation">Ruby data category</a>. ITS 2.0 does not provide ruby because at the time of writing the <a href="https://www.w3.org/TR/html51/text-level-semantics.html#the-ruby-element">ruby model in HTML5</a> was still under development. Once these discussions are settled, the Ruby data category possibly will be reintroduced, in a subsequent version of ITS.</li><li>The <a href="#directionality">Directionality</a> data category reflects directionality markup in <a title="HTML 4.01" href="#html4">[HTML 4.01]</a>. The reason is that enhancements are being discussed in the context of HTML5 that are expected to change the approach to marking up directionality, in particular to support content whose directionality needs to be isolated from that of surrounding content. However, these enhancements are not finalized yet. They will be reflected in a future revision of ITS.</li></ul> Additional or modified mechanisms: The following mechanisms from ITS 1.0 have been modified or added to ITS 2.0:<ul><li>ITS 1.0 used only XPath as the mechanism for selecting nodes in <a href="#basic-concepts-selection-global">global rules</a>. ITS 2.0 allows for choosing the <a href="#selectors">query language of selectors</a>. The default is XPath 1.0. An ITS 2.0 processor is free to support other selection mechanisms, like CSS selectors or other versions of XPath.</li><li>In global rules it is now possible to set <a href="#its-param">variables for the selectors</a> (XPath expression). The <code class="its-elem-markup">param</code> element serves this purpose.</li><li>ITS 2.0 has an <a href="#its-tool-annotation">ITS Tools Annotation</a> mechanism to associate processor information with the use of individual data categories. See <a class="section-ref" href="#traceability">Section 2.6: Traceability</a> for details.</li></ul> Mappings: ITS 2.0 provides a non-normative algorithm to convert ITS 2.0 information into <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a> and links to guidance about how to relate ITS 2.0 to XLIFF. See <a class="section-ref" href="#mapping-conversion">Section 2.7: Mapping and conversion</a> for details. Changes to the conformance section: The <a class="section-ref" href="#conformance">Section 4: Conformance</a> tells implementers how to implement ITS. For ITS 2.0, the conformance statements related to Ruby have been removed. For <a title="HTML5" href="#html5">[HTML5]</a>, a dedicated conformance section has been created. Finally, a conformance clause related to Non-ITS elements and attributes has been added.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="extended-implementation-hints" id="extended-implementation-hints"></a>1.5 Extended implementation hints</h3>As a general guidance, implementations of ITS 2.0 are encouraged to use a <a href="https://www.w3.org/TR/2012/WD-charmod-norm-20120501/#sec-NormalizingTranscoder">normalizing transcoder</a>. It converts from a legacy encoding to a Unicode encoding form and ensures that the result is in Unicode Normalization Form C. Further information on the topic of Unicode normalization is provided in <a title="Character Model for the World Wide Web 1.0: Normalization" href="#charmod-norm">[Charmod Norm]</a>.</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts" id="basic-concepts"></a>2 Basic Concepts</h2> This section is informative. The purpose of this section is to provide basic knowledge about how ITS 2.0 works. Detailed knowledge (including formal definitions) is given in the subsequent sections.<div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts-datacategories" id="basic-concepts-datacategories"></a>2.1 Data Categories</h3>A key concept of ITS is the abstract notion of <a href="#def-datacat">data categories</a>. Data categories define the information that can be conveyed via ITS. An example is the <a href="#trans-datacat">Translate</a> data category. It conveys information about translatability of content. <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> defines data categories. It also describes their implementation, i.e. ways to use them for example in an XML context. The motivation for separating data category definitions from their implementation is to enable different implementations with the following characteristics:<ul><li>For various types of content (XML in general or <a href="#specific-HTML-support">HTML</a>).</li><li>For a single piece of content, e.g. a <code>p</code> element. This is the so-called <a href="#basic-concepts-selection-local">local approach</a>.</li><li>For several pieces of content in one document or even a set of documents. This is the so-called <a href="#basic-concepts-selection-global">global approach</a>.</li><li>For a complete markup vocabulary. This is done by adding <a href="#its-schemas">ITS markup declarations</a> to the schema for the vocabulary.</li></ul>ITS 2.0 provides the following data categories:<ul><li><a href="#trans-datacat">Translate</a>: expresses information about whether a selected piece of content is intended for translation or not.</li><li><a href="#locNote-datacat">Localization Note</a>: communicates notes to localizers about a particular item of content.</li><li><a href="#terminology">Terminology</a>: marks terms and optionally associates them with information, such as definitions or references to a term data base.</li><li><a href="#directionality">Directionality</a>: specifies the base writing direction of blocks, embeddings and overrides for the Unicode bidirectional algorithm.</li><li><a href="#language-information">Language Information</a>: expresses the language of a given piece of content.</li><li><a href="#elements-within-text">Elements Within Text:</a> expresses how content of an element is related to the text flow (constitutes its own segment like paragraphs, is part of a segment like emphasis marker etc.).</li><li><a href="#domain">Domain</a>: identifies the topic or subject of the annotated content for translation-related applications.</li><li><a href="#textanalysis">Text Analysis</a>: annotates content with lexical or conceptual information (e.g. for the purpose of contextual disambiguation).</li><li><a href="#LocaleFilter">Locale Filter</a>: specifies that a piece of content is only applicable to certain locales. </li><li><a href="#provenance">Provenance</a>: communicates the identity of agents that have been involved processing content.</li><li><a href="#externalresource">External Resource</a>: indicates reference points in a resource outside the document that need to be considered during localization or translation. Examples of such resources are external images and audio or video files.</li><li><a href="#target-pointer">Target Pointer</a>: associates the markup node of a given source content (i.e. the content to be translated) and the markup node of its corresponding target content (i.e. the source content translated into a given target language). This is relevant for formats that hold the same content in different languages inside a single document.</li><li><a href="#idvalue">Id Value</a>: identifies a value that can be used as unique identifier for a given part of the content. </li><li><a href="#preservespace">Preserve Space</a>: indicates how whitespace is to be handled in content.</li><li><a href="#lqissue">Localization Quality Issue</a>: describes the nature and severity of an error detected during a language-oriented quality assurance (QA) process.</li><li><a href="#lqrating">Localization Quality Rating</a>: expresses an overall measurement of the localization quality of a document or an item in a document.</li><li><a href="#mtconfidence">MT Confidence</a>: indicates the confidence that MT systems provide about their translation. </li><li><a href="#allowedchars">Allowed Characters</a>: specifies the characters that are permitted in a given piece of content.</li><li><a href="#storagesize">Storage Size</a>: specifies the maximum storage size of a given piece of content.</li></ul>Most of the existing ITS 1.0 data categories are included and new ones have been added. Modifications of existing ITS 1.0 data categories are summarized in <a class="section-ref" href="#high-level-differences-between-1.0-and-2.0">Section 1.4: High-level differences between ITS 1.0 and ITS 2.0</a>.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts-selection" id="basic-concepts-selection"></a>2.2 Selection</h3>Information (e.g. “translate this”) captured by an ITS data category always pertains to one or more XML or HTML nodes, primarily element and attribute nodes. In a sense, the relevant node(s) get “selected”. Selection may be explicit or implicit. ITS distinguishes two mechanisms for explicit selection: (1) local and (2) global (via <code class="its-elem-markup">rules</code>). Both local and global approaches can interact with each other, and with additional ITS dimensions such as inheritance and defaults.The mechanisms defined for ITS selection resemble those defined in <a title="Cascading Style Sheets,
 level 2 revision 1 CSS 2.1 Specification" href="#css2-1">[CSS 2.1]</a>. The local approach can be compared to the <code>style</code> attribute in HTML/XHTML, and the global approach is similar to the <code>style</code> element in HTML/XHTML:<ul><li>The local approach puts ITS markup in the relevant element of the host vocabulary (e.g. the <code>author</code> element in DocBook)</li><li>The global <a href="#selection-global">rule-based approach</a> puts the ITS markup in elements defined by ITS itself (namely the <code class="its-elem-markup">rules</code> element)</li></ul>ITS usually uses XPath in rules for identifying nodes although CSS Selectors and other query languages can in addition be implemented by applications.ITS 2.0 can be used with XML documents (e.g. a DocBook article), HTML documents, document schemas (e.g. an XML Schema document for a proprietary document format), or data models in RDF.The following two examples provide more details about the distinction between the local and global approach, using the <a href="#trans-datacat">Translate</a> data category as an example.<div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts-selection-local" id="basic-concepts-selection-local"></a>2.2.1 Local Approach</h4>The document in <a href="#EX-basic-concepts-1">Example 3</a> shows how a content author can use the ITS <code class="its-attr-markup">translate</code> attribute to indicate that all content inside the <code>author</code> element is not intended for translation (i.e. has to be left untranslated). Translation tools that are aware of the meaning of the attribute can protect the relevant content from being translated (possibly still allowing translators to see the protected content as context information).<div class="exampleOuter"><div class="exampleHeader"><a name="EX-basic-concepts-1" id="EX-basic-concepts-1"></a>Example 3: ITS markup on elements in an XML document (local approach) </div><div class="exampleInner"><pre><article xmlns="http://docbook.org/ns/docbook" xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0" version="5.0" xml:lang="en"> <info> <title>An example article</title> <author its:translate="no"> <personname> <firstname>John</firstname> <surname>Doe</surname> </personname> <affiliation> <address><email>foo@example.com</email></address> </affiliation> </author> </info> <para>This is a short article.</para> </article> </pre></div>[Source file: <a href="examples/xml/EX-basic-concepts-1.xml">examples/xml/EX-basic-concepts-1.xml</a>]</div>For the local approach (and <a href="#EX-basic-concepts-1">Example 3</a>) to work for a whole markup vocabulary, a schema developer would need to add the <code class="its-attr-markup">translate</code> attribute to the schema as a common attribute or on all the relevant element definitions. The example indicates that <a href="#basic-concepts-overinher">inheritance</a> plays a part in identifying which content does have to be translated and which does not: Although only the <code>author</code> element is marked as “do not translate”, its descendants (<code>personname</code>, <code>firstname</code>, <code>surname</code>) are considered to be implicitly marked as well. Tools that process this content for translation need to implement the expected inheritance.For XML content, the local approach cannot be applied to a particular attribute. If ITS needs to be applied to a particular attribute, the global approach has to be used. The local approach applies to content of the current element and all its inherited nodes as described in <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a>. For the <a href="#trans-datacat">Translate</a> data category used in <a title="HTML5" href="#html5">[HTML5]</a>, this is different, see the explanation of the <a href="#translate-in-html5">HTML5 definition of Translate</a>.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts-selection-global" id="basic-concepts-selection-global"></a>2.2.2 Global Approach</h4>The document in <a href="#EX-basic-concepts-2">Example 4</a> shows a different approach to identifying non-translatable content, similar to that used with a <code>style</code> element in <a title="XHTML™ 1.0 The Extensible
 HyperText Markup Language (Second Edition)" href="#xhtml10">[XHTML 1.0]</a>, but using an ITS-defined element called <code class="its-elem-markup">rules</code>. It works as follows: A document can contain a <code class="its-elem-markup">rules</code> element (placed where it does not impact the structure of the document, e.g., in a “head” section, or even outside of the document itself). The <code class="its-elem-markup">rules</code> element contains one or more ITS children/rule elements (for example <code class="its-elem-markup">translateRule</code>). Each of these children elements contains a <code class="its-attr-markup">selector</code> attribute. As its name suggests, this attribute selects the node or nodes to which the corresponding ITS information pertains. The values of ITS <code class="its-attr-markup">selector</code> attributes are XPath absolute location paths (or CSS Selectors if queryLanguage is set to "css"). Via the <code class="its-elem-markup">param</code> element variables can be provided and used in selectors. Information for the handling of namespaces in XPath expressions is taken from namespace declarations <a title="Namespaces in XML
 (Second Edition)" href="#xmlns">[XML Names]</a> in the current rule element.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-basic-concepts-2" id="EX-basic-concepts-2"></a>Example 4: ITS global markup in an XML document (rule-based approach) </div><div class="exampleInner"><pre><myTopic xmlns="http://mynsuri.example.com" id="topic01" xml:lang="en-us"> <prolog> <title>Using ITS</title> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:translateRule selector="//n:term" translate="no" xmlns:n="http://mynsuri.example.com"/> </its:rules> </prolog> <body> ITS defines <term>data category</term> as an abstract concept for a particular type of information for internationalization and localization of XML schemas and documents. </body> </myTopic> </pre></div>[Source file: <a href="examples/xml/EX-basic-concepts-2.xml">examples/xml/EX-basic-concepts-2.xml</a>]</div>For the global approach (and <a href="#EX-basic-concepts-2">Example 4</a>) to work, a schema developer may need to add a <code class="its-elem-markup">rules</code> element and associated markup to the schema. In some cases, global rules may be sufficient and other ITS markup (such as an <code class="its-attr-markup">translate</code> attribute on the elements and attributes) may not be needed in the schema. However, it is likely that authors may need the local approach from time to time to override the general rule.For specification of the <a href="#trans-datacat">Translate</a> data category information, the contents of the <code class="its-elem-markup">translateRule</code> element would normally be designed by an information architect familiar with the document format and familiar with, or working with someone familiar with, the needs of localization/translation.The global, rule-based approach has the following benefits:<ul><li>Content authors do not have to concern themselves with creating additional markup or verifying that the markup was applied correctly. ITS data categories are associated with sets of nodes (for example all <code>p</code> elements in an XML instance)</li><li>Changes can be made in a single location, rather than by searching and modifying local markup throughout a document (or documents, if the <code class="its-elem-markup">rules</code> element is stored as an external entity)</li><li>ITS data categories can designate attribute values (as well as elements)</li><li>It is possible to associate ITS markup with existing markup (for example the <code>term</code> element in DITA)</li></ul>The commonality in both examples above is the markup <code>translate='no'</code>. This piece of ITS markup can be interpreted as follows:<ul><li>it pertains to the <a href="#trans-datacat">Translate</a> data category </li><li>the attribute <code class="its-attr-markup">translate</code> holds a value of "no"</li></ul></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts-overinher" id="basic-concepts-overinher"></a>2.3 Overriding, Inheritance and Defaults</h3>The power of the ITS selection mechanisms comes at a price: rules related to <a href="#selection-precedence">overriding/precedence</a> and <a href="#datacategories-defaults-etc">inheritance</a> have to be established.The document in <a href="#EX-basic-concepts-3">Example 5</a> shows how inheritance and overriding work for the <a href="#trans-datacat">Translate</a> data category:<ul><li>The ITS default is that all elements are translatable.</li><li>The <code class="its-elem-markup">translateRule</code> element declared in the header overrides the default for the <code>head</code> element inside text and for all its children.</li><li>Because the <code>title</code> element is actually translatable, the global rule needs to be overridden by a local <code>its:translate="yes"</code>.</li><li>In the body of the document the default applies, and <code>its:translate="no"</code> is used to set "faux pas" as non-translatable.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-basic-concepts-3" id="EX-basic-concepts-3"></a>Example 5: Overriding and Inheritance</div><div class="exampleInner"><pre><text xmlns:its="http://www.w3.org/2005/11/its"> <head> <revision>Sep-10-2006 v5</revision> <author>Ealasaidh McIan</author> <contact>ealasaidh@hogw.ac.uk</contact> <title its:translate="yes">The Origins of Modern Novel</title> <its:rules version="2.0"> <its:translateRule translate="no" selector="/text/head"/> </its:rules> </head> <body> <div xml:id="intro"> <head>Introduction</head> It would certainly be quite a <span its:translate="no">faux pas to start a dissertation on the origin of modern novel without mentioning the <tl>Epic of Gilgamesh</tl>... </div> </body> </text> </pre></div>[Source file: <a href="examples/xml/EX-basic-concepts-3.xml">examples/xml/EX-basic-concepts-3.xml</a>]</div>For XML content, <a href="#datacategories-overview">data category specific defaults</a> are provided. These are independent of the actual XML markup vocabulary. Example for the <a href="#trans-datacat">Translate</a> data category: <code>translate="yes"</code> for elements, and <code>translate="no"</code> for attributes.For <a title="HTML5" href="#html5">[HTML5]</a>, several HTML5 elements and attributes map exactly to ITS 2.0 data categories. Hence that HTML markup is normatively interpreted as ITS 2.0 data category information (see <a class="section-ref" href="#html5-existing-markup-versus-its">Section 2.5.3: HTML markup with ITS 2.0 counterparts</a> for more information).</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="basic-concepts-addingpointing" id="basic-concepts-addingpointing"></a>2.4 Adding Information or Pointing to Existing Information</h3>Data categories can add information or point to information for the selected nodes. For example, the <a href="#locNote-datacat">Localization Note</a> data category can add information to selected nodes (using a <code class="its-elem-markup">locNote</code> element), or point to existing information elsewhere in the document (using a <code class="its-attr-markup">locNotePointer</code> attribute).The <a href="#datacategories-overview">data category overview table</a>, in <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a>, provides an overview of which data categories allow the addition of information and which allow to point to existing information.Adding information and pointing to existing information are mutually exclusive; attributes for adding information and attributes for pointing to the same information are not allowed to appear at the same rule element.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="specific-HTML-support" id="specific-HTML-support"></a>2.5 Specific HTML support</h3>For applying ITS 2.0 data categories to HTML, five aspects are of importance:<ol class="depth1"><li>Global approach in HTML5</li><li>Local Approach</li><li>HTML markup with ITS 2.0 counterparts</li><li>Standoff markup in HTML5</li><li>Version of HTML</li></ol>In the following sections these aspects are briefly discussed.<div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-global-approach" id="html5-global-approach"></a>2.5.1 Global approach in HTML5</h4>To account for the so-called <a href="#basic-concepts-selection-global">global approach</a> in HTML, this specification (see <a class="section-ref" href="#html5-global-rules">Section 6.2: Global rules</a>) defines: <ul><li>A link type for referring to external files with global rules from a <code>link</code> element.</li><li>An approach to have inline global rules in the HTML <code>script</code> element.</li></ul>It is preferable to use external global rules linked via the <code>link</code> element rather than to have inline global rules in the HTML document. The advantage is in being able to reuse the same rules file for many documents and also inline rules require secondary parsing of the <code>script</code> element.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-translate-html5-global-1" id="EX-translate-html5-global-1"></a>Example 6: Using ITS global rules in HTML</div>The <code>link</code> element points to the rules file <code>EX-translateRule-html5-1.xml</code> The <code>rel</code> attribute identifies the ITS specific link relation <code>its-rules</code>.<div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Translate flag global rules example</title> <link href=EX-translateRule-html5-1.xml rel=its-rules> </head> <body> This sentence should be translated, but code names like the <code>span</code> element should not be translated. Of course there are always exceptions: certain code values should be translated, e.g. to a value in your language like <code translate=yes>warning</code>. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-translate-html5-global-1.html">examples/html5/EX-translate-html5-global-1.html</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-translate-html5-global-1-rules-file" id="EX-translate-html5-global-1-rules-file"></a>Example 7: ITS rules file linked from HTML</div>The rules file linked in <a href="#EX-translate-html5-global-1">Example 6</a>.<div class="exampleInner"><pre><its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its" xmlns:h="http://www.w3.org/1999/xhtml"> <its:translateRule translate="no" selector="//h:code"/> </its:rules> </pre></div>[Source file: <a href="examples/html5/EX-translateRule-html5-1.xml">examples/html5/EX-translateRule-html5-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-translate-html5-inline-global-1" id="EX-translate-html5-inline-global-1"></a>Example 8: Using ITS inline global rules in HTML</div>The <code>script</code> element contains the same rules as the external rules file <code>EX-translateRule-html5-1.xml</code> in <a href="#EX-translate-html5-global-1-rules-file">the above example</a>.<div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Translate flag global rules example</title> <script type=application/its+xml id=ru1> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its" xmlns:h="http://www.w3.org/1999/xhtml"> <its:translateRule translate="no" selector="//h:code"/> </its:rules> </script> </head> <body> This sentence should be translated, but code names like the <code>span</code> element should not be translated. Of course there are always exceptions: certain code values should be translated, e.g. to a value in your language like <code translate=yes>warning</code>. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-translate-html5-inline-global-1.html">examples/html5/EX-translate-html5-inline-global-1.html</a>]</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-its-local-markup" id="html5-its-local-markup"></a>2.5.2 Local approach</h4>In HTML, an ITS 2.0 local data category is realized with the prefix <code>its-</code>. The general mapping of the XML based ITS 2.0 attributes to their HTML counterparts is defined in <a class="section-ref" href="#html5-local-attributes">Section 6.1: Mapping of Local Data Categories to HTML</a>. An informative table in <a class="section-ref" href="#list-of-elements-and-attributes">Appendix I: List of ITS 2.0 Global Elements and Local Attributes</a> provides an overview of the mapping for all data categories.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-existing-markup-versus-its" id="html5-existing-markup-versus-its"></a>2.5.3 HTML markup with ITS 2.0 counterparts</h4>There are four ITS 2.0 data categories, which have counterparts in HTML markup. In these cases, native HTML markup provides some information in terms of ITS 2.0 data categories. For these data categories, ITS 2.0 defines the following:<ul><li>The <a href="#language-information">Language Information</a> data category has the HTML <code>lang</code> attribute as a counterpart. In XHTML the counterpart is the <code>xml:lang</code> attribute. These HTML attributes act as local markup for the <a href="#language-information">Language Information</a> data category in HTML and take <a href="#selection-precedence">precedence</a> over language information conveyed via a global <code class="its-elem-markup">langRule</code>.</li><li>The <a href="#idvalue">Id Value</a> data category has the HTML or XHTML <code>id</code> attribute as counterpart. This HTML attribute acts as local markup for the <a href="#idvalue">Id Value</a> data category in HTML and takes <a href="#selection-precedence">precedence</a> over identifier information conveyed via a global <code class="its-elem-markup">idValueRule</code>.</li><li>The <a href="#elements-within-text">Elements within Text</a> data category has a set of HTML elements (the so-called <a href="https://www.w3.org/TR/2013/CR-html5-20130806/dom.html#phrasing-content-1">phrasing content</a>) as counterpart. In the absence of an <a href="#elements-within-text">Elements within Text</a> local attribute or global rules selecting the element in question, most of the phrasing content elements are interpreted as <code>withinText="yes"</code> by default. The phrasing content elements <code class="its-elem-markup">iframe</code>, <code class="its-elem-markup">noscript</code>, <code class="its-elem-markup">script</code> and <code class="its-elem-markup">textarea</code> are interpreted as <code>withinText="nested"</code>.</li><li>The <a href="#trans-datacat">Translate</a> data category has a direct counterpart in <a title="HTML5" href="#html5">[HTML5]</a>, namely the <a title="HTML5" href="#html5">[HTML5]</a> <code>translate</code> attribute. ITS 2.0 does not define its own behavior for <a title="HTML5" href="#html5">[HTML5]</a> <code>translate</code>, but just refers to <a href="https://www.w3.org/TR/2013/CR-html5-20130806/dom.html#the-translate-attribute">the HTML5 definition</a>. That definition also applies to nodes selected via global rules. That is, a <code class="its-elem-markup">translateRule</code> like <code><its:translateRule selector="//h:img" translate="yes"/></code> will set the <code>img</code> element and its translatable attributes like <code>alt</code> to "yes".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-its-and-existing-HTML5-markup" id="EX-its-and-existing-HTML5-markup"></a>Example 9: The <a href="#language-information">Language Information</a>, <a href="#idvalue">Id Value</a>, <a href="#elements-within-text">Elements within Text</a> and <a href="#trans-datacat">Translate</a> ITS 2.0 data categories expressed by native HTML markup.</div>The <code>lang</code> attribute of the <code>html</code> element conveys the <a href="#language-information">Language Information</a> value "en". The <code>id</code> attribute of the <code>p</code> element conveys the <a href="#idvalue">Id Value</a> "p1". The elements <code>em</code> and <code>img</code> are interpreted to be <code>withinText="yes"</code>. The <code>p</code> element and its children are set to be non-translatable via an <a title="HTML5" href="#html5">[HTML5]</a> <code>translate</code> attribute. Via inheritance, the <code>alt</code> attribute, normally translatable by default, also is non-translatable.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>HTML native markup expressing three ITS 2.0 data categories</title> </head> <body> <p id="p1" translate="no">This is a motherboard and image: <img src="http://example.com/myimg.png" alt="My image"/>. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-its-and-existing-HTML5-markup.html">examples/html5/EX-its-and-existing-HTML5-markup.html</a>]</div>There are also some HTML markup elements that have or can have similar, but not necessarily identical, roles and behaviors as certain ITS 2.0 data categories. For example, the HTML <code>dfn</code> element could be used to identify a term in the sense of the <a href="#terminology">Terminology</a> data category. However, this is not always the case and it depends on the intentions of the HTML content author. To accommodate this situation, users of ITS 2.0 are encouraged to specify the semantics of existing HTML markup in an ITS 2.0 context with a dedicated global rules file. For example, a rule can be used to define that the HTML <code>dfn</code> has the semantics of ITS <code>term="yes"</code>. For additional examples, see the <a href="https://www.w3.org/TR/2008/NOTE-xml-i18n-bp-20080213/#relating-its-plus-xhtml">XML I18N Best Practices</a> document.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-standoff-markup-explanation" id="html5-standoff-markup-explanation"></a>2.5.4 Standoff markup in HTML5</h4>The <a href="#provenance">Provenance</a> and the <a href="#lqissue">Localization Quality Issue</a> data categories allow for using so-called standoff markup, see the XML <a href="#EX-provenance-global-1">Example 58</a>. In HTML such standoff markup is placed into a <code>script</code> element. If this is done, the constraints for <a href="#provenance-records-in-html5-constraint">Provenance standoff</a> markup in HTML and <a href="#loc-quality-issues-in-html5-constraint">Localization quality issue</a> markup in HTML need to be taken into account. Examples of standoff markup in HTML for the two data categories are <a href="#EX-provenance-html5-local-2">Example 61</a> and <a href="#EX-locQualityIssue-html5-local-2">Example 76</a>.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="usage-in-legacy-html" id="usage-in-legacy-html"></a>2.5.5 Version of HTML</h4>ITS 2.0 does not define how to use ITS in HTML versions prior to version 5. Users are thus encouraged to migrate their content to <a title="HTML5" href="#html5">[HTML5]</a> or XHTML. While it is possible to use <code>its-*</code> attributes introduced for <a title="HTML5" href="#html5">[HTML5]</a> in older versions of HTML (such as 3.2 or 4.01) and pages using these attributes will work without any problems, <code>its-*</code> attributes will be marked as invalid by validators.</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="traceability" id="traceability"></a>2.6 Traceability</h3>The <a href="#its-tool-annotation">ITS Tools Annotation</a> mechanism allows processor information to be associated with individual data categories in a document, independently from data category annotations themselves (e.g. the Entity Type related to Text Analysis). The mechanism associates identifiers for tools with data categories via the <code class="its-attr-markup">annotatorsRef</code> attribute (or <a href="">annotators-ref</a> in <a title="HTML5" href="#html5">[HTML5]</a>) and is mandatory for the <a href="#mtconfidence">MT Confidence</a> data category. For the <a href="#terminology">Terminology</a> and <a href="#textanalysis">Text Analysis</a> data categories the ITS Tools Annotation is mandatory if the data categories provide confidence information. Nevertheless, <a href="#its-tool-annotation">ITS Tools Annotation</a> can be used for all data categories. <a href="#EX-its-tool-annotation-2">Example 23</a> demonstrates the usage in the context of several data categories. </div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="mapping-conversion" id="mapping-conversion"></a>2.7 Mapping and conversion</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="mapping-NIF" id="mapping-NIF"></a>2.7.1 ITS and RDF/NIF</h4>ITS 2.0 provides a non-normative algorithm to convert XML or HTML documents (or their DOM representations) that contain ITS metadata to the RDF format based on <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a>. NIF is an RDF/OWL-based format that aims at interoperability between Natural Language Processing (NLP) tools, language resources and annotations.The conversion from <a href="#conversion-to-nif">ITS 2.0 to NIF</a> results in RDF triples. These triples represent the textual content of the original document as RDF typed information. The ITS annotation is represented as properties of content-related triples and relies on an <a href="https://www.w3.org/2005/11/its/rdf#">ITS RDF vocabulary</a>.The back conversion from <a href="#nif-backconversion">NIF to ITS 2.0</a> is defined informatively as well. One motivation for the back conversion is a roundtrip workflow like: 1) conversion to NIF 2) in NIF representation detection of named entities using NLP tools 3) back conversion to HTML and generation of <a href="#textanalysis">Text Analysis</a> markup. The outcome are HTML documents with linked information, see <a href="#EX-text-analysis-html5-local-1">Example 52</a>.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="mapping-XLIFF" id="mapping-XLIFF"></a>2.7.2 ITS and XLIFF</h4>The XML Localization Interchange File Format <a title="XLIFF Version 1.2" href="#xliff1.2">[XLIFF 1.2]</a> is an OASIS standard that enables translatable source text and its translation to be passed between different tools within localization and translation workflows. <a title="XLIFF Version 2.0" href="#xliff2.0">[XLIFF 2.0]</a> is the successor of <a title="XLIFF Version 1.2" href="#xliff1.2">[XLIFF 1.2]</a> and under development. XLIFF has been widely implemented in various translation management systems, computer aided translation tools and in utilities for extracting translatable content from source documents and merging back the content in the target language.The mapping between ITS and XLIFF therefore underpins several important ITS 2.0 usage scenarios <a title="Metadata for the Multilingual Web - Usage Scenarios and Implementations " href="#mlw-metadata-us-impl">[MLW US IMPL]</a>. These usage scenarios involve:<ul><li>the extraction of ITS metadata from a source language file into XLIFF</li><li>the addition of ITS metadata into an XLIFF file by translation tools</li><li>the mapping of ITS metadata in an XLIFF file into ITS metadata in the resulting target language files.</li></ul>ITS 2.0 has no normative dependency on XLIFF, however a <a href="https://www.w3.org/International/its/wiki/XLIFF_Mapping">non-normative definition of how to represent ITS 2.0 data categories in XLIFF 1.2 or XLIFF 2.0</a> is being defined within the <a href="https://www.w3.org/International/its/ig/">Internationalization Tag Set Interest Group</a>.</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="implementing-its20" id="implementing-its20"></a>2.8 ITS 2.0 Implementations and Conformance</h3>What does it mean to implement ITS 2.0? This specification provides several conformance clauses as the normative answer (see <a class="section-ref" href="#conformance">Section 4: Conformance</a>). The clauses target different types of implementers:<ul><li>Conformance clauses in <a class="section-ref" href="#conformance-product-schema">Section 4.1: Conformance Type 1: ITS Markup Declarations</a> tell markup vocabulary developers how to add ITS 2.0 markup declarations to their schemas.</li><li>Conformance clauses in <a class="section-ref" href="#conformance-product-processing-expectations">Section 4.2: Conformance Type 2: The Processing Expectations for ITS Markup</a> tell implementers how to process XML content according to ITS 2.0 data categories.</li><li>Conformance clauses in <a class="section-ref" href="#conformance-product-html-processing-expectations">Section 4.3: Conformance Type 3: Processing Expectations for ITS Markup in HTML</a> tell implementers how to process <a title="HTML5" href="#html5">[HTML5]</a> content.</li><li>Conformance clauses in <a class="section-ref" href="#conformance-product-html5-its">Section 4.4: Conformance Type 4: Markup conformance for HTML5+ITS documents</a> tell implementers how ITS 2.0 markup is integrated into <a title="HTML5" href="#html5">[HTML5]</a>.</li></ul>The conformance clauses in <a class="section-ref" href="#conformance-product-processing-expectations">Section 4.2: Conformance Type 2: The Processing Expectations for ITS Markup</a> and <a class="section-ref" href="#conformance-product-html-processing-expectations">Section 4.3: Conformance Type 3: Processing Expectations for ITS Markup in HTML</a> clarify how information needs to be made available for given pieces of markup when processing a dedicated ITS 2.0 data category. To allow for flexibility, an implementation can choose whether it wants to support only ITS 2.0 global or local information, or XML or HTML content. These choices are reflected in separate conformance clauses and also in the <a href="https://github.com/w3c/its-2.0-testsuite/">ITS 2.0 test suite</a>.ITS 2.0 processing expectations only define which information needs to be made available. They do not define how that information actually is to be used. This is due to the fact that there is a wide variety of usage scenarios for ITS 2.0, and a wide variety of tools for working with ITS 2.0 is possible. Each of these tools may have its own way of using ITS 2.0 data categories (see <a title="Metadata for the Multilingual Web - Usage Scenarios and Implementations " href="#mlw-metadata-us-impl">[MLW US IMPL]</a> for more information).</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="notation-terminology" id="notation-terminology"></a>3 Notation and Terminology</h2> This section is normative. <div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="notation" id="notation"></a>3.1 Notation</h3>The keywords “MUST”, “MUST NOT”, “REQUIRED”, “SHALL”, “SHALL NOT”, “SHOULD”, “SHOULD NOT”, “RECOMMENDED”, “MAY”, and “OPTIONAL” in this document are to be interpreted as described in <a title="Key Words for use in RFCs to Indicate
 Requirement Levels" href="#rfc2119">[RFC 2119]</a>.The namespace URI that <a href="#rfc-keywords">MUST</a> be used by implementations of this specification is:<div class="exampleInner"><div class="exampleOuter"><pre>http://www.w3.org/2005/11/its</pre></div></div>The namespace prefix used in this specification for XML implementations of ITS for the above URI is <code>its</code>. It is recommended that XML implementations of this specification use this prefix, unless there is existing dedicated markup in use for a given data category. In HTML there is no namespace prefix: <code>its-</code> is used instead to indicate ITS 2.0 attributes in HTML documents. See <a class="section-ref" href="#html5-local-attributes">Section 6.1: Mapping of Local Data Categories to HTML</a> for details.In addition, the following namespaces are used in this document:<ul><li><code>http://www.w3.org/2001/XMLSchema</code> for the XML Schema namespace, here used with the prefix <code>xs</code></li><li><code>http://www.w3.org/1999/xlink</code> for the XLink namespace, here used with the prefix <code>xlink</code></li><li><code>http://www.w3.org/1999/xhtml</code> for the HTML namespace, here used with the prefix <code>h</code></li></ul></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="def-datacat" id="def-datacat"></a>3.2 Data category</h3> [<a name="t002" id="t002" title="data category">Definition</a>: ITS defines data category as an abstract concept for a particular type of information for internationalization and localization of XML schemas and documents.] The concept of a data category is independent of its implementation in an XML and HTML environment (e.g., using an element or attribute).For each data category, ITS distinguishes between the following:<ul><li>the prose description, see <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a></li><li>schema language-independent formalization, see the "implementation" subsections in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a></li><li>schema language-specific implementations, see <a class="section-ref" href="#its-schemas">Appendix D: Schemas for ITS</a></li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="d0e1611" id="d0e1611"></a>Example 10: A data category and its implementation</div>The <a href="#trans-datacat">Translate</a> data category conveys information as to whether a piece of content is intended for translation or not.The simplest formalization of this prose description on a schema language-independent level is a <code class="its-attr-markup">translate</code> attribute with two possible values: "yes" and "no". An implementation on a schema language-specific level would be the declaration of the <code class="its-attr-markup">translate</code> attribute in, for example, an XML Schema document or a RELAX NG document. A different implementation would be a <code class="its-elem-markup">translateRule</code> element that allows for specifying <a href="#selection-global">global rules</a> about the <a href="#trans-datacat">Translate</a> data category.</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="def-selection" id="def-selection"></a>3.3 Selection</h3> [<a name="termdef-selection" id="termdef-selection" title="Selection">Definition</a>: selection encompasses mechanisms to specify to what parts of an XML or HTML document an ITS data category and its values apply.] Selection is discussed in detail in <a class="section-ref" href="#its-processing">Section 5: Processing of ITS information</a>. Selection can be applied globally, see <a class="section-ref" href="#selection-global">Section 5.2.1: Global, Rule-based Selection</a>, and locally, see <a class="section-ref" href="#selection-local">Section 5.2.2: Local Selection in an XML Document</a>. As for global selection, ITS information can be <a href="#def-adding-pointing">added</a> to the selected nodes, or it can <a href="#def-adding-pointing">point to existing information</a> that is related to selected nodes. <div class="note">Note:The selection of the ITS data categories applies to textual values contained within element or attribute nodes. In some cases these nodes form pointers to other resources; a well-known example is the <code>src</code> attribute on the <code>img</code> element in HTML. The ITS <a href="#trans-datacat">Translate</a> data category applies to the text of the pointer itself, not the object to which it points. Thus in the following example, the translation information specified via the <code class="its-elem-markup">translateRule</code> element applies to the filename "instructions.jpg", and is not an instruction to open the graphic and change the words therein.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-notation-terminology-1" id="EX-notation-terminology-1"></a>Example 11: Selecting the text of a pointer to an external object</div><div class="exampleInner"><pre><text> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:translateRule translate="yes" selector="//p/img/@src"/> </its:rules> ... <p xmlns:its="http://www.w3.org/2005/11/its">As you can see in <img src="instructions.jpg"/>, the truth is not always out there. </text> </pre></div>[Source file: <a href="examples/xml/EX-notation-terminology-1.xml">examples/xml/EX-notation-terminology-1.xml</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="def-local-attributes" id="def-local-attributes"></a>3.4 ITS Local Attributes</h3> [<a name="local-attributes" id="local-attributes" title="ITS Local Attributes">Definition</a>: ITS Local Attributes are all attributes defined in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> as a local markup.] </div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="def-rule-elements" id="def-rule-elements"></a>3.5 Rule Elements</h3> [<a name="rule-elements" id="rule-elements" title="Rule Elements">Definition</a>: Rule Elements are all elements defined in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> as elements for global rules.] </div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="iri-usage" id="iri-usage"></a>3.6 Usage of Internationalized Resource Identifiers in ITS</h3>All attributes that have the type <code>anyURI</code> in the normative RELAX NG schema in <a class="section-ref" href="#its-schemas">Appendix D: Schemas for ITS</a> <a href="#rfc-keywords">MUST</a> allow the usage of Internationalized Resource Identifiers (IRIs, <a title="Internationalized Resource
 Identifiers (IRIs)" href="#rfc3987">[RFC 3987]</a> or its successor) to ease the adoption of ITS in international application scenarios.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="def-html" id="def-html"></a>3.7 The Term HTML</h3>This specification uses the term <code>HTML</code> to refer to HTML5 or its successor in HTML syntax <a title="HTML5" href="#html5">[HTML5]</a>.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="def-css-selector" id="def-css-selector"></a>3.8 The Term CSS Selectors</h3>This specification uses the term <code>CSS Selectors</code> in the sense of <code>Selectors</code> as specified in <a title="Selectors Level
 3" href="#css3-selectors">[Selectors Level 3]</a> to prevent confusion with the generic use of the word "selector".</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="conformance" id="conformance"></a>4 Conformance</h2> This section is normative. The usage of the term conformance clause in this section is in compliance with <a title="QA Framework:
 Specification Guidelines" href="#qa-framework">[QAFRAMEWORK]</a>.This specification defines four types of conformance: conformance of <a href="#conformance-product-schema">1) ITS markup declarations</a>, conformance of <a href="#conformance-product-processing-expectations">2) processing expectations for ITS Markup</a>, conformance of <a href="#conformance-product-html-processing-expectations">3) processing expectations for ITS Markup in HTML</a>, and <a href="#conformance-product-html5-its">4) markup conformance for HTML5+ITS documents</a>. The conformance type 4 is defined for using ITS markup in HTML5 documents, HTML5+ITS, which serves as an applicable specification in the sense specified in the <a href="https://www.w3.org/TR/html5/infrastructure.html#extensibility">Extensibility section</a> of <a title="HTML5" href="#html5">[HTML5]</a>. These conformance types and classes complement each other. An implementation of this specification <a href="#rfc2119">MAY</a> use them separately or together.<div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="conformance-product-schema" id="conformance-product-schema"></a>4.1 Conformance Type 1: ITS Markup Declarations</h3> Description: ITS markup declarations encompass all declarations that are part of the Internationalization Tag Set. They do not concern the usage of the markup in XML documents. Such markup is subject to the conformance clauses in <a class="section-ref" href="#conformance-product-processing-expectations">Section 4.2: Conformance Type 2: The Processing Expectations for ITS Markup</a>. Definitions related to this conformance type: ITS markup declarations are defined in various subsections in a schema language independent manner. Who uses this conformance type: Schema designers integrating ITS markup declarations into a schema. All conformance clauses for this conformance type concern the position of ITS markup declarations in that schema, and their status as mandatory or optional. Conformance clauses: <ul><li> 1-1: At least one of the following <a href="#rfc-keywords">MUST</a> be in the schema:<ul><li><code class="its-elem-markup">rules</code> element</li><li>one of the local ITS attributes</li><li><code class="its-elem-markup">span</code> element</li></ul></li><li> 1-2: If the <code class="its-elem-markup">rules</code> element is used, it <a href="#rfc-keywords">MUST</a> be part of the content model of at least one element declared in the schema. It <a href="#rfc-keywords">SHOULD</a> be in a content model for meta information, if this is available in that schema (e.g., the <code>head</code> element in <a title="XHTML™ 1.0 The Extensible
 HyperText Markup Language (Second Edition)" href="#xhtml10">[XHTML 1.0]</a>).</li><li> 1-3: If the <code class="its-elem-markup">span</code> element is used, it <a href="#rfc-keywords">SHOULD</a> be declared as an inline element.</li></ul>Full implementations of this conformance type will implement all markup declarations for ITS. Statements related to this conformance type <a href="#rfc-keywords">MUST</a> list all markup declarations they implement. Examples: Examples of the usage of ITS markup declarations in various existing schemas are given in a separate document <a title="Best
 Practices for XML Internationalization" href="#xml-i18n-bp">[XML i18n BP]</a>.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="conformance-product-processing-expectations" id="conformance-product-processing-expectations"></a>4.2 Conformance Type 2: The Processing Expectations for ITS Markup</h3> Description: Processors need to compute the ITS information that pertains to a node in an XML document. The ITS processing expectations define how the computation has to be carried out. Correct computation involves support for <a href="#def-selection">selection mechanism</a>, <a href="#datacategories-defaults-etc">defaults / inheritance / overriding characteristics</a>, and <a href="#selection-precedence">precedence</a>. The markup <a href="#rfc-keywords">MAY</a> be valid against a schema that conforms to the clauses in <a class="section-ref" href="#conformance-product-schema">Section 4.1: Conformance Type 1: ITS Markup Declarations</a>. Definitions related to this conformance type: The processing expectations for ITS markup make use of selection mechanisms defined in <a class="section-ref" href="#its-processing">Section 5: Processing of ITS information</a>. The individual data categories defined in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> have <a href="#datacategories-defaults-etc">defaults / inheritance / overriding characteristics</a>, and allow for using ITS markup in various positions (<a href="#selection-global">global</a> and <a href="#selection-local">local</a>). Who uses this conformance type: Applications that need to process the nodes captured by a data category for internationalization or localization. Examples of this type of application are: ITS markup-aware editors, or translation tools that make use of ITS markup to filter translatable text as an input to the localization process.<div class="note">Note: Application-specific processing (that is processing that goes beyond the computation of ITS information for a node), such as automated filtering of translatable content based on the <a href="#trans-datacat">Translate</a> data category, is not covered by the conformance clauses below.</div> Conformance clauses: <ul><li> 2-1: A processor <a href="#rfc-keywords"> MUST</a> implement at least one <a href="#def-datacat">data category</a>. For each implemented <a href="#def-datacat">data category</a>, the following <a href="#rfc-keywords">MUST</a> be taken into account:<ul><li> 2-1-1: processing of at least one selection mechanism (<a href="#selection-global">global</a> or <a href="#selection-local">local</a>).</li><li> 2-1-2: the <a href="#datacategories-defaults-etc">default selections for the data category</a>.</li><li> 2-1-3: the precedence definitions for selections defined in <a class="section-ref" href="#selection-precedence">Section 5.5: Precedence between Selections</a>, for the type of selections it processes.</li></ul></li><li> 2-2: If an application claims to process ITS markup for the global selection mechanism, it <a href="#rfc-keywords">MUST</a> process an XLink <code class="its-attr-markup">href</code> attribute found on a <code class="its-elem-markup">rules</code> element.</li><li> 2-3: If an application claims to process ITS markup implementing the conformance clauses 2-2 and 2-3, it <a href="#rfc-keywords">MUST</a> process that markup with XML documents.</li><li> 2-4: Non-ITS elements and attributes found in ITS elements <a href="#rfc2119">MAY</a> be ignored.</li></ul>Statements related to this conformance type <a href="#rfc-keywords">MUST</a> list all <a href="#def-datacat">data categories</a> they implement, and for each <a href="#def-datacat">data category</a>, which type of selection they support, whether they support processing of XML.<div class="note">Note:The above conformance clauses are directly reflected in the <a href="https://github.com/w3c/its-2.0-testsuite/">ITS 2.0 test suite</a>. All tests specify which data category is processed (clause <a href="#its-conformance-2-1">2-1</a>); they are relevant for (clause <a href="#its-conformance-2-1-1">2-1-1</a>) global or local selection, or both; they require the processing of defaults and precedence of selections (clauses <a href="#its-conformance-2-1-2">2-1-2</a> and <a href="#its-conformance-2-1-3">2-1-3</a>); for each data category there are tests with linked rules (<a href="#its-conformance-2-2">2-2</a>); and all types of tests are given for XML (clause <a href="#its-conformance-2-3">2-3</a>). Implementers are encouraged to organize their documentation in a similar way, so that users of ITS 2.0 easily can understand the processing capabilities available.</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="conformance-product-html-processing-expectations" id="conformance-product-html-processing-expectations"></a>4.3 Conformance Type 3: Processing Expectations for ITS Markup in HTML</h3> Description: Processors need to compute the ITS information that pertains to a node in an HTML document. The ITS processing expectations define how the computation has to be carried out. Correct computation involves support for <a href="#def-selection">selection mechanism</a>, <a href="#datacategories-defaults-etc">defaults / inheritance / overriding characteristics</a>, and <a href="#html5-selection-precedence">precedence</a>. Definitions related to this conformance type: The processing expectations for ITS markup make use of selection mechanisms defined in <a class="section-ref" href="#its-processing">Section 5: Processing of ITS information</a>. The individual data categories defined in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> have <a href="#datacategories-defaults-etc">defaults / inheritance / overriding characteristics</a>, and allow for using ITS markup in various positions (<a href="#html5-local-attributes">local</a>, <a href="#html5-external-global-rules">external global</a> and <a href="#html5-inline-global-rules">inline global</a>). Who uses this conformance type: Applications that need to process the nodes captured by a data category for internationalization or localization. Examples of this type of application are ITS markup-aware editors or translation tools that make use of ITS markup to filter translatable text as an input to the localization process.<div class="note">Note: Application-specific processing (that is processing that goes beyond the computation of ITS information for a node) such as automated filtering of translatable content based on the <a href="#trans-datacat">Translate</a> data category is not covered by the conformance clauses below.</div> Conformance clauses: <ul><li> 3-1: A processor <a href="#rfc-keywords"> MUST</a> implement at least one <a href="#def-datacat">data category</a>. For each implemented <a href="#def-datacat">data category</a>, the following <a href="#rfc-keywords">MUST</a> be taken into account:<ul><li> 3-1-1: processing of at least one selection mechanism (<a href="#selection-global">global</a> or <a href="#selection-local">local</a>).</li><li> 3-1-2: the <a href="#datacategories-defaults-etc">default selections for the data category</a>.</li><li> 3-1-3: the precedence definitions for selections defined in <a class="section-ref" href="#html5-selection-precedence">Section 6.4: Precedence between Selections</a>, for the type of selections it processes.</li></ul></li><li> 3-2: If an application claims to process ITS markup for the global selection mechanism, it <a href="#rfc-keywords">MUST</a> process a <code class="its-attr-markup">href</code> attribute found on a <code>link</code> element that has a <code>rel</code> attribute with the value <code>its-rules</code>.</li><li> 3-3: If an application claims to process ITS markup implementing the conformance clauses 3-1 and 3-2, it <a href="#rfc-keywords">MUST</a> process that markup within HTML documents.</li></ul>Statements related to this conformance type <a href="#rfc-keywords">MUST</a> list all <a href="#def-datacat">data categories</a> they implement and, for each <a href="#def-datacat">data category</a>, which type of selection they support.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="conformance-product-html5-its" id="conformance-product-html5-its"></a>4.4 Conformance Type 4: Markup conformance for HTML5+ITS documents</h3>Conforming HTML5+ITS documents are those that comply with all the conformance criteria for documents as defined in <a title="HTML5" href="#html5">[HTML5]</a> with the following exception:<ul><li>Conformance clause 4-1: <a href="http://dev.w3.org/html5/spec/single-page.html#global-attributes">Global attributes</a> that can be used on all HTML elements are extended by attributes for local data categories as defined in <a class="section-ref" href="#html5-local-attributes">Section 6.1: Mapping of Local Data Categories to HTML</a>.</li></ul></div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="its-processing" id="its-processing"></a>5 Processing of ITS information</h2> This section is normative. <div class="note">Note:Additional definitions about processing of HTML are given in <a class="section-ref" href="#html5-markup">Section 6: Using ITS Markup in HTML</a>.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="its-version-attribute" id="its-version-attribute"></a>5.1 Indicating the Version of ITS</h3>The version of the ITS schema defined in this specification is "2.0". The version is indicated by the ITS <code class="its-attr-markup">version</code> attribute. This attribute is mandatory for the <code class="its-elem-markup">rules</code> element, where it <a href="#rfc-keywords">MUST</a> be in no namespace.If there is no <code class="its-elem-markup">rules</code> element in an XML document, a prefixed ITS <code class="its-attr-markup">version</code> attribute (e.g., <code>its:version</code>) <a href="#rfc-keywords">MUST</a> be provided on the element where the ITS markup is used, or on one of its ancestors.If there is no <code class="its-elem-markup">rules</code> element and there are elements with standoff ITS markup in an XML document, an ITS <code class="its-attr-markup">version</code> attribute <a href="#rfc-keywords">MUST</a> be provided on element with standoff ITS markup or a prefixed ITS <code class="its-attr-markup">version</code> attribute (e.g., <code>its:version</code>) <a href="#rfc-keywords">MUST</a> be provided on one of its ancestors.There <a href="#rfc-keywords">MUST NOT</a> be two different versions of ITS in the same document.External, linked rules can have different versions than internal rules.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="datacategory-locations" id="datacategory-locations"></a>5.2 Locations of Data Categories</h3>ITS data categories can appear in two places:<ul><li><a href="#selection-global">Global rules</a>: the selection is realized within a <code class="its-elem-markup">rules</code> element. It contains <a href="#rule-elements">rule elements</a> for each data category. Each rule element has a <code class="its-attr-markup">selector</code> attribute and possibly other attributes. The <code class="its-attr-markup">selector</code> attribute contains an absolute selector as defined in <a class="section-ref" href="#selectors">Section 5.3: Query Language of Selectors</a>.</li><li><a href="#selection-local">Locally in a document</a>: the selection is realized using ITS local attributes, which are attached to an element node, or the <code class="its-elem-markup">span</code> element. There is no additional <code class="its-attr-markup">selector</code> attribute. The default selection for each data category defines whether the selection covers attributes and child elements. See <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a>.</li></ul>The two locations are described in detail below.<div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="selection-global" id="selection-global"></a>5.2.1 Global, Rule-based Selection</h4>Global, rule-based selection is implemented using the <code class="its-elem-markup">rules</code> element. The <code class="its-elem-markup">rules</code> element contains zero or more <a href="#rule-elements">rule elements</a>. Each <a href="#rule-elements">rule element</a> has a mandatory <code class="its-attr-markup">selector</code> attribute. This attribute and all other possible attributes on <a href="#rule-elements">rule elements</a> are in the empty namespace and used without a prefix.If there is more than one <code class="its-elem-markup">rules</code> element in an XML document, the rules from each section are to be processed at the same precedence level. The <code class="its-elem-markup">rules</code> sections are to be read in document order, and the ITS rules with them processed sequentially. The versions of these <code class="its-elem-markup">rules</code> elements <a href="#rfc-keywords">MUST NOT</a> be different.Depending on the data category and its usage, there are additional attributes for adding information to the selected nodes, or for pointing to existing information in the document. For example, the <a href="#locNote-datacat">Localization Note</a> data category can be used for adding notes to selected nodes, or for pointing to existing notes in the document. For the former purpose, a <code class="its-elem-markup">locNote</code> element can be used. For the latter purpose, a <code class="its-attr-markup">locNotePointer</code> attribute can be used.The <a href="#datacategories-overview">data category overview table</a>, in <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a>, provides an overview of what data categories allow to point to existing information or to add information.The functionalities of adding information and pointing to existing information are mutually exclusive. That is: markup for pointing and adding the same information <a href="#rfc-keywords">MUST NOT</a> appear in the same rule element.Global rules can appear in the XML document they will be applied to, or in a separate XML document. The precedence of their processing depends on these variations. See also <a class="section-ref" href="#selection-precedence">Section 5.5: Precedence between Selections</a>.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="selection-local" id="selection-local"></a>5.2.2 Local Selection in an XML Document</h4>Local selection in XML documents is realized with <a href="#local-attributes">ITS local attributes</a> or the <code class="its-elem-markup">span</code> element. <code class="its-elem-markup">span</code> serves just as a carrier for the local ITS attributes.The data category determines what is being selected. The necessary data category specific defaults are described in <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a>.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-selection-local-1" id="EX-selection-local-1"></a>Example 12: Defaults for various data categories</div>By default the content of all elements in a document is translatable. The attribute <code>its:translate="no"</code> in the <code>head</code> element means that the content of this element, including child elements, is not intended for translation. The attribute <code>its:translate="yes"</code> in the <code>title</code> element means that the content of this element, is to be translated (overriding the <code>its:translate="no"</code> in <code>head</code>). Attribute values of the selected elements or their children are not affected by local <code class="its-attr-markup">translate</code> attributes. By default they are not translatable.The default directionality of a document is left-to-right. The <code>its:dir="rtl"</code> in the <code>quote</code> element means that the directionality of the content of this element, including child elements and attributes, is right-to-left. Note that <code>xml:lang</code> indicates only the language, not the directionality.<div class="exampleInner"><pre><text xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0" xml:lang="en"> <head its:translate="no"> <author>Sven Corneliusson</author> <date>2006-09-26T17:34:04Z</date> <title its:translate="yes" role="header">Bidirectional Text</title> </head> <body> <par>In Arabic, the title <quote xml:lang="ar" its:dir="rtl">نشاط التدويل، W3C</quote> means <quote>Internationalization Activity, W3C</quote>.</par> </body> </text> </pre></div>[Source file: <a href="examples/xml/EX-selection-local-1.xml">examples/xml/EX-selection-local-1.xml</a>]</div><div class="note">Note:The <code class="its-attr-markup">dir</code> and <code class="its-attr-markup">translate</code> attributes are not listed in the ITS attributes to be used in HTML. The reason is that these two attributes are available in HTML natively, so there is no need to provide them as <code>its-</code> attributes. The definition of the two attributes in HTML is compatible, that is it provides the same values and interpretation, as the definition for the two data categories <a href="#trans-datacat">Translate</a> and <a href="#directionality">Directionality</a>.</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="selectors" id="selectors"></a>5.3 Query Language of Selectors</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="queryLanguage" id="queryLanguage"></a>5.3.1 Choosing Query Language</h4> <a href="#rule-elements">Rule elements</a> have attributes that contain absolute and relative selectors. Interpretation of these selectors depends on the actual query language. The query language is set by <code class="its-attr-markup">queryLanguage</code> attribute on <code class="its-elem-markup">rules</code> element. If <code class="its-attr-markup">queryLanguge</code> is not specified XPath 1.0 is used as a default query language.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="d0e2513" id="d0e2513"></a>5.3.2 XPath 1.0</h4>XPath 1.0 is identified by <code>xpath</code> value in <code class="its-attr-markup">queryLanguage</code> attribute.<div class="div4"> <h5><a name="d0e2524" id="d0e2524"></a>5.3.2.1 Absolute selector</h5>The absolute selector <a href="#rfc-keywords">MUST</a> be an XPath expression that starts with "<code>/</code>". That is, it <a href="#rfc-keywords">MUST</a> be an <a href="https://www.w3.org/TR/xpath/#NT-AbsoluteLocationPath"> AbsoluteLocationPath</a> or union of <a href="https://www.w3.org/TR/xpath/#NT-AbsoluteLocationPath"> AbsoluteLocationPath</a>s as described in <a href="#xpath">XPath 1.0</a>. This ensures that the selection is not relative to a specific location. The resulting nodes <a href="#rfc-keywords">MUST</a> be either element or attribute nodes.Context for evaluation of the XPath expression is as follows:<ul><li>Context node is set to <a href="https://www.w3.org/TR/xpath/#root-node">Root Node</a>.</li><li>Both context position and context size are 1.</li><li>All variables defined by <code class="its-elem-markup">param</code> elements are bind.</li><li>All functions defined in the <a href="https://www.w3.org/TR/xpath/#corelib">XPath Core Function Library</a> are available. It is an error for an expression to include a call to any other function.</li><li>The set of namespace declarations are those in scope on the element that has the attribute in which the expression occurs. This includes the implicit declaration of the prefix <code>xml</code> required by the <a href="#xmlns">XML Namespaces Recommendation</a>; the default namespace (as declared by <code>xmlns</code>) is not part of this set.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-selection-global-1" id="EX-selection-global-1"></a>Example 13: XPath expressions with namespaces</div>The <code>term</code> element from the TEI is in a namespace <code>http://www.tei-c.org/ns/1.0</code>. <div class="exampleInner"><pre> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:termRule selector="//tei:term" term="yes" xmlns:tei="http://www.tei-c.org/ns/1.0"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-selection-global-1.xml">examples/xml/EX-selection-global-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-selection-global-2" id="EX-selection-global-2"></a>Example 14: XPath expressions without namespaces</div>The <code class="its-elem-markup">term</code> element from DocBook V4.5 is in no namespace.<div class="exampleInner"><pre> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:termRule selector="//term" term="yes"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-selection-global-2.xml">examples/xml/EX-selection-global-2.xml</a>]</div></div><div class="div4"> <h5><a name="xpath-relative-selector" id="xpath-relative-selector"></a>5.3.2.2 Relative selector</h5>The relative selector <a href="#rfc-keywords">MUST</a> use a <a href="https://www.w3.org/TR/xpath/#NT-RelativeLocationPath">RelativeLocationPath</a> or an <a href="https://www.w3.org/TR/xpath/#NT-AbsoluteLocationPath">AbsoluteLocationPath</a> as described in <a href="#xpath">XPath 1.0</a>. The XPath expression is evaluated relative to the nodes selected by the selector attribute.The following attributes point to existing information: <code class="its-attr-markup">allowedCharactersPointer</code>, <code class="its-attr-markup">taClassRefPointer</code>, <code class="its-attr-markup">taIdentPointer</code>, <code class="its-attr-markup">taIdentRefPointer</code>, <code class="its-attr-markup">taSourcePointer</code>, <code class="its-attr-markup">domainPointer</code>, <code class="its-attr-markup">externalResourceRefPointer</code>, <code class="its-attr-markup">langPointer</code>, <code class="its-attr-markup">locNotePointer</code>, <code class="its-attr-markup">locNoteRefPointer</code>, <code class="its-attr-markup">locQualityIssuesRefPointer</code>, <code class="its-attr-markup">provenanceRecordsRefPointer</code>, <code class="its-attr-markup">storageEncodingPointer</code>, <code class="its-attr-markup">storageSizePointer</code>, <code class="its-attr-markup">targetPointer</code>, <code class="its-attr-markup">termInfoPointer</code>, <code class="its-attr-markup">termInfoRefPointer</code>.Context for evaluation of the XPath expression is the same as for an absolute selector with the following changes:<ul><li>Nodes selected by the expression in the <code class="its-attr-markup">selector</code> attribute form the current node list.</li><li>Context node comes from the current node list.</li><li>The context position comes from the position of the current node in the current node list; the first position is 1.</li><li>The context size comes from the size of the current node list.</li></ul></div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="css-selectors" id="css-selectors"></a>5.3.3 CSS Selectors</h4><div class="note">Note:The term <code>CSS Selectors</code> is used throughout the specification in the sense of <code>Selectors</code> as specified in <a title="Selectors Level
 3" href="#css3-selectors">[Selectors Level 3]</a> to prevent confusion with the generic use of the word "selector". See <a href="#css-selectors">The term CSS Selector</a>.</div><div class="note">Note:The working group will not provide a CSS Selectors-based implementation; nevertheless there are several existing libraries that can translate CSS Selectors to XPath so that XPath selectors-based implementations can be used.</div><div class="note">Note:CSS selectors have no ability to point to attributes.</div>CSS Selectors are identified by the value <code>css</code> in the <code class="its-attr-markup">queryLanguage</code> attribute.<div class="div4"> <h5><a name="d0e2738" id="d0e2738"></a>5.3.3.1 Absolute selector</h5>An absolute selector <a href="#rfc-keywords">MUST</a> be interpreted as a selector as defined in <a title="Selectors Level
 3" href="#css3-selectors">[Selectors Level 3]</a>. Both simple selectors and groups of selectors can be used.</div><div class="div4"> <h5><a name="d0e2748" id="d0e2748"></a>5.3.3.2 Relative selector</h5>A relative selector <a href="#rfc-keywords">MUST</a> be interpreted as a selector as defined in <a title="Selectors Level
 3" href="#css3-selectors">[Selectors Level 3]</a>. A selector is not evaluated against the complete document tree but only against subtrees rooted at nodes selected by the selector in the <code class="its-attr-markup">selector</code> attribute.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="d0e2761" id="d0e2761"></a>5.3.4 Additional query languages</h4>ITS processors <a href="#rfc-keywords">MAY</a> support additional query languages. For each additional query language the processor <a href="#rfc-keywords">MUST</a> define:<ul><li>the identifier of the query language used in <code class="its-attr-markup">queryLanguage</code>;</li><li>rules for evaluating an absolute selector to a collection of nodes;</li><li>rules for evaluating a relative selector to a collection of nodes.</li></ul>Because future versions of this specification are likely to define additional query languages, the following query language identifiers are reserved: <code>xpath</code>, <code>css</code>, <code>xpath2</code>, <code>xpath3</code>, <code>xquery</code>, <code>xquery3</code>, <code>xslt2</code>, <code>xslt3</code>.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="its-param" id="its-param"></a>5.3.5 Variables in selectors</h4>A <code class="its-elem-markup">param</code> element (or several ones) can be placed as the first child element(s) of the <code class="its-elem-markup">rules</code> element to define the default values of variables used in the various selectors used in the rules.An implementation <a href="#rfc2119">MUST</a> support the <code class="its-elem-markup">param</code> element for all query languages it supports and at the same time define how variables are bound for evaluation of the selector expression. Implementations <a href="#rfc2119">SHOULD</a> also provide means for changing the default values of the <code class="its-elem-markup">param</code> elements. Such means are implementation-specific.The <code class="its-elem-markup">param</code> element has a required <code class="its-attr-markup">name</code> attribute. The value of the <code class="its-attr-markup">name</code> attribute is a <a href="https://www.w3.org/TR/2009/REC-xml-names-20091208/#NT-QName">QName</a>, see <a title="Namespaces in XML
 (Second Edition)" href="#xmlns">[XML Names]</a>. The content of the element is a string used as default value for the corresponding variable.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-param-in-global-rules-1" id="EX-param-in-global-rules-1"></a>Example 15: Using the <code class="its-elem-markup">param</code> element to define the default value of a variable in a <code class="its-attr-markup">selector</code> attribute.</div>The <code class="its-elem-markup">param</code> element defines the default value for the <code>$LCID</code> variable. In this case, only the <code>msg</code> element with the attribute <code>lcid</code> set to "0x049" is seen as translatable.<div class="exampleInner"><pre><doc its:version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:rules version="2.0"> <its:param name="LCID">0x0409</its:param> <its:translateRule selector="/doc" translate="no"/> <its:translateRule selector="//msg[@lcid=$LCID]" translate="yes"/> </its:rules> <msg lcid="0x0409" num="1">Create a folder</msg> <msg lcid="0x0411" num="1">フォルダーを作成する</msg> <msg lcid="0x0407" num="1">Erstellen Sie einen Ordner</msg> <msg lcid="0x040c" num="1">Créer un dossier</msg> </doc> </pre></div>[Source file: <a href="examples/xml/EX-param-in-global-rules-1.xml">examples/xml/EX-param-in-global-rules-1.xml</a>]</div><div class="note">Note:In XSLT-based applications, it may make sense to map ITS parameters directly to XSLT parameters. To avoid naming conflicts one can use a prefix with the parameter name's value to distinguish between the ITS parameters and the XSLT parameters.</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="link-external-rules" id="link-external-rules"></a>5.4 Link to External Rules</h3>One way to associate a document with a set of external ITS rules is to use the optional XLink <a title="XML Linking Language
 1.1" href="#xlink1">[XLink 1.1]</a> <code class="its-attr-markup">href</code> attribute in the <code class="its-elem-markup">rules</code> element. The referenced document <a href="#rfc-keywords">MUST</a> be a valid XML document containing at most one <code class="its-elem-markup">rules</code> element. That <code class="its-elem-markup">rules</code> element can be the root element or be located anywhere within the document tree (for example, the document could be an XML Schema).The rules contained in the referenced document <a href="#rfc-keywords">MUST</a> be processed as if they were at the top of the <code class="its-elem-markup">rules</code> element with the XLink <code class="its-attr-markup">href</code> attribute.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-link-external-rules-1" id="EX-link-external-rules-1"></a>Example 16: External file EX-link-external-rules-1.xml with global rules:</div>The example demonstrates how metadata can be added to ITS rules.<div class="exampleInner"><pre><myFormatInfo> <desc>ITS rules used by the Open University</desc> <hostVoc>http://www.tei-c.org/ns/1.0</hostVoc> <rulesId>98ECED99DF63D511B1250008C784EFB1</rulesId> <rulesVersion>v 1.81 2006/03/28 07:43:21</rulesVersion> ... <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:translateRule selector="//header" translate="no"/> <its:translateRule selector="//term" translate="no"/> <its:termRule selector="//term" term="yes"/> <its:withinTextRule withinText="yes" selector="//term | //b"/> </its:rules> </myFormatInfo> </pre></div>[Source file: <a href="examples/xml/EX-link-external-rules-1.xml">examples/xml/EX-link-external-rules-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-link-external-rules-2" id="EX-link-external-rules-2"></a>Example 17: Document with a link to EX-link-external-rules-1.xml</div><div class="exampleInner"><pre><myDoc> <header> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="EX-link-external-rules-1.xml"> <its:translateRule selector="//term" translate="yes"/> </its:rules> <author>Theo Brumble</author> <lastUpdate>Apr-01-2006</lastUpdate> </header> <body> A <term>Palouse horse</term> has a spotted coat. </body> </myDoc> </pre></div>[Source file: <a href="examples/xml/EX-link-external-rules-2.xml">examples/xml/EX-link-external-rules-2.xml</a>]</div>The result of processing the two documents above is the same as processing the following document.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-link-external-rules-3" id="EX-link-external-rules-3"></a>Example 18: Document with identical rules as in the case of included rules</div><div class="exampleInner"><pre><myDoc> <header> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:translateRule selector="//header" translate="no"/> <its:translateRule selector="//term" translate="no"/> <its:termRule selector="//term" term="yes"/> <its:withinTextRule withinText="yes" selector="//term | //b"/> <its:translateRule selector="//term" translate="yes"/> </its:rules> <author>Theo Brumble</author> <lastUpdate>Apr-01-2006</lastUpdate> </header> <body> A <term>Palouse horse</term> has a spotted coat. </body> </myDoc> </pre></div>[Source file: <a href="examples/xml/EX-link-external-rules-3.xml">examples/xml/EX-link-external-rules-3.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-link-external-rules-4" id="EX-link-external-rules-4"></a>Example 19: External rules file with the <code class="its-elem-markup">rules</code> element as the root element</div>As with <a href="#EX-link-external-rules-1">Example 16</a>, these rules can be applied to <a href="#EX-link-external-rules-2">Example 17</a>. The only difference is that in <a href="#EX-link-external-rules-4">Example 19</a>, the <code class="its-elem-markup">rules</code> element is the root element of the external file.<div class="exampleInner"><pre><its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:translateRule selector="//header" translate="no"/> <its:translateRule selector="//term" translate="no"/> <its:termRule selector="//term" term="yes"/> <its:withinTextRule withinText="yes" selector="//term | //b"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-link-external-rules-4.xml">examples/xml/EX-link-external-rules-4.xml</a>]</div>Applications processing global ITS markup <a href="#rfc-keywords">MUST</a> recognize the XLink <code class="its-attr-markup">href</code> attribute in the <code class="its-elem-markup">rules</code> element; they <a href="#rfc-keywords">MUST</a> load the corresponding referenced document and process its rules element before processing the content of the <code class="its-elem-markup">rules</code> element where the original XLink <code class="its-attr-markup">href</code> attribute is.External rules may also have links to other external rules (see <a href="#EX-link-external-rules-2">Example 17</a>). The linking mechanism is recursive in a depth-first approach, and subsequently after the processing the rules MUST be read top-down (see <a href="#EX-link-external-rules-3">Example 18</a>).</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="selection-precedence" id="selection-precedence"></a>5.5 Precedence between Selections</h3>The following precedence order is defined for selections of ITS information in various positions (the first item in the list has the highest precedence):<ol class="depth1"><li>Selection via explicit (i.e., not inherited) local ITS markup in documents (<a href="#local-attributes">ITS local attributes</a> on a specific element)</li><li>Global selections in documents (using a <code class="its-elem-markup">rules</code> element)Inside each <code class="its-elem-markup">rules</code> element the precedence order is: <ol class="depth2"><li>Any rule inside the rules element</li><li>Any rule linked via the XLink <code class="its-attr-markup">href</code> attribute</li></ol> <div class="note">Note:ITS does not define precedence related to rules defined or linked based on non-ITS mechanisms (such as processing instructions for linking rules).</div></li><li>Selection via inherited values. This applies only to element nodes. The inheritance rules are laid out in a dedicated <a href="#datacategories-overview">data category overview table</a>: see the column "Inheritance for element nodes". Selection via inheritance takes precedence over default values, see below item.</li><li>Selections via defaults for data categories, see <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a></li></ol>In case of conflicts between global selections via multiple <a href="#selection-global">rules</a> elements or conflicts between multiple <code class="its-elem-markup">param</code> elements with the same name, the last rule or last <code class="its-elem-markup">param</code> element has higher precedence.<div class="note">Note:The precedence order fulfills the same purpose as the built-in template rules of <a title="XSL Transformations (XSLT)
 Version 1.0" href="#xslt10">[XSLT 1.0]</a>. Override semantics are always complete, that is all information provided via lower precedence is overridden by the higher precedence. E.g. defaults are overridden by inherited values and these are overridden by nodes selected via global rules, which are in turn overridden by local markup.</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-selection-precedence-1" id="EX-selection-precedence-1"></a>Example 20: Conflicts between selections of ITS information resolved using the precedence order</div>The two elements <code>title</code> and <code>author</code> of this document are intended as separate content when inside a <code>prolog</code> element, but in other contexts as part of the content of their parent element. In order to make this distinction two <code class="its-elem-markup">withinTextRule</code> elements are used:The first rule specifies that <code>title</code> and <code>author</code> in general are to be treated as an element within text. This overrides the default.The second rule indicates that when <code>title</code> or <code>author</code> are found in a <code>prolog</code> element their content is to be treated separately. This is normally the default, but the rule is needed to override the first rule.<div class="exampleInner"><pre><text> <prolog> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:withinTextRule withinText="yes" selector="//title|//author"/> <its:withinTextRule withinText="no" selector="//prolog/title|//prolog/author"/> </its:rules> <title>Designing User Interfaces</title> <author>Janice Prakash</author> <keywords>user interface, ui, software interface</keywords> </prolog> <body> The book <title>Of Mice and Screens</title> by <author>Aldus Brandywine</author> is one of the best introductions to the vast topic of designing user interfaces. </body> </text> </pre></div>[Source file: <a href="examples/xml/EX-selection-precedence-1.xml">examples/xml/EX-selection-precedence-1.xml</a>]</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="associating-its-with-existing-markup" id="associating-its-with-existing-markup"></a>5.6 Associating ITS Data Categories with Existing Markup</h3>Some markup schemes provide markup that can be used to express ITS data categories. ITS data categories can be associated with such existing markup, using the global selection mechanism described in <a class="section-ref" href="#selection-global">Section 5.2.1: Global, Rule-based Selection</a>.Associating existing markup with ITS data categories can be done only if the processing expectations of the host markup are the same as, or greater than, those of ITS. For example, the <a title="OASIS
 Darwin Information Typing Architecture (DITA) Language Specification
 v1.0" href="#dita10">[DITA 1.0]</a> format can use its translate attribute to apply to “transcluded” content, going beyond the ITS 2.0 local selection mechanism, but not contradicting it.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-associating-its-with-existing-markup-1" id="EX-associating-its-with-existing-markup-1"></a>Example 21: Association of the ITS data categories <a href="#trans-datacat"> Translate</a> and <a href="#terminology">Terminology</a> with DITA 1.0 markup</div>In this example, there is an existing <code>translate</code> attribute in DITA, and it is associated with the ITS semantics using the its:rules section. Similarly, the DITA <code>dt</code> and <code>term</code> elements are associated with the ITS <a href="#terminology">Terminology</a> data category.<div class="exampleInner"><pre><topic id="myTopic"> <title>The ITS Topic</title> <prolog> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:translateRule selector="//*[@translate='no']" translate="no"/> <its:translateRule selector="//*[@translate='yes']" translate="yes"/> <its:termRule selector="//term | //dt" term="yes"/> </its:rules> </prolog> <body> <dl> <dlentry id="tDataCat"> <dt>Data category</dt> <dd>ITS defines <term>data category</term> as an abstract concept for a particular type of information related to internationalization and localization of XML schemas and documents.</dd> </dlentry> </dl> For the implementation of ITS, apply the rules in the order: <ul> <li>Defaults</li> <li>Rules in external files</li> <li>Rules in the document</li> <li>Local attributes</li> </ul> <ph translate="no" xml:lang="fr">Et voilà !</ph>. </body> </topic> </pre></div>[Source file: <a href="examples/xml/EX-associating-its-with-existing-markup-1.xml">examples/xml/EX-associating-its-with-existing-markup-1.xml</a>]</div>Global rules can be associated with a given XML document using different means:<ul><li>By using an <code class="its-elem-markup">rules</code> element in the document itself:<ul><li>with the rules directly inside the document, as shown in <a href="#EX-associating-its-with-existing-markup-1">Example 21</a></li><li>with a link to an external rules file using the XLink <code class="its-attr-markup">href</code> attribute, as shown in <a href="#EX-link-external-rules-1">Example 16</a></li></ul></li><li>By associating the rules and the document through a tool-specific mechanism. For example, in the case of a command-line tool by providing the paths of both the XML document to process and its corresponding external rules file.</li></ul></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="its-tool-annotation" id="its-tool-annotation"></a>5.7 ITS Tools Annotation</h3>In some cases, it may be important for instances of data categories to be associated with information about the processor that generated them. For example, the score of the <a href="#mtconfidence">MT Confidence</a> data category (provided via the <code class="its-attr-markup">mtConfidence</code> attribute) is meaningful only when the consumer of the information also knows which MT engine produced it, because the score provides the relative confidence of translations from the same MT engine but does not provide a score that can be reliably compared between MT engines. The same is true for confidence provided for the <a href="#textanalysis">Text Analysis</a> data category, providing confidence information via the <code class="its-attr-markup">taConfidence</code> attribute, or the <a href="#terminology">Terminology</a> data category, providing confidence information via the <code class="its-attr-markup">termConfidence</code> attribute.ITS 2.0 provides a mechanism to associate such processor information with the use of individual data categories in a document, independently from data category annotations themselves.The attribute <code class="its-attr-markup">annotatorsRef</code> provides a way to associate all the annotations of a given data category within the element with information about the processor that generated those data category annotations.<div class="note">Note:<ul><li>Three cases of providing tool information can be expected:<ol class="depth1"><li>information about tools used for creating or modifying the textual content;</li><li>information about tools that do 1), but also create ITS annotations, see <a class="section-ref" href="#list-of-elements-and-attributes">Appendix I: List of ITS 2.0 Global Elements and Local Attributes</a>; </li><li>information about tools that don’t modify or create content, but just create ITS annotations.</li></ol> <code class="its-attr-markup">annotatorsRef</code> is only meant to be used when actual ITS annotation is involved, that is for 2) and 3). To express tool information related only to the creation or modification of textual content and independent of ITS data categories, that is case 1), the tool or <code class="its-attr-markup">toolRef</code> attribute provided by the <a href="#provenance">Provenance</a> data category is to be used.</li><li>An example of case 2) is an MT engine that modifies content and creates ITS <a href="#mtconfidence">MT Confidence</a> annotations. Here the situation may occur that several tools are involved in creating MT Confidence annotations: the MT engine and the tool inserting the markup. The annotatorsRef attribute is to identify the tool most useful in further processes, in this case the MT engine.</li></ul></div>The value of <code class="its-attr-markup">annotatorsRef</code> is a space-separated list of references where each reference is composed of two parts: a data category identifier and an IRI. These two parts are separated by a <code>|</code> VERTICAL LINE (U+007C) character:<ul><li>The data category identifier <a href="#rfc2119">MUST</a> be one of the identifiers specified in the <a href="#datacategories-overview">data category overview table</a>.</li><li>Within one <code class="its-attr-markup">annotatorsRef</code> value, a data category identifier <a href="#rfc2119">MUST NOT</a> appear more than one time.</li><li>The IRI indicates information about the processor used to generate the data category annotation. No single means is specified for how this IRI has to be used to indicate processor information. Possible mechanisms are: to encode information directly in the IRI, e.g., as parameters; to reference an external resource that provides such information, e.g. an XML file or an RDF declaration; or to reference another part of the document that provides such information.</li></ul>In HTML documents, the mechanism is implemented with the <code class="its-attr-markup">its-annotators-ref</code> attribute.The attribute applies to the content of the element where it is declared (including its children elements) and to the attributes of that element.On any given node, the information provided by this mechanism is a space-separated list of the accumulated references found in the <code class="its-attr-markup">annotatorsRef</code> attributes declared in the enclosing elements and sorted by data category identifiers. For each data category, the IRI part is the one of the inner-most declaration.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-its-tool-annotation-1" id="EX-its-tool-annotation-1"></a>Example 22: Accumulation and Overriding of the <code class="its-attr-markup">annotatorsRef</code> Values</div>In this example, the text shows the computed tools reference information for the given node. Note that the references are ordered alphabetically and that the IRI values are always the ones of the inner-most declaration.<div class="exampleInner"><pre><doc its:version="2.0" xmlns:its="http://www.w3.org/2005/11/its" its:annotatorsRef="mt-confidence|MT1" >doc node: "mt-confidence|MT1" <group its:annotatorsRef="terminology|ABC" >group node: "mt-confidence|MT1 terminology|ABC" <p its:annotatorsRef="text-analysis|Tool3" >This p node: "text-analysis|Tool3 mt-confidence|MT1 terminology|ABC" <p its:annotatorsRef="mt-confidence|MT123" >This p node: "mt-confidence|MT123 terminology|ABC" </group>  <p its:annotatorsRef="text-analysis|XYZ" >This p node: "text-analysis|XYZ mt-confidence|MT1" </doc> </pre></div>[Source file: <a href="examples/xml/EX-its-tool-annotation-1.xml">examples/xml/EX-its-tool-annotation-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-its-tool-annotation-2" id="EX-its-tool-annotation-2"></a>Example 23: Example of ITS Tools Annotation</div>The <code class="its-attr-markup">annotatorsRef</code> attribute is used in this XML document to indicate that information about the processor that generated the <code class="its-attr-markup">mtConfidence</code> values for the first two <code>p</code> elements are found in element with <code>id="T1"</code> in the external document tools.xml, while that information for the third <code>p</code> element is found in the element with <code>id="T2"</code> in the same document. In addition, <code class="its-attr-markup">annotatorsRef</code> is used to identify a Web resource with information about the QA tool used to generate the <a href="#lqissue">Localization Quality Issue</a> annotation in the document.<div class="exampleInner"><pre><doc its:version="2.0" its:annotatorsRef= "mt-confidence|file:///tools.xml#T1 localization-quality-issue |http://www.qalsp-ex.com/qatools/transcheckv1.3" xmlns:its="http://www.w3.org/2005/11/its"> <p its:mtConfidence="0.78">Text translated with tool T1 <p its:mtConfidence="0.55" its:locQualityIssueType="typographical" its:locQualityIssueComment="Sentence without capitalization" its:locQualityIssueSeverity="50">text also translated with tool T1 <p its:mtConfidence="0.34" its:annotatorsRef="mt-confidence|file:///tools.xml#T2"> Text translated with tool T2 </doc> </pre></div>[Source file: <a href="examples/xml/EX-its-tool-annotation-2.xml">examples/xml/EX-its-tool-annotation-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-its-tool-annotation-html5-1" id="EX-its-tool-annotation-html5-1"></a>Example 24: Example of ITS Tool Annotation</div>The <code class="its-attr-markup">its-annotators-ref</code> attributes are used in this HTML document to indicate that the <a href="#mtconfidence">MT Confidence</a> annotation on the first two <code>span</code> elements come from one MT (French to English) engine, while the annotation on the third comes from another (Italian to English) engine. Both <code class="its-attr-markup">its-annotators-ref</code> attributes refer to a Web resource for information about the engine generating the <a href="#mtconfidence">MT Confidence</a> annotation.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Sentences about capital cities machine translated into English with mtConfidence defined locally.</title> </head> <body its-annotators-ref="mt-confidence|http://www.exmt-prov.com/2012/11/9/fr-t-en"> <span its-mt-confidence=0.8982>Dublin is the capital of Ireland. <span its-mt-confidence=0.8536>The capital of the Czech Republic is Prague. <span its-mt-confidence=0.7009 its-annotators-ref="mt-confidence|http://www.exmt-prov.com/2012/11/9/it-t-en"> The capital Italia is Roma. </body> </html> </pre></div>[Source file: <a href="examples/html5/EX-its-tool-annotation-html5-1.html">examples/html5/EX-its-tool-annotation-html5-1.html</a>]</div></div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-markup" id="html5-markup"></a>6 Using ITS Markup in HTML</h2> This section is normative. <div class="note">Note:Please note that the term <code>HTML</code> refers to HTML5 or its successor in HTML syntax <a title="HTML5" href="#html5">[HTML5]</a>.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-local-attributes" id="html5-local-attributes"></a>6.1 Mapping of Local Data Categories to HTML</h3>All data categories defined in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> and having local implementation may be used in HTML with the exception of the <a href="#trans-datacat">Translate</a>, <a href="#directionality">Directionality</a> and <a href="#language-information">Language Information</a> data categories.<div class="note">Note:The above-mentioned data categories are excluded because HTML has native markup for them.</div>In HTML data categories are implemented as attributes. The name of the HTML attribute is derived from the name of the attribute defined in the local implementation by using the following rules:<ol class="depth1"><li>The attribute name is prefixed with <code>its-</code></li><li>Each uppercase letter in the attribute name is replaced by <code>-</code> (U+002D) followed by a lowercase variant of the letter.</li></ol> <a href="#EX-within-text-local-1">Example 48</a> demonstrates the <a href="#elements-within-text">Elements Within Text</a> data category with the local XML attribute <code class="its-attr-markup">withinText</code>. <a href="#EX-within-text-local-html5-1">Example 49</a> demonstrates the counterpart in HTML, i.e., the local attribute <code class="its-attr-markup">its-within-text</code>.Values of attributes, which corresponds to data categories with a predefined set of values, <a href="#rfc2119">MUST</a> be matched ASCII-case-insensitively. <div class="note">Note:Case of attribute names is also irrelevant given the nature of HTML syntax. So in HTML the <a href="#terminology">terminology data category</a> can be stored as <code class="its-attr-markup">its-term</code>, <code>ITS-TERM</code>, <code>its-Term</code> etc. All of those attributes are treated as equivalent and will be normalized upon DOM construction.</div>Values of attributes that correspond to data categories that use <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> <a href="#rfc2119">MUST</a> be also valid floating-point numbers as defined in <a title="HTML5" href="#html5">[HTML5]</a>.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-global-rules" id="html5-global-rules"></a>6.2 Global rules</h3>Various aspects for global rules in general, external global rules, or inline global rules need to be taken into account. An example of an HTML5 document using global rules is <a href="#EX-translate-html5-global-1">Example 6</a>. The corresponding rules file is <a href="#EX-translate-html5-global-1-rules-file">Example 7</a>.<div class="note">Note:By default XPath 1.0 will be used for selection in global rules. If users prefer an easier selection mechanism, they can switch query language to CSS selectors by using the <code class="its-attr-markup">queryLanguage</code> attribute, see <a class="section-ref" href="#queryLanguage">Section 5.3.1: Choosing Query Language</a>.</div><div class="note">Note:The HTML5 parsing algorithm automatically puts all HTML elements into the XHTML namespace (<code>http://www.w3.org/1999/xhtml</code>). Selectors used in global rules need to take this into account.</div>Linking to external global rules is specified in the <code class="its-attr-markup">href</code> attribute of <code>link</code> elements, with the link relation <code>its-rules</code>.<div class="note">Note:Using XPath in global rules linked from HTML documents does not create an additional burden to implementers. Parsing HTML content produces a DOM tree that can be directly queried using XPath, functionality supported by all major browsers.</div>Inline global rules <a href="#rfc2119">MUST</a> be specified inside a <code>script</code> element that has a <code>type</code> attribute with the value <code>application/its+xml</code>. The <code>script</code> element itself <a href="#rfc2119">SHOULD</a> be a child of the <code>head</code> element. Comments <a href="#rfc2119">MUST NOT</a> be used inside global rules. Each <code>script</code> element <a href="#rfc2119">MUST NOT</a> contain more than one <code class="its-elem-markup">rules</code> element.<div class="note">Note:It is preferred to use external global rules linked using the <code>link</code> element than to have global rules embedded in the document.</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-standoff-markup" id="html5-standoff-markup"></a>6.3 Standoff Markup in HTML</h3>The constraints for <a href="#provenance-records-in-html5-constraint">Provenance standoff markup in HTML</a> and <a href="#loc-quality-issues-in-html5-constraint">Localization quality issues markup in HTML</a> <a href="#rfc2119">MUST</a> be followed.</div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="html5-selection-precedence" id="html5-selection-precedence"></a>6.4 Precedence between Selections</h3>The following precedence order is defined for selections of ITS information in various positions of HTML document (the first item in the list has the highest precedence):<ol class="depth1"><li>Implicit local selection in documents (<a href="#html5-local-attributes">ITS local attributes</a> on a specific element)</li><li>Global selections in documents (using the mechanism of <a href="#html5-external-global-rules">external global rules</a> or <a href="#html5-inline-global-rules">inline global rules</a>), to be processed in a document order, see <a class="section-ref" href="#selection-global">Section 5.2.1: Global, Rule-based Selection</a> for details.<div class="note">Note:ITS does not define precedence related to rules defined or linked based on non-ITS mechanisms (such as processing instructions for linking rules). Selection via inheritance takes precedence over default values (see below).</div></li><li>Selection via inherited values. This applies only to element nodes. The inheritance rules are laid out in a dedicated <a href="#datacategories-overview">data category overview table</a> (see the column "Inheritance for element nodes). Selection via inheritance takes precedence over default values (see below)."</li><li>Selections via defaults for data categories, see <a class="section-ref" href="#datacategories-defaults-etc">Section 8.1: Position, Defaults, Inheritance, and Overriding of Data Categories</a>.</li></ol>In case of conflicts between global selections via multiple <a href="#selection-global">rules</a> elements or conflicts between multiple <code class="its-elem-markup">param</code> elements with the same name, the last rule or last <code class="its-elem-markup">param</code> element has higher precedence. <a href="#EX-translate-html5-global-1">Example 6</a>, previously discussed, demonstrates the precedence: the <code>code</code> element with the <code class="its-attr-markup">translate</code> attribute set to yes has precedence over the global rule setting all <code>code</code> elements as untranslatable.</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="xhtml5-markup" id="xhtml5-markup"></a>7 Using ITS Markup in XHTML</h2> This section is normative. XHTML documents aimed at public consumption by Web browsers, including HTML5 documents in XHTML syntax, <a href="#rfc2119">SHOULD</a> use the syntax described in <a class="section-ref" href="#html5-markup">Section 6: Using ITS Markup in HTML</a> in order to adhere to <a href="https://www.w3.org/TR/html-design-principles/#dom-consistency">DOM Consistency HTML Design Principle</a>.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-xhtml-markup-1" id="EX-xhtml-markup-1"></a>Example 25: Using ITS 2.0 markup in XHTML</div>This example illustrates the use of ITS 2.0 local markup in XHTML.<div class="exampleInner"><pre><!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en"> <head> <title>XHTML and ITS2.0</title> </head> <body> <h1>XHTML and ITS2.0</h1> Don't use <span its-loc-note="Internationalization Tag Set">ITS prefixed attributes inside the content, like its:locNote. </body> </html> </pre></div>[Source file: <a href="examples/html5/EX-xhtml-markup-1.html">examples/html5/EX-xhtml-markup-1.html</a>]</div><div class="note">Note:Please note that this section defines how to use ITS in XHTML content that is directly served to Web browsers. Such XHTML is very often sent with an incorrect media type and parsed as HTML rather than XML in Web browsers. In such case it is more robust and safer to use HTML-like syntax for ITS metadata.However when XHTML is not used as a delivery but rather as an exchange or storage format all XML features can be used in XHTML and it is advised to use XML syntax for ITS metadata.</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="datacategory-description" id="datacategory-description"></a>8 Description of Data Categories</h2> This section is normative. <div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="datacategories-defaults-etc" id="datacategories-defaults-etc"></a>8.1 Position, Defaults, Inheritance, and Overriding of Data Categories</h3>The following table summarizes for each data category which selection, default value, and inheritance and overriding behavior apply. It also provides data category identifiers used in <a class="section-ref" href="#its-tool-annotation">Section 5.7: ITS Tools Annotation</a>:<ul><li> Default values apply if both local and global selection are absent. The default value for the <a href="#trans-datacat">Translate</a> data category, for example, mandates that elements are translatable, and attributes are not translatable if there is no <code class="its-elem-markup">translateRule</code> element and no <code class="its-attr-markup">translate</code> attribute available.</li><li> Inheritance describes whether ITS information is applicable to child elements of nodes and attributes related to these nodes or their child notes. The inheritance for the <a href="#trans-datacat">Translate</a> data category, for example, mandates that all child elements of nodes are translatable whereas all attributes related to these nodes or their child notes are not translatable.</li><li>For ITS data categories with inheritance, the information conveyed by the data category can be overridden. For example, a local <code class="its-attr-markup">translate</code> attribute overrides the <a href="#trans-datacat">Translate</a> information conveyed by a global <code class="its-elem-markup">translateRule</code>.</li></ul>Foreign elements can be used only inside <code class="its-elem-markup">rules</code>. Foreign attributes can be used on any element defined in ITS.<div class="note">Note:An ITS application is free to decide what pieces of content it uses. For example:<ul><li><a href="#terminology">Terminology</a> information is added to a <code>term</code> element. The information pertains only to the content of the element, since there is no inheritance for <a href="#terminology">Terminology</a>. Nevertheless an ITS application can make use of the complete element, e.g., including attribute nodes etc. </li><li>Using <a href="#idvalue">ID Value</a>, a unique identifier is provided for a <code>p</code> element. An application can make use of the complete <code>p</code> element, including child nodes and attributes nodes. The application is also free to make use just of the string value of <code>p</code>. Nevertheless the id provided via <a href="#idvalue">ID Value</a> pertains only to the <code>p</code> element. It cannot be used to identify nested elements or attributes.</li><li>Using <a href="#target-pointer">target pointer</a>, selected <code>source</code> elements have the ITS information that their translation is available in a <code>target</code> element; see <a href="#EX-target-pointer-global-1">Example 65</a>. This information does not inherit to child elements of <code>target pointer</code>. E.g., the translation of a <code>span</code> element nested in <code>source</code> is not available in a specific <code>target</code> element. Nevertheless, an application is free to use the complete content of <code>source</code>, including <code>span</code>, and, e.g., present it to a translator.</li></ul></div><a name="datacategories-overview" id="datacategories-overview"></a><table border="1" width="100%"><thead><tr><td>Data category (<code>identifier</code>)</td><td>Local Usage</td><td>Global, rule-based selection</td><td>Global adding of information</td><td>Global pointing to existing information</td><td>Default Values</td><td>Inheritance for elements nodes</td><td>Examples</td></tr></thead><tbody><tr><td> <a href="#trans-datacat">Translate</a> (<code>translate</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>No</td><td>For XML: <code>translate="yes"</code> for elements, and <code>translate="no"</code> for attributes. For <a title="HTML5" href="#html5">[HTML5]</a>: see <a href="#html5-translate-handling">HTLM5 Translate Handling</a>.</td><td>For XML: Textual content of element, including content of child elements, but excluding attributes. For <a title="HTML5" href="#html5">[HTML5]</a>: see <a href="#html5-translate-handling">HTLM5 Translate Handling</a>.</td><td> <a href="#EX-translate-selector-2">local</a>, <a href="#EX-translate-selector-1">global</a> </td></tr><tr><td> <a href="#locNote-datacat">Localization Note</a> (<code>localization-note</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>Yes</td><td>None</td><td>Textual content of element, including content of child elements, but excluding attributes</td><td> <a href="#EX-locNote-selector-2">local</a>, <a href="#EX-locNote-element-1">global</a> </td></tr><tr><td> <a href="#terminology">Terminology</a> (<code>terminology</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>Yes</td><td> <code>term="no"</code> </td><td>None</td><td> <a href="#EX-terms-selector-4">local</a>, <a href="#EX-terms-selector-1">global</a> </td></tr><tr><td> <a href="#directionality">Directionality</a> (<code>directionality</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>No</td><td> <code>dir="ltr"</code> </td><td>Textual content of element, including attributes and child elements</td><td> <a href="#EX-dir-selector-3">local</a>, <a href="#EX-dir-selector-2">global</a> </td></tr><tr><td> <a href="#language-information">Language Information</a> (<code>language-information</code>) </td><td>No</td><td>Yes</td><td>No</td><td>Yes</td><td>None</td><td>Textual content of element, including attributes and child elements</td><td> <a href="#EX-lang-definition-1">global</a> </td></tr><tr><td> <a href="#elements-within-text">Elements Within Text</a> (<code>elements-within-text</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>No</td><td>For XML content: <code>withinText="no"</code>. For <a title="HTML5" href="#html5">[HTML5]</a>: see <a href="#html5-withintext-handling">HTLM5 Element Within Text Handling</a>.</td><td>None</td><td> <a href="#EX-within-text-local-1">local</a>, <a href="#EX-within-text-implementation-1">global</a> </td></tr><tr><td> <a href="#domain">Domain</a> (<code>domain</code>) </td><td>No</td><td>Yes</td><td>Yes</td><td>Yes</td><td>None</td><td>Textual content of element, including attributes and child elements</td><td> <a href="#EX-domain-1">global</a> </td></tr><tr><td> <a href="#textanalysis">Text Analysis</a> (<code>text-analysis</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>Yes</td><td>None</td><td>None</td><td> <a href="#EX-text-analysis-html5-local-1">local</a>, <a href="#EX-text-analysis-html5-rdfa-companion-document">global</a> </td></tr><tr><td> <a href="#LocaleFilter">Locale Filter</a> (<code>locale-filter</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>No</td><td> <code>localeFilterList="*"</code>, <code>localeFilterType="include"</code> </td><td>Textual content of element, including attributes and child elements</td><td> <a href="#EX-locale-filter-attribute-1">local</a>, <a href="#EX-locale-filter-selector-1">global</a> </td></tr><tr><td> <a href="#provenance">Provenance</a> (<code>provenance</code>) </td><td>Yes</td><td>Yes</td><td>No</td><td>Yes</td><td>None</td><td>Textual content of element, including child elements and attributes</td><td> <a href="#EX-provenance-local-1">local</a>, <a href="#EX-provenance-global-1">global</a> </td></tr><tr><td> <a href="#externalresource">External Resource</a> (<code>external-resource</code>) </td><td>No</td><td>Yes</td><td>No</td><td>Yes</td><td>None</td><td>None</td><td> <a href="#EX-externalresource-1">global</a> </td></tr><tr><td> <a href="#target-pointer">Target Pointer</a> (<code>target-pointer</code>) </td><td>No</td><td>Yes</td><td>No</td><td>Yes</td><td>None</td><td>None</td><td> <a href="#EX-target-pointer-global-1">global</a> </td></tr><tr><td> <a href="#idvalue">ID Value</a> (<code>id-value</code>) </td><td>No</td><td>Yes</td><td>No</td><td>Yes</td><td>None</td><td>None</td><td> <a href="#EX-idvalue-element-1">global</a> </td></tr><tr><td> <a href="#preservespace">Preserve Space</a> (<code>preserve-space</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>No</td><td> <code>default</code> </td><td>Textual content of element, including attributes and child elements</td><td> <a href="#EX-preservespace-local-1">local</a>, <a href="#EX-preservespace-global-1">global</a> </td></tr><tr><td> <a href="#lqissue">Localization Quality Issue</a> (<code>localization-quality-issue</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>Yes</td><td>None</td><td>Textual content of element, including child elements, but excluding attributes</td><td> <a href="#EX-locQualityIssue-local-1">local</a>, <a href="#EX-locQualityIssue-global-2">global</a> </td></tr><tr><td> <a href="#lqrating">Localization Quality Rating</a> (<code>localization-quality-rating</code>) </td><td>Yes</td><td>No</td><td>No</td><td>No</td><td>None</td><td>Textual content of element, including child elements, but excluding attributes</td><td> <a href="#EX-locQualityRating-local-1">local</a> </td></tr><tr><td> <a href="#mtconfidence">MT Confidence</a> (<code>mt-confidence</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>No</td><td>None</td><td>Textual content of element, including child elements, but excluding attributes</td><td> <a href="#EX-mtConfidence-html5-local-1">local</a>, <a href="#EX-mtconfidence-global-html5-1-external-rules">global</a> </td></tr><tr><td> <a href="#allowedchars">Allowed Characters</a> (<code>allowed-characters</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>Yes</td><td>None</td><td>Textual content of element, including child elements, but excluding attributes</td><td> <a href="#EX-allowedCharacters-local-1">local</a>, <a href="#EX-allowedCharacters-global-1">global</a> </td></tr><tr><td> <a href="#storagesize">Storage Size</a> (<code>storage-size</code>) </td><td>Yes</td><td>Yes</td><td>Yes</td><td>Yes</td><td>None</td><td>None</td><td> <a href="#EX-storageSize-local-1">local</a>, <a href="#EX-storageSize-global-1">global</a> </td></tr></tbody></table><div class="exampleOuter"><div class="exampleHeader"><a name="EX-datacat-behavior-1" id="EX-datacat-behavior-1"></a>Example 26: Defaults, inheritance and overriding behavior of data categories</div>In this example, the content of all the <code>data</code> elements is translatable and none of the attributes are translatable, because the default for the <a href="#trans-datacat">Translate</a> data category in elements is "yes" and in attributes is "no", and neither of their values are overridden at all. The first <code class="its-elem-markup">translateRule</code> is overridden by the local <code>its:translate="no"</code> attribute. The content of <code>revision</code>, <code>profile</code>, <code>reviser</code> and <code>locNote</code> elements are not translatable. This is because the default is overridden by the same <code>its:translate="no"</code> that these elements inherit from the local ITS markup in the <code>prolog</code> element. The exception is the <code>field</code> element where the second <code class="its-elem-markup">translateRule</code> takes precedence over the inherited value. The last <code class="its-elem-markup">translateRule</code> indicates that the content of <code>type</code> is not translatable because the global rule takes precedence over the default value.The localization note for the two first <code>data</code> elements is the text defined globally with the <code class="its-elem-markup">locNoteRule</code> element. This note is overridden for the last <code>data</code> element by the local <code class="its-attr-markup">locNote</code> attribute.<div class="exampleInner"><pre><Res xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <prolog its:translate="no"> <revision>Sep-07-2006</revision> <profile> <reviser>John Doe</reviser> <field>Computing Engineering</field> </profile> <its:rules version="2.0"> <its:translateRule selector="//prolog" translate="yes"/> <its:translateRule selector="/Res/prolog/profile/field" translate="yes"/> <its:translateRule selector="//msg/type" translate="no"/> <its:locNoteRule locNoteType="description" selector="//msg/data"> <its:locNote>The variable {0} is the name of the host.</its:locNote> </its:locNoteRule> </its:rules> </prolog> <body> <msg id="HostNotFound"> <type>Error</type> <data>Host {0} cannot be found.</data> </msg> <msg id="HostDisconnected"> <type>Error</type> <data>The connection with {0} has been lost.</data> </msg> <msg id="FileNotFound"> <type>Error</type> <data its:locNote="{0} is a filename">{0} not found.</data> </msg> </body> </Res> </pre></div>[Source file: <a href="examples/xml/EX-datacat-behavior-1.xml">examples/xml/EX-datacat-behavior-1.xml</a>]</div><div class="note">Note:The data categories differ with respect to defaults. This difference is due to existing standards and practices. It is common practice for example that information about translation refers only to textual content of an element. Thus, the default selection for the <a href="#trans-datacat">Translate</a> data category is the textual content.</div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="trans-datacat" id="trans-datacat"></a>8.2 Translate</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="translatability-definition" id="translatability-definition"></a>8.2.1 Definition</h4>The <a href="#trans-datacat">Translate</a> data category expresses information about whether the content of an element or attribute is intended for translation or not. The values of this data category are "yes" (translatable) or "no" (not translatable).</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="translatability-implementation" id="translatability-implementation"></a>8.2.2 Implementation</h4>The <a href="#trans-datacat">Translate</a> data category can be expressed with global rules, or locally on an individual element. Handling of inheritance and interaction between elements and attributes is different for XML content versus <a title="HTML5" href="#html5">[HTML5]</a> content.For XML: for elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements, but excluding attributes. The default is that elements are translatable and attributes are not.For HTML: The interpretation of the <code class="its-attr-markup">translate</code> attribute is given in <a href="https://www.w3.org/TR/2013/CR-html5-20130806/dom.html#the-translate-attribute">HTML5</a>. Nodes in an HTML document selected via a <a href="#translate-global">global rule</a> are also interpreted following <a href="https://www.w3.org/TR/2013/CR-html5-20130806/dom.html#the-translate-attribute">HTML5</a>.<div class="note">Note:As of writing, the default in <a title="HTML5" href="#html5">[HTML5]</a> is that elements are translatable, and that translatable attributes inherit from the respective elements. There is a pre-defined list of translatable attributes, for example <code>alt</code> or <code>title</code>.Since the <a title="HTML5" href="#html5">[HTML5]</a> definition also applies to nodes selected via global rules, a <code class="its-elem-markup">translateRule</code> like <code><its:translateRule selector=""//h:img" translate="yes"/></code> will set the <code>img</code> element and its translatable attributes like <code>alt</code> to "yes".</div>GLOBAL: The <code class="its-elem-markup">translateRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">translate</code> attribute with the value "yes" or "no".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-translate-selector-1" id="EX-translate-selector-1"></a>Example 27: The <a href="#trans-datacat">Translate</a> data category expressed globally</div>The <code class="its-elem-markup">translateRule</code> element specifies that the elements <code>code</code> is not to be translated.<div class="exampleInner"><pre><its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:translateRule translate="no" selector="//code"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-translate-selector-1.xml">examples/xml/EX-translate-selector-1.xml</a>]</div>LOCAL: The following local markup is available for the <a href="#trans-datacat">Translate</a> data category:<ul><li>A <code class="its-attr-markup">translate</code> attribute with the value "yes" or "no".</li></ul>In <a title="HTML5" href="#html5">[HTML5]</a> the native <a title="HTML5" href="#html5">[HTML5]</a> <code>translate</code> attribute <a href="#rfc2119">MUST</a> be used to express the <a href="#trans-datacat">Translate</a> data category.<div class="note">Note:For XML content, it is not possible to override the <a href="#trans-datacat">Translate</a> data category settings of attributes using local markup. This limitation is consistent with the advised practice of not using translatable attributes. If attributes need to be translatable, then this has to be declared globally. Note that this restriction does not apply to <a href="#html5-translate-handling">HTML5</a>.</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-translate-selector-2" id="EX-translate-selector-2"></a>Example 28: The <a href="#trans-datacat">Translate</a> data category expressed locally</div>The local <code>its:translate="no"</code> specifies that the content of <code>panelmsg</code> is not to be translated.<div class="exampleInner"><pre><messages its:version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <msg num="123">Click Resume Button on Status Display or <panelmsg its:translate="no" >CONTINUE</panelmsg> Button on printer panel</msg> </messages> </pre></div>[Source file: <a href="examples/xml/EX-translate-selector-2.xml">examples/xml/EX-translate-selector-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-translate-html5" id="EX-translate-html5"></a>Example 29: The <a href="#trans-datacat">Translate</a> data category expressed locally in HTML</div>The local <code>translate="no"</code> attribute specifies that the content of <code>span</code> is not to be translated.<div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Translate flag test: Default</title> </head> <body> The <span translate=no>World Wide Web Consortium is making the World Wide Web worldwide! </body> </html> </pre></div>[Source file: <a href="examples/html5/EX-translate-html5-local-1.html">examples/html5/EX-translate-html5-local-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="locNote-datacat" id="locNote-datacat"></a>8.3 Localization Note</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="locNote-definition" id="locNote-definition"></a>8.3.1 Definition</h4>The <a href="#locNote-datacat">Localization Note</a> data category is used to communicate notes to localizers about a particular item of content.This data category can be used for several purposes, including, but not limited to:<ul><li>Tell the translator how to translate parts of the content</li><li>Expand on the meaning or contextual usage of a specific element, such as what a variable refers to or how a string will be used in the user interface</li><li>Clarify ambiguity and show relationships between items sufficiently to allow correct translation (e.g., in many languages it is impossible to translate the word"enabled" in isolation without knowing the gender, number, and case of the thing it refers to.)</li><li>Indicate why a piece of text is emphasized (important, sarcastic, etc.)</li></ul>Two types of informative notes are needed:<ul><li>An alert contains information that the translator has to read before translating a piece of text. Example: an instruction to the translator to leave parts of the text in the source language.</li><li>A description provides useful background information that the translator will refer to only if they wish. Example: a clarification of ambiguity in the source text.</li></ul>Editing tools may offer an easy way to create this type of information. Translation tools can be made to recognize the difference between these two types of localization notes, and present the information to translators in different ways.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="locNote-implementation" id="locNote-implementation"></a>8.3.2 Implementation</h4>The <a href="#locNote-datacat">Localization Note</a> data category can be expressed with global rules, or locally on an individual element. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements, but excluding attributes.GLOBAL: The <code class="its-elem-markup">locNoteRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">locNoteType</code> attribute with the value "description" or "alert".</li><li>Exactly one of the following:<ul><li>A <code class="its-elem-markup">locNote</code> element that contains the note itself and allows for <a href="#selection-local">local ITS markup</a>.</li><li>A <code class="its-attr-markup">locNotePointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that holds the localization note.</li><li>A <code class="its-attr-markup">locNoteRef</code> attribute that contains an IRI referring to the location of the localization note.</li><li>A <code class="its-attr-markup">locNoteRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that holds the IRI referring to the location of the localization note.</li></ul></li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locNote-element-1" id="EX-locNote-element-1"></a>Example 30: The <code class="its-elem-markup">locNote</code> element</div>The <code class="its-elem-markup">locNoteRule</code> element associates the content of the <code class="its-elem-markup">locNote</code> element with the message with the identifier 'DisableInfo' and flags it as important. This would also work if the rule is in an external file, allowing it to provide notes without modifying the source document.<div class="exampleInner"><pre><myRes> <head> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0" its:translate="no"> <its:locNoteRule locNoteType="alert" selector="//msg[@id='DisableInfo']"> <its:locNote>The variable {0} has three possible values: 'printer', 'stacker' and 'stapler options'.</its:locNote> </its:locNoteRule> </its:rules> </head> <body> <msg id="DisableInfo">The {0} has been disabled.</msg> </body> </myRes></pre></div>[Source file: <a href="examples/xml/EX-locNote-element-1.xml">examples/xml/EX-locNote-element-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locNotePointer-attribute-1" id="EX-locNotePointer-attribute-1"></a>Example 31: The <code class="its-attr-markup">locNotePointer</code> attribute</div>The <code class="its-attr-markup">locNotePointer</code> attribute is a <a href="#selectors">relative selector</a> pointing to a node that holds the note.<div class="exampleInner"><pre><Res> <prolog> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:translateRule selector="//msg/notes" translate="no"/> <its:locNoteRule locNoteType="description" selector="//msg/data" locNotePointer="../notes"/> </its:rules> </prolog> <body> <msg id="FileNotFound"> <notes>Indicates that the resource file {0} could not be loaded.</notes> <data>Cannot find the file {0}.</data> </msg> <msg id="DivByZero"> <notes>A division by 0 was going to be computed.</notes> <data>Invalid parameter.</data> </msg> </body> </Res></pre></div>[Source file: <a href="examples/xml/EX-locNotePointer-attribute-1.xml">examples/xml/EX-locNotePointer-attribute-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locNoteRef-attribute-1" id="EX-locNoteRef-attribute-1"></a>Example 32: The <code class="its-attr-markup">locNoteRef</code> attribute</div>The <code class="its-elem-markup">locNoteRule</code> element specifies that the message with the identifier 'NotFound' has a corresponding explanation note in an external file. The IRI for the exact location of the note is stored in the <code class="its-attr-markup">locNoteRef</code> attribute.<div class="exampleInner"><pre><myRes> <head> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:locNoteRule locNoteType="description" selector="//msg[@id='NotFound']" locNoteRef="ErrorsInfo.html#NotFound"/> </its:rules> </head> <body> <msg id="NotFound">Cannot find {0} on {1}.</msg> </body> </myRes></pre></div>[Source file: <a href="examples/xml/EX-locNoteRef-attribute-1.xml">examples/xml/EX-locNoteRef-attribute-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locNoteRefPointer-attribute-1" id="EX-locNoteRefPointer-attribute-1"></a>Example 33: The <code class="its-attr-markup">locNoteRefPointer</code> attribute</div>The <code class="its-attr-markup">locNoteRefPointer</code> attribute contains a <a href="#selectors">relative selector</a> pointing to a node that holds the IRI referring to the location of the note.<div class="exampleInner"><pre><dataFile> <prolog> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:locNoteRule locNoteType="description" selector="//data" locNoteRefPointer="../@noteFile"/> </its:rules> </prolog> <body> <string id="FileNotFound" noteFile="Comments.html#FileNotFound"> <data>Cannot find the file {0}.</data> </string> <string id="DivByZero" noteFile="Comments.html#DivByZero"> <data>Invalid parameter.</data> </string> </body> </dataFile></pre></div>[Source file: <a href="examples/xml/EX-locNoteRefPointer-attribute-1.xml">examples/xml/EX-locNoteRefPointer-attribute-1.xml</a>]</div>LOCAL: The following local markup is available for the <a href="#locNote-datacat">Localization Note</a> data category:<ul><li>Exactly one of the following:<ul><li>A <code class="its-attr-markup">locNote</code> attribute that contains the note itself.</li><li>A <code class="its-attr-markup">locNoteRef</code> attribute that contains an IRI referring to the location of the localization note.</li></ul></li><li>An optional <code class="its-attr-markup">locNoteType</code> attribute with the value "description" or "alert". If the <code class="its-attr-markup">locNoteType</code> attribute is not present, the type of localization note will be assumed to be "description".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locNote-selector-2" id="EX-locNote-selector-2"></a>Example 34: The <a href="#locNote-datacat">Localization Note</a> data category expressed locally</div><div class="exampleInner"><pre><msgList xmlns:its="http://www.w3.org/2005/11/its" xml:space="preserve" its:version="2.0"> <data name="LISTFILTERS_VARIANT" its:locNote="Keep the leading space!" its:locNoteType="alert"> <value> Variant {0} = {1} ({2})</value> </data> <data its:locNote="%1\$s is the original text's date in the format YYYY-MM-DD HH:MM always in GMT"> <value>Translated from English content dated <span id="version-info">%1\$s GMT.</value> </data> </msgList></pre></div>[Source file: <a href="examples/xml/EX-locNote-selector-2.xml">examples/xml/EX-locNote-selector-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locNote-html5" id="EX-locNote-html5"></a>Example 35: The <a href="#locNote-datacat">Localization Note</a> data category expressed locally in HTML</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>LocNote test: Default</title> </head> <body> This is a <span its-loc-note="Check with terminology engineer" its-loc-note-type=alert> motherboard. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-locNote-html5-local-1.html">examples/html5/EX-locNote-html5-local-1.html</a>]</div><div class="note">Note:It is generally recommended to avoid using attributes to store text, however, in this specific case, the need to provide the notes without interfering with the structure of the host document is outweighing the drawbacks of using an attribute.</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="terminology" id="terminology"></a>8.4 Terminology</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="terminology-definition" id="terminology-definition"></a>8.4.1 Definition</h4>The <a href="#terminology">Terminology</a> data category is used to mark terms and optionally associate them with information, such as definitions. This helps to increase consistency across different parts of the documentation. It is also helpful for translation.<div class="note">Note:Existing terminology standards such as <a title="TermBase eXchange (TBX)" href="#iso30042">[ISO 30042]</a> and its derived formats are about coding terminology data, while the ITS <a href="#terminology">Terminology</a> data category simply allows to identify terms in XML documents and optionally to point to corresponding information.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="terminology-implementation" id="terminology-implementation"></a>8.4.2 Implementation</h4>The <a href="#terminology">Terminology</a> data category can be expressed with global rules, or locally on an individual element. There is no inheritance. The default is that neither elements nor attributes are terms.GLOBAL: The <code class="its-elem-markup">termRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">term</code> attribute with the value "yes" or "no".</li><li>Zero or one of the following:<ul><li>A <code class="its-attr-markup">termInfoPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that holds the terminology information.</li><li>A <code class="its-attr-markup">termInfoRef</code> attribute that contains an IRI referring to the resource providing information about the term.</li><li>A <code class="its-attr-markup">termInfoRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that holds the IRI referring to the location of the terminology information.</li></ul></li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-terms-selector-1" id="EX-terms-selector-1"></a>Example 36: Usage of the <code class="its-attr-markup">termInfoPointer</code> attribute</div><div class="exampleInner"><pre><text> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:termRule selector="//term" term="yes" termInfoPointer="id(@def)"/> </its:rules> We may define <term def="TDPV">discoursal point of view</term> as <gloss xml:id="TDPV">the relationship, expressed through discourse structure, between the implied author or some other addresser, and the fiction.</gloss> </text></pre></div>[Source file: <a href="examples/xml/EX-terms-selector-1.xml">examples/xml/EX-terms-selector-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-terms-selector-2" id="EX-terms-selector-2"></a>Example 37: Usage of the <code class="its-attr-markup">termInfoRef</code> attribute</div><div class="exampleInner"><pre><text> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:termRule selector="//term[1]" term="yes" termInfoRef="#TDPV"/> </its:rules> We may define <term>discoursal point of view</term> as <gloss xml:id="TDPV">the relationship, expressed through discourse structure, between the implied author or some other addresser, and the fiction.</gloss> </text> </pre></div>[Source file: <a href="examples/xml/EX-terms-selector-2.xml">examples/xml/EX-terms-selector-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-terms-selector-3" id="EX-terms-selector-3"></a>Example 38: Usage of the <code class="its-attr-markup">termInfoRefPointer</code> attribute</div><div class="exampleInner"><pre><text> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:termRule selector="//term" term="yes" termInfoRefPointer="@target"/> </its:rules> We may define <term target="#TDPV">discoursal point of view</term> as <gloss xml:id="TDPV">the relationship, expressed through discourse structure, between the implied author or some other addresser, and the fiction.</gloss> </text> </pre></div>[Source file: <a href="examples/xml/EX-terms-selector-3.xml">examples/xml/EX-terms-selector-3.xml</a>]</div>LOCAL: The following local markup is available for the <a href="#terminology">Terminology</a> data category:<ul><li>A <code class="its-attr-markup">term</code> attribute with the value "yes" or "no".</li><li>An optional <code class="its-attr-markup">termInfoRef</code> attribute that contains an IRI referring to the resource providing information about the term.</li><li>An optional <code class="its-attr-markup">termConfidence</code> attribute with the value of a rational number in the interval 0 to 1 (inclusive). The value follows the <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive">minInclusive</a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive">maxInclusive</a> set to 1. <code class="its-attr-markup">termConfidence</code> represents the confidence of the agents producing the annotation that the annotated unit is a term or not. 1 represents the highest level of confidence. <code class="its-attr-markup">termConfidence</code> does not provide confidence information related to <code class="its-attr-markup">termInfoRef</code>.</li></ul>Any node selected by the terminology data category with the <code class="its-attr-markup">termConfidence</code> attribute specified <a href="#rfc2119">MUST</a> be contained in an element with the <code class="its-attr-markup">annotatorsRef</code> (or in HTML <code class="its-attr-markup">its-annotators-ref</code>) attribute specified for the <a href="#terminology">Terminology</a> data category. See <a class="section-ref" href="#its-tool-annotation">Section 5.7: ITS Tools Annotation</a> for more information.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-terms-selector-4" id="EX-terms-selector-4"></a>Example 39: The <a href="#terminology">Terminology</a> data category expressed locally, including term information reference and confidence score.</div><div class="exampleInner"><pre><book its:version="2.0" xmlns:its="http://www.w3.org/2005/11/its" its:annotatorsRef="terminology|http://example.com/term-tool"> <head>...</head> <body> ... And he said: you need a new <quote its:term="yes" its:termInfoRef="http://www.directron.com/motherboards1.html" its:termConfidence="0.5">motherboard</quote> ... </body> </book> </pre></div>[Source file: <a href="examples/xml/EX-terms-selector-4.xml">examples/xml/EX-terms-selector-4.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-term-local-html-1" id="EX-term-local-html-1"></a>Example 40: The <a href="#terminology">Terminology</a> data category expressed locally in HTML</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Terminology test: default</title> </head> <body> We need a new <span its-term=yes>motherboard </body> </html></pre></div>[Source file: <a href="examples/html5/EX-term-html5-local-1.html">examples/html5/EX-term-html5-local-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="directionality" id="directionality"></a>8.5 Directionality</h3><div class="note">Note:At the time of writing, enhancements are being discussed in the context of HTML5 that are expected to change the approach to marking up <a href="#directionality">Directionality</a>, in particular to support content where directionality needs to be isolated from that of surrounding content. However, these enhancements are not finalized yet. This section therefore reflects directionality markup in <a title="HTML 4.01" href="#html4">[HTML 4.01]</a>; enhancements in HTML5 will be reflected in a future revision.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="directionality-definition" id="directionality-definition"></a>8.5.1 Definition</h4>The <a href="#directionality">Directionality</a> data category allows the user to specify the base writing direction of blocks, embeddings, and overrides for the Unicode bidirectional algorithm. It has four values: "ltr", "rtl", "lro" and "rlo".<div class="note">Note:ITS defines only the values of the <a href="#directionality">Directionality</a> data category and their inheritance. The behavior of text labeled in this way may vary, according to the implementation. Implementers are encouraged, however, to model the behavior on that described in the CSS 2.1 specification or its successor. In such a case, the effect of the data category's values would correspond to the following CSS rules:<ul><li>Data category value: "ltr" (left-to-right text)CSS rule: <code>*[dir="ltr"] { unicode-bidi: embed; direction: ltr}</code> </li><li>Data category value: "rtl" (right-to-left text)CSS rule: <code>*[dir="rtl"] { unicode-bidi: embed; direction: rtl}</code> </li><li>Data category value: "lro" (left-to-right override)CSS rule: <code>*[dir="lro"] { unicode-bidi: bidi-override; direction: ltr}</code> </li><li>Data category value: "rlo" (right-to-left override)CSS rule: <code>*[dir="rlo"] { unicode-bidi: bidi-override; direction: rtl}</code> </li></ul>More information about how to use this data category is provided by <a title="What you
 need to know about the bidi algorithm and inline markup" href="#bidiarticle">[Bidi Article]</a>.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="directionality-implementation" id="directionality-implementation"></a>8.5.2 Implementation</h4>The <a href="#directionality">Directionality</a> data category can be expressed with global rules, or locally on an individual element. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements and attributes. The default is that both elements and attributes have the directionality of left-to-right.GLOBAL: The <code class="its-elem-markup">dirRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">dir</code> attribute with the value "ltr", "rtl", "lro" or "rlo".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-dir-selector-1" id="EX-dir-selector-1"></a>Example 41: Document that needs global rules for directionality</div>In this document the right-to-left directionality is marked using a <code>direction</code> attribute with a value "rtlText".<div class="exampleInner"><pre><text xml:lang="en"> <body> <par>In Hebrew, the title <quote xml:lang="he" direction="rtlText">פעילות הבינאום, W3C</quote> means "Internationalization Activity, W3C", and the order of characters is <bdo direction='rtlText'>פעילות הבינאום, W3C</bdo>.</par> </body> </text> </pre></div>[Source file: <a href="examples/xml/EX-dir-selector-1.xml">examples/xml/EX-dir-selector-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-dir-selector-2" id="EX-dir-selector-2"></a>Example 42: The <a href="#directionality">Directionality</a> data category expressed with global rules</div>The <code class="its-elem-markup">dirRule</code> element indicates that all elements with an attribute <code>direction="rtlText"</code> have right-to-left content, except that bdo elements with that attribute have right-to-left override content.<div class="exampleInner"><pre><its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:dirRule dir="rtl" selector="//*[@direction='rtlText']"/> <its:dirRule dir="rlo" selector="//bdo[@direction='rtlText']"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-dir-selector-2.xml">examples/xml/EX-dir-selector-2.xml</a>]</div>LOCAL: The following local markup is available for the <a href="#directionality">Directionality</a> data category:<ul><li>A <code class="its-attr-markup">dir</code> attribute with the value "ltr", "rtl", "lro" or "rlo".</li></ul><div class="note">Note: <a title="HTML 4.01" href="#html4">[HTML 4.01]</a> does not have the "lro" and "rlo" values for its <code>dir</code> attribute, so these values are not used for HTML documents. HTML uses an inline <code>bdo</code> element instead.</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-dir-selector-3" id="EX-dir-selector-3"></a>Example 43: The <a href="#directionality">Directionality</a> data category expressed locally</div>On the first <code>quote</code> element, the <code>its:dir="rtl"</code> attribute indicates a right-to-left content.<div class="exampleInner"><pre><text xml:lang="en" xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <body> <par>In Arabic, the title <quote xml:lang="ar" its:dir="rtl">نشاط التدويل، W3C</quote> means "Internationalization Activity, W3C".</par> </body> </text> </pre></div>[Source file: <a href="examples/xml/EX-dir-selector-3.xml">examples/xml/EX-dir-selector-3.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-dir-html5-local-1" id="EX-dir-html5-local-1"></a>Example 44: The <a href="#directionality">Directionality</a> data category expressed locally in HTML</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Dir test: Default</title> </head> <body> In Arabic, the title <q dir=rtl lang=ar>نشاط التدويل، W3C</q> means "Internationalization Activity, W3C". </body> </html></pre></div>[Source file: <a href="examples/html5/EX-dir-html5-local-1.html">examples/html5/EX-dir-html5-local-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="language-information" id="language-information"></a>8.6 Language Information</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="langinfo-definition" id="langinfo-definition"></a>8.6.1 Definition</h4>The element <code class="its-elem-markup">langRule</code> is used to express the language of a given piece of content. The <code class="its-attr-markup">langPointer</code> attribute points to the markup that expresses the language of the text selected by the selector attribute. This markup <a href="#rfc-keywords">MUST</a> use values that conform to <a title="Tags for Identifying
 Languages" href="#bcp47">[BCP47]</a>. The recommended way to specify language identification is to use <code>xml:lang</code> in XML, and <code>lang</code> in HTML. The <code class="its-elem-markup">langRule</code> element is intended only as a fall-back mechanism for documents where language is identified with another construct.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-lang-definition-1" id="EX-lang-definition-1"></a>Example 45: Pointing to language information via <code class="its-elem-markup">langRule</code> </div>The following <code class="its-elem-markup">langRule</code> element expresses that the content of all <code>p</code> elements (including attribute values and textual content of child elements) are in the language indicated by <code>mylangattribute</code>, which is attached to the <code>p</code> elements, and expresses language using values conformant to <a title="Tags for Identifying
 Languages" href="#bcp47">[BCP47]</a>.<div class="exampleInner"><pre><its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:langRule selector="//p" langPointer="@mylangattribute"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-lang-definition-1.xml">examples/xml/EX-lang-definition-1.xml</a>]</div><div class="note">Note:The <a href="#language-information">Language Information</a> data category only provides for rules to be expressed at a global level. Locally users are able to use <code>xml:lang</code> (which is defined by XML), or <code>lang</code> in HTML, or an attribute specific to the format in question (as in <a href="#EX-lang-definition-1">Example 45</a>).In XML <code>xml:lang</code> is the preferable means of language identification. To ease the usage of <code>xml:lang</code>, a declaration for this attribute is part of the non-normative XML DTD and XML Schema document for ITS markup declarations. There is no declaration of <code>xml:lang</code> in the non-normative RELAX NG document for ITS, since in RELAX NG it is not necessary to declare attributes from the XML namespace.Applying the <a href="#language-information">Language Information</a> data category to <code>xml:lang</code> attributes using global rules is not necessary, since <code>xml:lang</code> is the standard way to specify language information in <a title="Extensible Markup Language
 (XML) 1.0 (Fifth Edition)" href="#xml10spec">[XML 1.0]</a>.In HTML <code>lang</code> is the mandated means of language identification.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="langinfo-implementation" id="langinfo-implementation"></a>8.6.2 Implementation</h4>The <a href="#language-information">Language Information</a> data category can be expressed only with global rules. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements and attributes. There is no default.GLOBAL: The <code class="its-elem-markup">langRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">langPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that contains language information. If the attribute <code>xml:lang</code> is present or <code>lang</code> in HTML for the selected node, the value of the <code>xml:lang</code> attribute or <code>lang</code> in HTML <a href="#rfc2119">MUST</a> take precedence over the <code class="its-attr-markup">langPointer</code> value.</li></ul></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="elements-within-text" id="elements-within-text"></a>8.7 Elements Within Text</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="within-text-definition" id="within-text-definition"></a>8.7.1 Definition</h4>The <a href="#elements-within-text">Elements Within Text</a> data category reveals if and how an element affects the way text content behaves from a linguistic viewpoint. This information is for example relevant to provide basic text segmentation hints for tools such as translation memory systems. The values associated with this data category are:<ul><li> "yes": The element and its content are part of the flow of its parent element. For example the element <code>strong</code> in <a title="XHTML™ 1.0 The Extensible
 HyperText Markup Language (Second Edition)" href="#xhtml10">[XHTML 1.0]</a>: <code>Appaloosa horses have spotted coats.</code> </li><li> "nested": The element is part of the flow of its parent element, its content is an independent flow. For example the element <code>fn</code> in <a title="OASIS
 Darwin Information Typing Architecture (DITA) Language Specification
 v1.0" href="#dita10">[DITA 1.0]</a>: <code>Palouse horses<fn>A Palouse horse is the same as an Appaloosa.</fn> have spotted coats.</code> </li><li> "no": The element splits the text flow of its parent element and its content is an independent text flow. For example the element <code>p</code> when inside the element <code>li</code> in DITA or XHTML: <code><li>Palouse horses: They have spotted coats. They have been bred by the Nez Perce. </li></code> </li></ul></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="within-text-implementation" id="within-text-implementation"></a>8.7.2 Implementation</h4>The <a href="#elements-within-text">Elements Within Text</a> data category can be expressed with global rules, or locally on an individual element. There is no inheritance.For XML: The default is that elements are not within text.For HTML: The default is that elements are not within text, with the following exceptions:<ul><li>For the elements that are part of the <a href="https://www.w3.org/TR/2013/CR-html5-20130806/dom.html#phrasing-content-1">HTML5 phrasing content</a> the default is <code>withinText="yes"</code>, with the following exceptions:<ul><li>For the elements <code class="its-elem-markup">iframe</code>, <code class="its-elem-markup">noscript</code>, <code class="its-elem-markup">script</code> and <code class="its-elem-markup">textarea</code> the default is <code>withinText="nested"</code>.</li></ul></li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-within-text-defaults-html5-1" id="EX-within-text-defaults-html5-1"></a>Example 46: Illustrates the defaults for the <a href="#elements-within-text">Elements Within Text</a> data category in HTML.</div>In this document the different flows of text are the following (brackets indicating inline or nested elements): <code> - "Elements within Text defaults for HTML5" - "The element p is not within text. But [the element em is]." - "A button [Click Here] is also within text. But [] is nested." - "The content of textarea" - "Some additional text... [] []" - "The script element is nested." - "The noscript element is nested." </code> <div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Elements within Text defaults for HTML5</title> </head> <body> The element p is not within text. But the element em is. A button <button onclick="display()">Click Here</button> is also within text. But <textarea>The content of textarea</textarea> is nested. Some additional text... <script> </script> <noscript>The noscript element is nested.</noscript> </body> </html> </pre></div>[Source file: <a href="examples/html5/EX-within-text-defaults-html5-1.html">examples/html5/EX-within-text-defaults-html5-1.html</a>]</div>GLOBAL: The <code class="its-elem-markup">withinTextRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">withinText</code> attribute with the value "yes", "no" or "nested".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-within-text-implementation-1" id="EX-within-text-implementation-1"></a>Example 47: Specifying elements within text with a <code class="its-elem-markup">withinTextRule</code> element</div><div class="exampleInner"><pre><its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:withinTextRule withinText="yes" selector="//b | //em | //i"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-within-text-implementation-1.xml">examples/xml/EX-within-text-implementation-1.xml</a>]</div>LOCAL: The following local markup is available for the <a href="#elements-within-text">Elements Within Text</a> data category:<ul><li>A <code class="its-attr-markup">withinText</code> attribute with the values "yes", "no" or "nested".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-within-text-local-1" id="EX-within-text-local-1"></a>Example 48: The <a href="#trans-datacat">Elements Within Text</a> data category expressed locally</div><div class="exampleInner"><pre><text xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <body> <par>Text with <bold its:withinText="yes">bold</bold>.</par> </body> </text></pre></div>[Source file: <a href="examples/xml/EX-within-text-local-1.xml">examples/xml/EX-within-text-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-within-text-local-html5-1" id="EX-within-text-local-html5-1"></a>Example 49: The <a href="#trans-datacat">Elements Within Text</a> data category expressed locally in HTML</div><div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Within text test: Default</title> </head> <body> Text with <span its-within-text='yes'>bold. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-within-text-local-html5-1.html">examples/html5/EX-within-text-local-html5-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="domain" id="domain"></a>8.8 Domain</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="domain-definition" id="domain-definition"></a>8.8.1 Definition</h4>The <a href="#domain">Domain</a> data category is used to identify the topic or subject of content. Such information allows for more relevant linguistic choices during various processes.Examples of usage include:<ul><li>Allowing machine translation systems to select the most appropriate engine and rules to translate the content.</li><li>Providing a general indication of what terminology collection is most suitable for use by translators.</li></ul>This data category addresses various challenges:<ul><li>Often domain-related information already exists in the document (e.g., keywords in the HTML <code>meta</code> element). The <a href="#domain">Domain</a> data category provides a mechanism to point to this information.</li><li>There are many flat or structured lists of domain related values, keywords, key phrases, classification codes, ontologies, etc. The <a href="#domain">Domain</a> data category does not propose its own given list. Instead it provides a mapping mechanism to associate the values in the document with the values used by the consumer tool.</li></ul></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="domain-implementation" id="domain-implementation"></a>8.8.2 Implementation</h4>The <a href="#domain">Domain</a> data category can be expressed only with global rules. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements and attributes. There is no default.The information provided by this data category is a comma-separated list of one or more values, which is obtained by applying the following algorithm:<ul class="slist"><li>STEP 1: Set the initial value of the resulting string as an empty string.</li><li>STEP 2: Get the list of nodes resulting of the evaluation of the <code class="its-attr-markup">domainPointer</code> attribute.</li><li>STEP 3: For each node:<ul class="slist"><li>STEP 3-1: If the node value contains a COMMA (U+002C):<ul class="slist"><li>STEP 3-1-1: Split the node value into separate strings using the COMMA (U+002C) as separator.</li><li>STEP 3-1-2: For each string:<ul class="slist"><li>STEP 3-1-2-1: Trim the leading and trailing white spaces of the string.</li><li>STEP 3-1-2-2: If the first character of the value is an APOSTROPHE (U+0027) or a QUOTATION MARK (U+0022): Remove it.</li><li>STEP 3-1-2-3: If the last character of the value is an APOSTROPHE (U+0027) or a QUOTATION MARK (U+0022): Remove it.</li><li>STEP 3-1-2-4: If the value is empty: Go to STEP 3-1-2.</li><li>STEP 3-1-2-5: Check the <code>domainMapping</code> attribute to see if there is a mapping set for the string:<ul class="slist"><li>STEP 3-1-2-5-1. If a mapping is found: Add the corresponding value to the result string.</li><li>STEP 3-1-2-5-2. Else (if no mapping is found): Add the string to the result string.</li></ul></li></ul></li></ul></li><li>STEP 3-2: Else (if the node value does not contain a COMMA (U+002C)):<ul class="slist"><li>STEP 3-2-1: Trim the leading and trailing white spaces of the string.</li><li>STEP 3-2-2: If the first character of the value is an APOSTROPHE (U+0027) or a QUOTATION MARK (U+0022): Remove it.</li><li>STEP 3-2-3: If the last character of the value is an APOSTROPHE (U+0027) or a QUOTATION MARK (U+0022): Remove it.</li><li>STEP 3-2-4: If the value is empty: Go to STEP 3.</li><li>STEP 3-2-5: Check if there is a mapping for the string:<ul class="slist"><li>STEP 3-2-5-1: If a mapping is found: Add the corresponding value to the result string.</li><li>STEP 3-2-5-2: Else (if no mapping is found): Add the string (in its original cases) to the result string.</li></ul></li></ul></li></ul></li><li>STEP 4: Remove duplicated values from the resulting string.</li><li>STEP 5: Return the resulting string.</li></ul>GLOBAL: The <code class="its-elem-markup">domainRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">domainPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that contains the domain information.</li><li>An optional <code class="its-attr-markup">domainMapping</code> attribute that contains a comma separated list of mappings between values in the content and consumer tool specific values. The left part of the pair corresponds to the source content and is unique within the mapping and case-sensitive. The right part of the mapping belongs to the consumer tool. Several left parts can map to a single right part. The values in the left or the right part of the mapping may contain spaces; in that case they <a href="#rfc-keywords">MUST</a> be delimited by quotation marks, that is pairs of APOSTROPHE (U+0027) or QUOTATION MARK (U+0022).</li></ul><div class="note">Note:Although the <code class="its-attr-markup">domainMapping</code> attribute it is optional, its usage is recommended. Many commercial machine translation systems use their own domain definitions; the <code class="its-attr-markup">domainMapping</code> attribute will foster interoperability between these definitions and metadata items like <code>keywords</code> or <code>dcterms.subject</code> in Web pages or other types of content.Values used in the <code class="its-attr-markup">domainMapping</code> attribute are arbitrary strings. In some consumer systems or existing content, the domain may be identified via an IRI like <code>http://example.com/domains/automotive</code>. The <code class="its-attr-markup">domainMapping</code> allows for using IRIs too. For the mapping, they are regarded as ordinary string values.</div><div class="note">Note: Although the focus of ITS 2.0, and some of the usage scenarios addressed in <a href="https://www.w3.org/TR/mlw-metadata-us-impl/">ITS 2.0 High-level Usage Scenarios</a>) is on “single engine” environments, ITS 2.0 (for example in the context of the <a href="#domain">Domain</a> data category) can accommodate ""workflow/multi engine" scenarios.Example:<ul><li>A scenario involves Machine Translation (MT) engines A and B. The domain labels used by engine A follow the naming scheme A_123, the one for engine B follow the naming scheme B_456.</li><li>A <code class="its-attr-markup">domainMapping</code> as follows is in place: domainMapping="'sports law' Legal, 'property law' Legal"</li><li>Engine A maps 'Legal' to A_4711, Engine B maps 'Legal' to B_42.</li></ul>Thus, ITS does not encode a process or workflow (like "Use MT engine A with domain A_4711, and use MT engine B with domain A_42"). Rather, it encodes information that can be used in workflows.</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-domain-1" id="EX-domain-1"></a>Example 50: The <code class="its-elem-markup">domainRule</code> element</div>The <code class="its-elem-markup">domainRule</code> element expresses that the content of the HTML <code>body</code> element is in the domain expressed by the HTML <code>meta</code> element with the <code>name</code> attribute, value <code>keywords</code>. The <code class="its-attr-markup">domainPointer</code> attribute points to that <code>meta</code> element.<div class="exampleInner"><pre><its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0" xmlns:h="http://www.w3.org/1999/xhtml"> <its:domainRule selector="/h:html/h:body" domainPointer="/h:html/h:head/h:meta[@name='keywords']/@content"/> </its:rules></pre></div>[Source file: <a href="examples/xml/EX-domain-1.xml">examples/xml/EX-domain-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-domain-2" id="EX-domain-2"></a>Example 51: The <code class="its-elem-markup">domainRule</code> element</div>The <code class="its-elem-markup">domainRule</code> element expresses that the content of the HTML <code>body</code> element is in the domain expressed by associated values. The <code class="its-attr-markup">domainPointer</code> attribute points to the values in the source content. In this case it points to the <code>meta</code> elements with the <code>name</code> attribute set to "keywords" or to "dcterms.subject". These elements hold the values in their <code>content</code> attributes. The <code class="its-attr-markup">domainMapping</code> attribute contains the comma-separated list of mappings. In the example, "automotive" is available in the source content, and "auto" is used within the consumer tool, e.g., a machine translation system.<div class="exampleInner"><pre><its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0" xmlns:h="http://www.w3.org/1999/xhtml"> <its:domainRule selector="/h:html/h:body" domainPointer="/h:html/h:head/h:meta[@name='dcterms.subject' or @name='keywords']/@content" domainMapping="automotive auto, medical medicine, 'criminal law' law, 'property law' law"/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-domain-2.xml">examples/xml/EX-domain-2.xml</a>]</div><div class="note">Note:In HTML, one possible way how to express domain information is a <code>meta</code> element with the <code>name</code> attribute set to "keywords" (see <a href="https://www.w3.org/TR/html5/single-page.html#standard-metadata-names">standard metadata names in HTML</a>). Alternatively, following the process for <a href="https://www.w3.org/TR/html5/single-page.html#other-metadata-names">other metadata names</a> the <a href="https://wiki.whatwg.org/wiki/MetaExtensions">extension value</a> of "dcterms.subject" can be used. The usage of both "keywords" and "dcterms.subject" is shown in example <a href="#EX-domain-2">Example 51</a>.In the area of machine translation (e.g., machine translation systems or systems harvesting content for machine translation training), there is no agreed upon set of value sets for domain. Nevertheless, it is recommended to use a small set of values both in source content and within consumer tools, to foster interoperability. If larger value sets are needed (e.g., detailed terms in the law or medical domain), mappings to the smaller value set needed for interoperability is to be provided. An example would be a <code class="its-attr-markup">domainMapping</code> attribute for generalizing the law domain: <code>domainMapping="'criminal law' law, 'property law' law, 'contract law' law"</code>. It is possible to have more than one domain associated with a piece of content. For example, if the consumer tool is a statistical machine translation engine, it could include corpora from all domains available in the source content in training the machine translation engine. The consumer machine translation engine might choose to ignore the domain and take a one-size-fits-all approach, or may be selective in which domains to use, based on the range of content marked with domain. For example, if the content has hundreds of sentences marked with domain "automotive" and "medical", but only a couple of sentences marked with additional domains "criminal law" and "property law", the consumer tool may opt to include its domains "auto" and "medicine", but not "law", since the extra training resources do not justify the improvement in the output. Guidance about appropriate actions in such cases is beyond the scope of this specification.</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="textanalysis" id="textanalysis"></a>8.9 Text Analysis</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="textanalysis-definition" id="textanalysis-definition"></a>8.9.1 Definition</h4> The <a href="#textanalysis">Text Analysis</a> data category is used to annotate content with lexical or conceptual information for the purpose of contextual disambiguation. This information can be provided by so-called text analysis software agents such as named entity recognizers, lexical concept disambiguators, etc., and is represented by either string valued or IRI references to possible resource descriptions. Example: A named entity recognizer provides the information that the string "Dublin" in a certain context denotes a town in Ireland. While text analysis can be done by humans, this data category is targeted more at software agents. The information can be used for several purposes, including, but not limited to:<ul><li>Informing a human agent such as a translator that a certain fragment of textual content (so-called “text analysis target”) may follow specific translation rules. Examples: proper names, brands, or officially regulated expressions.</li><li>Informing a software agent such as a content management system about the conceptual type of a textual entity to enable special processing. Examples: places, personal names, product names, or geographic names, chemical compounds, and protein names that are situated in a specific index.</li></ul>The data category provides three pieces of annotation: confidence, entity type or concept class, entity identifier or concept identifier as specified in the following table.<a name="textAnalysis-info-pieces" id="textAnalysis-info-pieces"></a><table border="1" width="100%"><thead><tr><td>Information</td><td>Description</td><td>Value</td><td>Example</td><td>Comments</td></tr></thead><tbody><tr><td>Text analysis confidence</td><td>The confidence of the agent (that produced the annotation)in its own computation</td><td> The <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type </a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive"> minInclusive </a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive"> maxInclusive </a> set to 1</td><td>0.5647346</td><td> The confidence value applies to two pieces of information (see the following rows in this table). This is opposed to <a href="#terminology-termConfidence">termConfidence</a> which is part of the <a href="#terminology">Terminology</a> data category. <a href="#terminology-termConfidence">termConfidence</a> represents the confidence in just a single piece of information: the decision whether something is a term or not (term). <a href="#terminology-termConfidence">termConfidence</a> does not relate to the confidence about additional information about the term that can be encoded with <code class="its-attr-markup">termInfoRef</code>.</td></tr><tr><td>Entity type / concept class</td><td>The type of entity, or concept class of the text analysis target </td><td>IRI</td><td> <a href="http://nerd.eurecom.fr/ontology#Location">http://nerd.eurecom.fr/ontology#Location</a> </td><td/></tr><tr><td rowspan="2">Entity / concept identifier</td><td rowspan="2">A unique identifier for the text analysis target</td><td>Mode 1: Identifier (string value) of the collection source + identifier of the concept in that collection</td><td>"Wordnet3.0" to identify the collection resource; "301467919" to identify a synset in Wordnet3.0</td><td rowspan="2">Mode 1 and mode 2 are mutually exclusive. They <a href="#rfc-keywords">MUST NOT</a> be used at the same time for the same text analysis target/node.</td></tr><tr><td>Mode 2: Identifier ( IRI) of the text analysis target</td><td> <a href="http://dbpedia.org/resource/Dublin">http://dbpedia.org/resource/Dublin</a> </td></tr></tbody></table><div class="note">Note:The use case for <a href="#textanalysis">Text Analysis</a> is distinct from that for the <a href="#terminology">Terminology</a> data category. Text Analysis informs human agents or software agents in cases where either explicit terminology information is not (yet) available, or would not be appropriate, e.g. conceptual information for general vocabulary.Text Analysis support is achieved by associating a fragment of text with an external resource that can be interpreted by a language review agent. The agent may for example use the web resource to disambiguate the meaning or lexical choice of the fragment, and thereby contributing to its correct translation. The web resource may as well provide information on appropriate synonyms and example usage. This is for example the case if the web resource is WordNet <a title="WordNet" href="#wordnet">[WordNet]</a>. In the case of a <a href="#textAnalysis-info-pieces">concept class</a>, the external resource may provide a formalized conceptual definition arranged in a hierarchical framework of related concepts. In the case of a named entity, the external resource may provide a full-fledged description of the associated real world entity.Extended example: The word 'City' in the fragment 'I am going to the City' may be enhanced by one of the following: <ul><li>one of WordNet's synsets that can be represented by 'city' </li><li>an ontological concept of 'City' that could represent a subclass of 'Populated Place' as a concept</li><li>the central area of a particular city – as interpreted as an entity instance (e.g., 'City of London')</li></ul></div><div class="note">Note: A given document fragment can only be annotated once. When support for multiple annotations is necessary (e.g., when all three of the annotations in the extended example above need to be accommodated) NIF 2.0, <a href="http://www.tei-c.org/release/doc/tei-p5-doc/en/html/NH.html#NHSO">TEI Stand-off Markup</a>, or other so-called stand-off annotation mechanisms is better suitable.Some external resources such as DBpedia also provide information for some ontological concepts and named entity definitions in multiple languages, and this facilitates translation even more because a possible link traversal would allow a direct access to foreign language labels for named entities.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="textanalysis-implementation" id="textanalysis-implementation"></a>8.9.2 Implementation</h4> The <a href="#textanalysis">Text Analysis</a> data category can be expressed with global rules, or locally on an individual element. There is no inheritance.<div class="note">Note:This specification defines a normative way to represent <a href="#textAnalysis-info-pieces">text analysis information</a> in XML and HTML <a href="#text-analysis-local">locally</a>. However, <a href="#textAnalysis-info-pieces">text analysis information</a> can also be represented in other formats, e.g., <a href="http://tools.ietf.org/html/rfc4627">JSON</a>. The <a href="https://www.w3.org/International/its/ig/">Internationalization Tag Set Interest Group</a> maintains a <a href="https://www.w3.org/International/its/wiki/Text_Analysis_serializations">description of such alternative serializations</a>. Readers of this specification are encouraged to evaluate whether that description fulfills their needs and to provide comments in the <a href="http://lists.w3.org/Archives/Public/public-i18n-its-ig">ITS IG mailing list (public archive)</a>.</div> GLOBAL: The <code class="its-elem-markup">textAnalysisRule</code> element contains the following: <ul><li> A required <code class="its-attr-markup">selector</code> attribute that contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>At least one of the following:<ul><li> A <code class="its-attr-markup">taClassRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that holds an IRI, which implements the <a href="#textAnalysis-info-pieces">entity type / concept class </a> information.</li><li>Exactly one of the following:<ul><li> When using identification <a href="#textAnalysis-info-pieces">mode 1</a>: A <code class="its-attr-markup">taSourcePointer</code> attribute that contains a <a href="#selectors">relative selector</a> to a node that holds the <a href="#textAnalysis-info-pieces">identifier of the collection source</a>; and a <code class="its-attr-markup">taIdentPointer</code> attribute that contains a relative selector to a node that holds the <a href="#textAnalysis-info-pieces">identifier of the concept in the collection</a>.</li><li> When using identification <a href="#textAnalysis-info-pieces">mode 2</a>: A <code class="its-attr-markup">taIdentRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that holds an IRI that holds the <a href="#textAnalysis-info-pieces">identifier of the text analysis target</a>.</li></ul></li></ul></li></ul> For an example, see <a href="#EX-text-analysis-html5-rdfa-companion-document">Example 54</a>. LOCAL: The following local markup is available for the <a href="#textanalysis">Text Analysis</a> data category: <ul><li> An optional <code class="its-attr-markup">taConfidence</code> attribute that implements the <a href="#textAnalysis-info-pieces">text analysis confidence</a>. </li><li>At least one of the following:<ul><li> A <code class="its-attr-markup">taClassRef</code> attribute that holds an IRI, which implements the <a href="#textAnalysis-info-pieces">Entity type / concept class</a> information. </li><li>Exactly one of the following:<ul><li> When using identification <a href="#textAnalysis-info-pieces">mode 1</a>: A <code class="its-attr-markup">taSource</code> attribute that holds the <a href="#textAnalysis-info-pieces">identifier of the collection source</a>, and a <code class="its-attr-markup">taIdent</code> attribute that holds the <a href="#textAnalysis-info-pieces">identifier of the concept in the collection</a>.</li><li> When using identification <a href="#textAnalysis-info-pieces">mode 2</a>: A <code class="its-attr-markup">taIdentRef</code> attribute that holds the <a href="#textAnalysis-info-pieces">identifier of the text analysis target</a>.</li></ul></li></ul></li></ul> Any node selected by the <a href="#textanalysis">Text Analysis</a> data category with the <code class="its-attr-markup">taConfidence</code> attribute specified <a href="#rfc2119">MUST</a> be contained in an element with the <code class="its-attr-markup">annotatorsRef</code> (or in HTML <code class="its-attr-markup">its-annotators-ref</code>) attribute specified for the <a href="#textanalysis">Text Analysis</a> data category. For more information, see <a class="section-ref" href="#its-tool-annotation">Section 5.7: ITS Tools Annotation</a>.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-text-analysis-html5-local-1" id="EX-text-analysis-html5-local-1"></a>Example 52: Local mixed usage of <code class="its-attr-markup">taClassRef</code>, and <code class="its-attr-markup">taIdentRef</code> in HTML.</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang="en" its-annotators-ref="text-analysis|http://enrycher.ijs.si"> <head> <meta charset="utf-8" /> <title>Text analysis: Local Test</title> </head> <body> <span its-ta-confidence="0.7" its-ta-class-ref="http://nerd.eurecom.fr/ontology#Location" its-ta-ident-ref="http://dbpedia.org/resource/Dublin">Dublin is the <span its-ta-source="Wordnet3.0" its-ta-ident="301467919" its-ta-confidence="0.5" >capital of Ireland. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-text-analysis-html5-local-1.html">examples/html5/EX-text-analysis-html5-local-1.html</a>]</div><div class="note">Note: For expressing <a href="#textAnalysis-info-pieces">Entity type / concept class </a> information, implementers are encouraged to use an existing repository of entity types such as the Named Entity Recognition and Disambiguation <a title="Named Entity Recognition and Disambiguation ontology (NERD)" href="#nerd">[NERD]</a> ontology. Of course this requires that the repository satisfies the constraints imposed by the text analysis data category (e.g., use of IRIs). Various target types can be expressed via <a href="#textAnalysis-info-pieces">Entity type / concept class</a>: types of entities, types of lexical concepts, or ontology concepts. While a relationship between these types may exist, this specification does not prescribe a way of automatically inferring a one target type from another. </div><div class="note">Note: Text Analysis is primarily intended for textual content. Nevertheless, the data category can also be used in multimedia contexts. Example: objects on an image could be annotated with DBpedia IRIs. When serializing the <a href="#textanalysis">Text Analysis</a> data category markup in HTML, one way to serialize the markup is RDFa Lite or Microdata. This serialization is due to the existing search and crawling infrastructure that is able to consume these formats. For other usage scenarios (e.g., adding text annotation to feed into a subsequent terminology process), using native ITS Text Analysis data category markup is preferred. In this way, the markup easily can be stripped out again later.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-text-analysis-html5-rdfa" id="EX-text-analysis-html5-rdfa"></a>Example 53: Local mixed usage of <code class="its-attr-markup">taClassRefPointer</code>, and <code class="its-attr-markup">taIdentRefPointer</code>, in HTML+RDFa Lite. </div> See <a href="#EX-text-analysis-html5-rdfa-companion-document">Example 54</a> for the companion document with the mapping data.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <link href=EX-text-analysis-html5-rdfa.xml rel=its-rules> <title>Entity: Local Test</title> </head> <body> <span property="http://xmlns.com/foaf/0.1/name" about="http://dbpedia.org/resource/Dublin" typeof="http:/nerd.eurecom.fr/ontology#Location">Dublin is the capital of Ireland. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-text-analysis-html5-rdfa.html">examples/html5/EX-text-analysis-html5-rdfa.html</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-text-analysis-html5-rdfa-companion-document" id="EX-text-analysis-html5-rdfa-companion-document"></a>Example 54: Companion document, having the mapping data for <a href="#EX-text-analysis-html5-rdfa">Example 53</a>.</div><div class="exampleInner"><pre><its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:textAnalysisRule selector="//*[@typeof and @about]" taClassRefPointer="@typeof" taIdentRefPointer="@about"/> </its:rules> </pre></div>[Source file: <a href="examples/html5/EX-text-analysis-html5-rdfa.xml">examples/html5/EX-text-analysis-html5-rdfa.xml</a>]</div></div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="LocaleFilter" id="LocaleFilter"></a>8.10 Locale Filter</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="LocaleFilter-definition" id="LocaleFilter-definition"></a>8.10.1 Definition</h4>The <a href="#LocaleFilter">Locale Filter</a> data category specifies that a node is only applicable to certain locales.This data category can be used for several purposes, including, but not limited to:<ul><li>Including a legal notice only in locales for certain regions.</li><li>Dropping editorial notes from all localized output.</li></ul>The <a href="#LocaleFilter">Locale Filter</a> data category associates with each selected node a filter type and a list of extended language ranges conforming to <a title="Tags for Identifying
 Languages" href="#bcp47">[BCP47]</a>.The list is comma-separated and can include the wildcard extended language range "*". The list can also be empty. Whitespace surrounding language ranges is ignored.The type can take the values "include" or "exclude":<ul><li>A single wildcard "*" with a type "include" indicates that the selected content applies to all locales.</li><li>A single wildcard "*" with a type "exclude" indicates that the selected content applies to no locale.</li><li>An empty string with a type "include" indicates that the selected content applies to no locale.</li><li>An empty string with a type "exclude" indicates that the selected content applies to all locales.</li><li>Otherwise, with a type "include", the selected content applies to the locales for which the language tag has a match in the list when using the Extended Filtering algorithm defined in <a title="Tags for Identifying
 Languages" href="#bcp47">[BCP47]</a>.</li><li>If, instead, the type is "exclude", the selected content applies to the locales for which the language tag does not have a match in the list when using the Extended Filtering algorithm defined in <a title="Tags for Identifying
 Languages" href="#bcp47">[BCP47]</a>.</li></ul></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="LocaleFilter-implementation" id="LocaleFilter-implementation"></a>8.10.2 Implementation</h4>The <a href="#LocaleFilter">Locale Filter</a> data category can be expressed with global rules, or locally on an individual element. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements and attributes. The default is that the language range is "*" and the type is "include".GLOBAL: The <code class="its-elem-markup">localeFilterRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">localeFilterList</code> attribute with a comma-separated list of extended language ranges, or an empty string value.</li><li>An optional <code class="its-attr-markup">localeFilterType</code> attribute with a value "include" or "exclude".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locale-filter-selector-1" id="EX-locale-filter-selector-1"></a>Example 55: The <a href="#LocaleFilter">Locale Filter</a> data category expressed globally</div>This document contain three <code class="its-elem-markup">localeFilterRule</code> elements: The first one specifies that the elements <code>legalnotice</code> with a <code>role</code> set to "Canada" apply only to the Canadian locales. The second one specifies that the elements <code>legalnotice</code> with a <code>role</code> set to "nonCanada" apply to all locales that are not Canadian. And the third one specifies that none of the <code>remark</code> elements apply to any locale.<div class="exampleInner"><pre><book xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <info> <its:rules version="2.0"> <its:localeFilterRule selector="//legalnotice[@role='Canada']" localeFilterList="*-CA"/> <its:localeFilterRule selector="//legalnotice[@role='nonCanada']" localeFilterList="*-CA" localeFilterType="exclude"/> <its:localeFilterRule selector="//remark" localeFilterList=""/> </its:rules> <legalnotice role="Canada"> <para>This notice is only for Canadian locales.</para> </legalnotice> <legalnotice role="nonCanada"> <para>This notice is for locales that are non-Canadian locales.</para> </legalnotice> <remark>Note: This section will be written later.</remark> </info> </book> </pre></div>[Source file: <a href="examples/xml/EX-locale-filter-selector-1.xml">examples/xml/EX-locale-filter-selector-1.xml</a>]</div>LOCAL: The following local markup is available for the <a href="#LocaleFilter">Locale Filter</a> data category:<ul><li>A <code class="its-attr-markup">localeFilterList</code> attribute with a comma-separated list of extended language ranges, or an empty string value.</li><li>An optional <code class="its-attr-markup">localeFilterType</code> attribute with a value "include" or "exclude".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locale-filter-locale-html5-1" id="EX-locale-filter-locale-html5-1"></a>Example 56: The <a href="#LocaleFilter">Locale Filter</a> data category expressed locally in HTML</div>In this example the <a href="#LocaleFilter">Locale Filter</a> data category is used to select different sections depending on whether the locale is a Canadian one or not.<div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Locale filter</title> </head> <body> <div its-locale-filter-list="*-ca"> Text for Canadian locales. </div> <div its-locale-filter-list="*-ca" its-locale-filter-type="exclude"> Text for non-Canadian locales. </div> </body> </html> </pre></div>[Source file: <a href="examples/html5/EX-locale-filter-local-html5-1.html">examples/html5/EX-locale-filter-local-html5-1.html</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locale-filter-attribute-1" id="EX-locale-filter-attribute-1"></a>Example 57: The <a href="#LocaleFilter">Locale Filter</a> data category expressed locally in XML</div><div class="exampleInner"><pre><book xmlns:its="http://www.w3.org/2005/11/its"> <info> <legalnotice its:localeFilterList="en-CA, fr-CA"> <para>This legal notice is only for English and French Canadian locales.</para> </legalnotice> </info> </book> </pre></div>[Source file: <a href="examples/xml/EX-locale-filter-attribute-1.xml">examples/xml/EX-locale-filter-attribute-1.xml</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="provenance" id="provenance"></a>8.11 Provenance</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="provenance-definition" id="provenance-definition"></a>8.11.1 Definition</h4>The <a href="#provenance">Provenance</a> data category is used to communicate the identity of agents that have been involved in the translation of the content or the revision of the translated content. This allows translation and translation revision consumers, such as post-editors, translation quality reviewers, or localization workflow managers, to assess how the performance of these agents may impact the quality of the translation. Translation and translation revision agents can be identified as a person, a piece of software or an organization that has been involved in providing a translation that resulted in the selected content. This data category offers three types of information. First, it allows identification of translation agents. Second, it allows identification of revision agents. Third, if provenance information is needed that includes temporal or sequence information about translation processes (e.g. multiple revision cycles) or requires agents that support a wider range of activities, the data category offers a mechanism to refer to external provenance information.<div class="note">Note:The specification does not define the format of external provenance information, but it is recommended that an open provenance or change-logging format be used, e.g. the W3C provenance data model <a title="Provenance data model" href="#prov-dm">[PROV-DM]</a>.</div>Translation or translation revision tools, such as machine translation engines or computer assisted translation tools, may offer an easy way to create this information. Translation tools can then present this information to post-editors or translation workflow managers. Web applications may to present such information to consumers of translated documents.The data category defines seven pieces of information:<a name="provenanceDefs" id="provenanceDefs"></a><table border="1" width="100%"><thead><tr><td>Information</td><td>Description</td><td>Value</td></tr></thead><tbody><tr><td>Human provenance information</td><td>Identification of a human translation agent</td><td>A string or an IRI (only for the <code>Ref</code> attributes)</td></tr><tr><td>Organizational provenance information</td><td>Identification of an organization acting as a translation agent</td><td>A string or an IRI (only for the <code>Ref</code> attributes)</td></tr><tr><td>Tool-related provenance information</td><td>Identification of a software tool that was used in translating the selected content</td><td>A string or an IRI (only for the <code>Ref</code> attributes)</td></tr><tr><td>Human revision provenance information</td><td>Identification of a human translation revision agent</td><td>A string or an IRI (only for the <code>Ref</code> attributes)</td></tr><tr><td>Organizational revision provenance information</td><td>Identification of an organization acting as a translation revision agent</td><td>A string or an IRI (only for the <code>Ref</code> attributes)</td></tr><tr><td>Tool-related revision provenance information</td><td>Identification of a software tool that was used in revising the translation of the selected content</td><td>A string or an IRI (only for the <code>Ref</code> attributes)</td></tr><tr><td>Reference to external provenance information</td><td>A reference to external provenance information</td><td>A space (U+0020) separated list of IRIs</td></tr></tbody></table><div class="note">Note:The tool related provenance and tool related revision provenance pieces of information are not meant to express information about tools used for creating ITS annotations themselves. For this purpose, ITS 2.0 provides a separate mechanism. See <a class="section-ref" href="#its-tool-annotation">Section 5.7: ITS Tools Annotation</a> for details, especially the <a href="#annotators-ref-usage-scenarios">note on annotatorsRef usage scenarios</a>.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="provenance-implementation" id="provenance-implementation"></a>8.11.2 Implementation</h4>The <a href="#provenance">Provenance</a> data category can be expressed with global rules, or locally on individual elements. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements and attributes.GLOBAL: The <code class="its-elem-markup">provRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A <code class="its-attr-markup">provenanceRecordsRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node containing a list of <a href="#elem-provenanceRecords">provenance records</a>. These are related to the content selected via the <code class="its-attr-markup">selector</code> attribute.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-provenance-global-1" id="EX-provenance-global-1"></a>Example 58: The <a href="#provenance">Provenance</a> data category used globally with standoff provenance records.</div>This example expresses provenance information in a standoff manner using <code>provenanceRecords</code> elements. The <code class="its-elem-markup">provRule</code> element specifies that for any element with a <code>ref</code> attribute that <code>ref</code> attribute holds a reference to an associated <code class="its-elem-markup">provenanceRecords</code> element where the provenance information is listed. The <code>legalnotice</code> element has been revised two times. Hence, the related <code class="its-elem-markup">provenanceRecords</code> element contains two <code class="its-elem-markup">provenanceRecord</code> child elements.<div class="exampleInner"><pre><text xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <dc:creator>John Doe</dc:creator> <its:provenanceRecords xml:id="pr1"> <its:provenanceRecord toolRef="http://www.example.onlinemtex.com/2012/7/25/wsdl/" org="acme-CAT-v2.3" revToolRef="http://www.mycat.com/v1.0/download" revOrg="acme-CAT-v2.3" provRef="http://www.examplelsp.com/excontent987/production/prov/e6354"/> </its:provenanceRecords> <its:provenanceRecords xml:id="pr2"> <its:provenanceRecord person="John Doe" orgRef="http://www.legaltrans-ex.com" revPerson="Tommy Atkins" revOrgRef="http://www.example.myorg.com" provRef="http://www.example.myorg.com/job-12-7-15-X31/reviewed/prov/re8573469"/> <its:provenanceRecord revPerson="John Smith" revOrgRef="http://john-smith.qa.example.com"/> </its:provenanceRecords> <its:rules version="2.0"> <its:provRule selector="//*[@ref]" provenanceRecordsRefPointer="@ref"/> </its:rules> <title>Translation Revision Provenance Agent: Global Test in XML</title> <body> <par ref="#pr1"> This paragraph was translated from the machine.</par> <legalnotice postediting-by="http://www.example.myorg.com" ref="#pr2">This text was translated directly by a person.</legalnotice> </body> </text></pre></div>[Source file: <a href="examples/xml/EX-provenance-global-1.xml">examples/xml/EX-provenance-global-1.xml</a>]</div>LOCAL: Using the inline markup to represent the data category locally is limited to a single occurrence for a given content (e.g., one cannot have different <code class="its-attr-markup">toolRef</code> attributes applied to the same span of text because the inner-most one would override the others). A local standoff markup is provided to allow such cases.The following local markup is available for the <a href="#provenance">Provenance</a> data category:<ul><li>Either (inline markup): at least one of the following attributes:<ul><li>A <code class="its-attr-markup">person</code> or <code class="its-attr-markup">personRef</code> attribute that implements the <a href="#provenanceDefs">human provenance information</a>.</li><li>An <code class="its-attr-markup">org</code> or <code class="its-attr-markup">orgRef</code> attribute that implements the <a href="#provenanceDefs">organizational provenance information</a>.</li><li>A <code class="its-attr-markup">tool</code> or <code class="its-attr-markup">toolRef</code> attribute that implements the <a href="#provenanceDefs">tool-related provenance information</a>.</li><li>A <code class="its-attr-markup">revPerson</code> or <code class="its-attr-markup">revPersonRef</code> attribute that implements the <a href="#provenanceDefs">human revision provenance information</a>.</li><li>A <code class="its-attr-markup">revOrg</code> or <code class="its-attr-markup">revOrgRef</code> attribute that implements the <a href="#provenanceDefs">organizational revision provenance information</a>.</li><li>A <code class="its-attr-markup">revTool</code> or <code class="its-attr-markup">revToolRef</code> attribute that implements the <a href="#provenanceDefs">tool-related revision provenance information</a>.</li><li>A <code class="its-attr-markup">provRef</code> attribute that implements the <a href="#provenanceDefs">reference to external provenance descriptions</a>.</li></ul></li><li>Or (standoff markup):<ul><li>A <code class="its-attr-markup">provenanceRecordsRef</code> attribute. Its value is an IRI pointing to the <code class="its-elem-markup">provenanceRecords</code> element containing the list of <a href="#elem-provenanceRecords">provenance records</a> related to this content.</li><li>An element <code class="its-elem-markup">provenanceRecords</code>, which contains:<ul><li>One or more elements <code class="its-elem-markup">provenanceRecord</code>, each of which contains at least one of the following attributes:<ul><li>A <code class="its-attr-markup">person</code> or <code class="its-attr-markup">personRef</code> attribute that implements the <a href="#provenanceDefs">human provenance information</a>.</li><li>An <code class="its-attr-markup">org</code> or <code class="its-attr-markup">orgRef</code> attribute that implements the <a href="#provenanceDefs">organizational provenance information</a>.</li><li>A <code class="its-attr-markup">tool</code> or <code class="its-attr-markup">toolRef</code> attribute that implements the <a href="#provenanceDefs">tool-related provenance information</a>.</li><li>A <code class="its-attr-markup">revPerson</code> or <code class="its-attr-markup">revPersonRef</code> attribute that implements the <a href="#provenanceDefs">human revision provenance information</a>.</li><li>A <code class="its-attr-markup">revOrg</code> or <code class="its-attr-markup">revOrgRef</code> attribute that implements the <a href="#provenanceDefs">organizational revision provenance information</a>.</li><li>A <code class="its-attr-markup">revTool</code> or <code class="its-attr-markup">revToolRef</code> attribute that implements the <a href="#provenanceDefs">tool-related revision provenance information</a>.</li><li>A <code class="its-attr-markup">provRef</code> attribute that implements the <a href="#provenanceDefs">reference to external provenance descriptions</a>.</li></ul></li></ul></li></ul><div class="note">Note:Ideally the order of <code class="its-elem-markup">provenanceRecord</code> elements within a <code class="its-elem-markup">provenanceRecords</code> element reflects the order with which they were added to the document, with the most recently added one listed first.</div>When the attributes <code class="its-attr-markup">person</code>, <code class="its-attr-markup">personRef</code>, <code class="its-attr-markup">org</code>, <code class="its-attr-markup">orgRef</code>, <code class="its-attr-markup">tool</code>, <code class="its-attr-markup">toolRef</code>, <code class="its-attr-markup">revPerson</code>, <code class="its-attr-markup">revPersonRef</code>, <code class="its-attr-markup">revOrg</code>, <code class="its-attr-markup">revOrgRef</code>, <code class="its-attr-markup">revTool</code>, <code class="its-attr-markup">revToolRef</code> and <code class="its-attr-markup">provRef</code> are used in a standoff manner, the information they carry pertains to the content of the element that refers to the standoff annotation, not to the content of the element <code class="its-elem-markup">provenanceRecord</code> where they are declared. In HTML the standoff markup <a href="#rfc-keywords">MUST</a> either be stored inside a <code>script</code> element in the same HTML document, or be linked from any <code class="its-attr-markup">provenanceRecordsRef</code> to an external XML or HTML file with the standoff inside. If standoff is inside a <code>script</code> element that element <a href="#rfc-keywords">MUST</a> have a <code>type</code> attribute with the value <code>application/its+xml</code>. Its <code>id</code> attribute <a href="#rfc-keywords">MUST</a> be set to the same value as the <code>xml:id</code> attribute of the <code class="its-elem-markup">provenanceRecords</code> element it contains.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-provenance-local-1" id="EX-provenance-local-1"></a>Example 59: Annotating provenance information in XML with local inline markup</div>The provenance related attributes at the <code>par</code> and <code>legalnotice</code> elements are used to associate the provenance information directly with the content of these elements.<div class="exampleInner"><pre><text xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <title>Translation Revision Provenance Agent: Local Test in XML</title> <body> <par its:toolRef="http://www.onlinemtex.com/2012/7/25/wsdl/" its:org="acme-CAT-v2.3" its:revToolRef="http://www.mycat.com/v1.0/download" its:revOrg="acme-CAT-v2.3" its:provRef="http://www.example.lsp1.com/prov/e6354 http://www.example.lsp2.com/prov/e7738" >This paragraph was translated from the machine.</par> <legalnotice its:person="John Doe" its:orgRef="http://www.legaltrans-ex.com/" its:provRef="http://www.examplelsp.com/excontent987/legal/prov/e6354" its:revPerson="Tommy Atkins" its:revOrgRef="http://www.example.myorg.com" >This text was translated directly by a person.</legalnotice> </body> </text></pre></div>[Source file: <a href="examples/xml/EX-provenance-local-1.xml">examples/xml/EX-provenance-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-provenance-html5-local-1" id="EX-provenance-html5-local-1"></a>Example 60: Annotating provenance information in HTML with local inline markup</div>In this example several spans of content are associated with provenance information.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Provenance Agent: Local Test in HTML5</title> </head> <body> <p its-tool-ref="http://www.onlinemtex.com/2012/7/25/wsdl/" its-org="acme-CAT-v2.3" its-prov-ref="http://www.examplelsp.com/excontent987/production/prov/e6354" its-rev-org="acme-CAT-v2.3" >This paragraph was translated from the machine. <p class="legal-notice" its-person="John Doe" its-org-ref="http://www.legaltrans-ex.com/" its-prov-ref="http://www.examplelsp.com/excontent987/legal/prov/e6354" its-rev-person="Tommy Atkins" its-rev-org-ref="http://www.example.myorg.com" >This text was translated directly by a person. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-provenance-html5-local-1.html">examples/html5/EX-provenance-html5-local-1.html</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-provenance-html5-local-2" id="EX-provenance-html5-local-2"></a>Example 61: Annotating provenance information in HTML with local standoff markup</div>The following example shows a document using local standoff markup to encode provenance information. The <code>p</code> elements delimit the content to markup. They hold <code class="its-attr-markup">its-provenance-records-ref</code> attributes that point to the standoff information inside the <code>script</code> elements.<div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Test</title> <script id=pr1 type=application/its+xml> <its:provenanceRecords xml:id="pr1" xmlns:its="http://www.w3.org/2005/11/its"> <its:provenanceRecord toolRef="http://www.onlinemtex.com/2012/7/25/wsdl/" org="acme-CAT-v2.3" provRef="http://www.examplelsp.com/excontent987/production/prov/e6354" revToolRef="http://www.mycat.com/v1.0/download" revOrg="acme-CAT-v2.3" /> </its:provenanceRecords> </script> <script id=pr2 type=application/its+xml> <its:provenanceRecords xml:id="pr2" xmlns:its="http://www.w3.org/2005/11/its"> <its:provenanceRecord person="John Doe" orgRef="http://www.legaltrans-ex.com/" provRef="http://www.examplelsp.com/excontent987/legal/prov/e6354" revPerson="Tommy Atkins" revOrgRef="http://www.example.myorg.com" /> <its:provenanceRecord revPerson="John Smith" revOrgRef="http://john-smith.qa.example.com" /> </its:provenanceRecords> </script> </head> <body> <p its-provenance-records-ref="#pr1">This paragraph was translated from the machine. <p its-provenance-records-ref="#pr2">This text was translated directly by a person. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-provenance-html5-local-2.html">examples/html5/EX-provenance-html5-local-2.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="externalresource" id="externalresource"></a>8.12 External Resource</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="externalresource-definition" id="externalresource-definition"></a>8.12.1 Definition</h4>The <a href="#externalresource">External Resource</a> data category indicates that a node represents or references potentially translatable data in a resource outside the document. Examples of such resources are external images and audio or video files.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="externalresource-implementation" id="externalresource-implementation"></a>8.12.2 Implementation</h4>The <a href="#externalresource">External Resource</a> data category can be expressed only with global rules. There is no inheritance. There is no default.GLOBAL: The <code class="its-elem-markup">externalResourceRefRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">externalResourceRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node that provides the IRI of the external resource.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-externalresource-1" id="EX-externalresource-1"></a>Example 62: The <code class="its-elem-markup">externalResourceRefRule</code> element</div>The <code class="its-elem-markup">externalResourceRefRule</code> element expresses that the <code>imagedata</code>, <code>audiodata</code> and <code>videodata</code> elements contain references to external resources. These references are expressed via a <code>fileref</code> attribute. The <code class="its-attr-markup">externalResourceRefPointer</code> attribute points to that attribute.<div class="exampleInner"><pre><doc xmlns:its="http://www.w3.org/2005/11/its" xmlns:db="http://docbook.org/ns/docbook"> <its:rules version="2.0"> <its:externalResourceRefRule selector="//db:imagedata | //db:audiodata | //db:videodata" externalResourceRefPointer="@fileref"/> </its:rules> <db:mediaobject> <db:videoobject> <db:videodata fileref="movie.avi"/> </db:videoobject> <db:imageobject> <db:imagedata fileref="movie-frame.gif"/> </db:imageobject> <db:textobject> <db:para>This video illustrates the proper way to assemble an inverting time distortion device. </db:para> <db:warning> <db:para> It is imperative that the primary and secondary temporal couplings not be mounted in the wrong order. Temporal catastrophe is the likely result. The future you destroy may be your own. </db:para> </db:warning> </db:textobject> </db:mediaobject> </doc> </pre></div>[Source file: <a href="examples/xml/EX-externalresource-1.xml">examples/xml/EX-externalresource-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-externalresource-2" id="EX-externalresource-2"></a>Example 63: Two <code class="its-elem-markup">externalResourceRefRule</code> elements used for external resources associated with HTML <code>video</code> elements</div>The two <code class="its-elem-markup">externalResourceRefRule</code> elements select the <code>src</code> and the <code>poster</code> attributes at HTML <code>video</code> elements. These attributes identify different external resources, and at the same time contain the references to these resources. For this reason, the <code class="its-attr-markup">externalResourceRefPointer</code> attributes point to the value of <code>src</code> and <code>poster</code> respectively. The underlying HTML document is given in <a href="#EX-externalresource-html5-1">Example 64</a>.<div class="exampleInner"><pre><its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its" xmlns:html="http://www.w3.org/1999/xhtml"> <its:externalResourceRefRule selector="//html:video/@src" externalResourceRefPointer="."/> <its:externalResourceRefRule selector="//html:video/@poster" externalResourceRefPointer="."/> </its:rules> </pre></div>[Source file: <a href="examples/xml/EX-externalresource-2.xml">examples/xml/EX-externalresource-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-externalresource-html5-1" id="EX-externalresource-html5-1"></a>Example 64: An HTML document that can be used for <a href="#EX-externalresource-2">Example 63</a>.</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Video element example</title> </head> <body> <video height=360 poster=http://www.example.com/video-image.png src=http://www.example.com/video/v2.mp width=640> If your browser doesn't support the <code>video</code> element, you can <a href=http://www.example.com/video/v2.mp>download the video</a> instead. </video> </body> </html></pre></div>[Source file: <a href="examples/html5/EX-externalresource-html5-1.html">examples/html5/EX-externalresource-html5-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="target-pointer" id="target-pointer"></a>8.13 Target Pointer</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="target-pointer-definition" id="target-pointer-definition"></a>8.13.1 Definition</h4>Some formats, such as those designed for localization or for multilingual resources, hold the same content in different languages inside a single document. The <a href="#target-pointer">Target Pointer</a> data category is used to associate the node of a given source content (i.e., the content to be translated) and the node of its corresponding target content (i.e., the source content translated into a given target language).This specification makes no provision regarding the presence of the target nodes or their content: A target node may or may not exist and it may or may not have content.This data category can be used for several purposes, including but not limited to:<ul><li>Extract the source content to translate and put back the translation at its proper location.</li><li>Compare source and target content for quality verification.</li><li>Reuse existing translations when localizing the new version of an existing document.</li><li>Access aligned bi-lingual content to build memories, or to train machine translation engines.</li></ul><div class="note">Note:In general, it is recommended to avoid developing formats where the same content is stored in different languages in the same document, except for very specific use cases. See the best practices “<a href="https://www.w3.org/TR/2008/NOTE-xml-i18n-bp-20080213/#DevMLDoc">Working with multilingual documents</a>” from <a title="Best
 Practices for XML Internationalization" href="#xml-i18n-bp">[XML i18n BP]</a> for further guidance.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="target-pointer-implementation" id="target-pointer-implementation"></a>8.13.2 Implementation</h4>The <a href="#target-pointer">Target Pointer</a> data category can be expressed only with global rules. There is no inheritance. There is no default.GLOBAL: The <code class="its-elem-markup">targetPointerRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">targetPointer</code> attribute. It contains a <a href="#selectors">relative selector</a> that points to the node for the target content corresponding to the selected source node.</li></ul><div class="note">Note:The source node and the target node may be of different types, but the target node has to contain the same content as the source node (e.g., an attribute node cannot be the target node of a source node that is an element with children).</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-target-pointer-global-1" id="EX-target-pointer-global-1"></a>Example 65: Defining the target location of a source content with the <code class="its-elem-markup">targetPointerRule</code> element</div><div class="exampleInner"><pre><file> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:translateRule selector="/file" translate="no"/> <its:translateRule selector="//source" translate="yes"/> <its:targetPointerRule selector="//source" targetPointer="../target"/> </its:rules> <entry id="one"> <source>Remember last folder</source> <target/> </entry> <entry id="two"> <source>Custom file filter:</source> <target/> </entry> </file></pre></div>[Source file: <a href="examples/xml/EX-target-pointer-global-1.xml">examples/xml/EX-target-pointer-global-1.xml</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="idvalue" id="idvalue"></a>8.14 ID Value</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="idvalue-definition" id="idvalue-definition"></a>8.14.1 Definition</h4>The <a href="#idvalue">ID Value</a> data category indicates a value that can be used as unique identifier for a given part of the content.The recommended way to specify a unique identifier is to use <code>xml:id</code> <a title="xml:id Version
 1.0" href="#xml-id">[XML ID]</a> or <code>id</code> in HTML (See the best practice “<a href="https://www.w3.org/TR/2008/NOTE-xml-i18n-bp-20080213/#DevUniqueID">Defining markup for unique identifiers</a>” from <a title="Best
 Practices for XML Internationalization" href="#xml-i18n-bp">[XML i18n BP]</a>). The <code class="its-elem-markup">idValueRule</code> element is intended only as a fall-back mechanism for documents in which unique identifiers are available with another construct.Providing a unique identifier that is maintained in the original document can be useful for several purposes, for example:<ul><li>Allow automated alignment between different versions of the source document, or between source and translated documents.</li><li>Improve the confidence in leveraged translation for exact matches.</li><li>Provide backtracking information between displayed text and source material when testing or debugging.</li></ul><div class="note">Note:<ul><li>The <a href="#idvalue">ID Value</a> data category only provides for rules to be expressed at a global level. Locally, users are able to use <code>xml:id</code> (which is defined by XML) or <code>id</code> in HTML, or an attribute specific to the format in question (as in <a href="#EX-idvalue-attribute-1">Example 68</a>).</li><li>Applying the <a href="#idvalue">ID Value</a> data category to <code>xml:id</code> (in XML) or <code>id</code> (in HTML) attributes in global rules is not necessary, since these attributes are the recommended way to specify an identifier.</li></ul></div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="idvalue-implementation" id="idvalue-implementation"></a>8.14.2 Implementation</h4>The <a href="#idvalue">ID Value</a> data category can be expressed only with global rules. There is no inheritance. There is no default.GLOBAL: The <code class="its-elem-markup">idValueRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">idValue</code> attribute. It contains any XPath expression; the context for the evaluation of the XPath expression is the same as for <a href="#selectors">relative selectors</a>. The evaluation of the XPath expression constructs a string corresponding to the identifier of the node to which this rule applies. The identifier <a href="#rfc-keywords">MUST</a> be unique at least within the document. If the attribute <code>xml:id</code> is present or <code>id</code> in HTML for the selected node, the value of the <code>xml:id</code> attribute or <code>id</code> in HTML <a href="#rfc2119">MUST</a> take precedence over the <code class="its-attr-markup">idValue</code> value.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-idvalue-element-1" id="EX-idvalue-element-1"></a>Example 66: Pointing to an ID Value with the <code class="its-elem-markup">idValueRule</code> element</div>The <code class="its-elem-markup">idValueRule</code> element indicates that the unique identifier for each <code><text></code> element is the value of the attribute <code>name</code> of its parent element.<div class="exampleInner"><pre><?xml version="1.0"?> <resources> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:translateRule translate="no" selector="/resources"/> <its:translateRule translate="yes" selector="//text"/> <its:idValueRule selector="//text" idValue="../@name"/> </its:rules> <entry name="btn.OK"> <text>OK</text> <pos>1, 1</pos> <trig>sendOK</trig> </entry> <entry name="btn.CANCEL"> <text>Cancel</text> <pos>2, 1</pos> <trig>cancelAll</trig> </entry> </resources></pre></div>[Source file: <a href="examples/xml/EX-idvalue-element-1.xml">examples/xml/EX-idvalue-element-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-idvalue-element-2" id="EX-idvalue-element-2"></a>Example 67: Constructing ID values using the <code class="its-elem-markup">idValueRule</code> element.</div>The <code class="its-attr-markup">idValue</code> attribute allows to build composite values based on different attributes, elements, or even hard-coded text. Any of the String functions offered by XPath can be used. In the document below, the two elements <code><text></code> and <code><desc></code> are translatable, but they have only one corresponding identifier, the <code>name</code> attribute in their parent element.To make sure the identifier is unique for both the content of <code><text></code> and the content of <code><desc></code>, the XPath expression <code>concat(../@name, '_t')</code> gives the identifier "settingsMissing_t" for the content of <code><text></code> and the expression <code>concat(../@name, '_d')</code> gives the identifier "settingsMissing_d" for the content of <code><desc></code>.<div class="exampleInner"><pre><?xml version="1.0"?> <doc> <its:rules version="2.0" xmlns:its="http://www.w3.org/2005/11/its"> <its:idValueRule selector="//text" idValue="concat(../@name, '_t')"/> <its:idValueRule selector="//desc" idValue="concat(../@name, '_d')"/> </its:rules> <msg name="settingsMissing"> <text>Can't find settings file.</text> <desc>The module cannot find the default settings file. You need to re-initialize the system.</desc> </msg> </doc></pre></div>[Source file: <a href="examples/xml/EX-idvalue-element-2.xml">examples/xml/EX-idvalue-element-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-idvalue-attribute-1" id="EX-idvalue-attribute-1"></a>Example 68: Using <code>xml:id</code> and <code class="its-elem-markup">idValueRule</code> </div>When an <code>xml:id</code> attribute is present for a node selected by an <code class="its-elem-markup">idValueRule</code> element, the value of <code>xml:id</code> takes precedence over the value defined by the <code class="its-elem-markup">idValueRule</code> element. In the example below, the unique ID to use is “btnAgain” for the first <code><res></code> element, and “retryTip” for the second <code><res></code> element.<div class="exampleInner"><pre><?xml version="1.0"?> <file> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:idValueRule selector="//res" idValue="@name"/> </its:rules> <res name="retryBtn" xml:id="btnAgain">Try Again</res> <res name="retryTip">click this to re-run the process with the current settings.</res> </file></pre></div>[Source file: <a href="examples/xml/EX-idvalue-attribute-1.xml">examples/xml/EX-idvalue-attribute-1.xml</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="preservespace" id="preservespace"></a>8.15 Preserve Space</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="preservespace-definition" id="preservespace-definition"></a>8.15.1 Definition</h4>The <a href="#preservespace">Preserve Space</a> data category indicates how whitespace is to be handled in content. The possible values for this data category are "default" and "preserve" and carry the same meaning as the corresponding values of the <a href="https://www.w3.org/TR/2008/REC-xml-20081126/#sec-white-space">xml:space</a> attribute. The default value is "default". The Preserve Space data category does not apply to HTML documents in HTML syntax.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="preservespace-implementation" id="preservespace-implementation"></a>8.15.2 Implementation</h4>The <a href="#preservespace">Preserve Space</a> data category can be expressed with global rules, or locally using the <code>xml:space</code> attribute. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements and attributes.<div class="note">Note:The <a href="#preservespace">Preserve Space</a> data category is not applicable to HTML documents in HTML syntax because <code>xml:space</code> (and by extension <a href="#preservespace">Preserve Space</a>) has no effect in documents parsed as text/html. However, the data category can be used in HTML in XHTML syntax.</div>GLOBAL: The <code class="its-elem-markup">preserveSpaceRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">space</code> attribute with the value "default" or "preserve".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-preservespace-global-1" id="EX-preservespace-global-1"></a>Example 69: The <a href="#preservespace">Preserve Space</a> data category expressed globally</div>The <code class="its-elem-markup">preserveSpaceRule</code> element specifies that whitespace in all verse elements are to be treated literally.<div class="exampleInner"><pre><book> <info> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:preserveSpaceRule selector="//verse" space="preserve"/> </its:rules> </info> <verse> ’Twas brillig, and the slithy toves Did gyre and gimble in the wabe; All mimsy were the borogoves, And the mome raths outgrabe. </verse> </book> </pre></div>[Source file: <a href="examples/xml/EX-preservespace-global-1.xml">examples/xml/EX-preservespace-global-1.xml</a>]</div>LOCAL: The <code>xml:space</code> attribute, as defined in section 2.10 of <a title="Extensible Markup Language
 (XML) 1.0 (Fifth Edition)" href="#xml10spec">[XML 1.0]</a>, maps exactly to the <a href="#preservespace">Preserve Space</a> data category.<div class="exampleOuter"><div class="exampleHeader"><a name="EX-preservespace-local-1" id="EX-preservespace-local-1"></a>Example 70: The <a href="#preservespace">Preserve Space</a> data category expressed locally</div>The standard <code>xml:space</code> attribute specifies that the whitespace in the verse element are to be treated literally.<div class="exampleInner"><pre><book> <verse xml:space="preserve"> 'Twas brillig, and the slithy toves Did gyre and gimble in the wabe; All mimsy were the borogoves, And the mome raths outgrabe. </verse> </book> </pre></div>[Source file: <a href="examples/xml/EX-preservespace-local-1.xml">examples/xml/EX-preservespace-local-1.xml</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqissue" id="lqissue"></a>8.16 Localization Quality Issue</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqissue-definition" id="lqissue-definition"></a>8.16.1 Definition</h4>The <a href="#lqissue">Localization Quality Issue</a> data category is used to express information related to localization quality assessment tasks. Such tasks can be conducted on the translation of some source content (such as a text or an image) into a target language or on the source content itself where its quality may impact on the localization process.<div class="note">Note:Automated or manual quality assessment is one area of quality management for translation and localization. An example of existing quality assessment is in-country review (e.g., as part of a language acceptance test for software). An important part of quality assessment is the list of issue types that are being used. Very often, simple issue categories like "correct/incorrect" or "like/dislike" are inadequate; instead, more specific ones such as "terminology" or "grammar" are more helpful in identifying concrete reasons for quality problems and for obtaining a more objective picture of quality levels.Non-normative terminology related to localization quality as used in this section is provided in <a class="section-ref" href="#localization-quality-guidance">Appendix H: Localization Quality Guidance</a>.</div>This data category can be used in a number of ways, including the following example scenarios:<ul><li>A human reviewer working with a web-based tool adds quality markup manually in a text editor, including comments and suggestions, to localized content as part of the review process. A subsequent process examines this markup to ensure that changes were made.</li><li>A fully automatic quality checking tool flags a number of potential quality issues in an XML or HTML file and marks them up using ITS 2.0 markup. A human reviewer then uses another tool to examine this markup and decide whether the file needs to receive more extensive review or be passed on for further processing without a further manual review stage.</li><li>A quality assessment process identifies a number of issues and adds the ITS markup to a rendered HTML preview of an XML file along with CSS styling that highlights these issues. The resulting HTML file is then sent back to the translator to assist his or her revision efforts.</li></ul><div class="note">Note:What issues should be considered in quality assessment tasks depends on the nature of the project and tools used. Further guidance is beyond the scope of this specification, but implementers may wish to consult the references cited in <a class="section-ref" href="#localization-quality-guidance">Appendix H: Localization Quality Guidance</a>.</div>The data category defines five pieces of information:<a name="lqissueDefs" id="lqissueDefs"></a><table border="1" width="100%"><thead><tr><td>Information</td><td>Description</td><td>Value</td><td>Notes</td></tr></thead><tbody><tr><td>Type</td><td>A classifier that groups similar issues into categories (for example to differentiate spelling errors from grammar errors).</td><td>One of the values defined in <a href="#lqissue-typevalues">list of type values</a>.</td><td>ITS 2.0-compliant tools that use these types <a href="#rfc-keywords">MUST</a> map their internal values to these types. If the type of the issue is set to <code>uncategorized</code>, a comment <a href="#rfc-keywords">MUST</a> be specified as well.</td></tr><tr><td>Comment</td><td>A human-readable description of a specific instance of a quality issue.</td><td>Text</td><td>Comments can be used to explain an issue or provide guidance in addressing an issue. For example, a note about a Terminology issue might specify what term should be used.</td></tr><tr><td>Severity</td><td>A classifier for the seriousness of an issue. The seriousness depends on the Quality Model that is being applied. The Quality Model should be made explicit via the Profile Reference.</td><td>A rational number in the interval 0 to 100 (inclusive). The value follows the <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive">minInclusive</a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive">maxInclusive</a> set to 100. The higher values represent greater severity.</td><td>It is up to tools to map the values allowed by ITS 2.0 to their own system’s scale. If needed, the original value can be passed along using a custom namespace for XML, or a <code>data-</code> attribute for HTML.</td></tr><tr><td>Profile Reference</td><td>A reference to a description of the quality assessment model (or a specific profile (customization/instantiation) of a model, where relevant) used for the issue.</td><td>An IRI pointing to the reference document.</td><td>The use of resolvable IRIs is strongly recommended as it provides a way for human evaluators to learn more about the quality issues in use.</td></tr><tr><td>Enabled</td><td>A flag indicating whether the issue is enabled or not.</td><td>A value <code>yes</code> or <code>no</code>, with the default value being <code>yes</code>.</td><td>This flag is used to activate or deactivate issues. There is no prescribed behavior associated with activated or deactivated issues. One example of usage is a tool that allows the user to deactivate false positives so they are not displayed again each time the document is re-checked.</td></tr></tbody></table></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqissue-implementation" id="lqissue-implementation"></a>8.16.2 Implementation</h4>The <a href="#lqissue">Localization Quality Issue</a> data category can be expressed with global rules, or locally on individual elements. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements, but excluding attributes.GLOBAL: The <code class="its-elem-markup">locQualityIssueRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>Either (in parallel to <a href="#lqissue-local-inline-markup">local inline markup</a>)<ul><li>At least one of the following attributes:<ul><li>A <code class="its-attr-markup">locQualityIssueType</code> attribute that implements the <a href="#lqissueDefs">type information</a>.</li><li>A <code class="its-attr-markup">locQualityIssueComment</code> attribute that implements the <a href="#lqissueDefs">comment information</a>.</li></ul></li><li>An optional <code class="its-attr-markup">locQualityIssueSeverity</code> attribute that implements the <a href="#lqissueDefs">severity information</a>.</li><li>An optional <code class="its-attr-markup">locQualityIssueProfileRef</code> attribute that implements the <a href="#lqissueDefs">profile reference information</a>.</li><li>An optional <code class="its-attr-markup">locQualityIssueEnabled</code> attribute that implements the <a href="#lqissueDefs">enabled information</a>.</li></ul></li><li>Or (standoff markup) exactly one of the following:<ul><li>A <code class="its-attr-markup">locQualityIssuesRef</code> attribute. Its value is an IRI pointing to the <code class="its-elem-markup">locQualityIssues</code> element containing the <a href="#elem-locQualityIssues">list of issues</a> related to this content.</li><li>A <code class="its-attr-markup">locQualityIssuesRefPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node with the exact same semantics as <code class="its-attr-markup">locQualityIssuesRef</code>.</li></ul></li></ul><div class="note">Note:The attribute <code class="its-attr-markup">locQualityIssuesRefPointer</code> does not apply to HTML as local markup is provided for direct annotation in HTML.</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityIssue-global-1" id="EX-locQualityIssue-global-1"></a>Example 71: Annotating an issue in XML with <code class="its-elem-markup">locQualityIssueRule</code> element</div>The <code class="its-elem-markup">locQualityIssueRule</code> element associates the issue information with the value of the <code>text</code> attribute.<div class="exampleInner"><pre><?xml version="1.0"?> <doc> <header> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:locQualityIssueRule selector="//image[@id='i1']/@text" locQualityIssueType="typographical" locQualityIssueComment="Sentence without capitalization" locQualityIssueSeverity="50"/> </its:rules> </header> <para>Click the button <image id="i1" src="button.png" text="start button"/>.</para> </doc></pre></div>[Source file: <a href="examples/xml/EX-locQualityIssue-global-1.xml">examples/xml/EX-locQualityIssue-global-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityIssue-global-2" id="EX-locQualityIssue-global-2"></a>Example 72: Annotating an issue in XML with local standoff markup and a global rule</div>The following example shows a document using local standoff markup to encode several issues. But because, in this case, the <code>mrk</code> element does not allow attributes from another namespace we cannot use <code class="its-attr-markup">locQualityIssuesRef</code> directly. Instead, a global rule is used to map the function of <code class="its-attr-markup">locQualityIssuesRef</code> to a non-ITS construct, here the <code>ref</code> attribute of any <code>mrk</code> elements that have their attribute <code>type</code> set to "x-itslq".<div class="exampleInner"><pre><?xml version="1.0"?> <doc xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <file> <header> <its:rules version="2.0"> <its:locQualityIssueRule selector="//mrk[@type='x-itslq']" locQualityIssuesRefPointer="@ref"/> </its:rules> </header> <unit id="1"> <segment> <source>This is the content</source> <target><mrk type="x-itslq" ref="#lq1">c'es</mrk> le contenu</target> </segment> <its:locQualityIssues xml:id="lq1"> <its:locQualityIssue locQualityIssueType="misspelling" locQualityIssueComment="'c'es' is unknown. Could be 'c'est'" locQualityIssueSeverity="50"/> <its:locQualityIssue locQualityIssueType="typographical" locQualityIssueComment="Sentence without capitalization" locQualityIssueSeverity="30"/> </its:locQualityIssues> </unit> </file> </doc></pre></div>[Source file: <a href="examples/xml/EX-locQualityIssue-global-2.xml">examples/xml/EX-locQualityIssue-global-2.xml</a>]</div>LOCAL: Using inline markup to represent the data category locally is limited to a single occurrence for a given content (e.g. one cannot have different <code class="its-attr-markup">locQualityIssueType</code> attributes applied to the same span of text because the inner-most one would override the others). A local standoff markup is provided to allow such cases.The following local markup is available for the <a href="#lqissue">Localization Quality Issue</a> data category:<ul><li>Either (inline markup):<ul><li>At least one of the following attributes:<ul><li>A <code class="its-attr-markup">locQualityIssueType</code> attribute that implements the <a href="#lqissueDefs">type information</a>.</li><li>A <code class="its-attr-markup">locQualityIssueComment</code> attribute that implements the <a href="#lqissueDefs">comment information</a>.</li></ul></li><li>An optional <code class="its-attr-markup">locQualityIssueSeverity</code> attribute that implements the <a href="#lqissueDefs">severity information</a>.</li><li>An optional <code class="its-attr-markup">locQualityIssueProfileRef</code> attribute that implements the <a href="#lqissueDefs">profile reference information</a>.</li><li>An optional <code class="its-attr-markup">locQualityIssueEnabled</code> attribute that implements the <a href="#lqissueDefs">enabled information</a>.</li></ul></li><li>Or (standoff markup):<ul><li>A <code class="its-attr-markup">locQualityIssuesRef</code> attribute. Its value is an IRI pointing to the <code class="its-elem-markup">locQualityIssues</code> element containing the <a href="#elem-locQualityIssues">list of issues</a> related to this content.</li><li>An element <code class="its-elem-markup">locQualityIssues</code> with a <code>xml:id</code> attribute set to the identifier specified in the <code class="its-attr-markup">locQualityIssuesRef</code> attribute. The <code class="its-elem-markup">locQualityIssues</code> element contains:<ul><li>One or more elements <code class="its-elem-markup">locQualityIssue</code>, each of which contains:<ul><li>At least one of the following attributes:<ul><li>A <code class="its-attr-markup">locQualityIssueType</code> attribute that implements the <a href="#lqissueDefs">type information</a>.</li><li>A <code class="its-attr-markup">locQualityIssueComment</code> attribute that implements the <a href="#lqissueDefs">comment information</a>.</li></ul></li><li>An optional <code class="its-attr-markup">locQualityIssueSeverity</code> attribute that implements the <a href="#lqissueDefs">severity information</a>.</li><li>An optional <code class="its-attr-markup">locQualityIssueProfileRef</code> attribute that implements the <a href="#lqissueDefs">profile reference information</a>.</li><li>An optional <code class="its-attr-markup">locQualityIssueEnabled</code> attribute that implements the <a href="#lqissueDefs">enabled information</a>.</li></ul></li></ul></li></ul><div class="note">Note:Ideally the order of <code class="its-elem-markup">locQualityIssue</code> elements within a <code class="its-elem-markup">locQualityIssues</code> element reflects the order with which they were added to the document, with the most recently added one listed first.</div>When the attributes <code class="its-attr-markup">locQualityIssueType</code>, <code class="its-attr-markup">locQualityIssueComment</code>, <code class="its-attr-markup">locQualityIssueSeverity</code>, <code class="its-attr-markup">locQualityIssueProfileRef</code> and <code class="its-attr-markup">locQualityIssueEnabled</code> are used in a standoff manner, the information they carry pertains to the content of the element that refers to the standoff annotation, not to the content of the element <code class="its-elem-markup">locQualityIssue</code> where they are declared. In HTML the standoff markup <a href="#rfc-keywords">MUST</a> either be stored inside a <code>script</code> element in the same HTML document, or can be linked from any <code class="its-attr-markup">locQualityIssuesRef</code> to an external XML or HTML file with the standoff inside. If standoff is inside a <code>script</code> element, that element <a href="#rfc-keywords">MUST</a> have a <code>type</code> attribute with the value <code>application/its+xml</code>. Its <code>id</code> attribute <a href="#rfc-keywords">MUST</a> be set to the same value as the <code>xml:id</code> attribute of the <code class="its-elem-markup">locQualityIssues</code> element it contains.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityIssue-local-1" id="EX-locQualityIssue-local-1"></a>Example 73: Annotating an issue in XML with local inline markup</div>The attributes <code class="its-attr-markup">locQualityIssueType</code>, <code class="its-attr-markup">locQualityIssueComment</code> and <code class="its-attr-markup">locQualityIssueSeverity</code> are used to associate the issue information directly with a selected span of content.<div class="exampleInner"><pre><?xml version="1.0"?> <doc xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <para><span its:locQualityIssueType="typographical" its:locQualityIssueComment="Sentence without capitalization" its:locQualityIssueSeverity="50">this is an example</para> </doc></pre></div>[Source file: <a href="examples/xml/EX-locQualityIssue-local-1.xml">examples/xml/EX-locQualityIssue-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityIssue-html5-local-1" id="EX-locQualityIssue-html5-local-1"></a>Example 74: Annotating an issue in HTML with local inline markup</div>In this example several spans of content are associated with a quality issue.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Telharmonium 1897</title> <style type=text/css> [its-loc-quality-issue-type]{ background-color:yellow; margin:2px; } [its-loc-quality-issue-severity = "100"]{ border: 2px solid red; } </style> </head> <body> <h1>Telharmonium (1897)</h1> <span data-mytool-qacode=named_entity_not_found its-loc-quality-issue-comment="Should be Thomas Cahill." its-loc-quality-issue-profile-ref=http://example.org/qaMovel/v1 its-loc-quality-issue-severity=100 its-loc-quality-issue-type=inconsistent-entities>Christian Bale (1867–1934) conceived of an instrument that could transmit its sound from a power plant for hundreds of miles to listeners over telegraph wiring. Beginning in 1889 the sound quality of regular telephone concerts was very poor on account of the buzzing generated by carbon-granule microphones. As a result Cahill decided to set a new standard in perfection of sound <span its-loc-quality-issue-comment="should be 'quality'" its-loc-quality-issue-profile-ref=grammar its-loc-quality-issue-severity=50 its-loc-quality-issue-type=misspelling>qulaity with his instrument, a standard that would not only satisfy listeners but that would overcome all the flaws of traditional instruments. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-locQualityIssue-html5-local-1.html">examples/html5/EX-locQualityIssue-html5-local-1.html</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityIssue-local-2" id="EX-locQualityIssue-local-2"></a>Example 75: Annotating an issue in XML with local standoff markup</div>The following example shows a document using local standoff markup to encode several issues. The <code>mrk</code> element delimits the content to markup and holds a <code class="its-attr-markup">locQualityIssuesRef</code> attribute that points to the <code class="its-elem-markup">locQualityIssues</code> element where the issues are listed.<div class="exampleInner"><pre><?xml version="1.0"?> <xliff version="1.2" xmlns="urn:oasis:names:tc:xliff:document:1.2" xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <file original="example.doc" source-language="en" datatype="plaintext"> <body> <trans-unit id="1"> <source xml:lang="en">This is the content</source> <target xml:lang="fr"><mrk mtype="x-itslq" its:locQualityIssuesRef="#lq1">c'es</mrk> le contenu</target> <its:locQualityIssues xml:id="lq1"> <its:locQualityIssue locQualityIssueType="misspelling" locQualityIssueComment="'c'es' is unknown. Could be 'c'est'" locQualityIssueSeverity="50"/> <its:locQualityIssue locQualityIssueType="typographical" locQualityIssueComment="Sentence without capitalization" locQualityIssueSeverity="30"/> </its:locQualityIssues> </trans-unit> </body> </file> </xliff></pre></div>[Source file: <a href="examples/xml/EX-locQualityIssue-local-2.xml">examples/xml/EX-locQualityIssue-local-2.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityIssue-html5-local-2" id="EX-locQualityIssue-html5-local-2"></a>Example 76: Annotating an issue in HTML with local standoff markup</div>The following example shows a document using local standoff markup to encode several issues. The <code>span</code> element delimits the content to markup and holds a <code class="its-attr-markup">loc-quality-issues-ref</code> attribute that points to a special <code>span</code> element where the issues are listed within a set of other special <code>span</code> elements.<div class="exampleInner"><pre><!DOCTYPE html> <html> <head> <meta charset=utf-8> <title>Test</title> <script src=qaissues.js type=text/javascript></script> <script type=application/its+xml id=lq1> <its:locQualityIssues xml:id="lq1" xmlns:its="http://www.w3.org/2005/11/its"> <its:locQualityIssue locQualityIssueType="misspelling" locQualityIssueComment="'c'es' is unknown. Could be 'c'est'" locQualityIssueSeverity="50"/> <its:locQualityIssue locQualityIssueType="typographical" locQualityIssueComment="Sentence without capitalization" locQualityIssueSeverity="30"/> </its:locQualityIssues> </script> <style type=text/css>.qaissue { background-color: yellow; } </style> </head> <body onload=addqaissueattrs()> <span its-loc-quality-issues-ref=#lq1>c'es le contenu </body> </html></pre></div>[Source file: <a href="examples/html5/EX-locQualityIssue-html5-local-2.html">examples/html5/EX-locQualityIssue-html5-local-2.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqrating" id="lqrating"></a>8.17 Localization Quality Rating</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqrating-definition" id="lqrating-definition"></a>8.17.1 Definition</h4>The <a href="#lqrating">Localization Quality Rating</a> data category is used to express an overall measurement of the localization quality of a document or an item in a document.This data category allows to specify a quality score or a voting result for a given item or document, as well as to indicate what constitutes a passing score or vote. It also allows pointing to a profile describing the quality assessment model used for the scoring or the voting.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqrating-implementation" id="lqrating-implementation"></a>8.17.2 Implementation</h4>The <a href="#lqrating">Localization Quality Rating</a> data category is only expressed locally on individual elements. The data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements, but excluding attributes.LOCAL: The following local markup is available for the <a href="#lqrating">Localization Quality Rating</a> data category:<ul><li>Exactly one of the following:<ul><li>A <code class="its-attr-markup">locQualityRatingScore</code> attribute. Its value is a rational number in the interval 0 to 100 (inclusive). The value follows the <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive">minInclusive</a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive">maxInclusive</a> set to 100. The higher values represent better quality.</li><li>A <code class="its-attr-markup">locQualityRatingVote</code> attribute. Its value is a signed integer with higher values indicating a better vote.</li></ul></li><li>If <code class="its-attr-markup">locQualityRatingScore</code> is used:<ul><li>an optional <code class="its-attr-markup">locQualityRatingScoreThreshold</code> attribute indicating the lowest score that constitutes a passing score in the profile used. Its value is a rational number in the interval 0 to 100 (inclusive). The value follows the <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive">minInclusive</a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive">maxInclusive</a> set to 100.</li></ul></li><li>If <code class="its-attr-markup">locQualityRatingVote</code> is used:<ul><li>an optional <code class="its-attr-markup">locQualityRatingVoteThreshold</code> attribute indicating the lowest value that constitutes a passing vote in the profile used. Its value is a signed integer.</li></ul></li><li>An optional <code class="its-attr-markup">locQualityRatingProfileRef</code> attribute. Its value is an IRI pointing to the reference document describing the quality assessment model used for the scoring.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityRating-local-1" id="EX-locQualityRating-local-1"></a>Example 77: The <a href="#lqrating">Localization Quality Rating</a> data category expressed locally in XML</div>The <code class="its-attr-markup">locQualityRatingScore</code>, <code class="its-attr-markup">locQualityRatingThreshold</code> and <code class="its-attr-markup">locQualityRatingProfileRef</code> are used to score the quality of the document.<div class="exampleInner"><pre><?xml version="1.0"?> <doc xml:lang='nl' xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0" its:locQualityRatingScore="100" its:locQualityRatingScoreThreshold="95" its:locQualityRatingProfileRef="http://example.org/qaModel/v13"> <title>De lotgevallen van Tom Sawyer</title> <para>Hij kwam vrij laat te huis, en toen hij voorzichtig het raam insprong, viel hij in eene hinderlaag, in de persoon van zijne tante, bij wie, toen zij den staat zag, waarin zijne kleederen verkeerden, het besluit om zijn vrijen Zaterdag in een gevangenschap met dwangarbeid te veranderen, onherroepelijk vaststond.</para> </doc></pre></div>[Source file: <a href="examples/xml/EX-locQualityRating-local-1.xml">examples/xml/EX-locQualityRating-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-locQualityRating-html5-local" id="EX-locQualityRating-html5-local"></a>Example 78: The <a href="#lqrating">Localization Quality Rating</a> data category expressed locally in HTML</div>The <code class="its-attr-markup">its-loc-quality-rating-score</code>, <code class="its-attr-markup">its-loc-quality-rating-score-threshold</code> and <code class="its-attr-markup">its-loc-quality-rating-profile-ref</code> are used to score the quality of the document.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=fr its-loc-quality-rating-profile-ref=http://example.org/qaModel/v13 its-loc-quality-rating-score=90 its-loc-quality-rating-score-threshold=80 > <head> <meta charset=utf-8> <title>Rikki-tikki-tavi</title> </head> <body> C'est l'histoire de la grande guerre que Rikki-Tikki-Tavi a combattu tout seul, à travers les salles de bain du grand bungalow au cantonnement Segowlee. Darzee, le tailbird, l'a aidé, et Chuchundra, le rat musqué, qui ne sort jamais jusqu'au milieu du plancher, mais se glisse toujours contre la paroi, lui donnait des conseils, mais Rikki-Tikki-Tavi fait le véritable combat. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-locQualityRating-html5-local.html">examples/html5/EX-locQualityRating-html5-local.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="mtconfidence" id="mtconfidence"></a>8.18 MT Confidence</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="mtconfidence-definition" id="mtconfidence-definition"></a>8.18.1 Definition</h4>The <a href="#mtconfidence">MT Confidence</a> data category is used to communicate the confidence score from a machine translation engine for the accuracy of a translation it has provided. It is not intended to provide a score that is comparable between machine translation engines and platforms. This data category does NOT aim to establish any sort of correlation between the confidence score and either human evaluation of MT usefulness, or post-editing cognitive effort. For harmonization’s sake, MT Confidence is provided as a rational number in the interval 0 to 1 (inclusive).<div class="note">Note:Implementers are expected to interpret the floating-point number and present it to human and other consumers in a convenient form, such as percentage (0-100%) with up to 2 decimal digits, font or background color coding, etc.</div><div class="note">Note:The value provided by the <a href="#mtconfidence">MT Confidence</a> data category can be 1) the quality score of the translation as produced by an MT engine, or 2) a quality estimation score that uses both MT-system-internal features and additional external features. For this reason it is important that <a href="#mtconfidence">MT Confidence</a> provides additional information about the MT engine (via the <code class="its-attr-markup">annotatorsRef</code> attribute, or in HTML the <code class="its-attr-markup">its-annotators-ref</code> attribute). Otherwise the score on its own is hard to interpret and to reuse. In the case of 2), <a href="#mtconfidence">MT Confidence</a> potentially conveys information about any additional tools that were used in deriving the score.</div>This data category can be used for several purposes, including, but not limited to:<ul><li>Automated prioritising of raw machine translated text for further processing based on empirically set thresholds.</li><li>Providing readers, translators, post-editors, reviewers, and proof-readers of machine translated text with self-reported relative accuracy prediction.</li></ul>MT confidence scores can be displayed e.g., on websites machine translated on the fly, by simple web-based translation editors or by Computer Aided Translation (CAT) tools.</div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="mtconfidence-implementation" id="mtconfidence-implementation"></a>8.18.2 Implementation</h4>The <a href="#mtconfidence">MT Confidence</a> category can be expressed with global rules or locally on individual elements. For elements, the data category information <a href="#def-inheritance">is inherited</a> by the textual content of the element, including child elements, but excluding attributes.Any node selected by the <a href="#mtconfidence">MT Confidence</a> data category <a href="#rfc2119">MUST</a> be contained in an element with the <code class="its-attr-markup">annotatorsRef</code> (or in HTML, <code class="its-attr-markup">its-annotators-ref</code>) attribute specified for the <a href="#mtconfidence">MT Confidence</a> data category. For more information, see <a class="section-ref" href="#its-tool-annotation">Section 5.7: ITS Tools Annotation</a>.GLOBAL: The <code class="its-elem-markup">mtConfidenceRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>A required <code class="its-attr-markup">mtConfidence</code> attribute with a value that represents the translation confidence score as a rational number in the interval 0 to 1 (inclusive). The value follows the <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive">minInclusive</a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive">maxInclusive</a> set to 1.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-xmConfidence-global-html5-1" id="EX-xmConfidence-global-html5-1"></a>Example 79: Global usage of <code class="its-elem-markup">mtConfidenceRule</code> in a HTML document to specify the confidence scores for the translation into English of the <code>title</code> attributes of two <code>img</code> elements.</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <link href=EX-mtconfidence-global-html5-1-external-rules.xml rel=its-rules> <title>Machine translated title attributes of img elements give MT confidence scores using global rules</title> </head> <body its-annotators-ref="mt-confidence|file:///tools.xml#T1"> <img src="http://upload.wikimedia.org/wikipedia/commons/9/93/Trinity_College.jpg" title="Front gate of Trinity College Dublin" alt="alternative description"/> <img src="http://upload.wikimedia.org/wikipedia/commons/c/cc/Molly_alone.jpg" title="A tart with a cart" alt="alternative description"/> </body> </html></pre></div>[Source file: <a href="examples/html5/EX-mtConfidence-global-html5-1.html">examples/html5/EX-mtConfidence-global-html5-1.html</a>]</div>Where the external ITS rules file is as shown:<div class="exampleOuter"><div class="exampleHeader"><a name="EX-mtconfidence-global-html5-1-external-rules" id="EX-mtconfidence-global-html5-1-external-rules"></a>Example 80: XML file with external rules references from an HTML file.</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0" xmlns:h="http://www.w3.org/1999/xhtml"> <its:mtConfidenceRule mtConfidence="0.785" selector="//h:img[@title='Front gate of Trinity College Dublin']/@title"/> <its:mtConfidenceRule mtConfidence="0.805" selector="//h:img[@title='A tart with a cart']/@title"/> </its:rules> </pre></div>[Source file: <a href="examples/html5/EX-mtconfidence-global-html5-1-external-rules.xml">examples/html5/EX-mtconfidence-global-html5-1-external-rules.xml</a>]</div>LOCAL: the following local markup is available for the <a href="#mtconfidence">MT Confidence</a> data category:<ul><li>A <code class="its-attr-markup">mtConfidence</code> attribute with a value that represents the translation confidence score as a rational number in the interval 0 to 1 (inclusive). The value follows the <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#double">XML Schema double data type</a> with the constraining facets <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-minInclusive">minInclusive</a> set to 0 and <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/#rf-maxInclusive">maxInclusive</a> set to 1.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-mtConfidence-local-1" id="EX-mtConfidence-local-1"></a>Example 81: The <a href="#mtconfidence">MT Confidence</a> data category expressed locally for the content of a span in an XML document.</div><div class="exampleInner"><pre><text xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0" its:annotatorsRef="mt-confidence|file:///tools.xml#T1"> <body> <span its:mtConfidence="0.8982">Dublin is the capital city of Ireland. </body> </text></pre></div>[Source file: <a href="examples/xml/EX-mtConfidence-local-1.xml">examples/xml/EX-mtConfidence-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-mtConfidence-html5-local-1" id="EX-mtConfidence-html5-local-1"></a>Example 82: The <a href="#mtconfidence">MT Confidence</a> data category expressed locally for the content of two separate spans in a HTML document.</div><div class="exampleInner"><pre><!DOCTYPE html> <html lang=en > <head> <meta charset=utf-8> <title>Sentences about Dublin and Prague machine translated from Czech with mtConfidence locally.</title> </head> <body its-annotators-ref="mt-confidence|file:///tools.xml#T1"> <span its-mt-confidence=0.8982>Dublin is the capital of Ireland. <span its-mt-confidence=0.8536 >The capital of the Czech Republic is Prague. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-mtConfidence-html5-local-1.html">examples/html5/EX-mtConfidence-html5-local-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="allowedchars" id="allowedchars"></a>8.19 Allowed Characters</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="allowedchars-definition" id="allowedchars-definition"></a>8.19.1 Definition</h4>The <a href="#allowedchars">Allowed Characters</a> data category is used to specify the characters that are permitted in a given piece of content.This data category can be used for various purposes, including the following examples:<ul><li>Limiting the characters that may be used in the UI of a game due to font restrictions.</li><li>Preventing illegal characters from being entered as text content that represents file or directory names.</li><li>Controlling what characters can be used when translating examples of a login name in content.</li></ul><div class="note">Note:The <a href="#allowedchars">Allowed Characters</a> data category is not intended to disallow HTML markup. The purpose is to restrict the content to various characters only, e.g., when the content is to be used for URL or filename generation. In most Content Management Systems, content is divided into several fields, some of which may be restricted to plain text, while in other fields HTML fragments may be allowed. Enforcing such restrictions is outside the scope of this data category.</div>The set of characters that are allowed is specified using a regular expression. That is, each character in the selected content <a href="#rfc-keywords">MUST</a> be included in the set specified by the regular expression.The regular expression is the character class construct <code>charClass</code> defined as follows:<ul class="slist"><li><code>[1] charClass ::= singleCharEsc | charClassExpr | wildcardEsc</code></li><li><code>[2] singleCharEsc ::= '\' [nrt\|.?*+(){}#x2D#x5B#x5D#x5E]</code></li><li><code>[3] charClassExpr ::= '[' charGroup ']'</code></li><li><code>[4] charGroup ::= posCharGroup | negCharGroup</code></li><li><code>[5] posCharGroup ::= ( charRange | singleCharEsc )+</code></li><li><code>[6] charRange ::= seRange | xmlCharIncDash</code></li><li><code>[7] seRange ::= charOrEsc '-' charOrEsc</code></li><li><code>[8] charOrEsc ::= xmlChar | singleCharEsc</code></li><li><code>[9] xmlChar ::= [^\#x2D#x5B#x5D]</code></li><li><code>[10] xmlCharIncDash ::= [^\#x5B#x5D]</code></li><li><code>[11] negCharGroup ::= '^' posCharGroup</code></li><li><code>[12] wildcardEsc ::= '.'</code></li></ul>The <code>.</code> metacharacter also matches CARRIAGE RETURN (U+000D) and LINE FEED (U+000F). That is the dot-all option is set.This construct is a sub-set of the <a href="https://www.w3.org/TR/xmlschema-2/#charcter-classes">Character Classes</a> construct of XML Schema <a title="XML Schema Part 2:
 Datatypes Second Edition" href="#xmlschema2">[XML Schema Part 2]</a> and is compatible with most other regular expression engines.<div class="note">Note:Users may want to use a regular expression to make sure that they follow the definition given above. Sample regular expressions to verify the regular expression in allowed characters are provided: <a href="examples/allowed-characters-verify-xml-regex.txt">for XML</a> and <a href="examples/allowed-characters-verify-java-regex.txt">for Java</a>.</div>Example of expressions (shown as XML source):<ul><li><code>"[abc]"</code>: allows the characters 'a', 'b' and 'c'.</li><li><code>"[a-c]"</code>: allows the characters 'a', 'b' and 'c'.</li><li><code>"[a-zA-Z]"</code>: allows the characters from 'a' to 'z' and from 'A' to 'Z'.</li><li><code>"[^abc]"</code>: allows any characters except 'a', 'b', and 'c'.</li><li><code>"[^&#x0061;-c]"</code>: allows any characters except 'a', 'b', and 'c'.</li><li><code>"[^&lt;>:&quot;\\/|\?*]"</code>: allows only the characters valid for Windows file names.</li><li><code>"."</code>: allows any character.</li><li><code>""</code>: allows no character.</li></ul></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="allowedchars-implementation" id="allowedchars-implementation"></a>8.19.2 Implementation</h4>The <a href="#allowedchars">Allowed Characters</a> data category can be expressed with global rules, or locally on individual elements. For elements, the data category information <a href="#def-inheritance">inherits</a> to the textual content of the element, including child elements, but excluding attributes.GLOBAL: The <code class="its-elem-markup">allowedCharactersRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>Exactly one of the following:<ul><li>An <code class="its-attr-markup">allowedCharacters</code> attribute that contains the regular expression indicating the allowed characters.</li><li>An <code class="its-attr-markup">allowedCharactersPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node with the exact same semantics as <code class="its-attr-markup">allowedCharacters</code>.</li></ul></li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-allowedCharacters-global-1" id="EX-allowedCharacters-global-1"></a>Example 83: The <a href="#allowedchars">Allowed Characters</a> data category expressed globally in XML</div>The <code class="its-elem-markup">allowedCharactersRule</code> element states that the translated content of elements <code>content</code> cannot contain the characters <code>*</code> and <code>+</code>.<div class="exampleInner"><pre><?xml version="1.0"?> <myRes xmlns:its="http://www.w3.org/2005/11/its"> <head> <its:rules version="2.0"> <its:allowedCharactersRule allowedCharacters="[^*+]" selector="//content"/> </its:rules> </head> <body> <content>Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed diam voluptua.</content> </body> </myRes></pre></div>[Source file: <a href="examples/xml/EX-allowedCharacters-global-1.xml">examples/xml/EX-allowedCharacters-global-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-allowedCharacters-global-2" id="EX-allowedCharacters-global-2"></a>Example 84: Mapping the <a href="#allowedchars">Allowed Characters</a> data category in XML</div>The attribute <code class="its-attr-markup">allowedCharactersPointer</code> is used to map the data category to the non-ITS attribute <code>set</code> in this document. The attribute has the same semantics as <code class="its-attr-markup">allowedCharacters</code>.<div class="exampleInner"><pre><?xml version="1.0"?> <res xmlns:its="http://www.w3.org/2005/11/its"> <head> <its:rules version="2.0"> <its:allowedCharactersRule selector="//record" allowedCharactersPointer="@set"/> </its:rules> </head> <record id="a1" set="[ &#xFF01;–&#xFF5E;]">ＦＵＬＬＷＩＤＴＨＯＮＬＹ</record> </res></pre></div>[Source file: <a href="examples/xml/EX-allowedCharacters-global-2.xml">examples/xml/EX-allowedCharacters-global-2.xml</a>]</div>LOCAL: the following local markup is available for the <a href="#allowedchars">Allowed Characters</a> data category:<ul><li>A <code class="its-attr-markup">allowedCharacters</code> attribute that contains the regular expression indicating the allowed characters.</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-allowedCharacters-local-1" id="EX-allowedCharacters-local-1"></a>Example 85: The <a href="#allowedchars">Allowed Characters</a> data category expressed locally in XML</div>The local <code class="its-attr-markup">allowedCharacters</code> attribute specifies that the translated content of element <code>panelmsg</code> is only allowed to contain Unicode characters between U+0020 and U+00FE.<div class="exampleInner"><pre><?xml version="1.0"?> <messages xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <msg num="123">Click the <panelmsg its:allowedCharacters="[&#x0020;-&#x00FE;]" >CONTINUE</panelmsg> Button on the printer panel</msg> </messages></pre></div>[Source file: <a href="examples/xml/EX-allowedCharacters-local-1.xml">examples/xml/EX-allowedCharacters-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-allowedCharacters-html5-local-1" id="EX-allowedCharacters-html5-local-1"></a>Example 86: The <a href="#allowedchars">Allowed Characters</a> data category expressed locally in HTML</div>The local <code class="its-attr-markup">its-allowed-characters</code> attribute specifies that the translated content of element <code>code</code> cannot contain the characters other than 'a' to 'z' in any case and the characters underscore and minus.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Example</title> </head> <body> Login names can only use letters from A to Z (upper or lowercase) and the character underscore (_) and minus (-). For example: <code its-allowed-characters=[a-zA-Z_\-]>Huck_Finn</code>. </body> </html></pre></div>[Source file: <a href="examples/html5/EX-allowedCharacters-html5-local-1.html">examples/html5/EX-allowedCharacters-html5-local-1.html</a>]</div></div></div><div class="div2"> <h3><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="storagesize" id="storagesize"></a>8.20 Storage Size</h3><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="storagesize-definition" id="storagesize-definition"></a>8.20.1 Definition</h4>The <a href="#storagesize">Storage Size</a> data category is used to specify the maximum storage size of a given content.This data category can be used for various purposes, including the following examples:<ul><li>Verify during translation if a string fits into a fixed-size database field.</li><li>Control the size of a string that is stored in a fixed-size memory buffer at run-time.</li></ul>The storage size is always expressed in bytes and excludes any leading Byte-Order-Markers. It is provided along with the character encoding and the line break type that will be used when the content is stored. If the encoding form does not use the byte as its unit (e.g. UTF-16 uses 16-bit code units) the storage size <a href="#rfc-keywords">MUST</a> still be given in byte (e.g., for UTF-16: 2 bytes per 16-bit code unit). An application verifying the storage size for a given content is expected to perform the following steps:<ul><li>All the LINE FEED (U+000A) characters of the content to verify are replaced by the character or characters specified by the line break type.</li><li>The resulting string is converted to an array of bytes using a character encoder for the specified encoding. If a character cannot be represented with the specified encoding, an error is generated.</li><li>If the leading bytes represent a Byte-Order-Mark, they are stripped from that array.</li><li>The length of the resulting array is compared to the storage size provided. The content is too long if the length is greater than the storage size.</li></ul><div class="note">Note:Storage size is not directly related to the display length of a text, and therefore is not intended as a display length constraint mechanism.</div></div><div class="div3"> <h4><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="storagesize-implementation" id="storagesize-implementation"></a>8.20.2 Implementation</h4>The <a href="#storagesize">Storage Size</a> data category can be expressed with global rules, or locally on individual elements. There is no inheritance. The default value of the character encoding is "UTF-8", and the default value for the line break is "lf" (LINE FEED (U+000A)).GLOBAL: The <code class="its-elem-markup">storageSizeRule</code> element contains the following:<ul><li>A required <code class="its-attr-markup">selector</code> attribute. It contains an <a href="#selectors">absolute selector</a> that selects the nodes to which this rule applies.</li><li>Exactly one of the following:<ul><li>A <code class="its-attr-markup">storageSize</code> attribute. It contains the maximum number of bytes the text of the selected node is allowed in storage.</li><li>A <code class="its-attr-markup">storageSizePointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node with the exact same semantics as <code class="its-attr-markup">storageSize</code>.</li></ul></li><li>None or exactly one of the following:<ul><li>A <code class="its-attr-markup">storageEncoding</code> attribute. It contains the name of the character encoding used to calculate the number of bytes of the selected text. The name <a href="#rfc-keywords">MUST</a> be one of the names or aliases listed in the <a href="http://www.iana.org/assignments/character-sets">IANA Character Sets registry</a> <a title="Character Sets" href="#ianacharsets">[IANA Character Sets]</a>. The default value is the string "UTF-8".</li><li>A <code class="its-attr-markup">storageEncodingPointer</code> attribute that contains a <a href="#selectors">relative selector</a> pointing to a node with the exact same semantics as <code class="its-attr-markup">storageEncoding</code>.</li></ul></li><li>An optional <code class="its-attr-markup">lineBreakType</code> attribute. It indicates what type of line breaks the storage uses. The possible values are: "cr" for CARRIAGE RETURN (U+000D), "lf" for LINE FEED (U+000A), or "crlf" for CARRIAGE RETURN (U+000D) followed by LINE FEED (U+000A). The default value is "lf".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-storageSize-global-1" id="EX-storageSize-global-1"></a>Example 87: The <a href="#storagesize">Storage Size</a> data category expressed globally in XML</div>The <code class="its-elem-markup">storageSizeRule</code> element is used to specify that, when encoded in ISO-8859-1, the content of the <code>country</code> element cannot be more than 25 bytes. The name "Papouasie-Nouvelle-Guinée" is 25 character long and fits because all characters in ISO-8859-1 are encoded as a single byte.<div class="exampleInner"><pre><?xml version="1.0"?> <db> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:storageSizeRule selector="//country" storageSize="25" storageEncoding="ISO-8859-1"/> </its:rules> <data> <country id="123">Papouasie-Nouvelle-Guinée</country> <country id="139">République Dominicaine</country> </data> </db></pre></div>[Source file: <a href="examples/xml/EX-storageSize-global-1.xml">examples/xml/EX-storageSize-global-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-storageSize-global-2" id="EX-storageSize-global-2"></a>Example 88: Mapping the <a href="#storagesize">Storage Size</a> data category in XML</div>The <code class="its-elem-markup">storageSizePointer</code> attribute is used to map the non-ITS attribute <code>max</code> to the same functionality as <code class="its-attr-markup">storageSize</code>. There is no character encoding specified, so the default UTF-8 is assumed. Note that, while the name "Papouasie-Nouvelle-Guinée" is 25 characters long, the character 'é' is encoded into two bytes in UTF-8. Therefore this name is one byte too long to fit in its storage destination.<div class="exampleInner"><pre><?xml version="1.0"?> <fields> <its:rules xmlns:its="http://www.w3.org/2005/11/its" version="2.0"> <its:storageSizeRule selector="//field" storageSizePointer="@max"/> </its:rules> <field type="country" id="123" max="25">Papouasie-Nouvelle-Guinée</field> <field type="country" id="139" max="25">République Dominicaine</field> </fields></pre></div>[Source file: <a href="examples/xml/EX-storageSize-global-2.xml">examples/xml/EX-storageSize-global-2.xml</a>]</div>LOCAL: the following local markup is available for the <a href="#storagesize">Storage Size</a> data category:<ul><li>A <code class="its-attr-markup">storageSize</code> attribute. It contains the maximum number of bytes the text of the selected node is allowed in storage.</li><li>An optional <code class="its-attr-markup">storageEncoding</code> attribute. It contains the name of the character encoding used to calculate the number of bytes of the selected text. The name <a href="#rfc-keywords">MUST</a> be one of the names or aliases listed in the <a href="http://www.iana.org/assignments/character-sets">IANA Character Sets registry</a> <a title="Character Sets" href="#ianacharsets">[IANA Character Sets]</a>. The default value is the string "UTF-8".</li><li>An optional <code class="its-attr-markup">lineBreakType</code> attribute. It indicates what type of line breaks the storage uses. The possible values are: "cr" for CARRIAGE RETURN (U+000D), "lf" for LINE FEED (U+000A), or "crlf" for CARRIAGE RETURN (U+000D) followed by LINE FEED (U+000A). The default value is "lf".</li></ul><div class="exampleOuter"><div class="exampleHeader"><a name="EX-storageSize-local-1" id="EX-storageSize-local-1"></a>Example 89: The <a href="#storagesize">Storage Size</a> data category expressed locally in XML</div>The <code class="its-attr-markup">storageSize</code> attribute allows specification of different maximum storage sizes throughout the document. Note that the string <code>CONTINUE</code> does not fit the specified restriction of 8 bytes. The minimal number of bytes to store such a string in UTF-16 is 16.<div class="exampleInner"><pre><?xml version="1.0"?> <messages xmlns:its="http://www.w3.org/2005/11/its" its:version="2.0"> <var num="panelA1_Continue" its:storageSize="8" its:storageEncoding="UTF-16">CONTINUE</var> <var num="panelA1_Stop" its:storageSize="8" its:storageEncoding="UTF-16">STOP</var> <var num="panelB5_Cancel" its:storageSize="12" its:storageEncoding="UTF-16">CANCEL</var> </messages></pre></div>[Source file: <a href="examples/xml/EX-storageSize-local-1.xml">examples/xml/EX-storageSize-local-1.xml</a>]</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-storageSize-html5-local-1" id="EX-storageSize-html5-local-1"></a>Example 90: The <a href="#storagesize">Storage Size</a> data category expressed locally in HTML</div>The <code class="its-attr-markup">its-storage-size</code> is used here to specify the maximum number of bytes the two editable strings can have in UTF-8.<div class="exampleInner"><pre><!DOCTYPE html> <html lang=en> <head> <meta charset=utf-8> <title>Example</title> </head> <body> String to translate: <p contenteditable=true id=123 its-storage-size=25>Papua New-Guinea <p contenteditable=true id=139 its-storage-size=25>Dominican Republic </body> </html></pre></div>[Source file: <a href="examples/html5/EX-storageSize-html5-local-1.html">examples/html5/EX-storageSize-html5-local-1.html</a>]</div></div></div></div></div><div class="back"><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="normative-references" id="normative-references"></a>A References</h2> This section is normative. <dl><dt class="label"><a name="bcp47" id="bcp47"/>BCP47</dt><dd>Addison Phillips, Mark Davis. <a href="http://www.rfc-editor.org/rfc/bcp/bcp47.txt"><cite>Tags for Identifying Languages</cite></a>, September 2009. Available at <a href="http://www.rfc-editor.org/rfc/bcp/bcp47.txt"> http://www.rfc-editor.org/rfc/bcp/bcp47.txt</a>.</dd><dt class="label"><a name="html4" id="html4"/>HTML 4.01</dt><dd>Dave Raggett et al. <a href="https://www.w3.org/TR/1999/REC-html401-19991224/"><cite>HTML 4.01</cite></a>. W3C Recommendation 24 December 1999. Available at <a href="https://www.w3.org/TR/1999/REC-html401-19991224/"> http://www.w3.org/TR/1999/REC-html401-19991224/</a>. The latest version of <a href="https://www.w3.org/TR/html401/">HTML 4.01</a> is available at http://www.w3.org/TR/html401.</dd><dt class="label"><a name="html5" id="html5"/>HTML5</dt><dd>Robin Berjon et al. <a href="https://www.w3.org/TR/2013/CR-html5-20130806/"><cite>HTML5</cite></a>. W3C Candidate Recommendation 06 August 2013. Available at <a href="https://www.w3.org/TR/2013/CR-html5-20130806/">http://www.w3.org/TR/2013/CR-html5-20130806/</a>. The latest version of <a href="https://www.w3.org/TR/html5/">HTML5</a> is available at http://www.w3.org/TR/html5/.</dd><dt class="label"><a name="ianacharsets" id="ianacharsets"/>IANA Character Sets</dt><dd> <a href="http://www.iana.org/assignments/character-sets"><cite>Character Sets</cite></a> Available at <a href="http://www.iana.org/assignments/character-sets">http://www.iana.org/assignments/character-sets</a>.</dd><dt class="label"><a name="qa-framework" id="qa-framework"/>QAFRAMEWORK</dt><dd>Karl Dubost, Lynne Rosental, Dominique Hazaël-Massieux, Lofton Henderson. <a href="https://www.w3.org/TR/2005/REC-qaframe-spec-20050817/"><cite>QA Framework: Specification Guidelines</cite></a>. W3C Recommendation 17 August 2005. Available at <a href="https://www.w3.org/TR/2005/REC-qaframe-spec-20050817/"> http://www.w3.org/TR/2005/REC-qaframe-spec-20050817/</a>. The latest version of <a href="https://www.w3.org/TR/qaframe-spec/">QAFRAMEWORK</a> is available at http://www.w3.org/TR/qaframe-spec/.</dd><dt class="label"><a name="relaxng" id="relaxng"/>RELAX NG</dt><dd>Information technology – Document Schema Definition Language (DSDL) – Part 2: <cite>Regular-grammar-based validation – RELAX NG</cite>. International Organization for Standardization (ISO) ISO/IEC 19757-2:2003.</dd><dt class="label"><a name="rfc2119" id="rfc2119"/>RFC 2119</dt><dd>S. Bradner. <a href="http://www.ietf.org/rfc/rfc2119.txt"><cite>Key Words for use in RFCs to Indicate Requirement Levels</cite></a>. IETF RFC 2119, March 1997. Available at <a href="http://www.ietf.org/rfc/rfc2119.txt"> http://www.ietf.org/rfc/rfc2119.txt</a>. </dd><dt class="label"><a name="rfc3987" id="rfc3987"/>RFC 3987</dt><dd>Martin Dürst, Michel Suignard. <a href="http://www.ietf.org/rfc/rfc3987.txt"><cite>Internationalized Resource Identifiers (IRIs)</cite></a>. RFC 3987, January 2005. See <a href="http://www.ietf.org/rfc/rfc3987.txt">http://www.ietf.org/rfc/rfc3987.txt</a>.</dd><dt class="label"><a name="css3-selectors" id="css3-selectors"/>Selectors Level 3</dt><dd>Tantek Çelik, Elika J. Etemad, Daniel Glazman, Ian Hickson, Peter Linss, John Williams <a href="https://www.w3.org/TR/2011/REC-css3-selectors-20110929/"><cite>Selectors Level 3</cite></a>. W3C Recommendation 29 September 2011. Available at <a href="https://www.w3.org/TR/2011/REC-css3-selectors-20110929/">http://www.w3.org/TR/2011/REC-css3-selectors-20110929/</a>. The latest version of <a href="https://www.w3.org/TR/css3-selectors/">Selectors Level 3</a> is available at http://www.w3.org/TR/css3-selectors/.</dd><dt class="label"><a name="unicode" id="unicode"/>Unicode</dt><dd>The Unicode Consortium. <a href="http://www.unicode.org/standard/versions/"><cite>The Unicode Standard, Version 6.2.0</cite></a>, , ISBN 978-1-936213-07-8, as updated from time to time by the publication of new versions. (See <a href="http://www.unicode.org/standard/versions/">http://www.unicode.org/unicode/standard/versions</a> for the latest version and additional information on versions of the standard and of the Unicode Character Database).</dd><dt class="label"><a name="xlink1" id="xlink1"/>XLink 1.1</dt><dd>Steve DeRose, Eve Maler, David Orchard, Norman Walsh. <a href="https://www.w3.org/TR/2010/REC-xlink11-20100506/"><cite>XML Linking Language 1.1</cite></a>. W3C Recommendation 6 May 2010. Available at <a href="https://www.w3.org/TR/2010/REC-xlink11-20100506/">http://www.w3.org/TR/2010/REC-xlink11-20100506/</a>. The latest version of <a href="https://www.w3.org/TR/xlink11/">XLink 1.1</a> is available at http://www.w3.org/TR/xlink11/.</dd><dt class="label"><a name="xml10spec" id="xml10spec"/>XML 1.0</dt><dd>Tim Bray, Jean Paoli, C.M. Sperberg-McQueen, et al., editors. <a href="https://www.w3.org/TR/2006/REC-xml-20060816/"><cite>Extensible Markup Language (XML) 1.0 (Fifth Edition)</cite></a>, W3C Recommendation 26 November 2008. Available at <a href="https://www.w3.org/TR/2008/REC-xml-20081126/"> http://www.w3.org/TR/2008/REC-xml-20081126//</a>. The latest version of <a href="https://www.w3.org/TR/xml/">XML 1.0</a> is available at http://www.w3.org/TR/xml/.</dd><dt class="label"><a name="xml-id" id="xml-id"/>XML ID</dt><dd>Jonathan Marsh, Daniel Veillard, Norman Walsh. <a href="https://www.w3.org/TR/2005/REC-xml-id-20050909/"><cite>xml:id Version 1.0</cite></a>. W3C Recommendation 9 September 2005. Available at <a href="https://www.w3.org/TR/2005/REC-xml-id-20050909/">http://www.w3.org/TR/2005/REC-xml-id-20050909/</a>. The latest version of <a href="https://www.w3.org/TR/xml-id/">xml:id Version 1.0</a> is available at http://www.w3.org/TR/xml-id/.</dd><dt class="label"><a name="xmlinfoset" id="xmlinfoset"/>XML Infoset</dt><dd>John Cowan, Richard Tobin. <a href="https://www.w3.org/TR/2004/REC-xml-infoset-20040204/"><cite>XML Information Set (Second Edition)</cite></a>. W3C Recommendation 4 February 2004. Available at <a href="https://www.w3.org/TR/2004/REC-xml-infoset-20040204/"> http://www.w3.org/TR/2004/REC-xml-infoset-20040204/</a>. The latest version of <a href="https://www.w3.org/TR/xml-infoset/">XML Infoset</a> is available at http://www.w3.org/TR/xml-infoset/.</dd><dt class="label"><a name="xmlns" id="xmlns"/>XML Names</dt><dd>Tim Bray, Dave Hollander, Andrew Layman, Richard Tobin. <a href="https://www.w3.org/TR/2006/REC-xml-names-20060816/"><cite>Namespaces in XML (Second Edition)</cite></a>. W3C Recommendation 16 August 2006. Available at <a href="https://www.w3.org/TR/2006/REC-xml-names-20060816/"> http://www.w3.org/TR/2006/REC-xml-names-20060816/</a>. The latest version of <a href="https://www.w3.org/TR/REC-xml-names/">XML Names</a> is available at http://www.w3.org/TR/REC-xml-names/.</dd><dt class="label"><a name="xmlschema1" id="xmlschema1"/>XML Schema</dt><dd>Henry S. Thompson, David Beech, Murray Maloney, Noah Mendelsohn. <a href="https://www.w3.org/TR/2004/REC-xmlschema-1-20041028/"><cite>XML Schema Part 1: Structures Second Edition</cite></a>. W3C Recommendation 28 October 2004. Available at <a href="https://www.w3.org/TR/2004/REC-xmlschema-1-20041028/"> http://www.w3.org/TR/2004/REC-xmlschema-1-20041028/</a>. The latest version of <a href="https://www.w3.org/TR/xmlschema-1/">XML Schema</a> is available at http://www.w3.org/TR/xmlschema-1/.</dd><dt class="label"><a name="xmlschema2" id="xmlschema2"/>XML Schema Part 2</dt><dd>Paul V. Biron, Ashok Malhotra. <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/"><cite>XML Schema Part 2: Datatypes Second Edition</cite></a>. W3C Recommendation 28 October 2004. Available at <a href="https://www.w3.org/TR/2004/REC-xmlschema-2-20041028/"> http://www.w3.org/TR/2004/REC-xmlschema-2-20041028/</a>. The latest version of <a href="https://www.w3.org/TR/xmlschema-2/">XML Schema</a> is available at http://www.w3.org/TR/xmlschema-2/.</dd><dt class="label"><a name="xpath" id="xpath"/>XPath 1.0</dt><dd>James Clark. <a href="https://www.w3.org/TR/1999/REC-xpath-19991116/"><cite>XML Path Language (XPath) Version 1.0</cite></a>. W3C Recommendation 16 November 1999. Available at <a href="https://www.w3.org/TR/1999/REC-xpath-19991116/"> http://www.w3.org/TR/1999/REC-xpath-19991116/</a>. The latest version of <a href="https://www.w3.org/TR/xpath/">XPath 1.0</a> is available at http://www.w3.org/TR/xpath/ .</dd></dl></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="its-mime-type" id="its-mime-type"></a>B Internationalization Tag Set (ITS) MIME Type</h2> This section is normative. This section defines a MIME type for Internationalization Tag Set (ITS) documents. It covers both ITS 1.0 and ITS 2.0. Type name: application Subtype name: its+xml Required parameters: none Optional parameters: charsetThis parameter has identical semantics to the charset parameter of the "application/xml" media type as specified in IETF RFC 3023. Encoding considerations: Identical to those of "application/xml" as described in IETF RFC 3023, section 3.2, as applied to an ITS document. Security considerations: An ITS 1.0 or ITS 2.0 document may cause arbitrary URIs or IRIs to be dereferenced, via the @xlink:href attribute at the its:rules element. Therefore, the security issues of <a title="Internationalized Resource
 Identifiers (IRIs)" href="#rfc3987">[RFC 3987]</a> Section 8 should be considered. In addition, the contents of resources identified by file: URIs can in some cases be accessed, processed and returned as results. An implementation of ITS global rules requires the support of XPath 1.0 or its successor. Hence, processing of global rules might encompass dereferencing of URIs or IRIs during computation of XPath expressions. Arbitrary recursion is possible, as is arbitrarily large memory usage, and implementations may place limits on CPU and memory usage, as well as restricting access to system-defined functions. ITS 1.0 and ITS 2.0 permit extensions. Hence it is possible that application/its+xml may describe content that has security implications beyond those described here. Interoperability considerations: There are no known interoperability issues. Published specification: <a href="https://www.w3.org/TR/2007/REC-its-20070403/">http://www.w3.org/TR/2007/REC-its-20070403/</a> and <a href="https://www.w3.org/TR/its20/">http://www.w3.org/TR/its20/</a>.Any XML document containing ITS 1.0 "its:rules" elements http://www.w3.org/TR/its/#selection-global can be labeled with <code>application/its+xml</code>. <a href="https://www.w3.org/TR/its/EX-link-external-rules-2.xml">http://www.w3.org/TR/its/EX-link-external-rules-2.xml</a> Provides an example of a document linking to a file with ITS 1.0 and ITS 2.0 "rules". The link target is at <a href="https://www.w3.org/TR/its/EX-link-external-rules-1.xml">http://www.w3.org/TR/its/EX-link-external-rules-1.xml</a>. There is no need that the link target has "its:rules" as a root element. The processing semantics is that rules are gathered in document order. Applications that use this media type: This new media type is being registered to allow for deployment of ITS 1.0 and ITS 2.0 on the World Wide Web., e.g., by localization tools. Additional information: <ul><li>Magic number(s): none</li><li>File extension(s): .its</li><li>Macintosh file type code(s): TEXT</li></ul> Person & email address to contact for further information: World Wide Web Consortium <web-human at w3.org> Intended usage: COMMON Restrictions on usage: none Author / Change controller: The Internationalization Tag Set (ITS) 1.0 and 2.0 specifications are a work product of the World Wide Web Consortium's Internationalization Tag Set Working Group. The W3C has change control over this specification.</div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="lqissue-typevalues" id="lqissue-typevalues"></a>C Values for the Localization Quality Issue Type</h2> This section is normative. The <code class="its-attr-markup">locQualityIssueType</code> attribute provides a basic level of interoperability between different localization quality assurance tools. It offers a list of high-level quality issue types common in fully automatic and manual localization quality assessment. Tools can map their internal types to these types in order to exchange information about the kinds of issues they identify and take appropriate action even if another tool does not know the specific issues identified by the generating tool.<div class="note">Note:Note: The values of locQualityIssueType were derived from an early version of the QTLaunchPad project's Multidimensional Quality Metrics (MQM) framework. MQM is based on a careful analysis of existing translation quality assessment tools and models, such as the LISA QA Model, SAE J2450, and various commercial tools. The values represent common issue types found in those models and are designed to provide interoperability between models. Differences in granularity and in issue types may prevent full interoperability, but using the shared values will maximize interoperability where possible.</div>The scope column in the following table identifies whether the issue type applies to the source content (“S”), target content (“T”) or both (“S or T”).The values listed in the following table are allowed for <code class="its-attr-markup">locQualityIssueType</code>. Ideally the values a tool implementing the data category produces for the attribute matches one of the values provided in this table and are as semantically accurate as possible. For example, marking the phrase “These man is” as a <code>terminology</code> issue, rather than as a <code>grammar</code> issue would be semantically inaccurate. Tools are encouraged to map their internal values to these types. The value <code>other</code> is reserved strictly for values that cannot be mapped.<div class="note">Note:For tools generating ITS 2.0 Localization Quality Issue markup, if one internal issue type can be categorized as multiple ITS 2.0 issue types, the first applicable one from the following table should be used. The list is ordered with more specific types first. For example, if a terminology database specifies that the term “USB memory stick” should be used instead of “USB pen drive” but the translated content has “Insert a USB pen drive into any available USB port”, <code>terminology</code> would be used instead of <code>mistranslation</code> because <code>terminology</code> occurs earlier in the list and is more specific than a (general) <code>mistranslation</code>. In the case where multiple separate issues must be marked on a single span (e.g., it contains both a <code>mistranslation</code> and a <code>grammar</code> issue), implementers may wish to use standoff annotation, as shown in <a href="#EX-locQualityIssue-local-2">Example 75</a> and <a href="#EX-locQualityIssue-html5-local-2">Example 76</a>.</div><div class="note">Note:The <a href="https://www.w3.org/International/its/ig/">ITS Interest Group</a> maintains informative <a href="https://www.w3.org/International/its/wiki/Localization_quality_types_mappings">mappings of tool-specific quality issue types and ITS 2.0 localization quality types</a>. The ITS IG Wiki provides information on how to update that list. The purpose of these mappings is to document how tool internal information relates to the ITS 2.0 quality types. To foster interoperability, implementers are strongly encouraged to implement the ITS 2.0 quality types natively.</div><a name="lqissue-typevalues-table" id="lqissue-typevalues-table"></a><table border="1" width="100%"><thead><tr><td>Value</td><td>Description</td><td>Example</td><td>Scope</td><td>Notes</td></tr></thead><tbody><tr><td> <code>terminology</code> </td><td>An incorrect term or a term from the wrong domain was used or terms are used inconsistently.</td><td> <ul><li>The localization had “Pen Drive” when corporate terminology specified that “USB Stick” was to be used.</li><li>The localized text inconsistently used "Start" and "Begin".</li><li>A text renders the Hungarian term recsegőhid as “buzzer bridge” in English (a literal translation), but the term to be used in English is “wedge block,” as specified in a terminology list supplied to the translator.</li></ul> </td><td>S or T</td><td>This value is not intended for simple typographical errors or word choice not related to defined terminologies. For example, a mistyping of “pin” as “pen” or the use of “imply” instead of “infer” (mistaking two commonly confused words) would not count as terminology issues and is best categorized as either spelling errors or mistranslations, depending on the nature of the issue. Terminology refers only to cases where incorrect choices about terms (either formal or commonly defined in a domain) are involved.</td></tr><tr><td> <code>mistranslation</code> </td><td>The content of the target mistranslates the content of the source.</td><td> <ul><li>The English source reads "An ape succeeded in grasping a banana lying outside its cage with the help of a stick" but the Italian translation reads "l'ape riuscì a prendere la banana posta tuori dall sua gabbia aiutandosi con un bastone" ("A bee succeeded...")</li></ul> </td><td>T</td><td>Issues related to translation of specific terms related to the domain or task-specific language are to be categorized as <code>terminology</code> issues.</td></tr><tr><td> <code>omission</code> </td><td>Necessary text has been omitted from the localization or source.</td><td> <ul><li>One or more segments found in the source that have been intended for translation are missing in the target.</li><li>After an alignment, a verification tool flags the pairs of aligned segments where the target has no corresponding source because of incorrect segmentation or some alignment issue. In such case the 'omission' type may apply to the source entry.</li></ul> </td><td>S or T</td><td>This value is not to be used for missing whitespace or formatting codes, but instead has to be reserved for linguistic content.</td></tr><tr><td> <code>untranslated</code> </td><td>Content that has been intended for translation is left untranslated.</td><td> <ul><li>The source segment reads "The Professor said to Smith that he would hear from his lawyer" but the Hungarian localization reads "A professzor azt mondta Smithnek, hogy he would hear from his lawyer."</li></ul> </td><td>T</td><td> <code>omission</code> takes precedence over <code>untranslated</code>. Omissions are distinct in that they address cases where text is not present, while <code>untranslated</code> addresses cases where text has been carried from the source untranslated.</td></tr><tr><td> <code>addition</code> </td><td>The translated text contains inappropriate additions.</td><td> <ul><li>The translated text contains a note from the translator to himself to look up a term; the note ought to have been deleted but was not.</li></ul> </td><td>T</td><td/></tr><tr><td> <code>duplication</code> </td><td>Content has been duplicated improperly.</td><td> <ul><li>A section of the target text was inadvertently copied twice in a copy and paste operation.</li></ul> </td><td>T</td><td/></tr><tr><td> <code>inconsistency</code> </td><td>The text is inconsistent with itself or is translated inconsistently (NB: not for use with terminology inconsistency).</td><td> <ul><li>The text states that an event happened in 1912 in one location but in another states that it happened in 1812.</li><li>The translated text uses different wording for multiple instances of a single regulatory notice that occurs in multiple locations in a series of manuals.</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>grammar</code> </td><td>The text contains a grammatical error (including errors of syntax and morphology).</td><td> <ul><li>The text reads "The guidelines says that users should use a static grounding strap."</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>legal</code> </td><td>The text is legally problematic (e.g., it is specific to the wrong legal system).</td><td> <ul><li>The localized text is intended for use in Thailand but includes U.S. regulatory notices.</li><li>A text translated into German contains comparative advertising claims that are not allowed by German law.</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>register</code> </td><td>The text is written in the wrong linguistic register of uses slang or other language variants inappropriate to the text.</td><td> <ul><li>A financial text in U.S. English refers to dollars as "bucks".</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>locale-specific-content</code> </td><td>The localization contains content that does not apply to the locale for which it was prepared.</td><td> <ul><li>A text translated for the Japanese market contains call center numbers in Texas and refers to special offers available only in the U.S.</li></ul> </td><td>S or T</td><td>Legally inappropriate material is to be classified as <code>legal</code>.</td></tr><tr><td> <code>locale-violation</code> </td><td>Text violates norms for the intended locale.</td><td> <ul><li>A text localized into German has dates in <code>mm/dd/yyyy</code> format instead of <code>DD.MM.YYYY</code>.</li><li>A text for the Irish market uses American-style foot and inch measurements instead of centimeters.</li><li>A text intended for a U.S.-based audience uses U.K. spellings such as “centre” and “colour.”</li></ul> </td><td>S or T</td><td>This value can be used for spelling errors only if they relate specifically to locale expectations (e.g., a text consistently uses British instead of U.S. spellings for a text intended for the U.S.). If these errors are not systematic (e.g., a text uses U.S. spellings but has a single instance of “centre”), they are instead to be counted as spelling errors.</td></tr><tr><td> <code>style</code> </td><td>The text contains stylistic errors.</td><td> <ul><li>Company style guidelines dictate that all individuals be referred to as Mr. or Ms. with a family name, but the text refers to “Jack Smith”.</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>characters</code> </td><td>The text contains characters that are garbled or incorrect or that are not used in the language in which the content appears.</td><td> <ul><li>A text ought to have a '•' but instead has a '¥' sign.</li><li>A German text erroneously uses û, ô, and â instead of the appropriate 'ü', 'ö', and 'ä'.</li><li>A Japanese text has been garbled and appears with Devanagari characters.</li></ul> </td><td>S or T</td><td>Characters ought to be used in cases of garbling or systematic use of inappropriate characters, not for spelling issues where individual characters are replaced with incorrect one.</td></tr><tr><td> <code>misspelling</code> </td><td>The text contains a misspelling.</td><td> <ul><li>A German text misspells the word "Zustellung" as "Zustlelung".</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>typographical</code> </td><td>The text has typographical errors such as omitted/incorrect punctuation, incorrect capitalization, etc.</td><td> <ul><li>An English text has the following sentence: "The man whom, we saw, was in the Military and carried it's insignias".</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>formatting</code> </td><td>The text is formatted incorrectly.</td><td> <ul><li>Warnings in the text are supposed to be set in italic face, but instead appear in bold face.</li><li>Margins of the text are narrower than specified.</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>inconsistent-entities</code> </td><td>The source and target text contain different named entities (dates, times, place names, individual names, etc.)</td><td> <ul><li>The name "Thaddeus Cahill" appears in an English source but is rendered as "Tamaš Cahill" in the Czech version.</li><li>The date "February 9, 2007" appears in the source but the translated text has "2. September 2007".</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>numbers</code> </td><td>Numbers are inconsistent between source and target.</td><td> <ul><li>A source text states that an object is 120 cm long, but the target text says that it is 129 cm. long.</li></ul> </td><td>S or T</td><td>Some tools may correct for differences in units of measurement to reduce false positives (e.g., a tool might adjust for differences in values between inches and centimeters to avoid flagging numbers that seem to be different but are in fact equivalent).</td></tr><tr><td> <code>markup</code> </td><td>There is an issue related to markup or a mismatch in markup between source and target.</td><td> <ul><li>The source segment has five markup tags but the target has only two.</li><li>An opening tag in the text is missing a closing tag.</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>pattern-problem</code> </td><td>The text fails to match a pattern that defines allowable content (or matches one that defines non-allowable content).</td><td> <ul><li>The tool disallows the regular expression pattern ['"”’][\.,] but the translated text contains "A leading “expert”, a political hack, claimed otherwise."</li><li>A tool uses a regular expression to ensure that the content of an element is an IRI and flags what appears to be a malformed IRI.</li></ul> </td><td>S or T</td><td>Defining what is or is not an allowable pattern is up to the processing application and is beyond the scope of this specification. Best practice would be to use the Comment attribute to specify the pattern that led to the issue.</td></tr><tr><td> <code>whitespace</code> </td><td>There is a mismatch in whitespace between source and target content or the text violates specific rules related to the use of whitespace.</td><td> <ul><li>A source segment starts with six space characters but the corresponding target segment has two non-breaking spaces at the start.</li><li>The text uses a run of 12 space characters instead of a tab character to align numbers in a table.</li><li>Two space characters appear after a period even though only a single space is to be used.</li></ul> </td><td>S or T</td><td/></tr><tr><td> <code>internationalization</code> </td><td>There is an issue related to the internationalization of content.</td><td> <ul><li>A line of programming code has embedded language-specific strings.</li><li>A user interface element leaves no room for text expansion.</li><li>A form allows only for U.S.-style postal addresses and expects five digit U.S. ZIP codes.</li></ul> </td><td>S or T</td><td>There are many kinds of internationalization issues. This value is therefore very heterogeneous in what it can refer to.</td></tr><tr><td> <code>length</code> </td><td>There is a significant difference in source and target length.</td><td> <ul><li>The translation of a segment is five times as long as the source.</li></ul> </td><td>S or T</td><td>What constitutes a "significant" difference in length is determined by the model referred to in the <code class="its-attr-markup">locQualityIssueProfileRef</code>.</td></tr><tr><td> <code>non-conformance</code> </td><td>The content is deemed to show poor statistical conformance to a reference corpus. Higher severity values reflect poorer conformance.</td><td>The sentence "The harbour connected which to printer is busy or configared not properly." would have poor conformance.</td><td>S or T</td><td>Non-conformance is determined through the use of multiple statistical measures of similarity to a corpus of known-good content. For example, in a system that uses classification techniques the poor conformance might be a function of combined incorrect terminology, wrong spelling and bad grammar, or other features as determined by the system.</td></tr><tr><td> <code>uncategorized</code> </td><td>The issue either has not been categorized or cannot be categorized.</td><td> <ul><li>A new version of a tool returns information on an issue that has not been previously checked and that is not yet classified.</li><li>A text is defective in ways that defy categorization, such as the appearance of nonsense garbled text of unknown origin (e.g., a translation shows an unintelligible result and/or appears unrelated to the source material).</li></ul> </td><td>S or T</td><td>This value has the following uses: <ol class="depth1"><li>A tool can use it to pass through quality data from another tool in cases where the issues from the other tool are not classified (for example, a localization quality assurance tool interfaces with a third-party grammar checker).</li><li>A tool’s issues are not yet assigned to values, and, until an updated assignment is made, they may be listed as <code>uncategorized</code>. In this case it is recommended that issues be assigned to appropriate values as soon as possible since <code>uncategorized</code> does not foster interoperability.</li><li><code>uncategorized</code> can be used where a portion of text is defective in a way that defies assignment to a value in either the originating system or in any other ITS localization quality markup to indicate that it is uncategorizable.</li></ol> </td></tr><tr><td> <code>other</code> </td><td>Any issue that cannot be assigned to any values listed above.</td><td/><td>S or T</td><td> <ul><li>This value allows for the inclusion of any issues not included in the previously listed values. It is encouraged not to use this value for any tool- or model-specific issues that can be mapped to the values listed above.</li><li>In addition, this value is not synonymous with <code>uncategorized</code> in that <code>uncategorized</code> issues may be assigned to another precise value, while other issues cannot.</li><li>If a system has an "miscellaneous" or "other" value, it is better to map this to this value even if the specific instance of the issue might be mapped to another value.</li></ul> </td></tr></tbody></table><div class="note">Note:The value <code>uncategorized</code> is used for issues that have not (yet) been categorized into a more specific value. For example, an automatic process might flag issues for attention but not provide any further detail or categorization: such issues would be listed as <code>uncategorized</code> in ITS 2.0. It may also be used when the exact nature of an issue is unclear and it cannot be categorized as a result (e.g., text is seriously garbled and the cause it unclear). By contrast other is used when the nature of an issue is clear but it cannot be categorized in one of the ITS 2.0 categories (or when a model or tool has its own “other” category). For example, in translation of subtitles there is a “respeaking” error category that does not correspond to any ITS 2.0 category and is highly specific to that environment; respeaking errors would therefore be categorized as <code>other</code> in ITS 2.0.</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="its-schemas" id="its-schemas"></a>D Schemas for ITS</h2> This section is informative. <div class="note">Note:The schemas are only informative and may be updated any time. An updated version of the schemas can be found in the <a href="https://github.com/w3c/its-2.0-testsuite/tree/master/its2.0/schema">ITS 2.0 test suite</a>.</div>The following schemas define ITS elements and attributes and can be used as building blocks when you want to integrate ITS markup into your own XML vocabulary. You can see examples of such integration in <a href="https://www.w3.org/TR/xml-i18n-bp/">Best Practices for XML Internationalization</a>.Foreign elements can be used only inside <code class="its-elem-markup">rules</code>. Foreign attributes can be used on any element defined in ITS.The following four schemas are provided: 1. NVDL document: The following <a title="Namespace-based Validation Dispatching Language
 (NVDL)" href="#nvdl">[NVDL]</a> document allows validation of ITS markup that has been added to a host vocabulary. Only ITS elements and attributes are checked. Elements and attributes of the host language are ignored during validation against this NVDL document/schema.<div class="exampleOuter"><div class="exampleHeader"><a name="its20.nvdl" id="its20.nvdl"></a>Example 91: NVDL schema for ITS</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <rules xmlns="http://purl.oclc.org/dsdl/nvdl/ns/structure/1.0"> <namespace ns="http://www.w3.org/2005/11/its"> <validate schema="its20-elements.rng"/> </namespace> <namespace ns="http://www.w3.org/2005/11/its" match="attributes"> <validate schema="its20-attributes.rng"/> </namespace> <anyNamespace> <allow/> </anyNamespace> </rules></pre></div>[Source file: <a href="schemas/its20.nvdl">schemas/its20.nvdl</a>]</div> 2. RELAX NG schema for elements and attributes: The NVDL schema depends on the following two schemas: RELAX NG schema for ITS elements, and RELAX NG schema for all ITS local attributes.<div class="exampleOuter"><div class="exampleHeader"><a name="its20-elements.rng" id="its20-elements.rng"></a>Example 92: RELAX NG schema for ITS elements</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <grammar xmlns="http://relaxng.org/ns/structure/1.0"> <include href="its20.rng"/> <start> <choice> <ref name="its-rules"/> <ref name="its-span"/> <ref name="its-standoff"/> </choice> </start> </grammar> </pre></div>[Source file: <a href="schemas/its20-elements.rng">schemas/its20-elements.rng</a>](<a href="schemas/its20-elements.rnc">RELAX NG compact syntax version of schema</a>)</div><div class="exampleOuter"><div class="exampleHeader"><a name="its20-attributes.rng" id="its20-attributes.rng"></a>Example 93: RELAX NG schema for all ITS local attributes</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <grammar xmlns="http://relaxng.org/ns/structure/1.0"> <include href="its20.rng"/> <start> <group> <optional> <ref name="its-local.attributes"/> </optional> <optional> <ref name="its-attribute.version"/> </optional> </group> </start> </grammar> </pre></div>[Source file: <a href="schemas/its20-attributes.rng">schemas/its20-attributes.rng</a>](<a href="schemas/its20-attributes.rnc">RELAX NG compact syntax version of schema</a>)</div> 3. Base RELAX NG schema for ITS: All ITS elements and attributes referenced by previous two schemas are defined in the base RELAX NG schema for ITS. <div class="exampleOuter"><div class="exampleHeader"><a name="its20.rng" id="its20.rng"></a>Example 94: Base RELAX NG schema for ITS</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <grammar ns="http://www.w3.org/2005/11/its" xmlns:a="http://relaxng.org/ns/compatibility/annotations/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:its="http://www.w3.org/2005/11/its" xmlns="http://relaxng.org/ns/structure/1.0" datatypeLibrary="http://www.w3.org/2001/XMLSchema-datatypes"> <include href="its20-types.rng"/> <define name="its-attribute.translate"> <attribute name="its:translate"> <ref name="its-translate.type"/> </attribute> </define> <define name="its-attribute.translate.nons"> <attribute name="translate"> <ref name="its-translate.type"/> </attribute> </define> <define name="its-attribute.dir"> <attribute name="its:dir"> <ref name="its-dir.type"/> </attribute> </define> <define name="its-attribute.dir.nons"> <attribute name="dir"> <ref name="its-dir.type"/> </attribute> </define> <define name="its-attribute.locNote"> <attribute name="its:locNote"> <ref name="its-locNote.type"/> </attribute> </define> <define name="its-attribute.locNote.nons"> <attribute name="locNote"> <ref name="its-locNote.type"/> </attribute> </define> <define name="its-attribute.locNoteType"> <attribute name="its:locNoteType"> <ref name="its-locNoteType.type"/> </attribute> </define> <define name="its-attribute.locNoteType.nons"> <attribute name="locNoteType"> <ref name="its-locNoteType.type"/> </attribute> </define> <define name="its-attribute.locNoteRef"> <attribute name="its:locNoteRef"> <ref name="its-locNoteRef.type"/> </attribute> </define> <define name="its-attribute.locNoteRef.nons"> <attribute name="locNoteRef"> <ref name="its-locNoteRef.type"/> </attribute> </define> <define name="its-attribute.termInfoRef"> <attribute name="its:termInfoRef"> <ref name="its-termInfoRef.type"/> </attribute> </define> <define name="its-attribute.termInfoRef.nons"> <attribute name="termInfoRef"> <ref name="its-termInfoRef.type"/> </attribute> </define> <define name="its-attribute.term"> <attribute name="its:term"> <ref name="its-term.type"/> </attribute> </define> <define name="its-attribute.term.nons"> <attribute name="term"> <ref name="its-term.type"/> </attribute> </define> <define name="its-attribute.termConfidence"> <attribute name="its:termConfidence"> <ref name="its-termConfidence.type"/> </attribute> </define> <define name="its-attribute.termConfidence.nons"> <attribute name="termConfidence"> <ref name="its-termConfidence.type"/> </attribute> </define> <define name="its-attribute.withinText"> <attribute name="its:withinText"> <ref name="its-withinText.type"/> </attribute> </define> <define name="its-attribute.withinText.nons"> <attribute name="withinText"> <ref name="its-withinText.type"/> </attribute> </define> <define name="its-attribute.domainMapping"> <attribute name="its:domainMapping"> <ref name="its-domainMapping.type"/> </attribute> </define> <define name="its-attribute.domainMapping.nons"> <attribute name="domainMapping"> <ref name="its-domainMapping.type"/> </attribute> </define> <define name="its-attribute.taConfidence"> <attribute name="its:taConfidence"> <ref name="its-taConfidence.type"/> </attribute> </define> <define name="its-attribute.taConfidence.nons"> <attribute name="taConfidence"> <ref name="its-taConfidence.type"/> </attribute> </define> <define name="its-attribute.taClassRef"> <attribute name="its:taClassRef"> <ref name="its-taClassRef.type"/> </attribute> </define> <define name="its-attribute.taClassRef.nons"> <attribute name="taClassRef"> <ref name="its-taClassRef.type"/> </attribute> </define> <define name="its-attribute.taIdent"> <attribute name="its:taIdent"> <ref name="its-taIdent.type"/> </attribute> </define> <define name="its-attribute.taIdent.nons"> <attribute name="taIdent"> <ref name="its-taIdent.type"/> </attribute> </define> <define name="its-attribute.taIdentRef"> <attribute name="its:taIdentRef"> <ref name="its-taIdentRef.type"/> </attribute> </define> <define name="its-attribute.taIdentRef.nons"> <attribute name="taIdentRef"> <ref name="its-taIdentRef.type"/> </attribute> </define> <define name="its-attribute.taSource"> <attribute name="its:taSource"> <ref name="its-taSource.type"/> </attribute> </define> <define name="its-attribute.taSource.nons"> <attribute name="taSource"> <ref name="its-taSource.type"/> </attribute> </define> <define name="its-attribute.localeFilterList"> <attribute name="its:localeFilterList"> <ref name="its-localeFilterList.type"/> </attribute> </define> <define name="its-attribute.localeFilterList.nons"> <attribute name="localeFilterList"> <ref name="its-localeFilterList.type"/> </attribute> </define> <define name="its-attribute.localeFilterType"> <attribute name="its:localeFilterType"> <ref name="its-localeFilterType.type"/> </attribute> </define> <define name="its-attribute.localeFilterType.nons"> <attribute name="localeFilterType"> <ref name="its-localeFilterType.type"/> </attribute> </define> <define name="its-attribute.person"> <attribute name="its:person"> <ref name="its-person.type"/> </attribute> </define> <define name="its-attribute.person.nons"> <attribute name="person"> <ref name="its-person.type"/> </attribute> </define> <define name="its-attribute.personRef"> <attribute name="its:personRef"> <ref name="its-personRef.type"/> </attribute> </define> <define name="its-attribute.personRef.nons"> <attribute name="personRef"> <ref name="its-personRef.type"/> </attribute> </define> <define name="its-attribute.org"> <attribute name="its:org"> <ref name="its-org.type"/> </attribute> </define> <define name="its-attribute.org.nons"> <attribute name="org"> <ref name="its-org.type"/> </attribute> </define> <define name="its-attribute.orgRef"> <attribute name="its:orgRef"> <ref name="its-orgRef.type"/> </attribute> </define> <define name="its-attribute.orgRef.nons"> <attribute name="orgRef"> <ref name="its-orgRef.type"/> </attribute> </define> <define name="its-attribute.tool"> <attribute name="its:tool"> <ref name="its-tool.type"/> </attribute> </define> <define name="its-attribute.tool.nons"> <attribute name="tool"> <ref name="its-tool.type"/> </attribute> </define> <define name="its-attribute.toolRef"> <attribute name="its:toolRef"> <ref name="its-toolRef.type"/> </attribute> </define> <define name="its-attribute.toolRef.nons"> <attribute name="toolRef"> <ref name="its-toolRef.type"/> </attribute> </define> <define name="its-attribute.revPerson"> <attribute name="its:revPerson"> <ref name="its-revPerson.type"/> </attribute> </define> <define name="its-attribute.revPerson.nons"> <attribute name="revPerson"> <ref name="its-revPerson.type"/> </attribute> </define> <define name="its-attribute.revPersonRef"> <attribute name="its:revPersonRef"> <ref name="its-revPersonRef.type"/> </attribute> </define> <define name="its-attribute.revPersonRef.nons"> <attribute name="revPersonRef"> <ref name="its-revPersonRef.type"/> </attribute> </define> <define name="its-attribute.revOrg"> <attribute name="its:revOrg"> <ref name="its-revOrg.type"/> </attribute> </define> <define name="its-attribute.revOrg.nons"> <attribute name="revOrg"> <ref name="its-revOrg.type"/> </attribute> </define> <define name="its-attribute.revOrgRef"> <attribute name="its:revOrgRef"> <ref name="its-revOrgRef.type"/> </attribute> </define> <define name="its-attribute.revOrgRef.nons"> <attribute name="revOrgRef"> <ref name="its-revOrgRef.type"/> </attribute> </define> <define name="its-attribute.revTool"> <attribute name="its:revTool"> <ref name="its-revTool.type"/> </attribute> </define> <define name="its-attribute.revTool.nons"> <attribute name="revTool"> <ref name="its-revTool.type"/> </attribute> </define> <define name="its-attribute.revToolRef"> <attribute name="its:revToolRef"> <ref name="its-revToolRef.type"/> </attribute> </define> <define name="its-attribute.revToolRef.nons"> <attribute name="revToolRef"> <ref name="its-revToolRef.type"/> </attribute> </define> <define name="its-attribute.provRef"> <attribute name="its:provRef"> <ref name="its-provRef.type"/> </attribute> </define> <define name="its-attribute.provRef.nons"> <attribute name="provRef"> <ref name="its-provRef.type"/> </attribute> </define> <define name="its-attribute.provenanceRecordsRef"> <attribute name="its:provenanceRecordsRef"> <ref name="its-provenanceRecordsRef.type"/> </attribute> </define> <define name="its-attribute.provenanceRecordsRef.nons"> <attribute name="provenanceRecordsRef"> <ref name="its-provenanceRecordsRef.type"/> </attribute> </define> <define name="its-attribute.locQualityIssuesRef"> <attribute name="its:locQualityIssuesRef"> <ref name="its-locQualityIssuesRef.type"/> </attribute> </define> <define name="its-attribute.locQualityIssuesRef.nons"> <attribute name="locQualityIssuesRef"> <ref name="its-locQualityIssuesRef.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueType"> <attribute name="its:locQualityIssueType"> <ref name="its-locQualityIssueType.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueType.nons"> <attribute name="locQualityIssueType"> <ref name="its-locQualityIssueType.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueComment"> <attribute name="its:locQualityIssueComment"> <ref name="its-locQualityIssueComment.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueComment.nons"> <attribute name="locQualityIssueComment"> <ref name="its-locQualityIssueComment.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueSeverity"> <attribute name="its:locQualityIssueSeverity"> <ref name="its-locQualityIssueSeverity.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueSeverity.nons"> <attribute name="locQualityIssueSeverity"> <ref name="its-locQualityIssueSeverity.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueProfileRef"> <attribute name="its:locQualityIssueProfileRef"> <ref name="its-locQualityIssueProfileRef.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueProfileRef.nons"> <attribute name="locQualityIssueProfileRef"> <ref name="its-locQualityIssueProfileRef.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueEnabled"> <attribute name="its:locQualityIssueEnabled"> <ref name="its-locQualityIssueEnabled.type"/> </attribute> </define> <define name="its-attribute.locQualityIssueEnabled.nons"> <attribute name="locQualityIssueEnabled"> <ref name="its-locQualityIssueEnabled.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingScore"> <attribute name="its:locQualityRatingScore"> <ref name="its-locQualityRatingScore.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingScore.nons"> <attribute name="locQualityRatingScore"> <ref name="its-locQualityRatingScore.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingVote"> <attribute name="its:locQualityRatingVote"> <ref name="its-locQualityRatingVote.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingVote.nons"> <attribute name="locQualityRatingVote"> <ref name="its-locQualityRatingVote.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingScoreThreshold"> <attribute name="its:locQualityRatingScoreThreshold"> <ref name="its-locQualityRatingScoreThreshold.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingScoreThreshold.nons"> <attribute name="locQualityRatingScoreThreshold"> <ref name="its-locQualityRatingScoreThreshold.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingVoteThreshold"> <attribute name="its:locQualityRatingVoteThreshold"> <ref name="its-locQualityRatingVoteThreshold.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingVoteThreshold.nons"> <attribute name="locQualityRatingVoteThreshold"> <ref name="its-locQualityRatingVoteThreshold.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingProfileRef"> <attribute name="its:locQualityRatingProfileRef"> <ref name="its-locQualityRatingProfileRef.type"/> </attribute> </define> <define name="its-attribute.locQualityRatingProfileRef.nons"> <attribute name="locQualityRatingProfileRef"> <ref name="its-locQualityRatingProfileRef.type"/> </attribute> </define> <define name="its-attribute.mtConfidence"> <attribute name="its:mtConfidence"> <ref name="its-mtConfidence.type"/> </attribute> </define> <define name="its-attribute.mtConfidence.nons"> <attribute name="mtConfidence"> <ref name="its-mtConfidence.type"/> </attribute> </define> <define name="its-attribute.allowedCharacters"> <attribute name="its:allowedCharacters"> <ref name="its-allowedCharacters.type"/> </attribute> </define> <define name="its-attribute.allowedCharacters.nons"> <attribute name="allowedCharacters"> <ref name="its-allowedCharacters.type"/> </attribute> </define> <define name="its-attribute.storageSize"> <attribute name="its:storageSize"> <ref name="its-storageSize.type"/> </attribute> </define> <define name="its-attribute.storageSize.nons"> <attribute name="storageSize"> <ref name="its-storageSize.type"/> </attribute> </define> <define name="its-attribute.storageEncoding"> <attribute name="its:storageEncoding"> <ref name="its-storageEncoding.type"/> </attribute> </define> <define name="its-attribute.storageEncoding.nons"> <attribute name="storageEncoding"> <ref name="its-storageEncoding.type"/> </attribute> </define> <define name="its-attribute.lineBreakType"> <attribute name="its:lineBreakType"> <ref name="its-lineBreakType.type"/> </attribute> </define> <define name="its-attribute.lineBreakType.nons"> <attribute name="lineBreakType"> <ref name="its-lineBreakType.type"/> </attribute> </define> <define name="its-attribute.annotatorsRef"> <attribute name="its:annotatorsRef"> <ref name="its-annotatorsRef.type"/> </attribute> </define> <define name="its-attribute.annotatorsRef.nons"> <attribute name="annotatorsRef"> <ref name="its-annotatorsRef.type"/> </attribute> </define> <define name="its-attribute.version"> <attribute name="its:version"> <a:documentation>Version of ITS</a:documentation> <ref name="its-version.type"/> </attribute> </define> <define name="its-attribute.version.nons"> <attribute name="version"> <a:documentation>Version of ITS</a:documentation> <ref name="its-version.type"/> </attribute> </define> <define name="its-attribute.queryLanguage"> <attribute name="its:queryLanguage"> <ref name="its-queryLanguage.type"/> </attribute> </define> <define name="its-attribute.queryLanguage.nons"> <attribute name="queryLanguage"> <ref name="its-queryLanguage.type"/> </attribute> </define> <define name="its-attribute.xlink.href"> <attribute name="xlink:href"> <data type="anyURI"/> </attribute> </define> <define name="its-attribute.xlink.type"> <attribute name="xlink:type"> <value>simple</value> </attribute> </define> <define name="its-attribute.selector"> <attribute name="selector"> <ref name="its-absolute-selector.type"/> </attribute> </define> <define name="its-foreign-attribute"> <attribute> <anyName> <except> <nsName ns=""/> </except> </anyName> </attribute> </define> <define name="its-foreign-no-xml-id-attribute"> <attribute> <anyName> <except> <nsName ns=""/> <name>xml:id</name> </except> </anyName> </attribute> </define> <define name="its-foreign-no-xlink-attribute"> <attribute> <anyName> <except> <nsName ns=""/> <nsName ns="http://www.w3.org/1999/xlink"/> </except> </anyName> </attribute> </define> <define name="its-any-attribute"> <attribute> <anyName/> </attribute> </define> <define name="its-any-element"> <element> <anyName/> <zeroOrMore> <choice> <zeroOrMore> <ref name="its-any-attribute"/> </zeroOrMore> <text/> <ref name="its-any-element"/> </choice> </zeroOrMore> </element> </define> <define name="its-foreign-element"> <element> <anyName> <except> <nsName/> </except> </anyName> <zeroOrMore> <choice> <zeroOrMore> <ref name="its-any-attribute"/> </zeroOrMore> <text/> <ref name="its-foreign-element"/> </choice> </zeroOrMore> </element> </define> <define name="its-rules"> <element name="rules"> <a:documentation>Container for global rules</a:documentation> <ref name="its-rules.content"/> <ref name="its-rules.attributes"/> </element> </define> <define name="its-rules.content"> <zeroOrMore> <ref name="its-param"/> </zeroOrMore> <zeroOrMore> <choice> <ref name="its-translateRule"/> <ref name="its-locNoteRule"/> <ref name="its-termRule"/> <ref name="its-dirRule"/> <ref name="its-langRule"/> <ref name="its-withinTextRule"/> <ref name="its-domainRule"/> <ref name="its-textAnalysisRule"/> <ref name="its-localeFilterRule"/> <ref name="its-provRule"/> <ref name="its-locQualityIssueRule"/> <ref name="its-mtConfidenceRule"/> <ref name="its-externalResourceRefRule"/> <ref name="its-targetPointerRule"/> <ref name="its-idValueRule"/> <ref name="its-preserveSpaceRule"/> <ref name="its-allowedCharactersRule"/> <ref name="its-storageSizeRule"/> <ref name="its-foreign-element"/> </choice> </zeroOrMore> </define> <define name="its-rules.attributes"> <ref name="its-attribute.version.nons"/> <optional> <ref name="its-attribute.xlink.href"/> <optional> <ref name="its-attribute.xlink.type"/> </optional> </optional> <optional> <ref name="its-attribute.queryLanguage.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-no-xlink-attribute"/> </zeroOrMore> </define> <define name="its-param"> <element name="param"> <a:documentation>Declaration of variable used in selectors</a:documentation> <ref name="its-param.content"/> <ref name="its-param.attributes"/> </element> </define> <define name="its-param.content"> <text/> </define> <define name="its-param.attributes"> <attribute name="name"> <data type="string"/> </attribute> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-local.attributes"> <interleave> <optional> <ref name="its-attribute.translate"/> </optional> <optional> <ref name="its-attribute.dir"/> </optional> <optional> <choice> <ref name="its-attribute.locNote"/> <ref name="its-attribute.locNoteRef"/> </choice> <optional> <ref name="its-attribute.locNoteType"/> </optional> </optional> <optional> <ref name="its-attribute.term"/> <optional> <ref name="its-attribute.termInfoRef"/> </optional> <optional> <ref name="its-attribute.termConfidence"/> </optional> </optional> <optional> <ref name="its-attribute.withinText"/> </optional> <optional> <interleave> <optional> <ref name="its-attribute.taConfidence"/> </optional> <interleave> <optional> <ref name="its-attribute.taClassRef"/> </optional> <optional> <choice> <group> <ref name="its-attribute.taSource"/> <ref name="its-attribute.taIdent"/> </group> <ref name="its-attribute.taIdentRef"/> </choice> </optional> </interleave> </interleave> </optional> <optional> <ref name="its-attribute.localeFilterList"/> <optional> <ref name="its-attribute.localeFilterType"/> </optional> </optional> <optional> <choice> <interleave> <optional> <choice> <ref name="its-attribute.person"/> <ref name="its-attribute.personRef"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.org"/> <ref name="its-attribute.orgRef"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.tool"/> <ref name="its-attribute.toolRef"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revPerson"/> <ref name="its-attribute.revPersonRef"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revOrg"/> <ref name="its-attribute.revOrgRef"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revTool"/> <ref name="its-attribute.revToolRef"/> </choice> </optional> <optional> <ref name="its-attribute.provRef"/> </optional> </interleave> <ref name="its-attribute.provenanceRecordsRef"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.locQualityIssuesRef"/> <interleave> <interleave> <optional> <ref name="its-attribute.locQualityIssueType"/> </optional> <optional> <ref name="its-attribute.locQualityIssueComment"/> </optional> </interleave> <optional> <ref name="its-attribute.locQualityIssueSeverity"/> </optional> <optional> <ref name="its-attribute.locQualityIssueProfileRef"/> </optional> <optional> <ref name="its-attribute.locQualityIssueEnabled"/> </optional> </interleave> </choice> </optional> <optional> <choice> <group> <ref name="its-attribute.locQualityRatingScore"/> <optional> <ref name="its-attribute.locQualityRatingScoreThreshold"/> </optional> </group> <group> <ref name="its-attribute.locQualityRatingVote"/> <optional> <ref name="its-attribute.locQualityRatingVoteThreshold"/> </optional> </group> </choice> <optional> <ref name="its-attribute.locQualityRatingProfileRef"/> </optional> </optional> <optional> <ref name="its-attribute.mtConfidence"/> </optional> <optional> <ref name="its-attribute.allowedCharacters"/> </optional> <optional> <ref name="its-attribute.storageSize"/> <optional> <ref name="its-attribute.storageEncoding"/> </optional> <optional> <ref name="its-attribute.lineBreakType"/> </optional> </optional> <optional> <ref name="its-attribute.annotatorsRef"/> </optional> </interleave> </define> <define name="its-local.nons.attributes"> <interleave> <optional> <ref name="its-attribute.translate.nons"/> </optional> <optional> <ref name="its-attribute.dir.nons"/> </optional> <optional> <choice> <ref name="its-attribute.locNote.nons"/> <ref name="its-attribute.locNoteRef.nons"/> </choice> <optional> <ref name="its-attribute.locNoteType.nons"/> </optional> </optional> <optional> <ref name="its-attribute.term.nons"/> <optional> <ref name="its-attribute.termInfoRef.nons"/> </optional> <optional> <ref name="its-attribute.termConfidence.nons"/> </optional> </optional> <optional> <ref name="its-attribute.withinText.nons"/> </optional> <optional> <interleave> <optional> <ref name="its-attribute.taConfidence.nons"/> </optional> <interleave> <optional> <ref name="its-attribute.taClassRef.nons"/> </optional> <optional> <choice> <group> <ref name="its-attribute.taSource.nons"/> <ref name="its-attribute.taIdent.nons"/> </group> <ref name="its-attribute.taIdentRef.nons"/> </choice> </optional> </interleave> </interleave> </optional> <optional> <ref name="its-attribute.localeFilterList.nons"/> <optional> <ref name="its-attribute.localeFilterType.nons"/> </optional> </optional> <optional> <choice> <interleave> <optional> <choice> <ref name="its-attribute.person.nons"/> <ref name="its-attribute.personRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.org.nons"/> <ref name="its-attribute.orgRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.tool.nons"/> <ref name="its-attribute.toolRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revPerson.nons"/> <ref name="its-attribute.revPersonRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revOrg.nons"/> <ref name="its-attribute.revOrgRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revTool.nons"/> <ref name="its-attribute.revToolRef.nons"/> </choice> </optional> <optional> <ref name="its-attribute.provRef.nons"/> </optional> </interleave> <ref name="its-attribute.provenanceRecordsRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.locQualityIssuesRef.nons"/> <interleave> <interleave> <optional> <ref name="its-attribute.locQualityIssueType.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueComment.nons"/> </optional> </interleave> <optional> <ref name="its-attribute.locQualityIssueSeverity.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueProfileRef.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueEnabled.nons"/> </optional> </interleave> </choice> </optional> <optional> <choice> <group> <ref name="its-attribute.locQualityRatingScore.nons"/> <optional> <ref name="its-attribute.locQualityRatingScoreThreshold.nons"/> </optional> </group> <group> <ref name="its-attribute.locQualityRatingVote.nons"/> <optional> <ref name="its-attribute.locQualityRatingVoteThreshold.nons"/> </optional> </group> </choice> <optional> <ref name="its-attribute.locQualityRatingProfileRef.nons"/> </optional> </optional> <optional> <ref name="its-attribute.mtConfidence.nons"/> </optional> <optional> <ref name="its-attribute.allowedCharacters.nons"/> </optional> <optional> <ref name="its-attribute.storageSize.nons"/> <optional> <ref name="its-attribute.storageEncoding.nons"/> </optional> <optional> <ref name="its-attribute.lineBreakType.nons"/> </optional> </optional> <optional> <ref name="its-attribute.annotatorsRef.nons"/> </optional> </interleave> </define> <define name="its-span"> <element name="span"> <a:documentation>Inline element to contain ITS information</a:documentation> <ref name="its-span.content"/> <ref name="its-span.attributes"/> </element> </define> <define name="its-span.content"> <zeroOrMore> <choice> <text/> <ref name="its-span"/> </choice> </zeroOrMore> </define> <define name="its-span.attributes"> <interleave> <ref name="its-local.nons.attributes"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </interleave> </define> <define name="its-translateRule"> <element name="translateRule"> <a:documentation>Rule about the Translate data category</a:documentation> <ref name="its-translateRule.content"/> <ref name="its-translateRule.attributes"/> </element> </define> <define name="its-translateRule.content"> <empty/> </define> <define name="its-translateRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.translate.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-locNoteRule"> <element name="locNoteRule"> <a:documentation>Rule about the Localization Note data category</a:documentation> <ref name="its-attribute.selector"/> <ref name="its-attribute.locNoteType.nons"/> <choice> <ref name="its-locNote"/> <ref name="its-attribute.locNotePointer.nons"/> <ref name="its-attribute.locNoteRef.nons"/> <ref name="its-attribute.locNoteRefPointer.nons"/> </choice> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </element> </define> <define name="its-attribute.locNotePointer.nons"> <attribute name="locNotePointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-attribute.locNoteRefPointer.nons"> <attribute name="locNoteRefPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-locNote"> <element name="locNote"> <a:documentation>Localization note</a:documentation> <ref name="its-locNote.content"/> <ref name="its-locNote.attributes"/> </element> </define> <define name="its-locNote.content"> <zeroOrMore> <choice> <text/> <ref name="its-span"/> </choice> </zeroOrMore> </define> <define name="its-locNote.attributes"> <ref name="its-local.nons.attributes"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-termRule"> <element name="termRule"> <a:documentation>Rule about the Terminology data category</a:documentation> <ref name="its-termRule.content"/> <ref name="its-termRule.attributes"/> </element> </define> <define name="its-termRule.content"> <empty/> </define> <define name="its-termRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.term.nons"/> <optional> <choice> <ref name="its-attribute.termInfoPointer.nons"/> <ref name="its-attribute.termInfoRef.nons"/> <ref name="its-attribute.termInfoRefPointer.nons"/> </choice> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.termInfoPointer.nons"> <attribute name="termInfoPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-attribute.termInfoRefPointer.nons"> <attribute name="termInfoRefPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-dirRule"> <element name="dirRule"> <a:documentation>Rule about the Directionality data category</a:documentation> <ref name="its-dirRule.content"/> <ref name="its-dirRule.attributes"/> </element> </define> <define name="its-dirRule.content"> <empty/> </define> <define name="its-dirRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.dir.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-langRule"> <element name="langRule"> <a:documentation>Rule about the Language Information data category</a:documentation> <ref name="its-langRule.content"/> <ref name="its-langRule.attributes"/> </element> </define> <define name="its-langRule.content"> <empty/> </define> <define name="its-langRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.langPointer.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.langPointer.nons"> <attribute name="langPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-withinTextRule"> <element name="withinTextRule"> <a:documentation>Rule about the Elements Within Text data category</a:documentation> <ref name="its-withinTextRule.content"/> <ref name="its-withinTextRule.attributes"/> </element> </define> <define name="its-withinTextRule.content"> <empty/> </define> <define name="its-withinTextRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.withinText.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-domainRule"> <element name="domainRule"> <a:documentation>Rule about the Domain data category</a:documentation> <ref name="its-domainRule.content"/> <ref name="its-domainRule.attributes"/> </element> </define> <define name="its-domainRule.content"> <empty/> </define> <define name="its-domainRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.domainPointer.nons"/> <optional> <ref name="its-attribute.domainMapping.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.domainPointer.nons"> <attribute name="domainPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-textAnalysisRule"> <element name="textAnalysisRule"> <a:documentation>Rule about the Disambiguation data category</a:documentation> <ref name="its-textAnalysisRule.content"/> <ref name="its-textAnalysisRule.attributes"/> </element> </define> <define name="its-textAnalysisRule.content"> <empty/> </define> <define name="its-textAnalysisRule.attributes"> <ref name="its-attribute.selector"/> <optional> <ref name="its-attribute.taClassRefPointer.nons"/> </optional> <optional> <choice> <group> <ref name="its-attribute.taSourcePointer.nons"/> <ref name="its-attribute.taIdentPointer.nons"/> </group> <ref name="its-attribute.taIdentRefPointer.nons"/> </choice> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.taClassRefPointer.nons"> <attribute name="taClassRefPointer"> <ref name="its-taClassRefPointer.type"/> </attribute> </define> <define name="its-attribute.taIdentPointer.nons"> <attribute name="taIdentPointer"> <ref name="its-taIdentPointer.type"/> </attribute> </define> <define name="its-attribute.taSourcePointer.nons"> <attribute name="taSourcePointer"> <ref name="its-taSourcePointer.type"/> </attribute> </define> <define name="its-attribute.taIdentRefPointer.nons"> <attribute name="taIdentRefPointer"> <ref name="its-taIdentRefPointer.type"/> </attribute> </define> <define name="its-localeFilterRule"> <element name="localeFilterRule"> <a:documentation>Rule about the LocaleFilter data category</a:documentation> <ref name="its-localeFilterRule.content"/> <ref name="its-localeFilterRule.attributes"/> </element> </define> <define name="its-localeFilterRule.content"> <empty/> </define> <define name="its-localeFilterRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.localeFilterList.nons"/> <optional> <ref name="its-attribute.localeFilterType.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-provRule"> <element name="provRule"> <a:documentation>Rule about the Provenance data category</a:documentation> <ref name="its-provRule.content"/> <ref name="its-provRule.attributes"/> </element> </define> <define name="its-provRule.content"> <empty/> </define> <define name="its-provRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.provenanceRecordsRefPointer.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.provenanceRecordsRefPointer.nons"> <attribute name="provenanceRecordsRefPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-externalResourceRefRule"> <element name="externalResourceRefRule"> <a:documentation>Rule about the External Resource data category</a:documentation> <ref name="its-externalResourceRefRule.content"/> <ref name="its-externalResourceRefRule.attributes"/> </element> </define> <define name="its-externalResourceRefRule.content"> <empty/> </define> <define name="its-externalResourceRefRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.externalResourceRefPointer.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.externalResourceRefPointer.nons"> <attribute name="externalResourceRefPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-targetPointerRule"> <element name="targetPointerRule"> <a:documentation>Rule about the Target Pointer data category</a:documentation> <ref name="its-targetPointerRule.content"/> <ref name="its-targetPointerRule.attributes"/> </element> </define> <define name="its-targetPointerRule.content"> <empty/> </define> <define name="its-targetPointerRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.targetPointer.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.targetPointer.nons"> <attribute name="targetPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-idValueRule"> <element name="idValueRule"> <a:documentation>Rule about the Id Value data category</a:documentation> <ref name="its-idValueRule.content"/> <ref name="its-idValueRule.attributes"/> </element> </define> <define name="its-idValueRule.content"> <empty/> </define> <define name="its-idValueRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.idValue.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.idValue.nons"> <attribute name="idValue"> <ref name="its-xpath-expression.type"/> </attribute> </define> <define name="its-preserveSpaceRule"> <element name="preserveSpaceRule"> <a:documentation>Rule about the Preserve Space data category</a:documentation> <ref name="its-preserveSpaceRule.content"/> <ref name="its-preserveSpaceRule.attributes"/> </element> </define> <define name="its-preserveSpaceRule.content"> <empty/> </define> <define name="its-preserveSpaceRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.space.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.space.nons"> <attribute name="space"> <choice> <value>default</value> <value>preserve</value> </choice> </attribute> </define> <define name="its-locQualityIssueRule"> <element name="locQualityIssueRule"> <a:documentation>Rule about the Localization Quality Issue data category</a:documentation> <ref name="its-locQualityIssueRule.content"/> <ref name="its-locQualityIssueRule.attributes"/> </element> </define> <define name="its-locQualityIssueRule.content"> <empty/> </define> <define name="its-locQualityIssueRule.attributes"> <ref name="its-attribute.selector"/> <choice> <choice> <ref name="its-attribute.locQualityIssuesRef.nons"/> <ref name="its-attribute.locQualityIssuesRefPointer.nons"/> </choice> <group> <oneOrMore> <choice> <ref name="its-attribute.locQualityIssueType.nons"/> <ref name="its-attribute.locQualityIssueComment.nons"/> </choice> </oneOrMore> <optional> <ref name="its-attribute.locQualityIssueSeverity.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueProfileRef.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueEnabled.nons"/> </optional> </group> </choice> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.locQualityIssuesRefPointer.nons"> <attribute name="locQualityIssuesRefPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-mtConfidenceRule"> <element name="mtConfidenceRule"> <a:documentation>Rule about the MT Confidence data category</a:documentation> <ref name="its-mtConfidenceRule.content"/> <ref name="its-mtConfidenceRule.attributes"/> </element> </define> <define name="its-mtConfidenceRule.content"> <empty/> </define> <define name="its-mtConfidenceRule.attributes"> <ref name="its-attribute.selector"/> <ref name="its-attribute.mtConfidence.nons"/> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-allowedCharactersRule"> <element name="allowedCharactersRule"> <a:documentation>Rule about the Allowed Characters data category</a:documentation> <ref name="its-allowedCharactersRule.content"/> <ref name="its-allowedCharactersRule.attributes"/> </element> </define> <define name="its-allowedCharactersRule.content"> <empty/> </define> <define name="its-allowedCharactersRule.attributes"> <ref name="its-attribute.selector"/> <choice> <ref name="its-attribute.allowedCharacters.nons"/> <ref name="its-attribute.allowedCharactersPointer.nons"/> </choice> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.allowedCharactersPointer.nons"> <attribute name="allowedCharactersPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-storageSizeRule"> <element name="storageSizeRule"> <a:documentation>Rule about the Allowed Characters data category</a:documentation> <ref name="its-storageSizeRule.content"/> <ref name="its-storageSizeRule.attributes"/> </element> </define> <define name="its-storageSizeRule.content"> <empty/> </define> <define name="its-storageSizeRule.attributes"> <ref name="its-attribute.selector"/> <choice> <ref name="its-attribute.storageSize.nons"/> <ref name="its-attribute.storageSizePointer.nons"/> </choice> <optional> <choice> <ref name="its-attribute.storageEncoding.nons"/> <ref name="its-attribute.storageEncodingPointer.nons"/> </choice> </optional> <optional> <ref name="its-attribute.lineBreakType.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </define> <define name="its-attribute.storageSizePointer.nons"> <attribute name="storageSizePointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-attribute.storageEncodingPointer.nons"> <attribute name="storageEncodingPointer"> <ref name="its-relative-selector.type"/> </attribute> </define> <define name="its-standoff"> <choice> <ref name="its-provenanceRecords"/> <ref name="its-locQualityIssues"/> </choice> </define> <define name="its-provenanceRecords"> <element name="its:provenanceRecords"> <a:documentation>Standoff markup for Provenance data category</a:documentation> <oneOrMore> <ref name="its-provenanceRecord"/> </oneOrMore> <attribute name="xml:id"> <data type="ID"/> </attribute> <optional> <ref name="its-attribute.version.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-no-xml-id-attribute"/> </zeroOrMore> </element> </define> <define name="its-provenanceRecord"> <element name="its:provenanceRecord"> <a:documentation>Provenance record used in Provenance standoff markup</a:documentation> <ref name="its-provenanceRecord.attributes"/> </element> </define> <define name="its-provenanceRecord.attributes"> <interleave> <optional> <choice> <ref name="its-attribute.person.nons"/> <ref name="its-attribute.personRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.org.nons"/> <ref name="its-attribute.orgRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.tool.nons"/> <ref name="its-attribute.toolRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revPerson.nons"/> <ref name="its-attribute.revPersonRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revOrg.nons"/> <ref name="its-attribute.revOrgRef.nons"/> </choice> </optional> <optional> <choice> <ref name="its-attribute.revTool.nons"/> <ref name="its-attribute.revToolRef.nons"/> </choice> </optional> <optional> <ref name="its-attribute.provRef.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </interleave> </define> <define name="its-locQualityIssues"> <element name="its:locQualityIssues"> <a:documentation>Standoff markup for Localization Quality Issue data category</a:documentation> <oneOrMore> <ref name="its-locQualityIssue"/> </oneOrMore> <attribute name="xml:id"> <data type="ID"/> </attribute> <optional> <ref name="its-attribute.version.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-no-xml-id-attribute"/> </zeroOrMore> </element> </define> <define name="its-locQualityIssue"> <element name="its:locQualityIssue"> <a:documentation>Issue recorded in Localization Quality standoff markup</a:documentation> <ref name="its-locQualityIssue.attributes"/> </element> </define> <define name="its-locQualityIssue.attributes"> <interleave> <optional> <ref name="its-attribute.locQualityIssueType.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueComment.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueSeverity.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueProfileRef.nons"/> </optional> <optional> <ref name="its-attribute.locQualityIssueEnabled.nons"/> </optional> <zeroOrMore> <ref name="its-foreign-attribute"/> </zeroOrMore> </interleave> </define> </grammar> </pre></div>[Source file: <a href="schemas/its20.rng">schemas/its20.rng</a>](<a href="schemas/its20.rnc">RELAX NG compact syntax version of schema</a>)</div> 4. Data type definitions: All datatypes used in the base RELAX NG schema are defined the following schema. <div class="exampleOuter"><div class="exampleHeader"><a name="its20-types.rng" id="its20-types.rng"></a>Example 95: RELAX NG schema with datatypes for ITS</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <grammar xmlns:a="http://relaxng.org/ns/compatibility/annotations/1.0" xmlns="http://relaxng.org/ns/structure/1.0" datatypeLibrary="http://www.w3.org/2001/XMLSchema-datatypes"> <define name="its-version.type"> <a:documentation>Version of ITS</a:documentation> <data type="string"> <param name="pattern">[0-9]+\.[0-9]+</param> </data> </define> <define name="its-queryLanguage.type"> <a:documentation>The query language to be used for processing the rules</a:documentation> <choice> <value>xpath</value> <value>css</value> <text/> </choice> </define> <define name="its-absolute-selector.type"> <data type="string" datatypeLibrary=""> <a:documentation>Absolute selector</a:documentation> </data> </define> <define name="its-relative-selector.type"> <data type="string" datatypeLibrary=""> <a:documentation>Relative selector</a:documentation> </data> </define> <define name="its-xpath-expression.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-confidence.type"> <data type="double"> <param name="minInclusive">0</param> <param name="maxInclusive">1</param> </data> </define> <define name="its-translate.type"> <a:documentation>The Translate data category information to be attached to the current node</a:documentation> <choice> <value>yes</value> <a:documentation>The nodes need to be translated</a:documentation> <value>no</value> <a:documentation>The nodes must not be translated</a:documentation> </choice> </define> <define name="its-locNote.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-locNoteType.type"> <a:documentation>The type of localization note</a:documentation> <choice> <value>alert</value> <a:documentation>Localization note is an alert</a:documentation> <value>description</value> <a:documentation>Localization note is a description</a:documentation> </choice> </define> <define name="its-locNoteRef.type"> <data type="anyURI"/> </define> <define name="its-termInfoRef.type"> <data type="anyURI"/> </define> <define name="its-term.type"> <a:documentation>Indicates a term locally</a:documentation> <choice> <value>yes</value> <a:documentation>The value 'yes' means that this is a term</a:documentation> <value>no</value> <a:documentation>The value 'no' means that this is not a term</a:documentation> </choice> </define> <define name="its-termConfidence.type"> <ref name="its-confidence.type"/> </define> <define name="its-dir.type"> <a:documentation>The text direction for the context</a:documentation> <choice> <value>ltr</value> <a:documentation>Left-to-right text</a:documentation> <value>rtl</value> <a:documentation>Right-to-left text</a:documentation> <value>lro</value> <a:documentation>Left-to-right override</a:documentation> <value>rlo</value> <a:documentation>Right-to-left override</a:documentation> </choice> </define> <define name="its-withinText.type"> <a:documentation>States whether current context is regarded as "within text"</a:documentation> <choice> <value>yes</value> <a:documentation>The element and its content are part of the flow of its parent element</a:documentation> <value>no</value> <a:documentation>The element splits the text flow of its parent element and its content is an independent text flow</a:documentation> <value>nested</value> <a:documentation>The element is part of the flow of its parent element, its content is an independent flow</a:documentation> </choice> </define> <define name="its-domainMapping.type"> <a:documentation>A comma separated list of mappings between values in the content and workflow specific values. The values may contain spaces; in that case they MUST be delimited by quotation marks.</a:documentation> <data type="string" datatypeLibrary=""/> </define> <define name="its-taConfidence.type"> <ref name="its-confidence.type"/> </define> <define name="its-taClassPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-taClassRefPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-taClassRef.type"> <data type="anyURI"/> </define> <define name="its-taIdentRef.type"> <data type="anyURI"/> </define> <define name="its-taIdent.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-taSource.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-taIdentPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-taIdentRefPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-taSourcePointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-localeFilterList.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-localeFilterType.type"> <choice> <value>include</value> <value>exclude</value> </choice> </define> <define name="its-provenanceRecordsRef.type"> <data type="anyURI"/> </define> <define name="its-person.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-personRef.type"> <data type="anyURI"/> </define> <define name="its-org.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-orgRef.type"> <data type="anyURI"/> </define> <define name="its-tool.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-toolRef.type"> <data type="anyURI"/> </define> <define name="its-revPerson.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-revPersonRef.type"> <data type="anyURI"/> </define> <define name="its-revOrg.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-revOrgRef.type"> <data type="anyURI"/> </define> <define name="its-revTool.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-revToolRef.type"> <data type="anyURI"/> </define> <define name="its-provRef.type"> <list> <oneOrMore> <data type="anyURI"/> </oneOrMore> </list> </define> <define name="its-externalResourceRefPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-targetPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-idValue.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-space.type"> <choice> <value>default</value> <value>preserve</value> </choice> </define> <define name="its-locQualityIssuesRef.type"> <data type="anyURI"/> </define> <define name="its-locQualityIssuesRefPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-locQualityIssueType.type"> <choice> <value>terminology</value> <value>mistranslation</value> <value>omission</value> <value>untranslated</value> <value>addition</value> <value>duplication</value> <value>inconsistency</value> <value>grammar</value> <value>legal</value> <value>register</value> <value>locale-specific-content</value> <value>locale-violation</value> <value>style</value> <value>characters</value> <value>misspelling</value> <value>typographical</value> <value>formatting</value> <value>inconsistent-entities</value> <value>numbers</value> <value>markup</value> <value>pattern-problem</value> <value>whitespace</value> <value>internationalization</value> <value>length</value> <value>non-conformance</value> <value>uncategorized</value> <value>other</value> </choice> </define> <define name="its-locQualityIssueTypePointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-locQualityIssueComment.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-locQualityIssueCommentPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-locQualityIssueSeverity.type"> <data type="double"> <param name="minInclusive">0</param> <param name="maxInclusive">100</param> </data> </define> <define name="its-locQualityIssueSeverityPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-locQualityIssueProfileRef.type"> <data type="anyURI"/> </define> <define name="its-locQualityIssueProfileRefPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-locQualityIssueEnabled.type"> <choice> <value>yes</value> <value>no</value> </choice> </define> <define name="its-locQualityRatingScore.type"> <data type="double"> <param name="minInclusive">0</param> <param name="maxInclusive">100</param> </data> </define> <define name="its-locQualityRatingVote.type"> <data type="integer"/> </define> <define name="its-locQualityRatingScoreThreshold.type"> <data type="double"> <param name="minInclusive">0</param> <param name="maxInclusive">100</param> </data> </define> <define name="its-locQualityRatingVoteThreshold.type"> <data type="integer"/> </define> <define name="its-locQualityRatingProfileRef.type"> <data type="anyURI"/> </define> <define name="its-mtConfidence.type"> <ref name="its-confidence.type"/> </define> <define name="its-allowedCharacters.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-allowedCharactersPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-storageSize.type"> <data type="nonNegativeInteger"/> </define> <define name="its-storageSizePointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-storageEncoding.type"> <data type="string" datatypeLibrary=""/> </define> <define name="its-storageEncodingPointer.type"> <ref name="its-relative-selector.type"/> </define> <define name="its-lineBreakType.type"> <choice> <value>cr</value> <value>lf</value> <value>crlf</value> </choice> </define> <define name="its-annotatorsRef.type"> <data type="string" datatypeLibrary=""/> </define> </grammar> </pre></div>[Source file: <a href="schemas/its20-types.rng">schemas/its20-types.rng</a>](<a href="schemas/its20-types.rnc">RELAX NG compact syntax version of schema</a>)</div> 5. Schematron schema: Several constraints of ITS markup cannot be validated with above ITS schemas. The following <a title="Rule-based validation –
 Schematron" href="#schematron">[Schematron]</a> document allows for validating some of these constraints.<div class="exampleOuter"><div class="exampleHeader"><a name="its-constraints-check-schematron" id="its-constraints-check-schematron"></a>Example 96: Schematron schema for ITS</div><div class="exampleInner"><pre><?xml version="1.0" encoding="UTF-8"?> <schema xmlns="http://purl.oclc.org/dsdl/schematron" queryBinding="xslt2"> <ns uri="http://www.w3.org/2005/11/its" prefix="its"/> <ns uri="http://www.w3.org/1999/xlink" prefix="xlink"/> <pattern> <title>Indicating the Version of ITS</title> <rule context="*[@its:*]"> <assert test="ancestor-or-self::*/@its:version | //its:rules/@version"> The version is indicated by the ITS version attribute. This attribute is mandatory for the rules element, where it MUST be in no namespace. If there is no rules element in an XML document, a prefixed ITS version attribute (e.g. its:version) MUST be on the element where the ITS markup is used, or on one of its ancestors.</assert> </rule> <rule context="its:provenanceRecords | its:locQualityIssues"> <assert test="self::*/@version | ancestor::*/@its:version | //its:rules/@version"> The version is indicated by the ITS version attribute. This attribute is mandatory for the rules element, where it MUST be in no namespace. If there is no rules element in an XML document, a prefixed ITS version attribute (e.g. its:version) MUST be on the element where the ITS markup is used, or on one of its ancestors. For standoff markup unprefixed version attribute is used.</assert> </rule> <rule context="*[@its:version]"> <assert test="if (@its:version and //its:rules/@version) then //its:rules/@version = @its:version else true()"> There MUST NOT be two different versions of ITS in the same document.</assert> <assert test="every $v in //*/@its:version satisfies $v = @its:version"> There MUST NOT be two different versions of ITS in the same document.</assert> </rule> <rule context="its:provenanceRecords | its:locQualityIssues"> <assert test="if (@version and //its:rules/@version) then //its:rules/@version = @version else true()"> There MUST NOT be two different versions of ITS in the same document.</assert> <assert test="every $v in //*/@its:version satisfies $v = @version"> There MUST NOT be two different versions of ITS in the same document.</assert> </rule> </pattern> <pattern> <title>Global, Rule-based Selection</title> <rule context="its:rules"> <assert test="every $rules in //its:rules satisfies $rules/@version = current()/@version"> If there is more than one rules element in an XML document, the rules from each section are to be processed at the same precedence level. The rules sections are to be read in document order, and the ITS rules with them processed sequentially. The versions of these rules elements MUST NOT be different.</assert> </rule> </pattern> <pattern> <title>Link to External Rules</title> <rule context="its:rules[@xlink:href]"> <assert test="count(doc(resolve-uri(@xlink:href, base-uri()))//its:rules) le 1"> The referenced document must be a valid XML document containing at most one rules element.</assert> </rule> </pattern> <pattern> <title>ITS Tools Annotation</title> <rule context="*[@its:annotatorsRef]"> <assert test="every $ref in tokenize(@its:annotatorsRef, '\s+') satisfies matches($ref, ' (translate|localization-note|terminology|directionality|language-information| elements-within-text|domain|text-analysis|locale-filter|provenance|external-resource| target-pointer|id-value|preserve-space|localization-quality-issue|localization-quality-rating| mt-confidence|allowed-characters|storage-size)\|.+')"> The value of annotatorsRef is a space-separated list of references where each reference is composed of two parts: a data category identifier and an IRI. These two parts are separated by a character | VERTICAL LINE (U+007C).</assert> </rule> </pattern> <pattern> <title>Source of confidence</title> <rule context="*[@its:termConfidence]"> <assert test="ancestor-or-self::*[@its:annotatorsRef] [matches(@its:annotatorsRef, '.*\s*terminology\|.+')]"> Any node selected by the terminology data category with the termConfidence attribute specified MUST be contained in an element with the annotatorsRef attribute specified for the Terminology data category.</assert> </rule> <rule context="*[@its:taConfidence]"> <assert test="ancestor-or-self::*[@its:annotatorsRef] [matches(@its:annotatorsRef, '.*\s*text-analysis\|.+')]"> Any node selected by the Text Analysis data category with the taConfidence attribute specified MUST be contained in an element with the annotatorsRef attribute specified for the Text Analysis data category.</assert> </rule> <rule context="*[@its:mtConfidence]"> <assert test="ancestor-or-self::*[@its:annotatorsRef] [matches(@its:annotatorsRef, '.*\s*mt-confidence\|.+')]"> Any node selected by the MT Confidence data category MUST be contained in an element with the annotatorsRef attribute specified for the MT Confidence data category.</assert> </rule> </pattern> <pattern> <title>Text analysis</title> <rule context="its:textAnalysisRule"> <assert test="@taClassRefPointer | @taSourcePointer | @taIdentPointer | @taIdentRefPointer"> Text analysis rule must specify at least target type class or target identity.</assert> </rule> </pattern> <pattern> <title>Provenance standoff markup</title> <rule context="its:provenanceRecord"> <assert test="@person | @personRef | @org | @orgRef | @tool | @toolRef | @revPerson | @revPersonRef | @revOrg | @revOrgRef | @revTool | @revToolRef | @provRef"> At least one attribute must be specified on the provenanceRecord element.</assert> </rule> </pattern> </schema></pre></div>[Source file: <a href="schemas/its20.sch">schemas/its20.sch</a>]</div><div class="note">Note:In order to make it easy to integrate ITS markup into schemas based on W3C XML Schema language the following informative schemas are provided:<ul><li> <a href="schemas/its20.xsd">its20.xsd</a> – base schema for ITS</li><li> <a href="schemas/its20-types.xsd">its20-types.xsd</a> – schema defining datatypes used in ITS markup</li></ul>Please note that W3C XML Schema is less expressive then RELAX NG and some content models are more loose. A document can validate against W3C XML Schema while it is not conforming to ITS specification and it is not valid according to RELAX NG schema.</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="informative-references" id="informative-references"></a>E Informative References</h2> This section is informative. <dl><dt class="label"><a name="bidiarticle" id="bidiarticle"/>Bidi Article</dt><dd>Richard Ishida. <a href="https://www.w3.org/International/articles/inline-bidi-markup/"><cite>What you need to know about the bidi algorithm and inline markup</cite></a>. Article of the <a href="https://www.w3.org/International/">W3C Internationalization Activity</a>, June 2005.</dd><dt class="label"><a name="charmod-norm" id="charmod-norm"/>Charmod Norm</dt><dd>Yergeau, François, Martin J. Dürst, Richard Ishida, Addison Phillips, Misha Wolf, Tex Texin. <a href="https://www.w3.org/TR/2012/WD-charmod-norm-20120501/"><cite>Character Model for the World Wide Web 1.0: Normalization</cite></a>. W3C Working Draft 1 May 2012. Available at <a href="https://www.w3.org/TR/2012/WD-charmod-norm-20120501/">http://www.w3.org/TR/2012/WD-charmod-norm-20120501/</a>. The latest version of <a href="https://www.w3.org/TR/charmod-norm/">Charmod Norm</a> is available at http://www.w3.org/TR/charmod-norm/ .</dd><dt class="label"><a name="checkmate" id="checkmate"/>CheckMate Quality Check</dt><dd>Okapi Project. <a href="http://www.opentag.com/okapi/wiki/index.php?title=CheckMate_-_Quality_Check_Configuration"><cite>CheckMate – Quality Check Configuration</cite></a>. Available at <a href="http://www.opentag.com/okapi/wiki/index.php?title=CheckMate_-_Quality_Check_Configuration">http://www.opentag.com/okapi/wiki/index.php?title=CheckMate_-_Quality_Check_Configuration</a>.</dd><dt class="label"><a name="css2-1" id="css2-1"/>CSS 2.1</dt><dd> Bert Bos, Tantek Çelik, Ian Hickson Håkon Wium Lie. <a href="https://www.w3.org/TR/2011/REC-CSS2-20110607/"><cite>Cascading Style Sheets, level 2 revision 1 CSS 2.1 Specification</cite></a>. W3C Recommendation 7 June 2011. Available at <a href="https://www.w3.org/TR/2011/REC-CSS2-20110607/"> http://www.w3.org/TR/2011/REC-CSS2-20110607/</a>. The latest version of <a href="https://www.w3.org/TR/CSS21/">CSS2</a> is available at http://www.w3.org/TR/CSS21/.</dd><dt class="label"><a name="dbpedia" id="dbpedia"/>DBpedia</dt><dd> <cite>DBpedia</cite>. Available at: <a href="http://dbpedia.org/OnlineAccess">http://dbpedia.org/OnlineAccess</a>.</dd><dt class="label"><a name="dita10" id="dita10"/>DITA 1.0</dt><dd>Michael Priestley, JoAnn Hackos, et. al., editors. <a href="https://www.oasis-open.org/committees/download.php/15316/dita10.zip"><cite>OASIS Darwin Information Typing Architecture (DITA) Language Specification v1.0</cite></a>. OASIS Standard 9 May 2005. Available at <a href="https://www.oasis-open.org/committees/download.php/15316/dita10.zip"> https://www.oasis-open.org/committees/download.php/15316/dita10.zip</a>.</dd><dt class="label"><a name="docbook" id="docbook"/>DocBook</dt><dd>Norman Walsh and Leonard Muellner. <a href="http://www.docbook.org/"><cite>DocBook: The Definitive Guide</cite></a>. Available at <a href="http://www.docbook.org/"> http://www.docbook.org/</a>.</dd><dt class="label"><a name="geo-i18n-l10n" id="geo-i18n-l10n"/>l10n i18n</dt><dd>Richard Ishida, Susan Miller. <a href="https://www.w3.org/International/questions/qa-i18n"><cite>Localization vs. Internationalization</cite></a>. Article of the <a href="https://www.w3.org/International/">W3C Internationalization Activity</a>, January 2006.</dd><dt class="label"><a name="iso30042" id="iso30042"/>ISO 30042</dt><dd>(International Organization for Standardization). <cite>TermBase eXchange (TBX)</cite>. [Geneva]: International Organization for Standardization, 2008.</dd><dt class="label"><a name="isots11669" id="isots11669"/>ISO/TS 11669:2002</dt><dd>(International Organization for Standardization). <cite>Translation projects – General guidance</cite>. [Geneva]: International Organization for Standardization, 2012.</dd><dt class="label"><a name="its10" id="its10"/>ITS 1.0</dt><dd>Christian Lieske and Felix Sasaki. <a href="https://www.w3.org/TR/2007/REC-its-20070403/"><cite> Internationalization Tag Set (ITS) Version 1.0 </cite></a>. W3C Recommendation 03 April 2007. Available at <a href="https://www.w3.org/TR/2007/REC-its-20070403/">http://www.w3.org/TR/2007/REC-its-20070403/</a>. The latest version of <a href="https://www.w3.org/TR/its/">ITS 1.0</a> is available at  http://www.w3.org/TR/its/.</dd><dt class="label"><a name="its-rdf-ontology" id="its-rdf-ontology"/>ITS RDF</dt><dd> <a href="https://www.w3.org/2005/11/its/rdf#"><cite>ITS RDF Ontology</cite></a>, version May 2013. Available at http://www.w3.org/2005/11/its/rdf# .</dd><dt class="label"><a name="itsreq" id="itsreq"/>ITS REQ</dt><dd>Yves Savourel. <a href="https://www.w3.org/TR/2006/WD-itsreq-20060518/"><cite>Internationalization and Localization Markup Requirements</cite></a>. W3C Working Draft 18 May 2006. Available at <a href="https://www.w3.org/TR/2006/WD-itsreq-20060518/"> http://www.w3.org/TR/2006/WD-itsreq-20060518/</a>. The latest version of <a href="https://www.w3.org/TR/itsreq/">ITS REQ</a> is available at http://www.w3.org/TR/itsreq/.</dd><dt class="label"><a name="reqlocdtd" id="reqlocdtd"/>Localizable DTDs</dt><dd>Richard Ishida, Yves Savourel <a href="http://people.w3.org/rishida/localizable-dtds/"><cite>Requirements for Localizable DTD Design</cite></a>. Working Draft 7 July 2003. Available at <a href="http://people.w3.org/rishida/localizable-dtds/">http://people.w3.org/rishida/localizable-dtds/</a>. </dd><dt class="label"><a name="microdata" id="microdata"/>Microdata</dt><dd>Ian Hickson <a href="https://www.w3.org/TR/microdata/"><cite>HTML Microdata</cite></a>. W3C Working Draft 25 October 2012. Available at <a href="https://www.w3.org/TR/2012/WD-microdata-20121025/">http://www.w3.org/TR/2012/WD-microdata-20121025/</a>. </dd><dt class="label"><a name="mlw-metadata-us-impl" id="mlw-metadata-us-impl"/>MLW US IMPL</dt><dd>Christian Lieske (ed.). <a href="https://www.w3.org/TR/2013/WD-mlw-metadata-us-impl-20130307/"><cite>Metadata for the Multilingual Web - Usage Scenarios and Implementations </cite></a>. W3C Working Draft 7 March 2013. Available at <a href="https://www.w3.org/TR/2013/WD-mlw-metadata-us-impl-20130307/">http://www.w3.org/TR/2013/WD-mlw-metadata-us-impl-20130307/</a>. The latest version of <a href="https://www.w3.org/TR/mlw-metadata-us-impl/">MLW Metadata US IMPL</a> is available at http://www.w3.org/TR/mlw-metadata-us-impl/ .</dd><dt class="label"><a name="mqm" id="mqm"/>Multidimensional Quality Metrics</dt><dd>Lommel, Arle. <cite>Useful Quality Metrics (for Humans, Not Researchers)</cite>. Presentation at the Workshop on UserCentric Machine Translation & Evaluation, <a href="http://www.mtsummit2013.info/workshops.asp">MT Summit 2013</a>.</dd><dt class="label"><a name="nerd" id="nerd"/>NERD</dt><dd> <cite>Named Entity Recognition and Disambiguation ontology (NERD)</cite>. available at: <a href="http://nerd.eurecom.fr/ontology">http://nerd.eurecom.fr/ontology</a> </dd><dt class="label"><a name="nif-reference" id="nif-reference"/>NIF</dt><dd>Hellmann, S. et al. (ed.). <a href="http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#"><cite>NIF 2.0 Core Ontology</cite></a>, as of August 2013. Available at <a href="http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#">http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#</a> under CC-BY 3.0 license maintained by the <a href="http://nlp2rdf.org">NLP2RDF project</a>.</dd><dt class="label"><a name="nvdl" id="nvdl"/>NVDL</dt><dd>Information technology – Document Schema Definition Languages (DSDL) – Part 4: <cite>Namespace-based Validation Dispatching Language (NVDL)</cite>. International Organization for Standardization (ISO) ISO/IEC 19757-4:2003.</dd><dt class="label"><a name="opendocument" id="opendocument"/>OpenDocument</dt><dd>Michael Brauer et al. <a href="https://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office"><cite>OASIS Open Document Format for Office Applications (OpenDocument).</cite></a>. Oasis Standard 1 May 2005. Available at <a href="https://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office"> https://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office</a>. The latest version of <a href="https://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office"> OpenDocument</a> is available at https://www.oasis-open.org/committees/tc_home.php?wg_abbrev=office.</dd><dt class="label"><a name="prov-dm" id="prov-dm"/>PROV-DM</dt><dd>Moreau, Luc and Paolo Missier (eds.). <a href="https://www.w3.org/TR/2013/REC-prov-dm-20130430/"><cite>Provenance data model</cite></a>. W3C Recommendation 30 April 2013. Available at <a href="https://www.w3.org/TR/2013/REC-prov-dm-20130430/">http://www.w3.org/TR/2013/REC-prov-dm-20130430/</a>. The latest version of <a href="https://www.w3.org/TR/prov-dm/">The PROV Data Model</a> is available at http://www.w3.org/TR/prov-dm/. </dd><dt class="label"><a name="rdfa-lite" id="rdfa-lite"/>RDFaLite</dt><dd>Manu Sporny (ed.). <a href="https://www.w3.org/TR/rdfa-lite/"><cite>RDFa Lite 1.1</cite></a>. W3C Recommendation 07 June 2012. Available at <a href="https://www.w3.org/TR/2012/REC-rdfa-lite-20120607/">http://www.w3.org/TR/2012/REC-rdfa-lite-20120607/</a>. </dd><dt class="label"><a name="schematron" id="schematron"/>Schematron</dt><dd>Information technology – Document Schema Definition Languages (DSDL) – Part 3: <cite>Rule-based validation – Schematron</cite>. International Organization for Standardization (ISO) ISO/IEC 19757-3:2003.</dd><dt class="label"><a name="structuredspecs" id="structuredspecs"/>Structured Specifications</dt><dd>(BYU Translation Research Group). <cite>Structured Specifications and Translation Parameters</cite>. Available at <a href="http://www.ttt.org/specs/">http://www.ttt.org/specs</a>.</dd><dt class="label"><a name="tei" id="tei"/>TEI</dt><dd>Lou Burnard and Syd Bauman (eds.) <a href="http://www.tei-c.org/Guidelines/P5/"><cite>Text Encoding Initiative Guidelines development version (P5)</cite></a>. TEI Consortium, Charlottesville, Virginia, USA, Text Encoding Initiative.</dd><dt class="label"><a name="wordnet" id="wordnet"/>WordNet</dt><dd> <cite>WordNet</cite>. Princeton University, 2010. Available at: <a href="http://wordnet.princeton.edu">http://wordnet.princeton.edu</a>.</dd><dt class="label"><a name="xhtml10" id="xhtml10"/>XHTML 1.0</dt><dd>Steven Pemberton et al. <a href="https://www.w3.org/TR/2002/REC-xhtml1-20020801/"><cite>XHTML™ 1.0 The Extensible HyperText Markup Language (Second Edition)</cite></a>. W3C Recommendation 26 January 2000, revised 1 August 2002. Available at <a href="https://www.w3.org/TR/2002/REC-xhtml1-20020801/"> http://www.w3.org/TR/2002/REC-xhtml1-20020801/</a>. The latest version of <a href="https://www.w3.org/TR/xhtml1/">XHTML 1.0</a> is available at http://www.w3.org/TR/xhtml1/.</dd><dt class="label"><a name="xliff1.2" id="xliff1.2"/>XLIFF 1.2</dt><dd>Savourel, Yves, John Reid, Tony Jewtushenko and Rodolfo M. Raya. <a href="http://docs.oasis-open.org/xliff/v1.2/os/xliff-core.html"><cite>XLIFF Version 1.2</cite></a>. OASIS Standard 1 February 2008. Available at <a href="http://docs.oasis-open.org/xliff/v1.2/os/xliff-core.html">http://docs.oasis-open.org/xliff/v1.2/os/xliff-core.html</a>.</dd><dt class="label"><a name="xliff2.0" id="xliff2.0"/>XLIFF 2.0</dt><dd>Comerford, Tom, David Filip, Rodolfo M. Raya and Yves Savourel. <a href="http://docs.oasis-open.org/xliff/xliff-core/v2.0/csprd01/xliff-core-v2.0-csprd01.html"><cite>XLIFF Version 2.0</cite></a>. Committee Specification Draft 01 / Public Review Draft 01. Available at <a href="http://docs.oasis-open.org/xliff/xliff-core/v2.0/csprd01/xliff-core-v2.0-csprd01.html">http://docs.oasis-open.org/xliff/xliff-core/v2.0/csprd01/xliff-core-v2.0-csprd01.html</a>. The latest version of <a href="http://docs.oasis-open.org/xliff/xliff-core/v2.0/xliff-core-v2.0.html">XLIFF 2.0</a> is available at http://docs.oasis-open.org/xliff/xliff-core/v2.0/xliff-core-v2.0.html</dd><dt class="label"><a name="xml-i18n-bp" id="xml-i18n-bp"/>XML i18n BP</dt><dd>Yves Savourel, Jirka Kosek, Richard Ishida. <a href="https://www.w3.org/TR/2008/NOTE-xml-i18n-bp-20080213/"><cite>Best Practices for XML Internationalization</cite></a>. Available at <a href="https://www.w3.org/TR/2008/NOTE-xml-i18n-bp-20080213/">http://www.w3.org/TR/2008/NOTE-xml-i18n-bp-20080213/</a>. The latest version of <a href="https://www.w3.org/TR/xml-i18n-bp/">xml-i18n-bp</a> is available at http://www.w3.org/TR/xml-i18n-bp/.</dd><dt class="label"><a name="xmlspecbib" id="xmlspecbib"/>XMLSPEC</dt><dd> <a href="https://www.w3.org/2002/xmlspec/"><cite>The XML Spec Schema and Stylesheets</cite></a>. Available at <a href="https://www.w3.org/2002/xmlspec/"> http://www.w3.org/2002/xmlspec/</a>.</dd><dt class="label"><a name="xslt10" id="xslt10"/>XSLT 1.0</dt><dd> James Clark. <a href="https://www.w3.org/TR/1999/REC-xslt-19991116"><cite>XSL Transformations (XSLT) Version 1.0</cite></a>. W3C Recommendation 16 November 1999. Available at <a href="https://www.w3.org/TR/1999/REC-xslt-19991116"> http://www.w3.org/TR/1999/REC-xslt-19991116</a>. The latest version of <a href="https://www.w3.org/TR/xslt">XSLT 1.0</a> is available at http://www.w3.org/TR/xslt.</dd><dt class="label"><a name="xul" id="xul"/>XUL</dt><dd> <a href="https://developer.mozilla.org/en-US/docs/XUL"><cite>exTensible User Interface Language</cite></a>. Available at <a href="https://developer.mozilla.org/en-US/docs/XUL">https://developer.mozilla.org/en-US/docs/XUL</a>.</dd></dl></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="conversion-to-nif" id="conversion-to-nif"></a>F Conversion to NIF</h2> This section is informative. This section provides an informative algorithm to convert XML or HTML documents (or their DOM representations) that contain ITS metadata to the RDF format based on <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a>. The conversion results in RDF triples.<div class="note">Note:The algorithm creates URIs that in the query part contain the characters "[" and "]", as part of XPath expressions. In the conversion output (see an <a href="examples/nif/EX-nif-conversion-output.ttl">example</a>), The URIs are escaped as "%5B" and "%5D". For readability the URIs shown in this section do not escape these characters.</div><div class="note">Note:The algorithm is intended to extract the text from the XML/HTML/DOM for an NLP tool. It can produce a lot of "phantom" predicates from excessive whitespace, which 1) increases the size of the intermediate mapping and 2) extracts this whitespace as text, and therefore might decrease NLP performance. It is strongly recommended to normalize whitespace in the input XML/HTML/DOM in order to minimize such phantom predicates. A normalized example is given below. The whitespace normalization algorithm itself is format dependent (for example, it differs for HTML compared to general XML).</div><div class="note">Note:The output of the algorithm shown below uses the ITS RDF ontology <a title="ITS RDF Ontology" href="#its-rdf-ontology">[ITS RDF]</a> and its namespace <a href="https://www.w3.org/2005/11/its/rdf#">http://www.w3.org/2005/11/its/rdf#</a> Like the algorithm, this ontology is not a normative part of the ITS 2.0 specification and is being discussed in the <a href="https://www.w3.org/International/its/wiki/ITS-RDF_mapping">ITS Interest Group</a>.</div><div class="exampleOuter"><div class="exampleHeader"><a name="EX-HTML-whitespace-normalization" id="EX-HTML-whitespace-normalization"></a>Example 97: Example (see <a href="examples/html5/EX-HTML-whitespace-normalization.html">source code</a>) of an HTML document with whitespace character normalization as preparation for the conversion to NIF. Note that text nodes in the <code>head</code> element are not taken into account.</div><div class="exampleInner"><pre><!DOCTYPE html><html xmlns="http://www.w3.org/1999/xhtml"> <head><meta http-equiv="Content-Type" content="text/html;charset=utf-8" > <title>NIF conversion example</title></head> <body><h2 translate="yes">Welcome to <span its-ta-ident-ref="http://dbpedia.org/resource/Dublin" its-within-text="yes" translate="no">Dublin in <b translate="no" its-within-text="yes">Ireland!</h2></body></html> </pre></div></div>The conversion algorithm to generate NIF consists of seven steps:<ul><li>STEP 1: Get an ordered list of all text nodes of the document.</li><li>STEP 2: Generate an XPath expression for each non-empty text node of all leaf elements and memorize them.</li><li>STEP 3: Get the text for each text node and make a tuple with the corresponding XPath expression (X,T). Since the text nodes have a certain order we now have a list of ordered tuples ((x0,t0), (x1,t1), ..., (xn,tn)).</li><li>STEP 4 (optional): Serialize as XML or as RDF. The list with the XPath-to-text mapping can also be kept in memory. Part of a serialization example is given below. The upper part is in RDF Turtle Syntax while the lower part is in XML (the <code>mappings</code> element).</li></ul><div class="exampleInner"><div class="exampleOuter"><pre># Turtle example: @prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> . @prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> . <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=b0,e0> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=x0> . <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=b1,e1> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=x1> . # ... <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=bn,en> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=xn> .  <mappings> <mapping x="xpath(x0)" b="b0" e="e0" /> <mapping x="xpath(x1)" b="b1" e="e1" />  <mapping x="xpath(xn)" b="bn" e="en" /> </mappings> </pre></div></div>where<div class="exampleInner"><div class="exampleOuter"><pre>b0 = 0 e0 = b0 + (Number of characters of t0) b1 = e0 e1 = b1 + (Number of characters of t1) ... bn = e(n-1) en = bn + (Number of characters of tn) </pre></div></div>Example (continued)<div class="exampleInner"><div class="exampleOuter"><pre># Turtle example: @prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> . @prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> . # "Welcome to " <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,11> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/text()[1]>. # "Dublin" <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=11,17> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/span[1]/text()[1]>. # " in " <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=17,21> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/text()[2]> . # "Ireland" <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=21,28> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/b[1]/text()[1]> . # "!" <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=28,29> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/text()[3]> . # "Welcome to Dublin Ireland!" <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,29> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/text()> .  <mappings> <mapping x="xpath(/html/body[1]/h2[1]/text()[1])" b="0" e="11" /> <mapping x="xpath(/html/body[1]/h2[1]/span[1]/text()[1])" b="11" e="17" /> <mapping x="xpath(/html/body[1]/h2[1]/text()[2])" b="17" e="21" /> <mapping x="xpath(/html/body[1]/h2[1]/b[1]/text()[1])" b="21" e="28" /> <mapping x="xpath(/html/body[1]/h2[1]/text()[3])" b="28" e="29" /> <mapping x="xpath(/html/body[1]/h2[1])" b="0" e="29" /> </mappings></pre></div></div><ul><li>STEP 5: Create a context URI and attach the whole concatenated text <code>$(t0+t1+t2+...+tn)</code> of the document as reference.</li><li>STEP 6: Attach any ITS metadata annotations from the XML/HTML/DOM input to the respective NIF URIs.</li><li>STEP 7: Omit all URIs that do not carry annotations (to avoid bloating the data).</li></ul><div class="exampleInner"><div class="exampleOuter"><pre>@prefix itsrdf: <http://www.w3.org/2005/11/its/rdf#> . @prefix nif: <http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core#> <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,29> rdf:type nif:Context ; rdf:type nif:RFC5147String ; # concatenate the whole text nif:isString "$(t0+t1+t2+...+tn)" ; nif:beginIndex "0" ; nif:endIndex "29" ; itsrdf:translate "yes"; nif:sourceUrl <http://example.com/doc.html> . <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=11,17> rdf:type nif:RFC5147String ; nif:beginIndex "11" ; nif:endIndex "17" ; itsrdf:translate "no"; itsrdf:taIdentRef <http://dbpedia.org/resource/Dublin> ; nif:referenceContext <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,29> . <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=21,28> rdf:type nif:RFC5147String ; nif:beginIndex "21" ; nif:endIndex "28" ; itsrdf:translate "no"; nif:referenceContext <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,29> . </pre></div></div>A complete sample output in RDF/XML format after step 7, given the input document <a href="#EX-HTML-whitespace-normalization">Example 97</a>, is available at <a href="examples/nif/EX-nif-conversion-output.ttl">examples/nif/EX-nif-conversion-output.ttl</a>.<div class="note">Note:The conversion to NIF is a possible basis for a natural language processing (NLP) application that creates, for example, named entity annotations. A non-normative algorithm to integrate these annotations into the original input document is given in <a class="section-ref" href="#nif-backconversion">Appendix G: Conversion NIF2ITS</a>. Many decisions to be made in this algorithm depend on the particular NLP application being used.</div><div class="note">Note:NIF allows an URL for a String resource to be referenced as URIs that are fragments of the original document in the form: <code>http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,11</code> or <code>http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/text()[1]</code> This offers a convenient mechanism for linking NIF resources in RDF back to the original document. The <a href="http://persistence.uni-leipzig.org/nlp2rdf/specification/api.html">NIF Web Service Access Specification</a> defines the parameters for NIF web services.RDF treats URIs as opaque and does not impose any semantic constraints on the used fragment identifiers, thus enabling their usage in RDF in a consistent manner. However, fragment identifiers get interpreted according to the retrieved mime type, if a retrieval action occurs as is the case in Linked Data. The char fragment is defined currently only for text/plain while the xpath fragment is not defined for HTML. Therefore this URL recipe does fulfil the ITS requirements to support both XML and HTML and the aim of this mapping to produce resources adhering to the Linked Data principle of dereferenceablility. The future definition and registration of these fragment types, while a potentially attractive feature, is beyond the scope of this specification.</div></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="nif-backconversion" id="nif-backconversion"></a>G Conversion NIF2ITS</h2> This section is informative. The following algorithm relies on <a href="#EX-HTML-whitespace-normalization">Example 97</a>. It is assumed that the example has been converted to NIF, leading to the <a href="examples/nif/EX-nif-conversion-output.ttl">output</a> exemplified for the <a href="#its2nif-algorithm">ITS2NIF conversion algorithm</a>.This example uses <a href="https://github.com/dbpedia-spotlight/dbpedia-spotlight">DBpedia Spotlight</a> as an example natural language processing (NLP) tool. In it, DBpedia Spotlight linked "Ireland" to DBpedia:<div class="exampleInner"><div class="exampleOuter"><pre><http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=21,28> rdf:type nif:RFC5147String; itsrdf:taIdentRef <http://dbpedia.org/resource/Ireland> . <http://dbpedia.org/resource/Ireland> rdf:type <http:/nerd.eurecom.fr/ontology#Country> .</pre></div></div>The conversion algorithm to generate ITS out of NIF consists of two steps:<ul><li>STEP 1: NIF Web services accept two different types of input. It is possible to either send the extracted text (the object of the <code>nif:isString</code> property) directly or NIF RDF to the NLP tool, i.e. the text is sent as a <code>nif:Context</code> node and included as <code>nif:isString</code>. Either way, the output of the Web service will be a NIF representation. Accepting text will be the minimal requirement of a NIF web service. Ideally, you would be able to send the <code>nif:Context</code> node with the isString as RDF directly, which has the advantage, that all other annotations can be used by the NLP tool:<div class="exampleInner"><div class="exampleOuter"><pre><http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,29> rdf:type nif:RFC5147String ; rdf:type nif:Context ; nif:beginIndex "0" ; nif:endIndex "29" ; nif:isString "Welcome to Dublin in Ireland!" .</pre></div></div></li><li>STEP 2: Use the mapping from ITS2NIF (available after <a href="#its2nif-algorithm-step7">step 7</a> of the ITS2NIF algorithm) to reintegrate annotations in the original ITS annotated document.</li></ul>For step 2, three cases can occur.CASE 1: The NLP annotation created in NIF matches the text node. Solution: Attach the annotation to the parent element of the text node.<div class="exampleInner"><div class="exampleOuter"><pre># Based on: <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=21,28> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/b[1]/text()[1]> . # and: <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=21,28> itsrdf:taIdentRef <http://dbpedia.org/resource/Ireland> . # we can attach the metadata to the parent node: Ireland </pre></div></div>CASE 2: The NLP annotation created in NIF is a substring of the text node. Solution: Create a new element, e.g., for HTML "span". A different input example is given below as case 2 is not covered in the original example input.<div class="exampleInner"><div class="exampleOuter"><pre># Input: <html> <body> <h2>Welcome to Dublin in Ireland!</h2> </body> </html> # ITS2NIF <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=0,29> nif:wasConvertedFrom <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&xpath=/html/body[1]/h2[1]/text()[1]> . # DBpedia Spotlight returns: <http://example.com/myitsservice?informat=html&intype=url&input=http://example.com/doc.html&char=21,28> itsrdf:taIdentRef <http://dbpedia.org/resource/Ireland> . # NIF2ITS <html> <body> <h2>Welcome to Dublin in Ireland!</h2> </body> </html></pre></div></div>Case 3: The NLP annotation created in NIF starts in one region and ends in another. Solution: No straight mapping is possible; a mapping can be created if both regions have the same parent.</div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="localization-quality-guidance" id="localization-quality-guidance"></a>H Localization Quality Guidance</h2> This section is informative. The <a href="#lqissue">Localization Quality Issue</a> data category description uses the following terms as defined below for the purposes of this document.<ul><li>Quality assessment. The task of evaluating the quality of translated content to determine its quality and to assign a value to it. Localization quality assessment is commonly conducted by identifying, categorizing, and counting issues in the translated content.</li><li>Issue. A quality issue is a potential error detected in content. Issues may be detected automatically (e.g., by using a grammar checker or translation-specific tool) or manually, by human checking of content. Issues may or may not be errors (e.g., an apparent mistranslation may be deliberate and appropriate in some contexts) and should be confirmed by review.</li><li>Metric. A metric is a formal system used in quality assessment tasks to identify issues, evaluate them, and determine quality. Metrics provide specific reference points for categorizing issues (as opposed to subjective assessment of quality, which does not use a metric) and may include weights for issues.</li><li>Model. A model is the underlying description of the system that underlies a metric. (For example, some models may allow variable weights to be assigned to different issue types, in which case the specific metric used for a task will have these weights defined, even though the underlying model does not.)</li><li>Profile. A quality profile is the adaptation of a model to specific requirements. It specifies specific conditions for using a model. It may include instructions and other guidelines that are not included in the actual metric used. If a model allows for no customization, it has a single profile that is identical to the model; if it allows customization, each customization is a distinct profile.</li><li>Review. The task of examining a text to identify any issues that occur in it. Review may be tied to the task of fixing any issues, a task generally referred to as revision.</li><li>Specifications. Specifications (sometimes called a translation brief) are a description of the various expectations and requirements for a translation task. These may include statements about the type of translation expected, guidance on terminology to be used, information about audience, and so forth. Translation specifications are described in detail in ISO/TS-11669.</li><li>Tool. As used here, a tool is software that generates localization quality markup. Tools may be fully automatic (e.g., a tool that identifies potential issues with terminology and grammar and marks them without human intervention) or may required human input (e.g., a system that allows users to highlight spans of text and mark them with appropriate issues).</li></ul>For more information on setting translation project specifications and determining quality expectations, implementers are encouraged to consult the ISO standard definition of translation project specifications included in <a title="Translation projects – General guidance" href="#isots11669">[ISO/TS 11669:2002]</a>. Details about translation specifications are available at <a title="Structured Specifications and Translation Parameters" href="#structuredspecs">[Structured Specifications]</a>. While these documents do not directly address the definition of quality metrics, they provide useful guidance for implementers interested in determining which localization quality issue values should be used for specific scenarios.The issue types defined in Localization Quality Issue were derived from the QTLaunchPad project’s Multidimensional Quality Metrics (MQM) framework. Additional guidance on this project may be found at <a title="Useful Quality Metrics (for Humans, Not Researchers)" href="#mqm">[Multidimensional Quality Metrics]</a>.The topic of localization quality is rapidly evolving and ITS 2.0 represents the first step in standardizing this area and will serve for basic interoperability needs. For situations requiring additional expressive capability or categories, further custom markup may be required.</div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="list-of-elements-and-attributes" id="list-of-elements-and-attributes"></a>I List of ITS 2.0 Global Elements and Local Attributes</h2> This section is informative. The following table lists global ITS 2.0 elements inside <code class="its-elem-markup">rules</code> element and local ITS 2.0 markup in XML and HTML. Note that for the local markup there are various constraints on what local attributes can be used together. Here these constraints are expressed via occurrence indicators: optional "?", alternatives "|", or groups "(...)". Please check the related sub sections in <a class="section-ref" href="#datacategory-description">Section 8: Description of Data Categories</a> defining local markup normatively.In addition to below markup, ITS 2.0 provides a means to refer to the tools used to generate the markup: for XML the <code class="its-attr-markup">annotatorsRef</code> attribute and for HTML the <code class="its-attr-markup">annotators-ref</code> attribute. See <a class="section-ref" href="#its-tool-annotation">Section 5.7: ITS Tools Annotation</a> for details, especially the <a href="#annotators-ref-usage-scenarios">note on annotatorsRef usage scenarios</a>.<a name="its20-elements-and-attributes" id="its20-elements-and-attributes"></a><table border="1" width="100%"><thead><tr><td>Data category</td><td>Global element inside <code class="its-elem-markup">rules</code> element</td><td>Local XML attributes in ITS namespace</td><td>HTML attributes</td></tr></thead><tbody><tr><td> <a href="#trans-datacat">Translate</a> </td><td> <code class="its-elem-markup">translateRule</code> </td><td> <code class="its-attr-markup">translate</code> </td><td> <code class="its-attr-markup">translate</code> </td></tr><tr><td> <a href="#locNote-datacat">Localization Note</a> </td><td> <code class="its-elem-markup">locNoteRule</code> </td><td>(<code class="its-attr-markup">locNote</code> | <code class="its-attr-markup">locNoteRef</code>), <code class="its-attr-markup">locNoteType</code>?</td><td>(<code class="its-attr-markup">its-loc-note</code> | <code class="its-attr-markup">its-loc-note-ref</code>), <code class="its-attr-markup">its-loc-note-type</code>?</td></tr><tr><td> <a href="#terminology">Terminology</a> </td><td> <code class="its-elem-markup">termRule</code> </td><td> <code class="its-attr-markup">term</code>, <code class="its-attr-markup">termInfoRef</code>?, <code class="its-attr-markup">termConfidence</code>?</td><td> <code class="its-attr-markup">its-term</code>, <code class="its-attr-markup">its-term-info-ref</code>?, <code class="its-attr-markup">its-term-confidence</code>?</td></tr><tr><td> <a href="#directionality">Directionality</a> </td><td> <code class="its-elem-markup">dirRule</code> </td><td> <code class="its-attr-markup">dir</code> </td><td> <code class="its-attr-markup">dir</code> </td></tr><tr><td> <a href="#language-information">Language Information</a> </td><td> <code class="its-elem-markup">langRule</code> </td><td> <code class="its-attr-markup">xml:lang</code> </td><td> <code class="its-attr-markup">lang</code> </td></tr><tr><td> <a href="#elements-within-text">Elements Within Text</a> </td><td> <code class="its-elem-markup">withinTextRule</code> </td><td> <code class="its-attr-markup">withinText</code> </td><td> <code class="its-attr-markup">its-within-text</code> </td></tr><tr><td> <a href="#domain">Domain</a> </td><td> <code class="its-elem-markup">domainRule</code> </td><td>-</td><td>-</td></tr><tr><td> <a href="#textanalysis">Text Analysis</a> </td><td> <code class="its-elem-markup">textAnalysisRule</code> </td><td> <code class="its-attr-markup">taConfidence</code>?, at least one of (<code class="its-attr-markup">taClassRef</code>, ((<code class="its-attr-markup">taSource</code>, <code class="its-attr-markup">taIdent</code>) | <code class="its-attr-markup">taIdentRef</code>))</td><td> <code class="its-attr-markup">its-ta-confidence</code>?, at least one of (<code class="its-attr-markup">its-ta-class-ref</code>, ((<code class="its-attr-markup">its-ta-source</code>, <code class="its-attr-markup">its-ta-ident</code>) | <code class="its-attr-markup">its-ta-ident-ref</code>))</td></tr><tr><td> <a href="#LocaleFilter">Locale Filter</a> </td><td> <code class="its-elem-markup">localeFilterRule</code> </td><td> <code class="its-attr-markup">localeFilterList</code> </td><td> <code class="its-attr-markup">its-locale-filter-list</code> </td></tr><tr><td> <a href="#provenance">Provenance</a> </td><td> <code class="its-elem-markup">provRule</code> </td><td>(at least one of ((<code class="its-attr-markup">person</code> | <code class="its-attr-markup">personRef</code>), (<code class="its-attr-markup">org</code> | <code class="its-attr-markup">orgRef</code>), (<code class="its-attr-markup">tool</code> | <code class="its-attr-markup">toolRef</code>), (<code class="its-attr-markup">revPerson</code> | <code class="its-attr-markup">revPersonRef</code>), (<code class="its-attr-markup">revOrg</code> | <code class="its-attr-markup">revOrgRef</code>), (<code class="its-attr-markup">revTool</code> | <code class="its-attr-markup">revToolRef</code>), <code class="its-attr-markup">provRef</code>)) | <code class="its-attr-markup">provenanceRecordsRef</code> </td><td>(at least one of ((<code class="its-attr-markup">its-person</code> | <code class="its-attr-markup">its-person-ref</code>), (<code class="its-attr-markup">its-org</code> | <code class="its-attr-markup">its-org-ref</code>), (<code class="its-attr-markup">its-tool</code> | <code class="its-attr-markup">its-tool-ref</code>), (<code class="its-attr-markup">its-rev-person</code> | <code class="its-attr-markup">its-rev-person-ref</code>), (<code class="its-attr-markup">its-rev-org</code> | <code class="its-attr-markup">its-rev-org-ref</code>), (<code class="its-attr-markup">its-rev-tool</code> | <code class="its-attr-markup">its-rev-tool-ref</code>), <code class="its-attr-markup">its-prov-ref</code>)) | <code class="its-attr-markup">its-provenance-records-ref</code> </td></tr><tr><td> <a href="#externalresource">External Resource</a> </td><td> <code class="its-elem-markup">externalResourceRefRule</code> </td><td>-</td><td>-</td></tr><tr><td> <a href="#target-pointer">Target Pointer</a> </td><td> <code class="its-elem-markup">targetPointerRule</code> </td><td>-</td><td>-</td></tr><tr><td> <a href="#idvalue">ID Value</a> </td><td> <code class="its-elem-markup">idValueRule</code> </td><td> <code class="its-attr-markup">xml:id</code> </td><td> <code class="its-attr-markup">id</code> </td></tr><tr><td> <a href="#preservespace">Preserve Space</a> </td><td> <code class="its-elem-markup">preserveSpaceRule</code> </td><td> <code class="its-attr-markup">xml:space</code> </td><td>-</td></tr><tr><td> <a href="#lqissue">Localization Quality Issue</a> </td><td> <code class="its-elem-markup">locQualityIssueRule</code> </td><td>(at least one of (<code class="its-attr-markup">locQualityIssueType</code>, <code class="its-attr-markup">locQualityIssueComment</code>), <code class="its-attr-markup">locQualityIssueSeverity</code>?, <code class="its-attr-markup">locQualityIssueProfileRef</code>?, <code class="its-attr-markup">locQualityIssueEnabled</code>?) | <code class="its-attr-markup">locQualityIssuesRef</code> </td><td>(at least one of (<code class="its-attr-markup">its-loc-quality-issue-type</code>, <code class="its-attr-markup">its-loc-quality-issue-comment</code>), <code class="its-attr-markup">its-loc-quality-issue-severity</code>?, <code class="its-attr-markup">its-loc-quality-issue-profile-ref</code>?, <code class="its-attr-markup">its-loc-quality-issue-enabled</code>?) | <code class="its-attr-markup">its-loc-quality-issues-ref</code> </td></tr><tr><td> <a href="#lqrating">Localization Quality Rating</a> </td><td>-</td><td>(<code class="its-attr-markup">locQualityRatingScore</code>, <code class="its-attr-markup">locQualityRatingScoreThreshold</code>?) | (<code class="its-attr-markup">locQualityRatingVote</code>, <code class="its-attr-markup">locQualityRatingVoteThreshold</code>?), <code class="its-attr-markup">locQualityRatingProfileRef</code>?</td><td>(<code class="its-attr-markup">its-loc-quality-rating-score</code>, <code class="its-attr-markup">its-loc-quality-rating-score-threshold</code>?) | (<code class="its-attr-markup">its-loc-quality-rating-vote</code>, <code class="its-attr-markup">its-loc-quality-rating-vote-threshold</code>?), <code class="its-attr-markup">its-loc-quality-rating-profile-ref</code>?</td></tr><tr><td> <a href="#mtconfidence">MT Confidence</a> </td><td> <code class="its-elem-markup">mtConfidenceRule</code> </td><td> <code class="its-attr-markup">mtConfidence</code> </td><td> <code class="its-attr-markup">its-mt-confidence</code> </td></tr><tr><td> <a href="#allowedchars">Allowed Characters</a> </td><td> <code class="its-elem-markup">allowedCharactersRule</code> </td><td> <code class="its-attr-markup">allowedCharacters</code> </td><td> <code class="its-attr-markup">its-allowed-characters</code> </td></tr><tr><td> <a href="#storagesize">Storage Size</a> </td><td> <code class="its-elem-markup">storageSizeRule</code> </td><td> <code class="its-attr-markup">storageSize</code>, <code class="its-attr-markup">storageEncoding</code>?, <code class="its-attr-markup">lineBreakType</code>?</td><td> <code class="its-attr-markup">its-storage-size</code>, <code class="its-attr-markup">its-storage-encoding</code>?, <code class="its-attr-markup">its-line-break-type</code>?</td></tr></tbody></table></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="revisionlog" id="revisionlog"></a>J Revision Log</h2> This section is informative. The following log records major changes that have been made to this document since the <a href="https://www.w3.org/TR/2013/PR-its20-20130924/">ITS 2.0 Proposed Recommendation 24 September 2013</a>:<ol class="depth1"><li>In response to Working Group discussion and AC review, fixed an error in <a class="section-ref" href="#its-schemas">Appendix D: Schemas for ITS</a> and made the section informative.</li><li>Added an informative reference to <a title="Useful Quality Metrics (for Humans, Not Researchers)" href="#mqm">[Multidimensional Quality Metrics]</a> and reformatting of a few references.</li><li>Editorial fixes, see <a href="http://lists.w3.org/Archives/Public/public-i18n-its-ig/2013Oct/0021.html">related mail</a>.</li></ol></div><div class="div1"> <h2><a href="#contents"><img src="images/topOfPage.gif" align="right" height="26" width="26" title="Go to the table of contents." alt="Go to the table of contents."/></a><a name="acknowledgements" id="acknowledgements"></a>K Acknowledgements</h2>This document has been developed with contributions by the <a href="https://www.w3.org/International/multilingualweb/lt/">MultilingualWeb-LT Working Group</a> and collaborators: Mihael Arcan (DERI Galway at the National University of Ireland, Galway, Ireland), Pablo Badía (Linguaserve), Aaron Beaton (Opera Software), Renat Bikmatov (Logrus Plus LLC), Aljoscha Burchardt (German Research Center for Artificial Intelligence (DFKI GmbH)), Nicoletta Calzolari (CNR--Consiglio Nazionale delle Ricerche), Somnath Chandra (Department of Information Technology, Government of India), John Colosi (Verisign, Inc.), Mauricio del Olmo (Linguaserve), Giuseppe Deriard (Linguaserve), Pedro Luis Díez Orzas (Linguaserve), David Filip (University of Limerick), Leroy Finn (Trinity College Dublin), Karl Fritsche (Cocomore AG), Serge Gladkoff (Logrus Plus LLC), Tatiana Gornostay (Tilde), Daniel Grasmick (Lucy Software and Services GmbH), Declan Groves (Centre for Next Generation Localisation), Manuel Honegger (University of Limerick), Dominic Jones (Trinity College Dublin), Matthias Kandora (]init[), Milan Karásek (Moravia Worldwide), Jirka Kosek (University of Economics, Prague), Michael Kruppa (Cocomore AG), Alejandro Leiva (Cocomore AG), Swaran Lata (Department of Information Technology, Government of India), David Lewis (Trinity College Dublin), Fredrik Liden (ENLASO Corporation), Christian Lieske (SAP AG), Qun Liu (Centre for Next Generation Localisation), Arle Lommel (German Research Center for Artificial Intelligence (DFKI GmbH)), Priyanka Malik (Department of Information Technology, Government of India), Shaun McCance ((public) Invited expert), Sean Mooney (University of Limerick), Jan Nelson (Microsoft Corporation), Pablo Nieto Caride (Linguaserve), Pēteris Ņikiforovs (Tilde), Naoto Nishio (University of Limerick), Philip O'Duffy (University of Limerick), Des Oates (Adobe Systems Inc.), Georgios Petasis (Institute of Informatics & Telecommunications (IIT), NCSR), Mārcis Pinnis (Tilde), Prashant Verma Prashant (Department of Information Technology, Government of India), Georg Rehm (German Research Center for Artificial Intelligence (DFKI GmbH)), Phil Ritchie (VistaTEC), Thomas Rüdesheim (Lucy Software and Services GmbH), Nieves Sande (German Research Center for Artificial Intelligence (DFKI GmbH)), Felix Sasaki (DFKI / W3C Fellow), Yves Savourel (ENLASO Corporation), Jörg Schütz (W3C Invited Experts), Sebastian Sklarß (]init[), Ankit Srivastava (Centre for Next Generation Localisation), Tadej Štajner (Jozef Stefan Institute), Olaf-Michael Stefanov ((public) Invited expert), Najib Tounsi (Ecole Mohammadia d'Ingenieurs Rabat (EMI)), Naitik Tyagi Tyagi (Department of Information Technology, Government of India), Stephan Walter (Cocomore AG), Clemens Weins (Cocomore AG).A special thanks goes to the following persons: <ul><li>Sebastian Hellmann for introducing us to <a title="NIF 2.0 Core Ontology" href="#nif-reference">[NIF]</a> and for contributing to the creation of the <a href="https://www.w3.org/2005/11/its/rdf#">ITS 2.0 ontology</a> and NIF testing.</li><li>Daniel Naber for introducing us to <a href="http://languagetool.org">LanguageTool</a> and for implementing <a href="#lqissue-typevalues">Localization Quality Issue Type</a> functionality in language tool.</li></ul></div></div><script type="application/javascript" src="https://www.w3.org/scripts/TR/fixup.js"></script></body></html>