CINXE.COM
Display Problems?
<!doctype HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta http-equiv="Content-Language" content="en-us"> <title>Display Problems?</title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="description" content="Display Problems?"> <meta name="keywords" content="Display Problems"> <link rel="stylesheet" type="text/css" href="https://www.unicode.org/webscripts/standard_styles.css"> </head> <body> <table width="100%" cellpadding="0" cellspacing="0" border="0"> <tr> <td> <table width="100%" border="0" cellpadding="0" cellspacing="0"> <tr> <td class="icon" style="width:38px; height:35px"><a href="https://www.unicode.org/"><img border="0" src="https://www.unicode.org/webscripts/logo60s2.gif" align="middle" alt="[Unicode]" width="34" height="33"></a></td> <td class="icon" style="vertical-align:middle;"> <a class="bar" href="https://www.unicode.org/consortium/newcomer.html"><font size="3">General Information</font></a></td> <td class="bar"><a href="https://www.unicode.org/main.html" class="bar">Tech Site</a> | <a href="https://www.unicode.org/sitemap/" class="bar">Site Map</a> | <a href="https://www.unicode.org/search" class="bar">Search</a></td> </tr> </table> </td> </tr> <tr> <td class="gray"> </td> </tr> <!-- BEGIN CONTENTS --> <tr> <td> <table> <tr> <td class="contents" valign="top"> <blockquote> <h1>Display Problems?</h1> <p>During an early period in the history of the Unicode® Standard, when software products were starting to support Unicode text, it was often the case that products supported some Unicode characters and scripts but not others. This created problems for users. For instance, people who wanted to create Web content in different languages using Unicode characters couldn’t be certain that the browser used to read the content would be able to display it legibly. As a result, there was a broad need for tips on how to diagnose and solve display problems.</p> <p>Today, the situation is much better. Major operating systems and browsers have broad support for Unicode characters and scripts, and legible display of Unicode text is not the widespread problem that it was in early days.</p> <p>There are three kinds of text display problem that might still occur in modern software products:</p> <ul> <li><a href="#lack_font_support">Lack of font support for some characters</a></li> <li><a href="#incorrect_shaping">Incorrect shaping</a></li> <li><a href="#incorrect_characters">Incorrect characters or garbled text</a></li> </ul> <p>Other special considerations apply to the display of Unicode Emoji, but are not covered here. For more information regarding emoji, see <a href="https://www.unicode.org/faq/emoji_dingbats.html">FAQ: Emoji and Pictographs</a></p> <h2 id="lack_font_support">Lack of Font Support</h2> <p>Most operating systems include fonts that provide extensive coverage of Unicode characters, and most applications know how to make use of the system fonts. There may be gaps, however.</p> <p>When Unicode text is displayed but there is a lack of font support for some characters in the text, the typical symptom is appearance of special <em>character-not-supported</em> or “tofu” glyphs. (Font vendors often refer to such glyphs as “.notdef” glyphs.) Often, this will look like a white square box (like a piece of tofu), or a box containing a question mark or diagonals. Some applications generate a fallback glyph that shows the code point for the character.</p> <img src="https://www.unicode.org/img/notdef_glyphs.png" alt="Symbols indicating not supported characters"> <p>Other symbols might also be used. Sometimes, there might just be blank space.</p> <p>When this occurs, the underlying issue is most likely to be one of the following:</p> <ul> <li>The product might not yet have been updated to support characters added in the most recent versions of the Unicode Standard.</li> <li>An operating system might have font support, but an application running on that OS might have its own font selection or fallback logic that is not up to date with what’s available in the latest version of the OS.</li> <li>Due to limited storage (especially on mobile devices) or other such factors, a vendor might decide not to include font support for less-frequently-used characters.</li> </ul> <p>If you encounter this issue and have access to a font that does support the characters in the text, you may be able to work around the issue if the application provides a way for you to indicate that the text should be displayed with that font. In apps that support text editing, there will usually be a way to select the font used to display the text. In some cases, the app might not accept the font you select; if that happens, contact the app vendor for help.</p> <p>In apps that are not text editors, getting your custom font used might require tailoring of font fallback logic used by the app. That is not a commonly-available feature. Contact the vendor to see if that is possible, or to report the gap in font support in their app.</p> <p>If this issue occurs with Web content, it is likely that the content author has assumed that an appropriate font can be supplied by the browser or by the host OS the browser is running on. A better approach is for the content to use CSS Web fonts to control what fonts are used to display the content. Contact the content author to suggest that option.</p> <h2 id="incorrect_shaping">Incorrect Shaping</h2> <p>In some situations, text might display with recognizable characters of some script, but not with the expected glyph forms, or without correct positioning of marks. For example, within Arabic-script text, you might see a character that isn’t connecting to another character as expected. Or in an Indic-script text, you might see a conjunct form, but not the <em>expected</em> conjunct form.</p> <p>These symptoms can be due to one of three issues: incorrect encoding of text, a limitation or bug in software, or a limitation or bug in the font.</p> <h3>Incorrect Encoding of the Text</h3> <p>The content might not be using the appropriate Unicode characters for the text, or it might not be using appropriate character sequences to represent certain text elements. The text may look correct in some specific context (some specific software with a specific font), but is not represented in an interoperable way that would work as intended in other contexts.</p> <p>For example, if Arabic-script text contains characters from the Arabic Presentation Forms-A or Arabic Presentation Forms-B blocks, those characters would not display with different connecting forms in different word contexts. The characters in those blocks are for legacy or special-use purposes only and should not normally be used in Arabic-script text.</p> <p>Another common situation involves Indic scripts. Some characters, such as vowel letters, have an appearance that’s like a combination of other characters, but these are not considered equivalent in Unicode. For instance, U+0906 “आ” appears to be like a combination of U+0905 “अ” plus U+093E “ा”. However, that sequence is not equivalent and, in fact, is explicitly documented as not to be used. (See <a href="https://www.unicode.org/versions/Unicode15.0.0/ch12.pdf#G672982">Table 12-1, Devanagari Vowel Letters</a>.) Even so, some Devanagari-script content may incorrectly be using such sequences to represent the vowel letters. And some software or font implementations may intentionally be displaying the sequence with a different appearance from the vowel letter to avoid potential security issues.</p> <p>If you suspect the encoded representation used in the text is the problem, contact the content author.</p> <h3>Software Limitation or Bug</h3> <p>Many scripts have complex rendering behaviours that require specific support in a rendering or “shaping” engine. An app or operating system might be able to display a default form of each character in its logical order, but not have the special logic needed to correctly shape the text so that it appears as expected for that script. Symptoms can include the following:</p> <ul> <li>Character sequences are not displayed in the expected direction for that script (for example, left-to-right rather than right-to-left).</li> <li>Characters of a cursive-connecting script display with disconnected glyphs.</li> <li>Within syllable clusters, characters appear in the wrong order.</li> <li>Within syllable clusters, marks appear on the wrong base glyphs.</li> <li>Certain character sequences that are expected to display with a special form instead display with a different form or with the default glyphs for each character.</li> </ul> <p>These symptoms point to a lack of correct shaping support in software. There might also be font issues involved, as discussed below. If the same symptoms occur when using different fonts from different vendors, that even more strongly suggests a software issue.</p> <p>This could be a known limitation in the software: that version might not yet have shaping support for characters added in the most recent versions of the Unicode Standard, or the vendor might not yet have implemented support for that script. On the other hand, the vendor might have added support for the script but with proprietary logic that doesn’t follow Unicode specifications. Or, the software might simply have a bug.</p> <p>If you suspect a software limitation or bug is the cause, contact the software vendor.</p> <p>For particularly complex scripts, it’s also possible that the Unicode specifications for that script are incomplete. That could lead to different software implementations displaying the same character sequences in different ways, because there isn’t a complete specification for how certain text elements should be encoded, or how the encoded sequences should be displayed. If that’s the case, the Unicode Technical Committee can consider proposals to extend the specifications for that script.</p> <h3>Font Limitation or Bug</h3> <p>For scripts that have complex rendering behaviours, fonts need to be correctly implemented with certain layout data that determines what glyphs will be displayed and how they will be positioned. (This is in addition to software needing to have appropriate “shaping engine” support.) Typical symptoms include the following:</p> <ul> <li>Characters of a cursive-connecting script do not display with the correct connecting form.</li> <li>Marks are not correctly positioned on the base glyph or they display over spaces.</li> <li>Certain character sequences that are expected to display with a special form instead display with a different form or with the default glyphs for each character.</li> </ul> <p>It’s possible the font has an incomplete implementation. For example, the font developer may have added default glyphs for the characters of a script, matching what they see in the Unicode code charts, but not added the additional glyphs required for correct display of the script.</p> <p>If you suspect a font issue, contact the font vendor, or try using a different font.</p> <h2 id="incorrect_characters">Incorrect Characters</h2> <p>Occasionally, you may see garbled text with incorrect characters. In some cases, you might see several occurrences of “�” or another symbol such as “?”. This is sometimes referred to as “mojibake”. These symptoms suggest an encoding error—most likely, the text went through an incorrect encoding conversion.</p> <p>The most likely cause for this is that text was, at some earlier point, encoded in a legacy encoding (or character set) but was incorrectly labeled (with incorrect metadata) to indicate the exact encoding.</p> <p>For example, if a file containing the text “Русский” was encoded using the Windows-1251 encoding but was not labelled as such (with metadata contained inside the file or in the repository holding the file), then an app reading that file might assume a different encoding and interpret it as different characters. For instance, the software might assume Windows-1252 encoding and then interpret the text as “Ðóññêèé”. Or, if other heuristics suggested that the text was using Big 5 (Traditional Chinese) encoding, the app would interpret the text as “唒嚭膱�”.</p> <p>Good text encoding practice has always required that the encoding used for content be explicitly declared in metadata. Today, best practice is that text be encoded using a Unicode encoding form such as UTF-8.</p> <p>If you suspect an encoding or encoding conversion issue is the cause of the display problem, then contact the content author. Or, if the content is maintained in some repository, contact the agency maintaining that repository.</p> </blockquote> <p> </p> <hr width="50%"> <div align="center"> <center> <table cellspacing="0" cellpadding="0" border="0"> <tr> <td><a href="http://www.unicode.org/copyright.html"> <img src="http://www.unicode.org/img/hb_notice.gif" border="0" alt="Access to Copyright and terms of use" width="216" height="50"></a></td> </tr> </table> </center> </div> </td> </tr> </table> </td> </tr> </table> </body> </html>