Normalize Unicode to ASCII (-f:q5)

• Introduction:
  This normalization is used to convert Unicode string to pure ASCII. It performs two Unicode basic operations:
  • First, it used Unicode Core Norm to normalize the Unicode string (-f:q7)
  • Then, it converts non-ASCII Unicode characters to ![Unicode Name]! format (-f:q3)

    The main advantages of using this Norm are:

    • Pure ASCII results
    • Preserve Unicode information
      Unicode characters can be retrieved from ![Unicode Name]!
    • Algorithm:
      • Perform Unicode Core Norm
      • Convert non-ASCII characters from the result of above to Unicode name as ![Unicode name]!

    • Normalization Results:

      Block	Unicode (Hex)
      Basic Latin	[U+0000 - U+007F]
      Latin-1 Supplement	[U+0080 - U+00FF]
      Latin Extended-A	[U+0100 - U+017F]
      Latin Extended-B	[U+0180 - U+024F]
      IPA Extensions	[U+0250 - U+02AF]
      Greek	[U+0370 - U+03FF]
      Latin Extended Additional	[U+1E00 - U+1EFF]
      General Punctuation	[U+2000 - U+206F]
      Letterlike Symbols	[U+2100 - U+214F]
      Number Forms	[U+2150 - U+218F]
      Arrows	[U+2190 - U+21FF]
      Miscellaneous Technical	[U+2300 - U+23FF]
      Enclosed Alphanumerics	[U+2460 - U+24FF]
      CJK Symbols and Punctuation	[U+3000 - U+303F]
      Alphabetic Presentation Forms	[U+FB00 - U+FB4F]
      Small Form Variants	[U+FE50 - U+FE6F]
      Halfwidth and Fullwidth Forms	[U+FF00 - U+FFEF]

    • References:
      • Unicode