Re: Byte-order-marks considered harmful

[Mark Leisher <mleisher@crl.nmsu.edu>]

    Markus> The ZWNBSP was really primarily introduced for the BOM hack in
    Markus> UCS-2, not because it has some essential other function in
    Markus> encoding a language.  I am not sure exactly, what the U+200B ZERO
    Markus> WIDTH SPACE is good for, but suspect that it might have potential
    Markus> uses in special applications such as word processor math formula
    Markus> and table formatting.

We use the ZWS (U+200B) quite extensively as "word" separators inserted by
segmenters for languages like Chinese, Japanese, Thai, Lao, etc.
-----------------------------------------------------------------------------
Mark Leisher
Computing Research Lab            I have never made but one prayer to God,
New Mexico State University       a very short one:
Box 30001, Dept. 3CRL                 "Oh Lord, make my enemies ridiculous."
Las Cruces, NM  88003             And God granted it.  -- Voltaire, letter
-
Linux-UTF8:   i18n of Linux on all levels
Archive:      http://mail.nl.linux.org/lists/