[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: strcoll for utf-8

Paul Michel writes:

> But strtok() for instance does not handle utf-8
> data properly.

Sure strtok() handles UTF-8 strings propertly. It only has the
limitation that the 'delimiter' than you can pass must be an ASCII
character.

strtok() even works with strings encoded in "weird" encodings like
BIG-5 and GB18030, as long as the 'delimiter' is an ASCII character in
the range 0x00..0x2F.

Bruno
--
Linux-UTF8:   i18n of Linux on all levels
Archive:      http://mail.nl.linux.org/linux-utf8/