[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: High-Speed UTF-8 to UTF-16 Conversion
Rob Cameron wrote:
> As part of my research program into high-speed XML/Unicode/text
> processing using SIMD techniques, I have experimented extensively
> with the UTF-8 to UTF-16 conversion problem. I've generally been
> comparing performance of my software with that of iconv under
> Linux and Mac OS X. Are there any substantially faster implementations
> available? Currently our u8u16-0.9 software runs about 3X to 25X faster
> than iconv depending on platform and data characteristics.
>
> u8u16-0.9 is available as open source software under an OSL 3.0 license
> at http://u8u16.costar.sfu.ca/
>
>
I can't vouch for the relative performance because I haven't used it,
but you might want to try ICU. The documentation for its character set
converters is here:
http://www.icu-project.org/userguide/codepageConverters.html
--
Linux-UTF8: i18n of Linux on all levels
Archive: http://mail.nl.linux.org/linux-utf8/