Issue Bug Closed

#24171Word split is not working with non-latin letters

Myroslav Holyak 11/23/10, 10:41 updated 03/06/14, 11:49

Description

We use utf-8 for russian and ukrainian letters. Word splitting and highlight (in search results) is not working in such case.

In pi/class.tx_indexedsearch.php:markupSWpartsOfString we have

// Split and combine:
$parts = preg_split(‘/’.$regExString.’/i’, ‘ ‘.$str.’ ‘, 20000, PREG_SPLIT_DELIM_CAPTURE);

i think we should add one regexp option to that splitting (it fixes such wrong behaviour)

// Split and combine:
$parts = preg_split(‘/’.$regExString.’/iu’, ‘ ‘.$str.’ ‘, 20000, PREG_SPLIT_DELIM_CAPTURE);

(issue imported from #M16525)

Reviews 0

No change resolves or names this issue in its commit message, and no comment links one.