In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped.

• 在文本挖掘或全文搜索中,标识字符串内(在词边界、词素或词干处)有意义的单元以便可以对相关标记进行分组的过程。