Text segmentation & tokenization
Split your text into manageable pieces through text segmentation and tokenization.
Splitting text into sentencesThis operation splits text into sentences while paying attention to language-specific syntax rules.
Tokenization: splitting text into words and phrasesThe Tokenize & Tag operation splits text into meaningful units in the form of words, phrases, and named entities, tagged by part-of-speech.
Smart segmentationThe Segment Text operation splits text into segments based on semantic similarity as well as references between adjacent sentences.
Pattern-based text splittingThe Split by Pattern operation splits text by pattern, for example into sentences or paragraphs.