Namespace com.ibm.streamsx.nlp.utils

Toolkits > com.ibm.streamsx.nlp 1.9.2 > com.ibm.streamsx.nlp.utils

The C++ native functions under this namespace enable you to tag and lemmatize words.

Functions

• generateNgram(list<rstring>, uint32, list<rstring>): Generates n-grams of co-occuring words within a given window
• generateNgram(list<rstring>, uint32, uint32, list<rstring>): Generates a set of n-grams of co-occuring words within a given window.
• getToolkitPath(): Get the toolkit root directory.
• initializeLemmatizer(): Initialize and read lexicon files from default directory (<toolkit_dir>/etc/gposttl)
• initializeLemmatizer(rstring): Initialize and read lexicon files from given directory
• lemmatize(rstring, list<rstring>): Lemmatizing of the input text
• lemmatize(rstring, list<rstring>, list<rstring>, list<rstring>): PoS-tagging and lemmatizing of the input text