declare function tokenize(text: any, tokens: any): any[];
export { tokenize, };