@huggingface/tokenizers CDN files
- @huggingface/tokenizers@0.1.3 /
- types /
- core
| ... | |
| decoder | |
| normalizer | |
| postProcessor | |
| preTokenizer | |
| tokenizerModelImplementations | |
| AddedToken.d.ts | 1.14 KB |
| Decoder.d.ts | 1.09 KB |
| Normalizer.d.ts | 773 B |
| PostProcessor.d.ts | 1.26 KB |
| PreTokenizer.d.ts | 1.39 KB |
| Tokenizer.d.ts | 3.13 KB |
| TokenizerModel.d.ts | 1.13 KB |
Free Open Source CDN for @huggingface/tokenizers
Looking for a nice landing page for your package? https://www.jsdelivr.com/package/npm/@huggingface/tokenizers