@microsoft/tiktokenizer CDN files
| ... | |
| bytePairEncode.d.ts | 609 B |
| bytePairEncode.js | 4.69 KB |
| index.d.ts | 248 B |
| index.js | 1.73 KB |
| lru.d.ts | 559 B |
| lru.js | 1.7 KB |
| textEncoder.d.ts | 524 B |
| textEncoder.js | 1.34 KB |
| tikTokenizer.d.ts | 2.94 KB |
| tikTokenizer.js | 15.95 KB |
| tokenizerBuilder.d.ts | 1.98 KB |
| tokenizerBuilder.js | 9.79 KB |
Free Open Source CDN for @microsoft/tiktokenizer
Looking for a nice landing page for your package? https://www.jsdelivr.com/package/npm/@microsoft/tiktokenizer