| ... | |
| __init__.py | 1.1 KB |
| dom_tree_simplificator.py | 12 KB |
| html_extractor.py | 1.98 KB |
| image_deduplicator.py | 2.14 KB |
| laion_pair_filtering.py | 5.35 KB |
| pair_extractor.py | 5.25 KB |
| pair_filtering.py | 13.73 KB |
| pre_extraction_simplificator.py | 6.68 KB |
| warc_downloader.py | 1.6 KB |
| web_document_extractor.py | 17.27 KB |
| web_document_filtering.py | 48.87 KB |
| web_document_image_deduplication.py | 13.5 KB |
| web_document_line_deduplication.py | 6.4 KB |
Free Open Source CDN for huggingface/smollm
Looking for a nice landing page for your package? https://www.jsdelivr.com/package/gh/huggingface/smollm