# Web Crawler

- **URL:** https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/web-crawler
- **Summary:** Web Crawler

[Skip to main content](https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/web-crawler#__docusaurus_skipToContent_fallback)

Version: v3

Documentation for Knowledge Base API

[📄️Get all trained page links by knowledge base\
-----------------------------------------------\
\
Get all trained page links by knowledge base](https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/get-all-website-urls-data-by-knowledge-base)

[📄️Start crawling and discover pages for training\
-------------------------------------------------\
\
Start crawling and discover pages for training](https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/discover-website)

[📄️Delete trained pages\
-----------------------\
\
Delete trained pages](https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/delete-trained-urls-for-knowledge-base)

[📄️Get crawling status for the latest operation\
-----------------------------------------------\
\
Get crawling status for the latest operation](https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/get-crawling-status-for-latest-operation)

[📄️Train discovered website pages and ingest into the knowledge base\
--------------------------------------------------------------------\
\
Train discovered website pages and ingest into the knowledge base](https://marketplace.gohighlevel.com/docs/ghl/knowledge-base/train-discovered-urls)