زاحف المواقع الإلكترونية المتقدم

  # Botpress Integration: Apify Website Content Crawler

Automatically crawl websites and sync content to your Botpress Knowledge Base using Apify's powerful web scraping platform.

## Features

- **Website Crawling**: Extract content from any website with configurable crawling options
- **Auto-Sync to KB**: Crawled content is automatically synced to your Botpress Knowledge Base as files
- **Flexible Configuration**: Control crawl depth, URL patterns, content extraction, and more
- **Reliable Processing**: Built-in retry logic and continuation handling for large crawls
- **Multiple Crawlers**: Support for Playwright, Cheerio, and JSDOM crawlers

## Use Cases

- Train your chatbot with documentation from multiple websites
- Keep your KB up-to-date with the latest website content
- Extract and index knowledge from competitor sites or industry resources