colorfulchen/fetch_link_from_websit...

This is a comprehensive web link crawler system with a web-based management interface, designed for developers and teams who need to systematically crawl and manage links from multiple websites. The project features intelligent recursive crawling, MongoDB data persistence, scheduled task execution via APScheduler, real-time task monitoring, and data export capabilities in CSV/JSON/Excel formats. Built with Flask backend and Vue 3 frontend, it supports both incremental and full crawling strategies, making it suitable for regular website monitoring, competitive analysis, or building link databases while providing an intuitive interface for non-technical users to manage crawling operations.