Web Crawler

Configurable web crawler that extracts structured content from websites while respecting robots.txt rules and offering customizable settings for depth, delay, and concurrency.

Report

Similar MCPs

View All

The AWS Serverless Model Context Protocol (MCP) Server streamlines how developers build serverless applications. It provides contextual guidance specific to serverless development, helping developers make informed decisions about architecture, implementation, and deployment throughout the entire application development lifecycle. With AWS Serverless MCP, developers can build reliable, efficient, and production-ready serverless applications with confidence.

Integrates with Valyu's knowledge retrieval and feedback APIs, enabling information search across proprietary and web sources and submission of user feedback for enhanced information retrieval and interaction scenarios.

Google Docs to WordPress MCP, generate content from Cursor, add it to Google Docs and use Docswrite to publish it to your favorite WordPress automatically

BloodHound-MCP-AI is integration that connects BloodHound with AI through Model Context Protocol, allowing security professionals to analyze Active Directory attack paths using natural language instead of complex Cypher queries.

Provides a unified interface for MySQL and MongoDB operations, enabling seamless interaction with both database systems through TypeScript and Node.js with flexible deployment options.

Explore schemas and execute read-only SQL queries on MySQL databases.

  • tmp_val__name__