🔍

web-scraping-mcp-server

Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.

RUN IN TERMINAL
# See repository for install instructions
ADD TO claude_desktop_config.json
{ "mcpServers": { "comthenextgennexus-web-scraping-mcp-server": { "command": "npx", "args": [] } } }
ADD TO .vscode/mcp.json
{ "mcpServers": { "comthenextgennexus-web-scraping-mcp-server": { "command": "npx", "args": [] } } }
ADD TO .cursor/mcp.json
{ "mcpServers": { "comthenextgennexus-web-scraping-mcp-server": { "command": "npx", "args": [] } } }

TRY THIS MCP

Loading available tools...

About This MCP Server

The com.thenextgennexus/web-scraping-mcp-server is a Model Context Protocol server that enables generic URL crawling and HTML extraction, serving as a fallback for websites that do not have dedicated MCPs. It connects to remote websites to gather data, allowing developers to access and extract information from these sites. Developers would use this server when they need to retrieve data from websites without dedicated MCPs, providing a fallback option for their applications.

Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.. This is a Model Context Protocol (MCP) server that extends AI assistants like Claude with search & web scraping capabilities via the streamable-http transport.

HOW TO USE

Select your AI client above to get the install command. This MCP server uses the streamable-http transport.

What tools does it provide?

The web-scraping-mcp-server server extends your AI assistant with search & web scraping capabilities. Once installed, your AI can use its tools automatically.

DETAILS
README BADGE
Skills Playground MCP badge
[![Skills Playground](https://skillsplayground.com/badges/mcp/comthenextgennexus-web-scraping-mcp-server.svg)](https://skillsplayground.com/mcps/comthenextgennexus-web-scraping-mcp-server/)
SHARE
Share on X

Related MCP Servers

Get the best new skills
in your inbox

Weekly roundup of top Claude Code skills, MCP servers, and AI coding tips.