A catalog of ChatGPT & Codex plugins, sorted by people.
Best MCP servers & Codex plugins for scraping
5 plugins in our catalog say they help with scraping. Here are the top 5, editor's picks first, then by GitHub stars. Most of them sit in Docs, Content & SEO and Data & Backend.
How to choose
- Match the host first: Codex and Claude Code install commands differ, and the install line below shows which one each project targets.
- Check where it runs. Hosted MCP endpoints are quicker to set up but send your requests to someone else's server.
- Prefer a recent push and a real license (MIT or Apache-2.0) for anything you'll use at work.
- Stars tell you how many people looked, not whether it works. Read the code before you install.
The list
1. CRW
Fast, lightweight Firecrawl/Tavily alternative written in Rust: web scraper, crawler and search API that agents can call as an MCP server.
★ 1,260 · AGPL-3.0 · pushed 2026-11-15 (this week) · MCP server · by fastcrw
2. X Twitter Scraper
X/Twitter data, monitored workflows, HMAC webhooks, and MCP access through the Xquik REST API with confirmation-gated write guidance.
★ 229 · MIT · pushed 2026-11-13 (this week) · MCP server, plugin · by Xquik-dev
codex plugin marketplace add Xquik-dev/x-twitter-scraper
3. Crawlie
Fast, free, open-source technical SEO and GEO crawler built for humans and agents, installable as a Codex plugin marketplace.
★ 127 · No license file · pushed 2026-10-26 (last 30 days) · MCP server · by spronta
claude mcp add crawlie crawlie-mcp
4. Shopify AI SEO & Liquid
Audit Shopify robots.txt for AI search crawlers, generate Product Schema JSON-LD, and build shoppable blog product cards.
★ 0 · MIT · pushed 2026-11-11 (this week) · plugin · by kuaai
5. Known Agents MCP Server
Ask ChatGPT or Claude about the AI agents, crawlers and scrapers visiting your website, using Known Agents' bot-traffic analytics.
★ n/a · No license file · pushed 2026-11-10 (this week) · MCP server · by Known Agents
Matched by keywords in each project's own name and description. The topic comes from what people actually type into Google and Bing search boxes.
All comparisons and use cases →
Data from GitHub and each project's README, checked 2026-11-15. We haven't installed or audited these, and stars measure attention, not quality. Paid placements never change this page. Spot a mistake? hello@pickaplugin.com
New MCP servers & plugins, once a week
One short email a week: the MCP servers and plugins that joined the catalog, and the ones gaining stars fastest. Free. Confirm by email, unsubscribe in one click. Past issues.
