AI tools for “crawl”

Your endlessly configurable crawling companion; now with GPT integration. Skip to content Home GitHub Sponsor Login My Account Horseman v0.3.2 out now, with GPT integration and much more. Crawl the web the way you want.…

Home of the all-in-one, AI-powered web scraping platform, and a world-class data delivery team. Your devs or ours? #ExtractSummit2026 The world's largest web scraping conference returns. Austin Oct 7–8 · Dublin Nov…

Convert images to text instantly with AI technology. Extract text from PDF files and remove PDF watermarks with smart tools. Powered by advanced AI for accurate results.

Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting pages, gathering sources, discovering site URLs, bulk extraction, downloading a site, change alerts, or…

Find web sources with query-relevant page excerpts and optional full-page content, and discover workflows, data APIs, and indexes. Use for web research or finding structured records, listings, transcripts, and datasets.…

Read a known webpage or execute a discovered workflow or data-provider capability. Use for page content or structured results once the URL or tool is selected.

Build reliable web data workflows with Scrapeless Agent Browser, AI Scraper, Web Unlocker and Scraping API—made for AI agents, automation and data teams.

Transform any website into clean, structured data with Skrape.ai. Our AI-powered web scraping API extracts data in your preferred format - perfect for RAG systems, AI training, and data analysis. Start with 20 free…

Turn any webpage into a spreadsheet with AI agents. No setup or technical skills required—built for non-technical teams.

Hystruct uses AI to help you scrape the web with ease. Get started with our free plan with 100 credits per month - no credit card requiredHystructPricingAPIDocsBlogFree Tools Open menuHystructLoginGet startedWeb…

Experience the future of web scraping with Webtap.ai. Utilize our data AI for efficient and limitless scraping solutions.

One API for web scraping, search, document extraction, social data, and enrichment. Smart routing, exact provider pinning, one bill.

No-code web scraping by dashboard and free Chrome extension, with AI extraction and website change monitoring. Turn any site into structured data or an API.

A stateless command-line tool for web search, OSS code search, library docs, and scraping — one binary, no daemon, nothing to keep running.

InJob.AI finds out all the hidden jobs. It scrapes exclusive listings from company career pages in your industry, builds personalized cover letters. Elevate your job search beyond traditional job boards.

No-code web scraping for your business or AI. Turn any URL into clean, structured data with ready-to-run scrapers or build your own. Start free.

AI platform for GTM & B2B Sales: Automate web scraping, Deep Research, and CRM data enrichment for accurate B2B insights. 10x faster B2B research. Get started free.

Scrape business contacts, write personalized message sequences and create outstanding marketing copies faster than other humans with Scanlist AI.

Use AI in Google Sheets: generate content and images, run 64 custom functions, scrape the web, and delegate multi-step tasks to the AI Chat Agent.

Source leads with our agentic web scraper, qualify them with AI and reach them with contact enrichment. HomeProductWeb ScraperThe most powerful web scraper on the internet.Web SearchStop Googling your leads…