scraping-web

Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

Image Dataset Tool (idt) is a cli tool designed to make the otherwise repetitive and slow task of creating image datasets into a fast and intuitive process.

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，通过大量的爬虫实战掌握常见的爬虫与反爬套路。 引导式爬虫案例 + 免费爬虫视频教程，以闯关的形式挑战各个爬虫任务，培养爬虫开发的直觉及经验，验证自身爬虫开发与反爬虫实力的时候到了。

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.

Final Year project, scraping data of e-commerce stores and display in ReactJS app.

Web Scraping API code examples for Python, PHP and Node.js

A web scraper for extracting car ads data from Auto Trader

SERP Scraping API code examples for Python, PHP and Node.js

A simple contact info scraping tool written in Python and available as an executable file. It has a CLI & a GUI.

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

GPT4 Assisted Web Scraping Library

Get acquisitions by scraping titles of crunchbase.

Github Repository Search Tool

Scraping automation framework based on Playwright

Cross-platform Python crawler that finds and verifies downloadable media, documents, and other files, then creates wget-ready URL lists for fast bulk downloading. It also scans sitemap trees and generates validated text or XML sitemaps, with HTTP, HTTPS, FTP, persistent SQLite history, resumable crawls, robots support, and no pip dependencies.

A TUI interface with the library Jexer for fanfix

Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.

Unofficial ChatGPT Puppeteer API: A lightweight Node.js/Express backend that automates the ChatGPT web interface—with persistent sessions, conversation threading, and “Reason” & “Search” modes—via Puppeteer.