web-scraping

scrapy/scrapy
503日前50.1k

Scrapy, a fast high-level web crawling & scraping framework for Python.

python

framework

dgtlmoon/changedetection.io
502日前14.2k

The best and simplest free open source website change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply monitor which websites had a text change for free. Free Open source web page change detection, Website defacement monitoring, Price change notification

website-change-monitor

url-monitor

changedetection

website-change-detector

website-change-detection

website-change-tracker

website-change-notification

notifications

self-hosted

web-scraping

apify/crawlee
502日前11.4k

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.