Find your next open-source project

Search by name, purpose, or keyword — or paste a GitHub repository URL
All skills

scrapling-official

Scrape a web page into a Markdown, HTML, or text file using Scrapling's CLI or Python.

When to use it

You have a URL whose content you need as clean text or structured data, but the page is JavaScript-heavy or blocks plain HTTP requests.

For example

You say

Use scrapling-official to scrape the quotes on https://quotes.toscrape.com/js/ into a Markdown file, since the quotes only appear after JavaScript runs.

You get
  • quotes.md file
  • Extracted quote text

How it works

  • Start with `get` for simple pages; switch to `fetch` when JavaScript or anti-bot protection is involved.
  • `--ai-targeted` filters hidden elements and blocks ads to keep output lean.
  • CSS selectors via `-s` trim output to just the parts you need.

Before installing

Requires Python 3.10+ with pip; browser fetching also needs the Scrapling browser installed via `scrapling install`.

This skill includes 4 scripts your assistant may run on your computer.