Add CRW web scraping plugin

[us]

Plugin: CRW Web Scraper

Author: us
Plugin Type: Tool
Category: Search, Utilities

Description

CRW is an open-source, high-performance web scraper built for AI agents. Firecrawl-compatible API, 5.5x faster, 75x less memory.

Tools

Tool	Description
Scrape	Scrape a single URL → clean markdown, HTML, or structured JSON
Crawl	Async BFS crawl with depth/page limits
Crawl Status	Check/cancel crawl job status
Map	Discover all URLs via sitemap + link extraction

Backend Options

• Cloud: fastcrw.com — 500 free credits on signup
• Self-hosted: Single Rust binary, ~6 MB idle RAM

Links

• GitHub: https://github.com/us/crw
• PyPI: https://pypi.org/project/langchain-crw/
• npm: https://www.npmjs.com/package/openclaw-plugin-crw
• Cloud: https://fastcrw.com

[Copilot]

Copilot wasn't able to review any files in this pull request.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[crazywoola]

❌ Request Changes

Decision: Request changes

Failed Checks

Check	Status	Detail	Required action
Project structure	❌ Fail	Missing files: PRIVACY.md. Present: manifest.yaml, README.md. _assets/: yes.	Include all required files in the package: manifest.yaml, README.md, PRIVACY.md, and _assets/.
PRIVACY.md	❌ Fail	PRIVACY.md not found in plugin package. A privacy policy file is required for marketplace submission.	Add a non-empty PRIVACY.md file to the plugin package.
Install test	❌ Fail	Command failed (1): /var/folders/yl/54qqf2s909z2kjf8_vy8sg940000gn/T/pr-review-helper-ujin976f/.venv/bin/python /var/folders/yl/54qqf2s909z2kjf8_vy8sg940000gn/T/pr-review-helper-ujin976f/toolkit/validator/test-plugin-install.py -d /var/folders/yl/54qqf2s909z2…	Fix the plugin so test-plugin-install.py passes.

Full Check Results

Check	Status	Detail	Required action
PR content language	✅ Pass	PR title/body CJK ratio=0.0% (zh=0, en=612, ignored_zh=0, allowed_zh<=0)	None.
Project structure	❌ Fail	Missing files: PRIVACY.md. Present: manifest.yaml, README.md. _assets/: yes.	Include all required files in the package: manifest.yaml, README.md, PRIVACY.md, and _assets/.
Manifest author	✅ Pass	author is valid.	None.
Icon validation	✅ Pass	icon exists: _assets/icon.svg	None.
Version check	✅ Pass	version 0.0.1 is available.	None.
README language	✅ Pass	README.md CJK ratio=0.0% (zh=0, en=1802, allowed_zh<=0)	None.
PRIVACY.md	❌ Fail	PRIVACY.md not found in plugin package. A privacy policy file is required for marketplace submission.	Add a non-empty PRIVACY.md file to the plugin package.
Dependency install	✅ Pass	requirements installed successfully.	None.
dify_plugin version	✅ Pass	dify_plugin version 0.5.1 satisfies >= 0.5.0.	None.
Install test	❌ Fail	Command failed (1): /var/folders/yl/54qqf2s909z2kjf8_vy8sg940000gn/T/pr-review-helper-ujin976f/.venv/bin/python /var/folders/yl/54qqf2s909z2kjf8_vy8sg940000gn/T/pr-review-helper-ujin976f/toolkit/validator/test-plugin-install.py -d /var/folders/yl/54qqf2s909z2…	Fix the plugin so test-plugin-install.py passes.
Packaging test	✅ Pass	packaging check passed.	None.

Next steps

• Project structure: Include all required files in the package: manifest.yaml, README.md, PRIVACY.md, and _assets/.
• PRIVACY.md: Add a non-empty PRIVACY.md file to the plugin package.
• Install test: Fix the plugin so test-plugin-install.py passes.

Please address these issues and push an update.

[crazywoola]

Duplicated with another one.