unclecode

Prompt Net Requests — Development skill for Claude Code

Development community

I want to enhance the AsyncPlaywrightCrawlerStrategy to optionally capture network requests and console messages during a crawl, storing them in the final CrawlResult.

How to install Prompt Net Requests

Installs to ~/.claude/skills/unclecode-crawl4ai-prompt_net_requests/SKILL.md

Terminal
mkdir -p ~/.claude/skills/unclecode-crawl4ai-prompt_net_requests && curl -fsSL https://raw.githubusercontent.com/unclecode/crawl4ai/HEAD/prompts/prompt_net_requests.md -o ~/.claude/skills/unclecode-crawl4ai-prompt_net_requests/SKILL.md

Restart Claude Code, or start a new session, for it to be picked up.

What Prompt Net Requests does

I want to enhance the `AsyncPlaywrightCrawlerStrategy` to optionally capture network requests and console messages during a crawl, storing them in the final `CrawlResult`.

Here's a breakdown of the proposed changes across the relevant files:

**1. Configuration (`crawl4ai/async_configs.py`)**

  • Goal: Add flags to CrawlerRunConfig to enable/disable capturing.
  • Changes:
    • Add two new boolean attributes to CrawlerRunConfig:
      • `capture_network_requests: bool = Fals

Alternatives in Development

Full documentation available on GitHub

View Source Repository