Static & JavaScript rendering
Fast static fetcher by default. Flip render: true in your recipe and Trawlly spins up a headless Chromium with stealth patches — same API, 5× credits.
Turn any public web page into clean, structured data — in seconds
No browser automation to maintain. No proxy rotation to manage. No CAPTCHA headaches. Just send a recipe, get JSON or CSV. Static pages, JavaScript-heavy SPAs, infinite-scroll feeds — Trawlly handles it all.
100+Pages per run
5×JS render cost
99.9%%Uptime target
24/7Change monitoring
Built for developers who value their time
Every feature exists because we needed it ourselves — no bloat, no lock-in.
Smart pagination, zero code
Define next_link (CSS selector) or template ({n} placeholder). Trawlly follows pages automatically, respects max_pages, and deduplicates.
Precision extraction via CSS
Declarative extract rules: text, HTML, attributes, regex transforms. Relative URLs resolved automatically. Multiple extractors per recipe, each outputting clean arrays.
Scheduled jobs with change detection
POST a recipe to /v1/jobs with an interval. Trawlly runs it on schedule, computes a SHA-256 fingerprint of results, and fires an HMAC-signed webhook only when data actually changes.
Bulletproof by default
Per-host throttling, exponential backoff on 429/5xx, SSRF dial guard, 10 MiB response cap, robots.txt cache, panic recovery per page — one bad target never kills your crawl.
Credit-based, predictable billing
1 credit = 1 static page. JS-rendered = 5 credits. Hard quota enforcement with X-Credits-Remaining headers. No surprise overages — you hit the ceiling, you get a 402.
From recipe to results in three steps
No SDK to install. Pure HTTP. Works from any language.
Define your recipe
JSON with start URLs, pagination strategy, and CSS selectors for each field you want. Save it, version it, share it.
version: 1,
name: "product-listings",
start: ["https://shop.example.com/products"],
pagination: { "next_link": "a.next" },
extract: [{
"name": "products",
"item_selector": ".product-card",
"fields": [
{"name": "title", "selector": "h3"},
{"name": "price", "selector": ".price", "attr": "text"},
{"name": "url", "selector": "a", "attr": "href"}
]
}]POST to /v1/scrape
Auth with your API key. Get structured JSON instantly — or schedule it as a recurring job with /v1/jobs.
curl -X POST https://trawlly.com/v1/scrape \
-H "X-API-Key: trw_..." \
-H "Content-Type: application/json" \
-d @recipe.jsonConsume results
Clean arrays of objects — ready for your database, ML pipeline, or dashboard. Change alerts arrive as signed webhooks with full diffs.
{
"fetched": 47,
"credits_used": 47,
"items": {
"products": [
{"title": "Widget Pro", "price": "$29.99", "url": "https://..."},
{"title": "Widget Lite", "price": "$14.99", "url": "https://..."}
]
}
}Teams use Trawlly for
Any workflow that needs fresh, structured web data at scale.
Price & catalog monitoring
Track competitor SKUs, stock status, and promotions across dozens of sites. Get alerted the moment a price changes.
Lead generation & enrichment
Extract company directories, job boards, event attendees — then enrich in your CRM. No more manual copy-paste.
Market research & sentiment
Aggregate reviews, forum discussions, news mentions. Feed clean text into your NLP pipeline daily.
Real estate & listings
Monitor property portals for new listings, price drops, and status changes. Build alerts your agents actually trust.
Financial & regulatory data
Scrape SEC filings, central bank releases, commodity prices — on a schedule, with change diffs delivered to your inbox.
Travel & hospitality
Track hotel rates, flight availability, rental inventory across dates. Power dynamic pricing models with fresh data.
Simple, predictable pricing
No hidden fees. No annual contracts. Upgrade, downgrade, or cancel anytime.
| Plan | Monthly | Credits / month | Scheduled jobs | Max pages / run | Support | |
|---|---|---|---|---|---|---|
| Free For experimentation |
₹0 | 100 | 2 | 5 | Community | Start Free |
| Starter For solo devs & small projects |
₹799/mo | 5,000 | 10 | 25 | Email (48h) | Get Started |
| Pro For growing teams |
₹1,999/mo | 50,000 | 50 | 25 | Priority email (24h) | Get Started |
| Business For high-volume production |
₹7,999/mo | 250,000 | Unlimited | 100 | Dedicated Slack | Get Started |
1 credit = 1 static page fetched. JavaScript-rendered page = 5 credits. Prices exclusive of taxes. Cancellation & refund policy.
Questions?
Here are the most common ones. Can’t find yours? Email us.
What exactly counts as a “credit”?
1 credit = 1 static HTML page successfully fetched and parsed. If your recipe sets render: true (JavaScript rendering), each page costs 5 credits because we spin up a full headless Chromium instance. Credits reset monthly on your billing date and do not roll over.
Can I scrape JavaScript-heavy sites (React, Vue, Next.js)?
Yes. Add "render": true to your recipe. Trawlly launches a headless Chromium with stealth patches (navigator.webdriver hidden, realistic UA, etc.), waits for network idle, then extracts from the fully rendered DOM. Cost: 5 credits/page.
How does pagination work?
Two modes: next_link — give a CSS selector for the “Next” button (a.next); Trawlly clicks until the selector vanishes or max_pages is hit. template — provide a URL template with {n} (https://site.com/page/{n}) and Trawlly increments n until 404 or limit.
What happens when I hit my monthly credit limit?
The API returns 402 Payment Required with a clear error message. Your scheduled jobs pause until the next billing cycle (or you upgrade). The X-Credits-Remaining header on every response lets you monitor usage proactively.
Do you respect robots.txt and rate limits?
Yes — by default. Every target domain is checked against its robots.txt before the first request (cached for 24h). We also enforce per-host delays with jitter. You can disable robots.txt per recipe if you have explicit permission, but the default is strict compliance.
Can I scrape behind a login or paywall?
No. Trawlly is designed for publicly accessible data only. We do not support authentication, cookie injection, or any form of credentialed access. Attempting to circumvent access controls violates our Terms and will result in account termination.
What’s the SLA / uptime guarantee?
During this launch phase we target 99.9%% monthly uptime but offer no formal SLA yet. The service runs on a dedicated VPS with automated health checks, and the scheduler is monitored externally. We’ll publish an SLA once we exit beta.
How do I cancel or change my plan?
Cancel anytime from your Razorpay subscription page or email support. Cancellation stops future renewals; your current period runs to its end. Downgrades take effect immediately. See Cancellation & Refund Policy for details.
Is there a free trial for paid plans?
Not a time-limited trial — but the Free plan (100 credits/month) is free forever and requires no card. When you’re ready, upgrade to Starter/Pro/Business instantly via the billing API or Razorpay dashboard.
Ready to stop writing scrapers and start using data?
Create your free account in seconds. No credit card required. Upgrade when you need more.
Create Free Account →Prefer to talk first? Email us — we usually reply within a few hours.