palaniappan p5 min
Crawl your own docs into a Bedrock agent without a vector database
Managed Knowledge Base Web Crawler, GA with the service on 17 Jun 2026, follows up to 300 URLs per minute from 10 seeds or 3 sitemaps. A 10,000-URL help center is at least 34 minutes at that cap, and the crawler still has no per-page ACL.