BasicCrawler.get_request_manager() (src/crawlee/crawlers/_basic/_basic_crawler.py) opens the same default request queue for every crawler, so two crawlers in one process silently share requests and deduplication state. Only the first instance should use the default queue; the rest should get their own via an internal alias derived from the crawler id.
JS implementation: apify/crawlee#3834
✍️ Drafted by Claude Code
BasicCrawler.get_request_manager()(src/crawlee/crawlers/_basic/_basic_crawler.py) opens the same default request queue for every crawler, so two crawlers in one process silently share requests and deduplication state. Only the first instance should use the default queue; the rest should get their own via an internal alias derived from the crawler id.JS implementation: apify/crawlee#3834
✍️ Drafted by Claude Code