Remote job
Experienced Web Scraping Engineer - Python (Remote)
Job details
About this role
Role overview
Join a large engineering organization operating one of the world's most extensive web data collection platforms. As an experienced Python scraping engineer, you'll build and maintain high-volume scrapers and parsers serving thousands of requests per second for clients in e-commerce, market intelligence, and AI. The position is remote, with infrastructure at meaningful scale across storage, streaming, and traffic.
Responsibilities
- Build and maintain Python-based scrapers capable of handling high-throughput workloads across distributed infrastructure - Apply unblocking techniques and work with multiple scraping methodologies to reach target sites reliably - Operate browser automation tools and leverage browser developer tools to diagnose complex page behavior - Implement asynchronous code that scales across petabyte-scale data traffic - Maintain shared tooling and contribute to a scraping codebase processing hundreds of thousands of service requests per second - Use Git for version control across collaborative engineering workflows
Requirements
- Professional experience programming in Python - Solid grasp of computer science fundamentals: data structures, algorithms, computability, and complexity - Working knowledge of TLS/SSL and networking concepts - Hands-on experience with browser automation and modern open-source scraping libraries - Comfort with asynchronous programming patterns - Familiarity with browser developer tools for inspecting and debugging web applications
Nice to have
- Web development background and familiarity with a front-end framework - CSS Selector and XPath skills for parsing - Experience with Go or C++ - Work with browser internals or browser source code - Pydantic, FastAPI, and SQLAlchemy experience - Exposure to Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, and Prometheus - Machine learning applied to scraping problems - Track record of building scalable systems
Benefits and work setup
Fully remote position. Gross monthly compensation starts at 23,000 PLN, with flexibility to discuss a different figure based on skills and experience.