Web Scraping Engineer

Role overview Build and scale the systems that collect structured data from websites for use in investment research. You’ll own substantial parts of a production scraping platform, tackling difficult access and reliability problems across many sites and working directly with customers and engineering leadership.

Responsibilities - Develop scraping infrastructure that can collect millions of data points each day across thousands of websites. - Address anti-bot defenses and access challenges, including browser fingerprinting and proxy rotation. - Design data systems for scale and fault tolerance, and take responsibility for the infrastructure you build. - Work with customers to solve their most challenging scraping problems. - Collaborate closely with a small engineering team on production scraping code.

Requirements - At least three years of web scraping experience using tools such as Puppeteer, Playwright, or Selenium. - Strong Node.js or Python skills, plus experience with Docker, Kubernetes, and Google Cloud Platform. - Practical expertise with proxies, browser fingerprinting, and methods for handling automated access restrictions. - System design skills for scalable, resilient data infrastructure. - A customer-focused approach, clear communication, and a strong sense of ownership.

Nice to have - Experience using language models for data extraction. - Background in finance or investment management. - DevOps or continuous integration and delivery experience.

Benefits and work setup - Fully remote work with flexible hours and vacation. - Salary and equity are offered; amounts are not specified. - Lean team, direct customer feedback, and opportunities to work on production systems used by investment firms. - Regular team events and off-sites.