Python Web Scraping Engineer (AWS & Automation)

About the role

Deep Future is looking for a Python Web Scraping Engineer to design, build, and operate reliable web data collection systems. You will focus on production‑ready scrapers and browser automation for dynamic, JavaScript‑heavy sites, ensuring the scalability and quality of our data pipelines.

Key responsibilities

• Design, develop, and maintain Python‑based web scrapers.
• Build and maintain browser automation workflows using Playwright and Selenium.
• Extract data from dynamic, JavaScript‑heavy websites and handle routine target‑site changes.
• Containerise scraping services with Docker and deploy them on AWS.
• Monitor scraper performance, reliability, and data quality, troubleshooting failures and performance issues.

Required profile

• Hands‑on experience with production‑grade Python web scrapers.
• Strong familiarity with AWS services (EC2, ECS, Lambda, S3, SQS, CloudWatch).
• Experience building automation with Playwright or Selenium.
• Ability to containerise applications using Docker.
• Clear documentation skills and effective team communication.

Required skills

• Python
• AWS
• Playwright
• Selenium
• Docker

What we offer

• Ownership of core data acquisition components.
• Opportunity to solve real‑world data intelligence challenges.
• Mentorship from experienced engineers.
• Flexible working arrangements.
• Competitive remuneration aligned with experience.