Python Web Scraping Engineer (AWS & Browser Automation)

About the role

We are looking for a Python Web Scraping Engineer to design, build and operate reliable web data collection systems. You will work on production‑ready scrapers and browser automation for dynamic, JavaScript‑heavy sites, contributing to the scalability and quality of Deep Future’s data pipelines.

Key responsibilities

• Design, develop and maintain Python‑based web scrapers.
• Build and maintain browser automation workflows using Playwright and Selenium.
• Extract data from dynamic, JavaScript‑heavy websites and adapt to target‑site changes.
• Containerise scraping services with Docker and deploy them on AWS (EC2, ECS, Lambda, S3, SQS).
• Monitor scraper performance, reliability and data quality using AWS CloudWatch.
• Troubleshoot failures, performance issues and data inconsistencies.

Required profile

• Hands‑on Python engineer with experience delivering scraping solutions in production.
• Proficient in AWS deployment and operation of containerised workloads.
• Comfortable debugging changing web targets and documenting technical decisions.
• Effective communicator who collaborates using tools such as Slack, Google Workspace, Jira and Confluence.

Required skills

• Python
• AWS (EC2, ECS, Lambda, S3, SQS, CloudWatch)
• Playwright
• Selenium
• Docker

What we offer

• Ownership of core data acquisition systems.
• Opportunity to solve real‑world data intelligence problems.
• Mentorship from experienced engineers.
• Flexible working arrangements and competitive remuneration.