Data Engineer – Databricks / PySpark

About the role

We are seeking an experienced Data Engineer to build and optimise a modern data platform for an AI education client. The role focuses on creating self‑service data access for engineering teams by developing scalable SQL‑based pipelines and leveraging Databricks.

Key responsibilities

• Design, develop and maintain scalable SQL‑based data pipelines using Databricks.
• Integrate and optimise Microsoft SQL Server databases and other enterprise sources within the Databricks environment.
• Collaborate with the DevOps Engineer to build cloud infrastructure that supports data platforms and application deployments.
• Automate data ingestion, transformation and deployment processes while ensuring data quality, governance and security.
• Troubleshoot pipeline issues and continuously improve performance and reliability.

Required profile

• 3–5 years of professional experience as a Data Engineer or in a similar role.
• Strong expertise in Databricks and advanced SQL development.
• Experience with Microsoft SQL Server, relational databases and ETL/ELT workflows.
• Understanding of data modelling, architecture principles and cloud platforms, preferably Microsoft Azure.
• Excellent analytical, problem‑solving and communication skills.
• Availability to work 9:00 AM–5:00 PM Eastern Time (EST).

Required skills

• Databricks
• SQL (advanced query optimisation)
• Microsoft SQL Server
• Azure cloud services
• Git‑based development workflows
• ETL/ELT pipeline development

What we offer

• Meaningful work and growth opportunities with fast‑growing startups.
• Supportive environment that treats employees as the biggest asset.
• Global reach while working remotely from home.
• Contribution to empowering global startups through technology.