Databricks Developer

About the role

The Databricks Developer will design, build, and operate modern analytics and data platforms on the Databricks Lakehouse. You will work closely with analysts, data scientists, and application teams to deliver scalable, governed data solutions for BI, data engineering, and AI/ML workloads.

Key responsibilities

• Design and implement data platforms using the Databricks Lakehouse Platform.
• Build ingestion and transformation pipelines with Databricks Workflows, Apache Spark (PySpark / Spark SQL) and Delta Lake for batch, streaming, and near‑real‑time processing.
• Define platform standards for data ingestion, modeling, quality, and governance while ensuring cloud, security, and cost compliance.
• Develop and optimise Spark pipelines and Delta Lake models to support analytics, BI tools, and machine‑learning use cases.
• Implement monitoring, performance tuning, cluster optimisation, and CI/CD for notebooks, jobs, and pipelines.
• Collaborate with stakeholders, advise on Databricks capabilities, and mentor junior team members.

Required profile

• 4–6 years of overall data/analytics experience with 2–4 years of hands‑on Databricks and Spark.
• Strong focus on development and implementation of data platforms.
• Ability to align use cases, define success measures, and apply governance and change‑control standards.

Required skills

• Databricks Lakehouse Platform
• Apache Spark
• PySpark
• Spark SQL
• Delta Lake
• Structured Streaming
• Kafka