Data Engineer

About the role

As a Data Engineer at Salmon, you will build and own the data pipelines and lakehouse architecture that transform raw data into reliable inputs for products used by millions across Southeast Asia. You will work in a hybrid‑first environment, collaborating with analytics, engineering, and product teams to enable data‑driven decisions.

Key responsibilities

• Design, develop, and operate batch and streaming pipelines on Databricks and Apache Spark on AWS, ingesting data from databases, APIs, and event streams.
• Shape and maintain the lakehouse architecture on S3 and Delta Lake, implementing Bronze/Silver/Gold medallion layers and storage optimization.
• Own end‑to‑end projects, from stakeholder alignment and design review through implementation, launch, and ongoing support.
• Build self‑service data solutions that scale as new sources and use cases are added.
• Optimize Spark jobs (cluster sizing, caching, joins, shuffles, partitioning, Parquet/Delta formats) for performance and cost.
• Manage Databricks Workflows, jobs, cluster configurations, and underlying infrastructure, handling failures and performance issues.
• Implement data governance and access control with Unity Catalog, including PII handling.

Required profile

• Hands‑on experience with Databricks and strong proficiency in Apache Spark (PySpark or Scala).
• Strong Python programming skills for data engineering, plus SQL and Spark SQL for transformations.
• Experience with Delta Lake and lakehouse architectures, including performance tuning.
• Proven ability to own projects, gather feedback, and deliver scalable, maintainable solutions.
• Familiarity with Git‑based version control and writing clean, testable code.
• Experience with infrastructure‑as‑code tools (Terraform or Ansible) is a plus.

Required skills

• Databricks
• Apache Spark (PySpark, Scala)
• Python
• SQL / Spark SQL
• Delta Lake
• AWS (S3)
• Unity Catalog
• Git
• Terraform (optional)
• Ansible (optional)

What we offer

• Opportunity to shape fintech infrastructure in a fast‑growing Southeast Asian market.
• Ownership and flexibility with a four‑year stock option plan.
• Hybrid‑first work model with fully remote options for eligible roles.