Data Engineer

About the role

Penbrothers is seeking a Data Engineer to join its new Manila‑based offshore team. You will design, build, and maintain scalable data pipelines that support multiple business domains such as gaming, sportsbook, payments, and marketing. The role operates within a modern, cloud‑native ecosystem with Databricks at its core.

Key responsibilities

• Build and maintain scalable data pipelines integrating internal and external data sources.
• Develop real‑time and batch processing solutions using Databricks, Spark, Kafka, and Airflow.
• Design, test, and document data models for the transformation layer.
• Implement integrations with third‑party platforms (CRM, marketing, financial systems).
• Ensure data quality, integrity, and reliability through validation and monitoring.
• Provide data services and APIs for internal and external consumption.
• Monitor, troubleshoot, and resolve production issues, participating in on‑call rotation.
• Collaborate with engineering, BI, product, and infrastructure teams to deliver end‑to‑end solutions.
• Participate in code reviews, agile ceremonies, and continuous improvement of engineering practices.

Required profile

• Proven experience building data pipelines with Databricks and Apache Airflow.
• Hands‑on experience with modern data architectures (e.g., Snowflake, data lakes, lakehouses).
• Familiarity with streaming technologies such as Apache Kafka, Spark, or Flink.
• Strong software engineering fundamentals in Python and/or Java.
• Good knowledge of SQL and experience with relational, columnar, or NoSQL databases.
• Experience working on cloud platforms, preferably AWS.

Required skills

• Databricks
• Apache Airflow
• Apache Kafka
• Apache Spark
• Python
• Java
• SQL
• MySQL
• PostgreSQL
• Elasticsearch
• MongoDB
• AWS
• Snowflake