Senior / Lead Data Engineer (GCP Focus)

3 days ago


Kuala Lumpur, Kuala Lumpur, Malaysia Endava Full time 120,000 - 240,000 per year

Company Description
Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.

By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.

From prototype to real-world impact, be part of a global shift by doing work that matters.

Job Description
About the Role
We're looking for experienced
data engineers,
both
senior and lead level,
with strong expertise in
cloud-based data solutions
, ideally within
Google Cloud Platform (GCP)
.

In this role, you'll be responsible for
building, optimizing, and maintaining scalable data pipelines and architectures
that support analytics, machine learning, and data-driven decision-making across the organization.

While
GCP experience is preferred
, we also
welcome candidates with AWS or Azure backgrounds
who are keen to expand their hands-on experience with GCP.

Fluency in
Cantonese
is a
nice-to-have
and will help in collaborating effectively with local stakeholders, but it is
not a requirement
.

Key Responsibilities

  • Collaborate with data analysts and data scientists to design efficient data flows, pipelines, and reporting solutions.
  • Work closely with business stakeholders to understand data usage and identify areas for improvement.
  • Design and implement cloud-based architecture and deployment processes on GCP (or other cloud platforms).
  • Build and maintain data pipelines, transformations, and metadata to support business needs.
  • Develop, test, and optimize big data solutions for scalability, performance, and reliability.
  • Create and manage relational and dimensional data models aligned with platform capabilities.
  • Monitor and maintain the production environment, ensuring data quality, integrity, and governance.
  • Lead or contribute to initiatives improving data quality, governance, security, and compliance.

Requirements

  • Proven experience as a Data Engineer, ideally with GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Storage).
  • Experience with AWS or Azure is highly valued, especially for those eager to become more hands-on with GCP.
  • Strong understanding of data architecture, modeling, and ETL/ELT processes.
  • Hands-on experience with big data frameworks and modern data tools.
  • Excellent communication and collaboration skills across technical and business teams.
  • Familiarity with machine learning, AI, or advanced analytics is a plus.
  • Cantonese proficiency is a nice-to-have but not mandatory.

Qualifications

  • 5+ years of experience in data engineering.
  • Strong proficiency in Python and Apache Spark.
  • Hands-on experience designing and implementing ETL/ELT processes and data pipelines.
  • Solid expertise in SQL scripting and query optimization.
  • Experience with Snowflake or other modern cloud data platforms.
  • Background in cloud data technologies and tools, with exposure to:

  • Data processing frameworks (Spark, Hadoop, Apache Beam, Dataproc, or similar)

  • Data warehouses (BigQuery, Redshift, or equivalent)
  • Real-time streaming pipelines (Kinesis, Kafka, or similar)
  • Batch and serverless data processing

  • Strong analytical skills with the ability to work with both structured and unstructured data.

  • Experience in leading IT projects and managing stakeholder expectations.

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance:

Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
- Career Development:

Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
- Learning Opportunities:

Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
- Work-Life Balance:

Hybrid work and flexible working hours, employee assistance programme;
- Health:

Global internal wellbeing programme, access to wellbeing apps;
- Community:

Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

At Endava, we're committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.



  • Kuala Lumpur, Kuala Lumpur, Malaysia Endava Full time 120,000 - 240,000 per year

    Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Endava Full time 80,000 - 120,000 per year

    Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Endava Full time 120,000 - 180,000 per year

    Company DescriptionTechnology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Endava Full time

    Company DescriptionTechnology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Endava Full time 90,000 - 120,000 per year

    Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital...


  • Kuala Lumpur, Kuala Lumpur, Malaysia SECOND TALENT SDN. BHD. Full time 120,000 - 180,000 per year

    About the RoleWe are looking for a Data Engineer to design, build, and maintain scalable data pipelines and platforms that power advanced analytics and AI solutions. You will work with modern Google Cloud data technologies to enable high-quality, reliable, and timely data for the business, with a focus on building new capabilities and ensuring platform...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Talentbook Solutions Full time 60,000 - 120,000 per year

    Urgent opening for Senior Data Engineer-Quality who's focused on testing ETL pipelines, data structure etc ... must be able to work EMEA hours 4pm to 1am (hybrid) ... salary up to RM15kPerm employment with top notch US Delivery Center in Malaysia (4 Positions)Role SummaryWe are looking for a detail-oriented and passionate Quality Engineer to ensure the...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Pulse Consulting Full time 120,000 - 240,000 per year

    Company Description Our client is one of the global leading software houses (IT MNC) with core businesses in software development, SAP consultation and ITO services based in Kuala Lumpur, Malaysia. Job DescriptionImplement stream and batch processing data pipelines that feed article indexes and build machine learning models.Developing machine learning...


  • Kuala Lumpur, Kuala Lumpur, Malaysia ZALORA SOUTH EAST ASIA PTE LTD Full time $900,000 - $1,100,000 per year

    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team. As a Senior Data Engineer, you will:Work daily with machine learning problems. For this purpose, you are expected to be involved in the process of collecting, storing, processing, and analyzing data generated from our database, in addition to joining our data scientists in...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Capcon Asia Full time 120,000 - 200,000 per year

    Why are they awesome?Data driven technology spin off from a leading aviation strategy, logistics and air cargo consultancyBuilding data-driven SaaS tools that help airlines make informed commercial decisions from; routes, maintenance, demand planning, operations and forecast modelsProducts / Projects2 core SaaS products that are mature - actively used by...