Senior Data Engineering

1 day ago

Kuala Lumpur, Kuala Lumpur, Malaysia Lavu Tech Solutions Sdn Bhd Full time 120,000 - 240,000 per year

Description:

Role Summary :

We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads.

Key Responsibilities

* Develop and optimize data pipelines using Spark 3.5 and Python/Scala.

* Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT-based workflows.

* Integrate data pipelines with messaging systems (Kafka, Solace) and object stores (S3, MinIO).

* Troubleshoot and optimize distributed jobs running in Kubernetes environments.

* Collaborate closely with internal leads and architects to implement best practices.

* Design and implement migration/acceleration framework to automate end to end migration.

* Continuous enhancements to the frameworks to ensure the stability, scalability and support for diverse use cases and scenarios.

* Work with various data applications to enable and support the migration process.

* Deliver assigned migration tasks within agreed timelines.

Required Skills

* 6–9 years of hands-on data engineering experience.

* Strong expertise in Apache Spark (batch + streaming) and Hive.

* Proficiency in Python, Scala, or Java.

* Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

* Experience working with Kafka, Solace, and object stores (S3, MinIO).

* Exposure to Docker/Kubernetes for deployment.

* Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Engagement Expectations

* Vendor resource will be expected to work independently on assigned modules and deliver production-ready solutions.

* Must participate in daily/weekly status calls, reviews, and issue resolution.

* Should adapt to client processes, documentation standards, and compliance requirements.

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia SRKay Consulting Group Full time 1,000,000 - 1,400,000 per year

    Role DescriptionThis is a contract on-site role for a Senior Data Engineer based in WP. Kuala Lumpur. The Senior Data Engineer will be responsible for designing and implementing scalable data engineering solutions, building efficient data models, and managing ETL pipelines. Additional responsibilities include optimizing existing data architectures, ensuring...

  • Senior Data Engineer

    2 weeks ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Plaza Premium Group Full time 120,000 - 240,000 per year

    Join Our Family Today.Together, We'll Make Travel Better.The senior data engineer will be responsible for building and maintaining scalable and reliable data infrastructure to support enterprise-wide analytics and business intelligence initiatives.This role leads junior data engineer in designing and implementing efficient data pipelines, integrating diverse...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Ploy Full time 120,000 - 180,000 per year

    What's on offer:Job Type: ContractLocation: Menara AIA CapSquareDuration: 1 year (highly renewable)Job Summary:As a Senior Data Engineer, you will be responsible for designing and implementing scalable and robust data infrastructure to support our client's data processing needs.Job Responsibilities:Design, develop, and maintain data pipelines and ETL...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia NERA GROUP Full time 90,000 - 120,000 per year

    Job Description:We are seeking a highly experiencedSenior Data Engineerwith a proven track record in designing, building, and managing complex data engineering solutions. The ideal candidate will have deep expertise indata pipelines, data warehousing,andinfrastructure management, especially withon-premises server environments.Key Responsibilities:Lead the...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia ZALORA SOUTH EAST ASIA PTE LTD Full time $900,000 - $1,100,000 per year

    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team. As a Senior Data Engineer, you will:Work daily with machine learning problems. For this purpose, you are expected to be involved in the process of collecting, storing, processing, and analyzing data generated from our database, in addition to joining our data scientists in...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Kamlax Global Technologies SDN BHD Full time 96,000 - 120,000 per year

    OverviewWe are seeking an experienced Senior Data Engineer to support the migration of legacy Cloudera applications to a modern Kubernetes-based data platform. The ideal candidate will possess strong hands-on development skills in data engineering and the ability to deliver high-quality, production-ready data pipelines.Key ResponsibilitiesDevelop and...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Quandatics Full time 120,000 - 240,000 per year

    The Senior Data Engineer plays a key role in designing, building, and optimizing data solutions. This role involves leading and guiding a team of data engineers while working on data architecture, ETL pipelines, and business rule transformation. Expertise in data integration, processing, and visualization ensures the delivery of high-quality data...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Lalamove Full time 120,000 - 240,000 per year

    At Lalamove, we believe in the power of community. Millions of drivers and customers use our technology every day to connect with one another and move things that matter. Delivery is what we do best and we ensure it is always fast and simple. Since 2013, we have tackled the logistics industry head on to find the most innovative solutions for the world's...

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia InfoTech Consultancy Full time 100,000 - 120,000 per year

    Position: Senior Data EngineerLocation: MalaysiaDuration: 12+ Months and ExtendableRole OverviewProjects where date is stored at-rest and in-flight encryptionRedshift – Role based access (RBAC), Row and column level accessGovernance using  AWS Lakeformationor  AWS Cloudwatch, AWS SNS, Cloudtrail4. Orchestration using Airflow and Glue workflows

  • Senior Data Engineer

    1 day ago

    Kuala Lumpur, Kuala Lumpur, Malaysia axrail Full time $60,000 - $120,000 per year

    We are seeking a highly skilledCloud Data Engineerto design, build, and optimize data pipelines, AI-driven solutions, and cloud-based architectures. This role is ideal for individuals with strong logical and analytical thinking skills and hands-on experience with ETL processes, dashboards, and data engineering using PySpark. This is an exciting opportunity...