Senior Data Engineer
4 days ago
Overview
We are seeking an experienced Senior Data Engineer to support the migration of legacy Cloudera applications to a modern Kubernetes-based data platform. The ideal candidate will possess strong hands-on development skills in data engineering and the ability to deliver high-quality, production-ready data pipelines.
Key Responsibilities
- Develop and optimize data pipelines using Apache Spark 3.5 and Python/Scala.
- Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT workflows.
- Integrate pipelines with Kafka, Solace, and object stores such as S3 or MinIO.
- Troubleshoot and optimize distributed jobs running in Kubernetes.
- Collaborate with architects and internal leads to apply best practices in data engineering.
- Design and enhance migration/acceleration frameworks for end-to-end automation.
- Support and enable data migration across various applications.
- Ensure timely delivery of assigned migration tasks.
Required Skills & Experience
- 6–9 years of hands-on experience in data engineering.
- Strong expertise in Apache Spark (batch and streaming) and Hive.
- Proficient in Python, Scala, or Java.
- Familiar with Airflow, Control-M, and DBT.
- Experience with Kafka, Solace, and object stores (S3, MinIO).
- Knowledge of Docker/Kubernetes for deployment.
- Hands-on experience with Lakehouse formats (Iceberg, Delta Lake, or Hudi).
Engagement Expectations
- Work independently and deliver production-ready solutions.
- Participate actively in status calls, code reviews, and issue resolutions.
- Adhere to client processes, documentation standards, and compliance requirements.
Job Type: Full-time
Pay: From RM8,000.00 per month
Experience:
- Data Engineer: 6 years (Required)
Work Location: In person
-
Senior Data Engineer
2 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Ad Astra Consultants Full time 80,000 - 120,000 per yearClient is an award-winning DataTech company dedicated to enabling their clients to make safer, more informed decisions by delivering meaningful insights derived from reliable data. They utilise machine learning technology to analyse and provide corporate data from both public and private domains. Their award-winning app integrates these data to offer...
-
Senior Data Engineer
4 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia SRKay Consulting Group Full time 1,000,000 - 1,400,000 per yearRole DescriptionThis is a contract on-site role for a Senior Data Engineer based in WP. Kuala Lumpur. The Senior Data Engineer will be responsible for designing and implementing scalable data engineering solutions, building efficient data models, and managing ETL pipelines. Additional responsibilities include optimizing existing data architectures, ensuring...
-
Senior Data Engineer
2 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia SRKay Consulting Group Full time 90,000 - 120,000 per yearfor more other role, please kindly share the latest CV to email or WhatsApp to Role DescriptionThis is a full-time on-site role for a Senior Data Engineer, located in WP. Kuala Lumpur. The Senior Data Engineer will design, develop, and implement data pipelines and solutions to support organizational goals. Responsibilities include managing Extract,...
-
Senior Data Engineer
2 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Agensi Pekerjaan Two95 International SDN. BHD. Full time 72,000 - 96,000 per yearNow Hiring: Senior Data Engineer / Analytics EngineerWe're seeking a skilled Data Engineer / Analytics Engineer to join our client's growing data team in Malaysia. This position welcomes both local professionals and expats with a strong background in modern data platforms, modeling, and analytics enablement.Key Requirements:5+ years of experience in Data...
-
Senior Data Engineer
4 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Ploy Full time 120,000 - 180,000 per yearWhat's on offer:Job Type: ContractLocation: Menara AIA CapSquareDuration: 1 year (highly renewable)Job Summary:As a Senior Data Engineer, you will be responsible for designing and implementing scalable and robust data infrastructure to support our client's data processing needs.Job Responsibilities:Design, develop, and maintain data pipelines and ETL...
-
Senior Data Engineer
4 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia NERA GROUP Full time 90,000 - 120,000 per yearJob Description:We are seeking a highly experiencedSenior Data Engineerwith a proven track record in designing, building, and managing complex data engineering solutions. The ideal candidate will have deep expertise indata pipelines, data warehousing,andinfrastructure management, especially withon-premises server environments.Key Responsibilities:Lead the...
-
Senior Data Engineer
2 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Hayame Full time 72,000 - 96,000 per yearSenior Data EngineerResponsibilities:Build and maintain robust ETL pipelines using AWS services (Glue, Redshift, EMR, Athena, etc.).Optimize data architecture and ensure data integrity across sources.Collaborate with Data Scientists and Analysts to support analytics and business insights.Implement automation for data ingestion, transformation, and quality...
-
Senior Data Engineer
4 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia ZALORA SOUTH EAST ASIA PTE LTD Full time $900,000 - $1,100,000 per yearZALORA Group is looking for a Senior Data Engineer to join its Data Science Team. As a Senior Data Engineer, you will:Work daily with machine learning problems. For this purpose, you are expected to be involved in the process of collecting, storing, processing, and analyzing data generated from our database, in addition to joining our data scientists in...
-
Senior Data Engineer
2 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Averis Full time 120,000 - 240,000 per yearPosition Summary:As the Senior in Data Engineering, you will play a pivotal role in guiding our data engineering team, driving the design, development, and maintenance of scalable data architectures. You will collaborate with cross-functional teams to ensure that data solutions align with organizational goals, enabling data-driven decision-making.Key...
-
Senior Data Engineer
4 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Quandatics Full time 120,000 - 240,000 per yearThe Senior Data Engineer plays a key role in designing, building, and optimizing data solutions. This role involves leading and guiding a team of data engineers while working on data architecture, ETL pipelines, and business rule transformation. Expertise in data integration, processing, and visualization ensures the delivery of high-quality data...