Senior Data Engineer

2 days ago


Kuala Lumpur, Kuala Lumpur, Malaysia axrail Full time $60,000 - $120,000 per year

We are seeking a highly skilled
Cloud Data Engineer
to design, build, and optimize data pipelines, AI-driven solutions, and cloud-based architectures. This role is ideal for individuals with strong logical and analytical thinking skills and hands-on experience with ETL processes, dashboards, and data engineering using PySpark. This is an exciting opportunity to work on Generative AI innovations and AWS native technologies in a hybrid work environment.

Key Responsibilities:

1. Data Pipeline and ETL Development:

  • Build, optimize, and manage ETL pipelines using
    PySpark and AWS Glue
    for large-scale data processing.
  • Design robust data workflows for processing structured and unstructured data.
  • Ensure data integrity and security in all stages of processing.

2.Dashboard and Data Visualization for Data engineer:

  • Design and develop dashboards using tools like
    AWS QuickSight, Tableau, or Power BI.
  • Collaborate with stakeholders to create insightful visualizations for data-driven decision-making.

3. AI/ML Model Development and Deployment for AI engineer :

  • Develop, deploy, and maintain AI/ML models using frameworks such as TensorFlow, PyTorch, or Scikit-learn.
  • Implement models on cloud platforms using AWS SageMaker and automate model training and deployment pipelines.

4. Cloud Infrastructure and Data Management:

  • Architect and deploy scalable data solutions using AWS services like Redshift, EMR, and S3.
  • Use Infrastructure as Code tools (e.g., Terraform, AWS CDK, or CloudFormation) to automate deployments.

5. Performance Optimization:

  • Optimize ETL pipelines, AI models, and data queries for performance, cost-efficiency, and scalability.
  • Monitor data workflows and resolve bottlenecks proactively.

6. Explore AWS and Generative AI Innovations:

  • Gain hands-on experience with Generative AI tools and frameworks to create innovative data and AI solutions.
  • Experiment with the latest AWS native technologies to enhance data pipelines and AI projects.

Requirements:

  • Education: Bachelor's degree in
    Computer Science, Data Science, Engineering
    , or a related field. Equivalent practical experience will also be considered.
  • Hands-on experience with ETL pipelines using PySpark and data transformation tools like AWS Glue.
  • Proficiency in building interactive dashboards with tools like Tableau, AWS QuickSight, or Power BI.
  • Strong programming skills in Python
    (preferred) or other languages for data processing and AI/ML development.
  • Familiarity with cloud platforms (AWS preferred) and services like S3, Redshift, and SageMaker.
  • Strong logical and analytical thinking skills for solving complex data problems.
  • Knowledge of SQL and database management systems.
  • Fresh graduates with a passion for cloud data engineering and AI are encouraged to apply.

Preferred Skills:

  • Relevant AWS Certifications (e.g., AWS Certified Data Analytics, AWS Certified Machine Learning) are a strong plus.
  • Senior candidates (4+ years) should
    demonstrate expertise in PySpark, dashboard development, large-scale data processing, and AI/ML model deployment.
  • Familiarity with monitoring tools for data pipelines and AI workflows.
  • Strong communication skills for collaborating across teams and presenting data insights.


  • Kuala Lumpur, Kuala Lumpur, Malaysia SRKay Consulting Group Full time 1,000,000 - 1,400,000 per year

    Role DescriptionThis is a contract on-site role for a Senior Data Engineer based in WP. Kuala Lumpur. The Senior Data Engineer will be responsible for designing and implementing scalable data engineering solutions, building efficient data models, and managing ETL pipelines. Additional responsibilities include optimizing existing data architectures, ensuring...

  • Senior Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Plaza Premium Group Full time 120,000 - 240,000 per year

    Join Our Family Today.Together, We'll Make Travel Better.The senior data engineer will be responsible for building and maintaining scalable and reliable data infrastructure to support enterprise-wide analytics and business intelligence initiatives.This role leads junior data engineer in designing and implementing efficient data pipelines, integrating diverse...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Ploy Full time 120,000 - 180,000 per year

    What's on offer:Job Type: ContractLocation: Menara AIA CapSquareDuration: 1 year (highly renewable)Job Summary:As a Senior Data Engineer, you will be responsible for designing and implementing scalable and robust data infrastructure to support our client's data processing needs.Job Responsibilities:Design, develop, and maintain data pipelines and ETL...


  • Kuala Lumpur, Kuala Lumpur, Malaysia NERA GROUP Full time 90,000 - 120,000 per year

    Job Description:We are seeking a highly experiencedSenior Data Engineerwith a proven track record in designing, building, and managing complex data engineering solutions. The ideal candidate will have deep expertise indata pipelines, data warehousing,andinfrastructure management, especially withon-premises server environments.Key Responsibilities:Lead the...


  • Kuala Lumpur, Kuala Lumpur, Malaysia ZALORA SOUTH EAST ASIA PTE LTD Full time $900,000 - $1,100,000 per year

    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team. As a Senior Data Engineer, you will:Work daily with machine learning problems. For this purpose, you are expected to be involved in the process of collecting, storing, processing, and analyzing data generated from our database, in addition to joining our data scientists in...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Kamlax Global Technologies SDN BHD Full time 96,000 - 120,000 per year

    OverviewWe are seeking an experienced Senior Data Engineer to support the migration of legacy Cloudera applications to a modern Kubernetes-based data platform. The ideal candidate will possess strong hands-on development skills in data engineering and the ability to deliver high-quality, production-ready data pipelines.Key ResponsibilitiesDevelop and...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Quandatics Full time 120,000 - 240,000 per year

    The Senior Data Engineer plays a key role in designing, building, and optimizing data solutions. This role involves leading and guiding a team of data engineers while working on data architecture, ETL pipelines, and business rule transformation. Expertise in data integration, processing, and visualization ensures the delivery of high-quality data...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Lalamove Full time 120,000 - 240,000 per year

    At Lalamove, we believe in the power of community. Millions of drivers and customers use our technology every day to connect with one another and move things that matter. Delivery is what we do best and we ensure it is always fast and simple. Since 2013, we have tackled the logistics industry head on to find the most innovative solutions for the world's...


  • Kuala Lumpur, Kuala Lumpur, Malaysia InfoTech Consultancy Full time 100,000 - 120,000 per year

    Position: Senior Data EngineerLocation: MalaysiaDuration: 12+ Months and ExtendableRole OverviewProjects where date is stored at-rest and in-flight encryptionRedshift – Role based access (RBAC), Row and column level accessGovernance using  AWS Lakeformationor  AWS Cloudwatch, AWS SNS, Cloudtrail4. Orchestration using Airflow and Glue workflows


  • Kuala Lumpur, Kuala Lumpur, Malaysia Lavu Tech Solutions Sdn Bhd Full time 120,000 - 240,000 per year

    Description:Role Summary :We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads.Key...