lead / Senior data engineer: Python / AWS / Databricks

5 days ago

Kuala Lumpur, Kuala Lumpur, Malaysia Capcon Asia Full time 120,000 - 200,000 per year


Why are they awesome?

  • Data driven technology spin off from a leading aviation strategy, logistics and air cargo consultancy
  • Building data-driven SaaS tools that help airlines make informed commercial decisions from; routes, maintenance, demand planning, operations and forecast models

Products / Projects

  • 2 core SaaS products that are mature - actively used by customers and continuously evolving.
  • 1 successful data product is already in place that provides market insights from the supply side. A new data product targeting the demand side is currently in its initial phase, with significant development and scaling planned for H2 2025 and into 2026

Current challenges

  • Strategizing and planning efficient large-volume data extraction from various sources
  • Optimizing and enhancing the existing data infrastructure, architecture and workflows
  • Setting and driving technical standards across the data engineering function

Overall responsibilities

  • Take ownership of designing and continuously improving the cloud-based data architecture (including AWS, EKS, and Databricks) to support scalability, performance, and security needs
  • Develop and upkeep of reliable data pipelines, automation and CI/CD workflows
  • Lead technical discussions - identify and dissect complex problems and effectively communicate solutions across tech and non-tech stakeholders
  • Coach & mentor junior engineers by leading with examples

Team Org & Culture

  • Reporting to the Head of Data, based in Netherlands (you will still work KL hours)
  • Entrepreneurial and ambitious team from Malaysia and Europe, which include ex management consultants
  • The engineering hub in KL (15 staff) supports software development, data engineering and analytics - engineers who are results-driven, proactive and ready to wear multiple hats

Must Have

  • Databricks, Python, SQL and AWS - or any cloud platforms like GCP / Azure etc.
  • Experience in building rather than only maintaining
  • Excellent communication and problem-solving skills

Nice to have

  • Strong numerical intuition and comfort working with data
  • Experience in the cargo or logistics industry

Grade / Level

  • Lead Data Engineer (8+ years and above, must have lead experience)
  • Senior Data Engineer (5+ years and above)

Work Arrangement

  • Hybrid with 3 days work from office
  • Based in Bangsar South / KL Gateway (Close to MRT / LRT)

  • Lead Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Ironbook AI Full time $80,000 - $150,000 per year

    We are seeking an experienced and driven Lead Data Engineer to spearhead thedesign and development of a modern, cloud-native data warehouse on AWS. This roleis critical to building a scalable, secure, and efficient data platform that supportsanalytics, reporting, and AI use cases across the organization. The ideal candidate isboth technically hands-on and...

  • Senior Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Ploy Full time 120,000 - 180,000 per year

    What's on offer:Job Type: ContractLocation: Menara AIA CapSquareDuration: 1 year (highly renewable)Job Summary:As a Senior Data Engineer, you will be responsible for designing and implementing scalable and robust data infrastructure to support our client's data processing needs.Job Responsibilities:Design, develop, and maintain data pipelines and ETL...

  • Lead Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Collabera Full time 192,000 - 384,000 per year

    Collabera is expanding the team and welcomes a driven Lead Data Engineer to shape our cloud and data strategy, based in KL.Key Responsibilities:Provide ongoing support to the IT or AMS team during and after cloud migrations.Collaborate with the customer team to troubleshoot and resolve cloud-related issues.Proactively identify potential problems and...

  • Lead Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia TECHTIERA SDN. BHD. Full time 150,000 - 250,000 per year

    ResponsibilitiesTake end-to-end ownership of our cloud data architecture—designing, developing, and implementing a robust data warehouse using AWS services such as S3, Glue, Redshift, Lambda, Step Functions etc.Lead the evolution of our data infrastructure with a long-term vision, ensuring scalability, reliability, and performance.Define and enforce high...

  • Senior Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Talentbook Solutions Full time 60,000 - 120,000 per year

    Urgent opening for Senior Data Engineer-Quality who's focused on testing ETL pipelines, data structure etc ... must be able to work EMEA hours 4pm to 1am (hybrid) ... salary up to RM15kPerm employment with top notch US Delivery Center in Malaysia (4 Positions)Role SummaryWe are looking for a detail-oriented and passionate Quality Engineer to ensure the...

  • Senior Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Quandatics Full time 120,000 - 240,000 per year

    The Senior Data Engineer plays a key role in designing, building, and optimizing data solutions. This role involves leading and guiding a team of data engineers while working on data architecture, ETL pipelines, and business rule transformation. Expertise in data integration, processing, and visualization ensures the delivery of high-quality data...

  • Data Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Good Driver Mutuality Inc. Full time $150,000 - $200,000 per year

    Responsibilities:Build and maintain security-first data pipelines with embedded encryption, access controls, and audit trails to enable secure cross-functional collaboration.Design and implement data security strategies compliant with CCPA, HIPAA, GDPR, covering the entire data lifecycle (collection, storage, transmission, usage, disposal).Lead data...

  • Data Engineer-AWS

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia ABHIDI ENTERPRISES Full time $100,000 - $120,000 per year

    Data Engineer with expertisein AWS Glue, Python and AWS Transfer Family responsiblefor designing, building, and maintaining robust and efficient data pipelines for ingesting data into cloud-based data lakes and warehouses.If interested, Feel free to connect ator reach via WhatsApp at

  • Data Engineer – Databricks

    3 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia POWER IT SERVICES Full time 80,000 - 120,000 per year

    Required Technical Skill Set• Data processing Proficiency.• Database Technologies (Microsoft SQL & Cloud-native) 2 SQL Level 2 - 1 Oracle & Linux• Develop and optimize ETL processes using Databricks.• Containerization: Utilize Docker for packaging Databricks.• Problem-Solving and debugging• DevOps Practices: Implement CI/CD, automation, and...

  • AI ML Engineer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia POWER IT SERVICES Full time 80,000 - 120,000 per year

    AI ML EngineerJob Description.Technical Competencies• AI platform development (Expert)• ML frameworks and MLOps (Expert)• GPU optimization (Expert)• Data integration pipelines (Advanced)• Programming (Advanced)Primary Focus - Leading AI platform design and standardizationTechnical Skills:Databricks platform knowledge, Lakehouse in Databricks and...