Databricks Machine Learning Lead

2 weeks ago

Kuala Lumpur, Kuala Lumpur, Malaysia AVANADE ASIA PTE LTD Full time 120,000 - 180,000 per year

The Databricks M/L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.

Key Responsibilities

  • Lead the Design: Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows.
  • Hands-on Development: Serve as the most senior developer, writing high-quality, production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.
  • Performance Optimization: Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management.
  • Standards & Best Practices: Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps/CI/CD pipelines for the engineering team.

Qualifications

Required Skills & Experience:

  • 8+ years of experience in machine learning, data science, or MLOps, with at least 4+ years focused specifically on the Databricks Lakehouse Platform.
  • Expert proficiency in Python and PySpark/Scala for large-scale data processing and machine learning.
  • Deep understanding and practical experience with Delta Lake architecture and optimization techniques.
  • Proven expertise implementing MLOps principles using MLflow (Tracking, Registry, Projects, and Deployment).

Preferred Skills & Certifications:

  • Experience with Databricks features like Databricks Workflows, and Unity Catalog.
  • Experience with streaming technologies (e.g., Kafka, Spark Streaming).
  • Familiarity with CI/CD tools and Infrastructure-as-Code (e.g., Terraform, Databricks Asset Bundles).
  • Databricks Certified Machine Learning Professional certified.

  • Databricks Architect

    2 weeks ago

    Kuala Lumpur, Kuala Lumpur, Malaysia AVANADE ASIA PTE LTD Full time $120,000 - $200,000 per year

    The Databricks Solution Architect is a senior technical leadership role responsible for defining, designing, and overseeing the implementation of scalable, secure, and high-performance data platforms using the Databricks Lakehouse Platform. This individual will translate business strategy into technical architecture, guide development teams, and ensure all...

  • Databricks Data Engineer

    2 weeks ago

    Kuala Lumpur, Kuala Lumpur, Malaysia AVANADE ASIA PTE LTD Full time 120,000 - 240,000 per year

    The Databricks Data Engineer will be responsible for the design, development, and maintenance of scalable and high-performance data pipelines within the Databricks Lakehouse Platform. This role involves using Apache Spark, Delta Lake, and various Databricks services to process large volumes of batch and streaming data, ensuring data quality, reliability, and...

  • Machine Learning Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Outsized Full time 120,000 - 240,000 per year

    *This is a 6-month contract with a possibility of an extension into a multi-year contract. Applicants must be fully onsite in Kuala Lumpur. Must have strong experience in AzureML/Azure Databricks and Python.Project OverviewWe are working with a top tier global consulting firm to support the delivery of a large scale transfomation for a Telecom client based...

  • 64308 Machine Learning Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Half the sky Full time 100,000 - 150,000 per year

    Job DescriptionAs ML Engineer, you will be part of team to develop analytics solutions based on machine learning & statistical predictive algorithms for clients of Data & AI. We are looking for experienced machine learning engineers with extensive hands-on experience in machine and deep learning, statistical modeling, and software development, proven...

  • Machine Learning Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Unravel Carbon Full time 30,000 - 60,000 per year

    Machine Learning Engineerat Unravel CarbonABOUT UNRAVEL CARBONAt Unravel Carbon, we're on a mission to accelerate the world's transition to a zero-carbon economy. We're a team of entrepreneurs, engineers, and climate experts who believe that data and AI are the keys to unlocking a sustainable future. Our Sustainability AI agents platform helps companies...

  • Machine Learning Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia IITMatrix Full time 100,000 - 150,000 per year

    • Design, build, and maintain robust machine learning models into AzureML.• Develop reusable components for model training, evaluation, and deployment.• Monitor model performance in production and implement automated retraining workflows.• Optimize models for accuracy, latency, scalability, and cost efficiency.• Collaborate with data scientists to...

  • lead / Senior data engineer: Python / AWS / Databricks

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Capcon Asia Full time 120,000 - 200,000 per year

    Why are they awesome?Data driven technology spin off from a leading aviation strategy, logistics and air cargo consultancyBuilding data-driven SaaS tools that help airlines make informed commercial decisions from; routes, maintenance, demand planning, operations and forecast modelsProducts / Projects2 core SaaS products that are mature - actively used by...

  • Machine Learning Software Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Rosary Labs Full time 7,000 - 10,000 per year

    Job DescriptionAs a Machine Learning (ML) Software Engineer, you will develop and maintain the backend infrastructure that powers AI tools and ensures they run reliably at scale.In this role, you will design, implement, and optimize end-to-end ML pipelines: data ingestion, processing, model interaction, orchestration, and deployment. You will work with Large...

  • Data Scientist with Machine Learning

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Unison Group Full time $80,000 - $120,000 per year

    DS (Data Practice) will be working within a team of Data Scientists/ Data Engineers/ Privacy Research Engineer focused more generally on Privacy Enhancing TechnologiesThis role require a strong Data Science/ML foundation (model development, experimentation, diagnosing issues)Use Python + ML frameworks (PyTorch, TensorFlow, scikit-learn)This involve applied...

  • Senior Artificial Intelligence and Machine Learning Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Robert Walters Full time 200,000 - 250,000 per year

    A leading financial institution in Kuala Lumpur is seeking a Senior Artificial Intelligence and Machine Learning Engineer to join their forward-thinking team. This is an exceptional opportunity for you to play a pivotal role in designing, training, and deploying AI/ML models that drive digital transformation across consumer and SME banking domains. You will...