Machine Learning Operation Engineer

2 days ago


Kuala Lumpur, Kuala Lumpur, Malaysia Always Marketing Malaysia Full time 80,000 - 120,000 per year

Duties and Responsibilities:
  • Provides deep technical expertise in the aspects of cloud infrastructure design and API development for the business environments.
  • Bridges the gap between data scientists and software engineers, enabling the efficient and reliable delivery of ML - powered solutions
  • Ensures solutions are well designed with maintainability/ease of integration and testing across multiple platforms.
  • Possess strong proficiency in development and testing practices common to the industry
Summary of Principal Job Responsibility & Specific Job Duties and Responsibilities:
  • Working closely with data scientists, ML engineers, and other stakeholders to deploy ML models
  • Setting up and maintaining cloud and edge infrastructure for MIL models deployment
  • Design, implement and maintain scalable infrastructure for ML workloads
  • Good verbal and written communication skills
  • Collaborative and oriented
Academic Qualification (s):
Bachelor's degree in computer science, Engineering or related subject and/or equivalent formal training or work experience

Work Experience / Skills Requirement(s):
1. Cloud Infrastructure & Kubernetes
  • Minimum 2 years of hands-on experience managing cloud infrastructure (e.g. AWS,GCP,Azure) in a production environment
  • Hands-on experience with Kubernetes for container orchestration, scaling and deployment of ML services
  • Familiar with Helm charts, ConfigMaps, Secret and autoscaling strategies
2. API Development & Messaging Integration
  • Proficient in building and maintaining RESTful or gRPC APIs for ML inference and data services
  • Experience in message queue integration such as RabbitMQ or ZeroMQ for asyncronous communication, job queuing or real-time model inference pipelines
3. System Design, Database & Software Architecture
  • Proven experience working with relational databases (RDBMS) such as Microsoft SQL Server and PostgreSQL.
  • Proficient in schema design, writing complex queries, stored procedures, indexing strategies, and query optimization.
  • Hands-on experience with vector search and embedding-based retrieval systems.
  • Practical knowledge using FAISS, LanceDB, or Qdrant for building similarity search or semantic search pipelines.
  • Understanding of vector indexing strategies (e.g., HNSW, IVF), embedding dimensionality management, and integration with model inference pipelines.
4. Programming Languages
  • Demonstrated expertise in building scalable and maintainable API services using Python frameworks such as Flask, FastAPI, or Litestar.
  • Fluent in HTML, CSS, and JavaScript for building simple web-based dashboards and monitoring interfaces.
  • Experience with Go, C++, or Rust is a strong plus, especially for performance-critical or low-latency inference applications.
5. Edge AI Deployment
  • Experience in integrating models using NCNN, MNN, or ONNX Runtime Mobile on mobile and edge devices.
  • Familiarity with quantization, model optimization, and mobile inference profiling tools.
6. MLOps & Tooling
  • Experience with Docker/Podman, CI/CD pipelines, Git, and ML lifecycle tools such as MLflow, Airflow, or Kubeflow.
  • Exposure to model versioning, A/B testing, and automated re-training workflows.
7. Monitoring & Logging
  • Ability to set up monitoring (e.g., Prometheus, Grafana) and logging (e.g., ELK stack, Loki) to track model performance and system health.
8. Soft Skills & Collaboration
  • Strong analytical and troubleshooting skills.
  • Able to work closely with data scientists, backend engineers, and DevOps to deploy and maintain reliable ML systems.
  • Excellent communication and documentation habits.


  • Kuala Lumpur, Kuala Lumpur, Malaysia iSoftStone Full time 80,000 - 120,000 per year

    Job Summary:The Machine Learning Platform Engineer will work closely with our AI and gaming technology teams to design, build, and scale a robust platform for machine learning model training and online inference services. This role involves developing ML Ops processes that integrate cutting-edge AI capabilities into our gaming products, improving automation,...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Half the sky Full time 100,000 - 150,000 per year

    Job DescriptionAs ML Engineer, you will be part of team to develop analytics solutions based on machine learning & statistical predictive algorithms for clients of Data & AI. We are looking for experienced machine learning engineers with extensive hands-on experience in machine and deep learning, statistical modeling, and software development, proven...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Unravel Carbon Full time 30,000 - 60,000 per year

    Machine Learning Engineerat Unravel CarbonABOUT UNRAVEL CARBONAt Unravel Carbon, we're on a mission to accelerate the world's transition to a zero-carbon economy. We're a team of entrepreneurs, engineers, and climate experts who believe that data and AI are the keys to unlocking a sustainable future. Our Sustainability AI agents platform helps companies...


  • Kuala Lumpur, Kuala Lumpur, Malaysia ManpowerGroup Full time 120,000 - 180,000 per year

    Job Title: Machine Learning EngineerLocation: Level 7, Menara TH 1 Sentral, Jalan Stesen Sentral 5, KL Sentral, W.P. Kuala Lumpur, 50470 MalaysiaOrder Status: [Insert Status]What is your mission?Understand client requirements and how they translate into application featuresWrite high-quality source code to program complete applications within deadlinesPeer...


  • Kuala Lumpur, Kuala Lumpur, Malaysia IITMatrix Full time 100,000 - 150,000 per year

    • Design, build, and maintain robust machine learning models into AzureML.• Develop reusable components for model training, evaluation, and deployment.• Monitor model performance in production and implement automated retraining workflows.• Optimize models for accuracy, latency, scalability, and cost efficiency.• Collaborate with data scientists to...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Calibrax Full time 250,000 - 500,000 per year

    About Calibrax AI is a team of high-caliber AI practitioners dedicated to building cutting-edge, practical AI solutions with real business impact. We help organizations craft their AI strategy, ensuring alignment with their goals, and deliver end-to-end solutions—from ideation and model development to deployment and long-term optimization. Our culture...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Outsized Full time 120,000 - 240,000 per year

    *This is a 6-month contract with a possibility of an extension into a multi-year contract. Applicants must be fully onsite in Kuala Lumpur. Must have strong experience in AzureML/Azure Databricks and Python.Project OverviewWe are working with a top tier global consulting firm to support the delivery of a large scale transfomation for a Telecom client based...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Rosary Labs Full time 7,000 - 10,000 per year

    Job DescriptionAs a Machine Learning (ML) Software Engineer, you will develop and maintain the backend infrastructure that powers AI tools and ensures they run reliably at scale.In this role, you will design, implement, and optimize end-to-end ML pipelines: data ingestion, processing, model interaction, orchestration, and deployment. You will work with Large...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Robert Walters Full time 200,000 - 250,000 per year

    A leading financial institution in Kuala Lumpur is seeking a Senior Artificial Intelligence and Machine Learning Engineer to join their forward-thinking team. This is an exceptional opportunity for you to play a pivotal role in designing, training, and deploying AI/ML models that drive digital transformation across consumer and SME banking domains. You will...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Unison Group Full time $80,000 - $120,000 per year

    DS (Data Practice) will be working within a team of Data Scientists/ Data Engineers/ Privacy Research Engineer focused more generally on Privacy Enhancing TechnologiesThis role require a strong Data Science/ML foundation (model development, experimentation, diagnosing issues)Use Python + ML frameworks (PyTorch, TensorFlow, scikit-learn)This involve applied...