Data Engineer

2 days ago

Greater Kuala Lumpur, Malaysia Ironbook AI Full time 60,000 - 120,000 per year

Data Engineer (Microsoft Fabric & Azure)

Position: Data Engineer

Department: Data & AI

Role Overview

The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures using Microsoft Fabric. This role focuses on enabling data ingestion, transformation, and governance across OneLake, Synapse, and Power BI, supporting downstream AI and analytics workloads.

Key Responsibilities


• Design and implement end-to-end data pipelines across Bronze, Silver, and Gold layers within Microsoft Fabric.


• Develop Dataflows Gen2, Spark notebooks, and Synapse pipelines to ingest data from databases, APIs, and files (Excel, CSV, etc.).


• Manage and optimize data storage within OneLake, including partitioning, schema evolution, and delta tables.


• Collaborate with AI Engineers to prepare and curate training datasets for ML/AI use cases.


• Integrate Fabric data outputs with Power BI semantic models and Copilot for Fabric.


• Implement data governance and lineage tracking through Microsoft Purview and Defender for Cloud.


• Monitor pipeline performance using Monitoring Hub, Azure Monitor, and Log Analytics Workspace.


• Automate deployments using CI/CD pipelines for Fabric and Azure Data Factory.


• Enforce data security policies, including role-level security (RLS) and data masking.

Qualifications


• Bachelor's Degree in Computer Science, Data Engineering, or related field.


• 3+ years of experience in data engineering, preferably on Microsoft Azure or Fabric.


• Strong experience with PySpark, SQL, and Python-based ETL.


• Experience with Microsoft Fabric, Synapse Analytics, or Azure Data Factory.


• Familiarity with Power BI datasets, Purview, and Azure Key Vault.


• Knowledge of delta lakes, metadata management, and data versioning.


• Good understanding of data governance, compliance, and security best practices.

Preferred Skills


• Knowledge of ML data preparation or model output pipelines.


• Exposure to Azure AI Foundry, AI Search, or Copilot for Fabric is a plus.

  • Data Engineer

    2 weeks ago

    Greater Kuala Lumpur, Malaysia Cradle Fund Full time 80,000 - 120,000 per year

    The Data Engineer is responsible for assisting in the design and development of data pipelines that enable reliable, timely, and scalable data flow across the organization. This role ensures that business intelligence and analytics teams have access to clean, consistent, and well-structured data to support data-driven decision-making.Key...

  • Data Engineer

    2 weeks ago

    Greater Kuala Lumpur, Malaysia Kamlax Global Technologies Full time 60,000 - 120,000 per year

    Hiring: Data Engineer (AWS | Python | PySpark | Databricks)Location:Kuala Lumpur, MalaysiaExperience:7+ yearsWe're seeking aData Engineerto design and maintain scalabledata pipelines, ETL processes, anddata warehousing solutions.Must have strong hands-on experience withPython, PySpark, Databricks, and at least3+ years on AWS.AWS certificationwill be an added...

  • Product Engineer – Data

    2 days ago

    Greater Kuala Lumpur, Malaysia SRKK Group Full time 90,000 - 120,000 per year

    Role PurposeTheProduct Engineer – Data & AIplays a pioneering role in transforming our data and analytics projects into scalable, productized solutions built on Microsoft Fabric. This role involves full-stack development using the Fabric Extensibility Kit, integrating data, AI, and app components into reusable accelerators and SaaS-ready offerings. As one...

  • Databricks Data Engineer

    2 days ago

    Greater Kuala Lumpur, Malaysia Abhidi Solution Full time 120,000 - 240,000 per year

    Key Responsibilities:Design and implement scalable data pipelines using Apache Spark, Delta Lake, and Databricks Workflows.Build and maintain ETL/ELT processes on Databricks Lakehouse Platform to support BI and advanced analytics using Delta Live Tables.Optimize performance of data pipelines and queries using Spark tuning and caching strategies.Implement and...

  • Data Engineer

    2 days ago

    Greater Kuala Lumpur, Malaysia Naluri - Employee Health & Wellness Full time 120,000 - 240,000 per year

    About NaluriWe are a digital health therapeutics company operating across SEA, focused on the intersection of mental health and physical chronic diseases. We combine behavioural science, psychology, data science and digital design to help companies, healthcare providers, and ultimately, people on achieving a healthier lifestyle.Visit our website to learn...

  • Data Engineer

    2 weeks ago

    Greater Kuala Lumpur, Malaysia Helius Technologies Full time 90,000 - 120,000 per year

    Job ResponsibilitiesDesign, build and maintain scalable data pipelines for batch and/or real-time processing.Develop and optimize ETL processes to support data ingestion, transformation and analytics needs.Work with Databricks and Apache Spark to process large datasets efficiently.Ensure data quality, data governance and adherence to best...

  • Lead Data Engineer

    2 days ago

    Greater Kuala Lumpur, Malaysia YTL AI Labs Full time 150,000 - 250,000 per year

    About UsAt YTL AI Labs, we build sovereign AI models that perform on par with the world's best, while staying grounded in local needs, values, and context. Our flagship model,Ilmu, is designed to be culturally aware, contextually intelligent, and fluent in Bahasa Melayu, delivering cutting-edge solutions that empower Malaysian businesses with intelligence...

  • Senior Data Engineer

    2 days ago

    Greater Kuala Lumpur, Malaysia InfoTech Consultancy Full time 100,000 - 120,000 per year

    Please find required skillset below for Senior Data Engineer:Projects where date is stored at-rest and in-flight encryptionRedshift – Role based access (RBAC), Row and column level accessGovernance using  AWS Lakeformationor  AWS Cloudwatch, AWS SNS, Cloudtrail4. Orchestration using Airflow and Glue workflows

  • Data Engineer

    2 weeks ago

    Greater Kuala Lumpur, Malaysia Cognizant Full time 80,000 - 120,000 per year

    Responsible for building and maintaining data pipelines, managing data storage solutions, and ensuring efficient data processing using Google Cloud Platform.Design, develop, and maintain data pipelines on GCP.Implement data storage solutions and optimize data processing workflows.Ensure data quality and integrity throughout the data lifecycle.Collaborate...

  • Data Engineer

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Involve Asia Full time $60,000 - $120,000 per year

    Involve Asia is seeking a Data Engineer who will be responsible for supporting data analysts and software engineers by providing maintainable infrastructure and tooling to deliver end-to-end solutions to business problems. The successful candidate will work with terabytes of data in a complex data environment supporting multiple products and data...