Data Engineer

1 week ago


Kuala Lumpur, Kuala Lumpur, Malaysia MindGraph Full time

Responsibilities:

  • Design, develop, and maintain data solutions for data generation, collection, and processing.
  • Create, manage, and optimize data pipelines across systems.
  • Ensure data quality and implement ETL processes for data migration and deployment.
  • Act as a subject matter expert and guide the team to perform effectively.
  • Make team decisions and collaborate with multiple teams on key technical matters.
  • Provide solutions to problems across the immediate team and multiple teams.
  • Develop innovative data solutions to enhance data accessibility and usability.
  • Collaborate with cross-functional teams to implement data-driven strategies.
  • Monitor and optimize data pipeline efficiency and reliability.
  • Conduct regular data quality checks and implement improvements.
  • Stay updated with industry trends and new technologies to enhance data processes.

Requirements:

  • Minimum 3 years of experience as a Data Engineer.
  • Expert proficiency in Databricks Platform (required).
  • Expert proficiency in PySpark (recommended).
  • Advanced proficiency in:

Python

Apache Spark

ETL pipelines

Data Governance

  • Strong skills in:

Databricks

Spark (batch and/or real-time processing)

SQL

Scala

Data ingestion & transformation

Data quality & governance

Data infrastructure

Experience working with AWS or Azure cloud environments.



  • Kuala Lumpur, Kuala Lumpur, Malaysia AIMS Data Centre Sdn Bhd Full time

    Position Overview:As a Project Engineer within our Data Centre Infrastructure team, you will play a crucial role in supporting the design, implementation, and management of our mission-critical data centre facilities. You will work closely with senior engineers and project managers to ensure the seamless integration of mechanical, electrical, civil &...

  • Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Ryt Bank Full time 60,000 - 120,000 per year

    About the Role: Ryt Bank is seeking a highly motivated and enthusiastic Data Engineer to join our dynamic Data Engineering team. As a Data Engineer, you will work at the core of our engineering efforts, developing and optimizing scalable data infrastructure and pipelines, enabling efficient data processing and storage to power our innovative digital...

  • Data Engineer

    4 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Inter Island Group Full time

    Job Description: Create and manage data pipelines for diverse sources in our data lake/warehouse.  Collaborate with analysts to implement necessary data transformations. Research relevant data sources for property development.  Develop web scraping scripts for data acquisition.  Automate deployment and testing of data pipelines using CI/CD.  Utilize...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Inter Island Manpower Pte Ltd Full time

    Design, develop, and maintain offline and real-time ETL pipelines for the game advertising domain, including performance tuning and scalability improvements.Analyze ad conversion performance and produce customized/personalized reports and dashboards.Build and maintain Python-based backend systems for data crawling, web scraping, and data ingestion Job...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Agensi Pekerjaan WOBB Sdn Bhd Full time

    -Design, develop, and maintain offline and real-time ETL pipelines for the game advertising domain, including performance tuning and scalability improvements.-Analyze ad conversion performance and produce customized/personalized reports and dashboards.-Build and maintain Python-based backend systems for data crawling, web scraping, and data...

  • Data Engineer

    2 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Adecco Full time

    We're Hiring: Data Engineer (Data & AI Projects)Location: Kuala Lumpur, MalaysiaSalary: Up to RM15,000 per monthApply: Open to Malaysian citizens onlyWe are supportinglarge enterprise and technology-driven organizationson high-impactData & AI initiatives.What You'll Be DoingDesign, develop, and optimize end-to-end data pipelines using Python, SQL, and...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Axross (YC W22) Full time

    Data EngineerOffice Location :Kuala Lumpur, MalaysiaType :Full-TimeAbout AxrossAtAxross, we developAI-powered HVAC optimization platforms that help industrial clients, including those in pharmaceuticals, semiconductors, and precision manufacturing to monitor, control, and reduce their energy usage. Our systems rely on high-quality, real-time data from IoT...

  • Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Atomic Recruitment SEA Full time

    Job Title: Data Engineer (Mid to Senior)Key ResponsibilitiesPartner with product owners, managers, and engineers to define project scopes and shape Minimum Viable Products (MVPs).Collaborate with cross-functional teams to design and implement big data solutions using technologies such as Databricks, Azure Data Factory, Spark, PySpark, Python , and ...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Hyppies Full time

    Data EngineersSeniority: Mid to Senior to Principal to StaffIndustries: Across industries such as banking, fintech, digital banking, AI-driven organization, FMCG.Working Arrangement: Some hybrid, some are fully onsite - flexi hours however.Description:Some roles focus purely on data engineering, while others have expectations on data architecture or focus on...

  • Data Engineer

    2 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Hytech Consulting Management Sdn Bhd Full time

    We are seeking a highly skilled Data Engineer with experience in cloud-based data platforms to build scalable, reliable data pipelines and robust data models. This role will work closely with data teams, AI teams, and business stakeholders to ensure a solid data foundation that supports analytics, reporting, machine learning, and downstream data products.Job...