Databricks Data Engineer

2 days ago

Greater Kuala Lumpur, Malaysia Abhidi Solution Full time 120,000 - 240,000 per year

Key Responsibilities:

  • Design and implement scalable data pipelines using Apache Spark, Delta Lake, and Databricks Workflows.
  • Build and maintain ETL/ELT processes on Databricks Lakehouse Platform to support BI and advanced analytics using Delta Live Tables.
  • Optimize performance of data pipelines and queries using Spark tuning and caching strategies.
  • Implement and maintain CI/CD pipelines for data engineering workflows using tools like Databricks Repos, Git, and Azure DevOps.
  • Secure and govern data using Unity Catalog, data masking, and role-based access controls.
  • Integrate with upstream/downstream systems such as AWS S3, Snowflake, or Power BI.
  • Good Experience on Databricks Asset Bundles.
  • Develop documentation and promote best practices in the use of Databricks notebooks and workflows.

Required Qualifications:

  • Mandatory 4+ years of experience in data engineering, analytics, or platform engineering roles.
  • Proven hands-on experience with Databricks, Spark, Delta Lake.
  • Proficiency in Python and SQL.
  • Strong understanding of distributed computing and cloud data architecture and data warehousing.
  • Familiarity with DevOps practices and tools for CI/CD and infrastructure as code.
  • Nice-to-have Knowledge of Lakehouse architecture, Unity Catalog, and Databricks SQL.
  • Experience with data governance, metadata management, and security controls.
  • Databricks certifications (e.g., Databricks Certified Data Engineer Associate/Professional).

  • Databricks Data Engineer

    2 weeks ago

    Kuala Lumpur, Kuala Lumpur, Malaysia AVANADE ASIA PTE LTD Full time 120,000 - 240,000 per year

    The Databricks Data Engineer will be responsible for the design, development, and maintenance of scalable and high-performance data pipelines within the Databricks Lakehouse Platform. This role involves using Apache Spark, Delta Lake, and various Databricks services to process large volumes of batch and streaming data, ensuring data quality, reliability, and...

  • Data Engineer – Databricks

    4 hours ago

    Kuala Lumpur, Kuala Lumpur, Malaysia POWER IT SERVICES Full time 80,000 - 120,000 per year

    Required Technical Skill Set• Data processing Proficiency.• Database Technologies (Microsoft SQL & Cloud-native) 2 SQL Level 2 - 1 Oracle & Linux• Develop and optimize ETL processes using Databricks.• Containerization: Utilize Docker for packaging Databricks.• Problem-Solving and debugging• DevOps Practices: Implement CI/CD, automation, and...

  • Databricks Architect

    2 weeks ago

    Kuala Lumpur, Kuala Lumpur, Malaysia AVANADE ASIA PTE LTD Full time $120,000 - $200,000 per year

    The Databricks Solution Architect is a senior technical leadership role responsible for defining, designing, and overseeing the implementation of scalable, secure, and high-performance data platforms using the Databricks Lakehouse Platform. This individual will translate business strategy into technical architecture, guide development teams, and ensure all...

  • Data Engineer

    2 weeks ago

    Greater Kuala Lumpur, Malaysia Kamlax Global Technologies Full time 60,000 - 120,000 per year

    Hiring: Data Engineer (AWS | Python | PySpark | Databricks)Location:Kuala Lumpur, MalaysiaExperience:7+ yearsWe're seeking aData Engineerto design and maintain scalabledata pipelines, ETL processes, anddata warehousing solutions.Must have strong hands-on experience withPython, PySpark, Databricks, and at least3+ years on AWS.AWS certificationwill be an added...

  • Databricks Architect

    2 weeks ago

    Kuala Lumpur, Malaysia Avanade Full time

    Come join us The Databricks Solution Architect is a senior technical leadership role responsible for defining, designing, and overseeing the implementation of scalable, secure, and high-performance data platforms using the Databricks Lakehouse Platform. This individual will translate business strategy into technical architecture, guide development teams,...

  • Data Engineer

    2 weeks ago

    Greater Kuala Lumpur, Malaysia Helius Technologies Full time 90,000 - 120,000 per year

    Job ResponsibilitiesDesign, build and maintain scalable data pipelines for batch and/or real-time processing.Develop and optimize ETL processes to support data ingestion, transformation and analytics needs.Work with Databricks and Apache Spark to process large datasets efficiently.Ensure data quality, data governance and adherence to best...

  • Databricks Technical Lead

    2 weeks ago

    Kuala Lumpur, Malaysia Avanade Full time

    Come join us The Databricks Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the **Databricks Lakehouse Platform**. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns,...

  • Databricks Machine Learning Lead

    2 weeks ago

    Kuala Lumpur, Kuala Lumpur, Malaysia AVANADE ASIA PTE LTD Full time 120,000 - 180,000 per year

    The Databricks M/L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring...

  • lead / Senior data engineer: Python / AWS / Databricks

    2 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Capcon Asia Full time 120,000 - 200,000 per year

    Why are they awesome?Data driven technology spin off from a leading aviation strategy, logistics and air cargo consultancyBuilding data-driven SaaS tools that help airlines make informed commercial decisions from; routes, maintenance, demand planning, operations and forecast modelsProducts / Projects2 core SaaS products that are mature - actively used by...

  • Data Engineer

    5 hours ago

    Greater Kuala Lumpur, Malaysia Salt Full time 90,000 - 120,000 per year

    SALT Talent is looking to hire a Data Engineer for one of the big Automobile clients in Kuala Lumpur, Malaysia for 12 months & renewable contract role. In this role you are expected to bring an expert knowledge in the implementation and definition of reports and dashboardsJob Description:Requirements analysis and customer consulting for analytics...