Big Data Engineer

1 week ago


Kuala Lumpur, Kuala Lumpur, Malaysia Lavu Tech Solutions Sdn Bhd Full time

Required Technical Skill Set: Hadoop, PySpark, Spark SQL, HIVE

 Hands-on experience of Hadoop, PySpark, Spark SQL, Hive, Hadoop Big Data

Eco System Tools.

 Should be able to develop, tweak queries and work on performance

enhancement.

 Solid understanding of object-oriented programming and HDFS concepts

 The candidate will be responsible for delivering code, setting up

environment, connectivity, deploying the code in production after testing.

Good-to-Have

 Preferable to have good DWH/ Data Lake knowledge.

 Conceptual and creative problem-solving skills, ability to work with

considerable ambiguity, ability to learn new and complex concepts quickly.

 Experience in working with teams in a complex organization involving

multiple reporting lines

 The candidate should have good DevOps and Agile Development Framework

knowledge.

Responsibility of / Expectations from the Role;

 Need to work as a developer in Cloudera Hadoop.

 Work on Hadoop, PySpark, Spark SQL, Hive, Bigdata Eco System Tools.

 Experience in working with teams in a complex organization involving multiple reporting lines.

 The candidate should have strong functional and technical knowledge to deliver what is required and

he/she should be well acquainted with Banking terminologies.

 The candidate should have strong DevOps and Agile Development Framework knowledge.

 Create PySpark jobs for data transformation and aggregation.

 Experience with stream-processing systems like Spark-Streaming.


  • Big Data Engineer

    6 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia POWER IT SERVICES Full time

    · Hands-on experience of Hadoop, PySpark, Spark SQL, Hive, Hadoop Big Data Eco System Tools.· Should be able to develop, tweak queries and work on performance enhancement.· Solid understanding of object-oriented programming and HDFS conceptsThe candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Inter Island Manpower Pte Ltd Full time

    Design, develop, and maintain offline and real-time ETL pipelines for the game advertising domain, including performance tuning and scalability improvements.Analyze ad conversion performance and produce customized/personalized reports and dashboards.Build and maintain Python-based backend systems for data crawling, web scraping, and data ingestion Job...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Agensi Pekerjaan WOBB Sdn Bhd Full time

    -Design, develop, and maintain offline and real-time ETL pipelines for the game advertising domain, including performance tuning and scalability improvements.-Analyze ad conversion performance and produce customized/personalized reports and dashboards.-Build and maintain Python-based backend systems for data crawling, web scraping, and data...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Atomic Recruitment SEA Full time

    Job Title: Data Engineer (Mid to Senior)Key ResponsibilitiesPartner with product owners, managers, and engineers to define project scopes and shape Minimum Viable Products (MVPs).Collaborate with cross-functional teams to design and implement big data solutions using technologies such as Databricks, Azure Data Factory, Spark, PySpark, Python , and ...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia HCLTech Full time

    SummaryWe are seeking a highly skilledData Engineerwith strong experience in data warehousing and big data technologies. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and solutions that enable efficient data processing and analytics.ResponsibilitiesDesign, develop, and maintain data pipelines and ETL...

  • Data engineer

    7 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Nexperia Full time

    Nexperiais a world-class company in semiconductor development and in-house production. A proven global player with an entrepreneurial mentality. At our core is an 13,000+ strong international network with a singular focus. Built on passion and commitment to our work, belief in our goals and a drive to succeed regardless of the challenges we face. We support,...

  • Data engineer

    7 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Nexperia Germany GmbH Full time

    Nexperia is a world-class company in semiconductor development and in-house production. We form a global network of talent, with passion and performance, perseverance and professionalism. Join TeamNexperia and become part of a leading company that supports, rewards and challenges you equally, in a dynamic environment, working for world-class results. Talk to...

  • Data Engineer

    7 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Asgard Resources Sdn Bhd Full time

    Role OverviewWe are seeking a skilled Data Engineer to design and build scalable big data processing platforms that enable real-time decision-making and AI-driven automation. You will be responsible for developing robust data pipelines, ensuring high data quality, and optimizing system performance and resource usage. Your work will directly contribute to...

  • Data Engineer

    1 week ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Axross (YC W22) Full time

    Data EngineerOffice Location :Kuala Lumpur, MalaysiaType :Full-TimeAbout AxrossAtAxross, we developAI-powered HVAC optimization platforms that help industrial clients, including those in pharmaceuticals, semiconductors, and precision manufacturing to monitor, control, and reduce their energy usage. Our systems rely on high-quality, real-time data from IoT...

  • Data Engineer

    3 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia VCB Malaysia Berhad Full time

    The Data Engineer designs, builds, and maintains data infrastructure (pipelines, databases, systems) to collect, transform, and store large datasets, making them accessible and usable for analysts and scientists to drive business insights, focusing on scalability, quality, and security using tools like Python, SQL, and big data tech (Spark, Hadoop). You're...