Data Engineer

1 month ago


Kuala Lumpur, Malaysia Randstad Malaysia Full time

about the company
leading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectively

about the job

  • designing, development and maintaining data pipelines from various sources
  • responsible for data ingestion and transformation
  • work closely with data scientist and data analyst to implement data transformations and aggregations for reporting needs
  • developing scipts to perform web-scraping for datas available on open sources
  • building and maintaining CI/CD pipelines in automating deployment of data pipelines and data infrastructure
  • managing data solutions and implementations through various cloud services
  • monitoring and troubleshooting data pipelines to ensure data performance and quality

    about the manager/team

    • bachelor degree in computer science or information technology
    • minimum 3 years of experience in data engineering function
    • understanding and hands on experience with data engineering concepts and techniques
    • hands on experience with Azure or AWS cloud services
    • Python as programming language is mandatory
    • extensive experience and knowledge in data modelling, data warehousing
    • Experience in CI/CD

      experience

      2 years

      skills

      no additional skills required

      qualifications

      no additional qualifications required

      education

      Bachelor Degree


  • Data engineer

    3 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Unison Consulting Pte Ltd Full time

    Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

  • Data Engineer

    4 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyleading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectivelyabout the jobdesigning, development and maintaining data pipelines from various sources responsible for data ingestion and transformationwork closely with data scientist and data analyst to implement data transformations...

  • Data Engineer

    1 month ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Cognizant Technology Solutions Full time

    Role: Data Engineer (Cantonese Speaker)Location: KL, Malaysia Mandatory:Azure SQL, Azure Databricks, Azure DevOps, Azure Pipeline.Secondary:Java, Kafka, API, MS SQL Server, ADFDescription:Data Analysis of new and existing inhouse systems.Data analysis of heterogeneous external source systems.Query, analyse and transform complex data sets with the goal of...

  • Senior Data Engineer

    4 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyboutique consulting data and analytics services and solutioning company, providing end to end services including data strategy, data engineering, data visualization, data analytics and application development. about the jobResponsible to design, build and maintain data pipelines Responsible to perform ETL process with data from various...

  • Data engineer

    4 days ago


    Kuala Lumpur, Malaysia Growthfn Sdn Bhd Full time

    Job Purpose: • Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. • Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. • Monitoring Jobs Workflow and working with technical teams to derive permanent fix. • Hands on Experience in Building, Trouble...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyPioneering marketing-tech in ASEAN, this firm's mission is to simplify and leverage data to connect with millions of ASEAN consumers. Specializing in Consumers, Media & E-Commerce, it leads innovation in the industry. Join the journey to redefine marketing-tech and unlock the full potential of data-driven insights about the roleThis...

  • Data engineer

    3 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Growthfn Sdn Bhd Full time

    Job Purpose: Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. Monitoring Jobs Workflow and working with technical teams to derive permanent fix. Hands on Experience in Building, Trouble Shooting...

  • Senior Data Engineer

    4 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companycourier service provider that provides universal postal services, providing services to both end users and corporate clients. They also provide services within the logistics and aviation industry about the jobResponsible for creating and maintaining data pipeline architecture Tansforming structured and unstructured data that is extracted...


  • Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyPioneering marketing-tech in ASEAN, this firm's mission is to simplify and leverage data to connect with millions of ASEAN consumers. Specializing in Consumers, Media & E-Commerce, it leads innovation in the industry. Join the journey to redefine marketing-tech and unlock the full potential of data-driven insights! about the roleThis...

  • Data engineer

    10 hours ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Ambition Full time

    Role Overview:As the key player, you will manage the end-to-end software delivery process in the data analytics field. This includes everything from analyzing requirements to implementing solutions, conducting testing, and providing support in Finance & Risk Analytics.Analyze user needs and translate them into solution design documentsCommunicate technical...

  • Data engineer

    3 days ago


    Kuala Lumpur, Malaysia Unison Consulting Pte Ltd Full time

    Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

  • Data architect

    6 days ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Agensi Pekerjaan Btc Sdn Bhd Full time

    Open Position: Data Architect (MNC IT Services Provider) An MNC IT Services Provider is seeking for Data Architect to join the team and be based in the Kuala Lumpur officeKey requirements include: Proven experience as a Data Architect Experience in areas relevant to data engineering, including data management, custom ETL design, data mining and data modeling...

  • Data Analyst

    4 weeks ago


    Kuala Lumpur, Malaysia Rotate Full time

    **Our vision** Rotate is the go-to team in the cargo industry for commercial decision-making tools and solutions. We help airlines turn data into action and improve their day-to-day commercial decision-making. **What you’ll be doing** We build data-driven solutions in collaboration with airlines around the world. Data is the core asset of our business,...

  • Data engineer

    15 hours ago


    Kuala Lumpur, Malaysia Ambition Full time

    Job description Responsibilities: You will oversee the complete software delivery process within the data analytics domain, covering requirement analysis, solution design, development, testing, implementation, and production support in Finance & Risk Analytics. Analyze user requirements and translate them into solution design documents; effectively...

  • Data Modeler

    5 days ago


    Kuala Lumpur, Malaysia Virtual Calibre Sdn Bhd Full time

    **About the Role**: - Client: Oil and Gas Reputable Company - Number of Vacancies: 8 - Based Location: Onsite - Kuala Lumpur - Joining Date: Immediate / 1 Month - Note: Only open to local talents due to project requirements - Salary range: RM8,000 - RM10,000 **Data Engineer Skills**: - 5+ years of experience in large-scale data warehouse and lakehouse...

  • Data Analyst

    1 week ago


    Kuala Lumpur, Malaysia Talentbank Full time

    Data Analysis and Modeling: Employ advanced statistical techniques and machine learning algorithms to analyze user behavior, platform performance, and market trends. - Insight Generation: Translate complex data findings into clear, actionable insights that inform product development, marketing strategies, and user experience enhancements. - Predictive...


  • Kuala Lumpur, Malaysia NTT DATA Full time

    **In this role you will be responsible for**: - Maintaining positive relationships with customers. - Leading the service delivery team, managing conflict, and ensuring the team's processes and tasks are carried out efficiently. - Managing finances and budgets. - Identifying customer needs and overseeing service delivery within the business context. -...

  • Data Modeler

    4 weeks ago


    Kuala Lumpur, Malaysia Skill Quotient Resources Sdn Bhd Full time

    Employ tools and techniques used to understand and analyze how Oil & Gas company should collect, update, store and exchange data - Define and employ data modeling and design standards, tools, best practices, and related development methodologies - Designs, reviews and maintains data models - Performs the data analysis activities to capture data requirements...


  • Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the jobrole:Perform a variety of complicated work related tasksPerform technical training to MU EngineersCapable of working with little supervision based upon trainingIn all aspect of the job, need to have a higher standard of conduct.technical:Render Onsite and phone assistance to customers and fellow associatesSupport Customer Engineer MU for...

  • Data Analyst

    4 weeks ago


    Kuala Lumpur, Malaysia Skill Quotient Resources Sdn Bhd Full time

    Data Analyst will create user story on DevOps, during sprint grooming Data Analyst will brief on the Database Engineer(DBE) task - All the information and requirement of the data will be on the user story - In every sprint DBE will work and complete the task within the sprint - DBE role involves in updating and ingesting data on masterDB - DBE also works on...