Data Engineer

3 weeks ago


Kuala Lumpur, Malaysia Zurich Insurance Company Full time

Job Overview

We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

Responsibilities for Data Engineer

Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Work together with data scientists and analysts to understand the needs for data and create effective data workflows. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations. Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications for Data Engineer

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management. A successful history of manipulating, processing and extracting value from large disconnected datasets. Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. Strong project management and organizational skills. Experience supporting and working with cross-functional teams in a dynamic environment. We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools: Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with Azure cloud services implementation. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

You are the heart & soul of Zurich 

At Zurich, we like to think outside the box and challenge the status quo. We take an optimistic approach by focusing on the positives and constantly asking What can go right? 

Let’s continue to grow together

Location(s): MY - Kuala Lumpur  Schedule: Full Time Recruiter name: Eilma Fatehah Sabri Closing date: 29th February 2024
  • Data engineer

    3 weeks ago


    Kuala Lumpur, Malaysia Encora Inc. Full time

    Data Engineer  Important Information Location: Kuala Lumpur Experience: 5 years relevant experience Job Mode: Contract Work Mode: On-site Responsibilities and Duties Experience in SQL Have ETL background (In GUI tools like Talend/Informatica) Have good Experience in Unix/Windows command line/Python scripting Have good Experience in Big data...

  • Data engineer

    11 hours ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Unison Consulting Pte Ltd Full time

    Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

  • Data Engineer

    3 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyleading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectivelyabout the jobdesigning, development and maintaining data pipelines from various sources responsible for data ingestion and transformationwork closely with data scientist and data analyst to implement data transformations...

  • Data Engineer

    3 weeks ago


    Kuala Lumpur, Malaysia Mandrill Tech Full time

    Established in Kuala Lumpur since 2015, Mandrill Tech is a fast growing technology company. It serves many clients from various lines of industry.Being an MSC certified company, Mandrill Tech is recognized as leaders in ICT industry development in Malaysia. It reflects our commitment to be the frontliner of technology innovation and advancements.The RoleYou...

  • Data Engineer

    3 weeks ago


    Kuala Lumpur, Malaysia Two95 International Inc. Full time

    Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE) DATA ENGINEER - IT with Extensive experience in "Healthcare ". With Minimum Experience - 3 years & Maximun Experience - 15 yearsCore responsibilities include: Work within a highly specialized and growing team to enable delivery of data and advanced analytics system capability. Develop and...

  • Data Engineer

    4 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Cognizant Technology Solutions Full time

    Role: Data Engineer (Cantonese Speaker)Location: KL, Malaysia Mandatory:Azure SQL, Azure Databricks, Azure DevOps, Azure Pipeline.Secondary:Java, Kafka, API, MS SQL Server, ADFDescription:Data Analysis of new and existing inhouse systems.Data analysis of heterogeneous external source systems.Query, analyse and transform complex data sets with the goal of...

  • Senior Data Engineer

    3 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyboutique consulting data and analytics services and solutioning company, providing end to end services including data strategy, data engineering, data visualization, data analytics and application development. about the jobResponsible to design, build and maintain data pipelines Responsible to perform ETL process with data from various...


  • Kuala Lumpur, Malaysia Publicis Groupe Full time

    Job Description What you’ll do: As a Data Engineer, you’ll build the strategic and tactical foundation for data-driven marketing efforts. You’ll work to achieve client goals through proper management and transformation of client data. Day-to-day, your role includes: · Assessing, formulating and implement data management framework/solution...

  • Data Engineer

    3 weeks ago


    Kuala Lumpur, Malaysia CAPCO Full time

    Data Engineer at Capco Malaysia - Kuala Lumpur Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It’s important to us that we recruit and develop...


  • Kuala Lumpur, Malaysia Petroplan Full time

    KEY OBJECTIVE Lead the Engineering Data Management for the Project Development, ensuring efficient and impactful data utilization throughout the project lifecycle. Be the focal person to supervise and execute in Project database management and project insights development. Responsible to look after the Projects Document Control Management System, and...

  • Azure Data Engineer

    3 weeks ago


    Kuala Lumpur, Malaysia Tata Group Full time

    JOB DESCRIPTION: 1) Azure Data Engineering skill sets (Azure Data Factory, Databricks, Synapse, SQL, etc) 2) Python, PySpark, RDD, SQL and Big data processings 3) NoSQL database experience 4) BI & requirements gathering 5) Airline Domain Data knowledge 6) Good to have - CosmosDB, Azure DevOps 7) Good to have - knowledge of ITIL, Agile processes.

  • Data engineer

    20 hours ago


    Kuala Lumpur, Malaysia Growthfn Sdn Bhd Full time

    Job Purpose: • Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. • Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. • Monitoring Jobs Workflow and working with technical teams to derive permanent fix. • Hands on Experience in Building, Trouble...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companyPioneering marketing-tech in ASEAN, this firm's mission is to simplify and leverage data to connect with millions of ASEAN consumers. Specializing in Consumers, Media & E-Commerce, it leads innovation in the industry. Join the journey to redefine marketing-tech and unlock the full potential of data-driven insights about the roleThis...

  • Data Engineer, Data

    3 weeks ago


    Kuala Lumpur, Malaysia United Overseas Bank Full time

    Data Engineer, Data Posting Date: 13-May-2023 Location: Kuala Lumpur, Wilayah Persekutuan, MY Company: UOB Innovation Hub 2 Sdn. Bhd. About UOB United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America....


  • Kuala Lumpur, Malaysia Twelve Data Full time

    What we need An experienced front-end developer is required in the core development team. The team develops products that automate processes within the company, develops pages and components of the twelvedata.com site, improves site performance and customer experience. We make a high-quality intranet, meeting the high requirements of our users - Twelve Data...

  • Data engineer

    11 hours ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Growthfn Sdn Bhd Full time

    Job Purpose: Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. Monitoring Jobs Workflow and working with technical teams to derive permanent fix. Hands on Experience in Building, Trouble Shooting...

  • Senior Data Engineer

    3 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Randstad Malaysia Full time

    about the companycourier service provider that provides universal postal services, providing services to both end users and corporate clients. They also provide services within the logistics and aviation industry about the jobResponsible for creating and maintaining data pipeline architecture Tansforming structured and unstructured data that is extracted...

  • Software Engineer

    3 weeks ago


    Kuala Lumpur, Malaysia NXP Semiconductors Full time

    Develop breakthrough Data Analytics Methods and Solutions using Big Data solutions to drive predictive analytics, statistical inference and machine learning applications as applied to quality and cost improvement. Mentor data analytics team in implementing new and innovative algorithms. Define, develop and execute test analytics and automation solutions to...

  • Senior Data Engineer

    3 weeks ago


    Kuala Lumpur, Malaysia The Edge Partnership Full time

    Key responsibilities Implement ETL systems that are operationally stable, efficient, and automated. This includes technical solutions that are scalable, aligned with the enterprise architecture and can adapt to changes in business. Monitor and optimize batch jobs, including automation and scheduling. Consistently review and enhance performance with...


  • Kuala Lumpur, Malaysia Twelve Data Full time

    Summary Twelve Data’s Backend team is looking for a high-energy Golang backend developer with a passion for creating impactful FinTech products. This team is responsible for developing stable systems that process terabytes of financial quotes daily. The tools we develop will be used by thousands of users creating their own financial worlds that altogether...