Senior Data Engineer

4 days ago

Malacca, Melaka, Malaysia 5G-Starlink Pte. Full time 60,000 - 120,000 per year


Job description

Our team

We are the Business Intelligence team. We lead the organisation in cultivating a data-driven culture as our company moves toward the future. We collect meaningful data and analytics for us to deeply understand our consumers and build more valuable products and services. What we do is incredibly important in driving smart marketing decisions, optimising our business, and increasing profitability.

Your role

At Deriv, we are looking for a detail-oriented Senior Data Engineer with the capability to define the data pipeline of our future data models. You will leverage technologies such as Google Cloud Platform, Airflow, Python, Docker, and PostgreSQL to help provide the company with dependable business intelligence solutions. As part of this role, you will develop, test, and maintain architectures for data processing and build Extract, Transform, and Load (ETL) pipelines. You will be a key contributor to making our data warehouse trustworthy by ensuring data accuracy.

Your challenges

  • Ensure data integrity while extracting data from in-house and third-party complex sources and manage its systematic storage. Responsible for data security, accuracy, and accessibility
  • Provide tangible business solutions and decisions using your expertise in the data engineering domain
  • Design and build high-performance, secure, and scalable company data warehouse and pipeline to support data science projects following best practices
  • Debug and resolve complex issues, and recommend improvements to ensure a well-functioning ETL pipelined architecture
  • Transform raw data into easy-to-use tables for the Data Analysts
  • Keep up-to-date on company products and new releases to efficiently plan changes in our data warehouse or pipelines

What you have

  • A minimum of 5 years of experience in the data engineering field
  • Expertise in data modelling techniques such as Kimball star schema, Anchor modelling, and Data vault
  • Competence in object-oriented or object function scripting languages such as Python
  • Proficiency in relational SQL and NoSQL databases, preferably with PostgreSQL, PITR, Pg_basebackup, WAL archival, and Replication
  • Familiarity with column-oriented storage or data warehouses such as parquet, Redshift, and Bigquery
  • In-depth skills in developing and maintaining ETL/ELT data pipelines and workflow management tools such as Airflow
  • Hands-on experience with Google Cloud Platform (GCP) services such as BigQuery, scheduled queries, Cloud Storage and Cloud Functions
  • Familiar with alerting and self-recovery methods concerning data accuracy
  • Analytical skills with the ability to transform data into optimal business decisions
  • Expertise in peer reviewing pipeline codes and suggesting improvements when required
  • Experience in helping teams make informed business decisions with data
  • Strong communication and presentation skills
  • Fluency in spoken and written English

What's good to have

  • A good background in cybersecurity and data protection
  • Proficiency in using data pipeline and workflow management tools such as Luigi
  • Exposure to maintaining and monitoring database health and resolving errors
  • Experience in managing stakeholders expectations and technical requirement gathering
  • Familiarity with container technologies such as Docker
  • A fintech background

  • Senior Data Engineer

    4 days ago

    Malacca, Melaka, Malaysia 5G-Starlink Pte. Full time 90,000 - 120,000 per year

    Job descriptionOur teamWe are the Business Intelligence team. We lead the organisation in cultivating a data-driven culture as our company moves toward the future. We collect meaningful data and analytics for us to deeply understand our consumers and build more valuable products and services. What we do is incredibly important in driving smart marketing...

  • Fabric Data Engineer

    4 days ago

    Malacca, Melaka, Malaysia Elitez Pte Ltd Full time 80,000 - 120,000 per year

    Industry: Industrial automationKey Responsibilities:Utilize Microsoft Fabric for data integration and processing, including Notebooks, Azure Data Factory, and Dataflow Gen2.Evaluate and select the appropriate Fabric storage service—Lakehouse or Data Warehouse—based on project requirements and data architecture needs.Design, develop, and optimize semantic...

  • Senior Software Engineer

    4 days ago

    Malacca, Melaka, Malaysia BTI Executive Search Pte Ltd Full time 90,000 - 120,000 per year

    Software Senior Engineer (Melaka/Penang) - Relocation Allowance ProvidedA leading global provider of advanced semiconductor equipment solutions is looking for a Senior Software Engineer, focusing on developing high-quality software that interfaces with sophisticated hardware systems.Key Responsibilities:Executes full software development life cycles,...

  • Senior Engineer

    4 days ago

    Malacca, Melaka, Malaysia 5G-Starlink Pte. Full time 40,000 - 60,000 per year

    Job DescriptionResponsibilities:Participate in requirements analysis.Design and develop applications and services.Revise, update, refactor, improve, and debug code.Test and deploy applications and systems.Documents and demonstrates solutions by developing documentation, flowcharts, layouts, diagrams, charts, and code comments.Requirements:Minimum Bachelors...

  • Principal Engineer Data Systems

    2 days ago

    Malacca, Melaka, Malaysia Infineon Technologies (Malaysia) Sdn Bhd Full time 120,000 - 240,000 per year

    #WeAreIn for driving decarbonization and digitalization.As a global leader in semiconductor solutions in power systems and IoT, Infineon enables game-changing solutions for green and efficient energy, clean and safe mobility, as well as smart and secure IoT. Together, we drive innovation and customer success, while caring for our people and empowering them...

  • Senior Engineer Industrial Engineering

    4 days ago

    Malacca, Melaka, Malaysia Infineon Technologies Full time 120,000 - 240,000 per year

    Manages manufacturing and/or production operations including assembly, machinery, processing and/or packaging. Sets production schedules based on product introduction, equipment efficiency, materials supply, staffing resources, and volume required to meet demand and to ensure maximum production quantity and quality.Your RoleKey responsibilities in your new...

  • Quality Engineers/Senior Engineers

    4 days ago

    Malacca, Melaka, Malaysia ATX SEMICONDUCTOR (MELAKA) SDN. BHD. Full time 800,000 - 1,200,000 per year

    We're hiring [Mandarin-speakers preferred due to business communication with our China counterparts)If you're passionate about precision, love solving problems, and take pride in building things the right way — we want to hear from you We're on the lookout for Quality Engineers who are ready to make an impact and help us raise the bar even higher. The...

  • Senior Engineer Product Engineering

    4 days ago

    Malacca, Melaka, Malaysia Infineon Technologies Full time 120,000 - 200,000 per year

    Ensure manufacturability already in the product development phase by supporting running development projects and take ownership of dedicated deliverables of the product development flowYour RoleKey responsibilities in your new roleEnsure manufacturability already in the product development phase by supporting running development projects and take ownership...

  • Senior Staff Engineer Development Metrology

    2 days ago

    Malacca, Melaka, Malaysia Infineon Technologies (Malaysia) Sdn Bhd Full time 80,000 - 120,000 per year

    #WeAreIn for driving decarbonization and digitalization.As a global leader in semiconductor solutions in power systems and IoT, Infineon enables game-changing solutions for green and efficient energy, clean and safe mobility, as well as smart and secure IoT. Together, we drive innovation and customer success, while caring for our people and empowering them...

  • Senior Staff Engineer Development Metrology

    4 days ago

    Malacca, Melaka, Malaysia Infineon Technologies Full time 120,000 - 240,000 per year

    Responsible in data management systematic in backend development, jointly realizing design and implement automated development data pipelines for extraction, processing, and management.Job DescriptionIn your new role you will:Drive data governance implementation in Backend Development organization, leading to formulation of Data Quality Management...