Data Resiliency Engineer

2 days ago

Malaysia Payments Network Malaysia Full time 120,000 - 180,000 per year


SUMMARY OF RESPONSIBILITIES

As a Data Resiliency Engineer, you will be at the forefront of maintaining and enhancing the robustness of our data infrastructure. You will analyze issues to identify root causes and implement solutions that ensure a seamless user experience. Your expertise in data ecosystem monitoring, incident management, and data quality enhancement will play a pivotal role in maintaining operational excellence. You will utilize advanced tools like Datadog and Opsgenie to proactively monitor and resolve issues, act as a subject matter expert for data-related inquiries, and champion data quality initiatives. Additionally, you will work closely with the team to ensure our suite of payments reporting systems for participants as well as PayNet internal reports, are accurate and aligned with evolving organizational needs, driving continuous improvement in our data-driven operations.

KEY AREAS OF RESPONSIBILITIES

  • Root Cause Analysis & Bug Fixing: Analyze issues to uncover root causes and implement effective solutions, ensuring a smooth user experience.
  • Data Ecosystem Monitoring: Oversee the data environment using advanced monitoring tools like Datadog, proactively identifying and addressing issues before they escalate.
  • Alert System Management: Collaborate with the team managing Opsgenie and other alert systems, ensuring timely responses to critical incidents and maintaining operational excellence.
  • Data Lake Support: Serve as the primary contact for data-related inquiries, including ETL incident management, reporting challenges, and providing actionable insights.
  • Data Quality Monitoring: Own and enhance data quality monitoring tools, designing robust pipelines and frameworks to maintain the highest data integrity standards.
  • Reporting Management: Lead report amendments and ensure reporting processes are accurate and meet the evolving needs of the organization.

QUALIFICATIONS & EXPERIENCE

Minimum Qualifications

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
  • Strong experience with AWS data services (e.g., S3, Glue, Athena, Quicksight, Lambda).
  • Strong experience in Python programming language
  • Proficiency in PySpark for large-scale data processing.
  • Familiarity with workflow management tools (e.g., Apache Airflow)
  • Familiarity with operating data tools on Kubernetes and EKS
  • Expertise in monitoring tools (e.g., Datadog, CloudWatch) to proactively track and resolve issues.
  • Experience with alert management systems like Opsgenie or similar platforms.
  • Strong understanding of data lakes and managing large-scale data environments.
  • Experience in performing root cause analysis for complex data issues and implementing effective bug fixes.
  • Terraform or other IaC tools for infrastructure provisioning
  • Relevant certifications in AWS and data engineering

PERSONAL QUALITIES

  • Self-motivated problem solver who can work with minimal guidance
  • Excellent communication skills to articulate technical details clearly to non-technical stakeholders.
  • Detail-oriented with a focus on data quality and reliability
  • Proven ability to work cross-functionally with multiple teams (e.g., Data Engineering, Operations, Analytics).
  • Passionate engineer looking to learn new technologies

  • Risk & Resilience Program Manager

    2 days ago

    Penang, Malaysia - Grande Micron Full time 150,000 - 250,000 per year

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.As a Global Risk and Resilience Regional Program Manager,...

  • Data Engineer

    2 days ago

    Malaysia|Indonesia|Philippines AYP Full time 60,000 - 120,000 per year

    SummaryAYP is seeking a goal-oriented Data Engineer to be a part of the Technology team and work closely with the Business Intelligence team to ensure data pipelines are secure and effective.This person will play a pivotal role in operationalising the most-urgent data and analytics initiatives for AYP's digital business initiatives. You'll be given the...

  • Snr Manager, Data center support

    2 days ago

    Malaysia Oracle Full time 120,000 - 240,000 per year

    DescriptionAs a leader in the Cloud Hardware support organization, you will be responsible for leading teams of Datacenter Technicians and/or Field Engineers assigned for delivery of on-site support, installations, proactive services in a defined territory and/or data center sites across Malaysia. Focuses to meet the required service levels 24x7, improve...

  • Security Development Engineer

    2 days ago

    Malaysia Payments Network Malaysia Full time 80,000 - 120,000 per year

    SUMMARY OF RESPONSIBILITIESPart of the Security Engineering team, responsible for co-developing solutions and automation workflows to improve the overall security posture of PayNet.Serve as a change agent in automation initiatives, building pipelines to enhance operational efficiency.Ensure that sound security controls are in place, commensurate with...

  • Senior Software Engineer, Data Platform

    2 days ago

    Malaysia CoinGecko Full time 204,700 - 204,900 per year

    CoinGecko is a global leader in tracking cryptocurrency data. Operating since 2014, CoinGecko has built the world's largest cryptocurrency data platform, tracking over 10,000 tokens across more than 400 exchanges, serving over 300 million page views in more than 100 countries. We are proud to have played a major part in mainstream awareness, adoption, and...

  • Data Center Construction Manager, Apjc Cm Sea

    2 days ago

    Malaysia Amazon Web Services Malaysia SDN. BHD. Full time

    Bachelor’s degree or relevant work experience in Construction Management, Architecture, Structural, Civil, Mechanical or Electrical Engineering - 7-10 years of work experience in design, construction or program management in mission critical facilities. - Be able to read and interpret construction related drawings for all disciplines. - Possess...

  • Senior Data Engineer

    2 days ago

    Kuala Lumpur, , Malaysia QS Quacquarelli Symonds Full time 120,000 - 180,000 per year

    Role: Senior Data EngineerLocation: Kuala Lumpur, MalaysiaJob type: Full time, permanentWorking arrangement: HybridThis position offers a hybrid work model, allowing flexibility between working from home and our office. Typically, employees are expected to work 2 days in the office per week.Why QS?At QS, we believe that work should empower you. That's why we...

  • Data Quality Engineer

    2 days ago

    Malaysia Ttms My Full time 60,000 - 120,000 per year

    Tasks & Responsibilities: Responsible for automated data quality, risks and mitigations, and helping the team take ownership of data quality Risk management and mitigation associated with data products (i.e. operational risk or privacy) Planning and implementation of automated data quality tests, UAT (User Acceptance Test) and automated systems integrations...

  • Data Scientist

    2 days ago

    Malaysia British American Tobacco Full time 800,000 - 1,200,000 per year

    BAT is evolving at pace into a global multi-category business. Our purpose is to create A Better Tomorrow by Building a Smokeless World.To achieve our ambition, we are looking for colleagues who are ready to join us on this journey Tomorrow can't wait, let's shape it together British American Tobacco has an exciting opportunity for a Data Scientist in Subang...

  • Manufacturing Engineer 3

    2 days ago

    Malaysia Lam Research Full time 120,000 - 180,000 per year

    The group you'll be a part of The Global Operations Group brings information systems, facilities, supply chain, logistics, and high-volume manufacturing together to drive the engine of our global business operations. We help Lam deliver industry-leading solutions with speed and efficiency, while actively supporting the resilient and profitable growth...