DevOps Engineer

1 day ago

Malaysia Payments Network Malaysia Full time $60,000 - $120,000 per year


SUMMARY OF RESPONSIBILITIES

As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling efficient and reliable data pipeline building, data analysis, and data governance. Your primary responsibility will be to ensure smooth data ingestion into the data lake or data warehouse, enabling downstream data consumption for Data Scientists, Analysts, and other stakeholders. You will utilize various AWS services such as MSK/Kafka, S3, EMR or Glue, Lakeformation, Athena, QuickSight, and manage ingestion from different databases like MS SQL, MySQL, Oracle, and PostgreSQL.

KEY AREAS OF RESPONSIBILITIES

Data Pipeline Build:

  • Collaborate with Data Engineers to design, implement, and optimize data pipelines.
  • Ensure efficient and reliable data ingestion processes from various sources into the data lake or data warehouse.
  • Implement data validation and quality checks to maintain data integrity throughout the pipeline.

Data Analysis Support:

  • Assist Data Scientists and Analysts in their routine analytical work by providing data access and query support.
  • Optimize data storage and retrieval mechanisms to enhance performance and efficiency.
  • Collaborate with stakeholders to identify and implement solutions for data analysis and reporting requirements.

Data Governance and Security:

  • Utilize AWS Lakeformation and other relevant tools to establish and enforce data governance policies.
  • Implement security measures and access controls to protect sensitive data.
  • Collaborate with stakeholders to ensure compliance with data privacy regulations.

FUNCTIONAL COMPETENCIES

Technical Expertise:

  • Strong expertise in AWS services such as MSK/Kafka, S3, EMR or Glue, Lakeformation, Athena, and QuickSight.
  • Proficient in database management systems like MS SQL, MySQL, Oracle, and PostgreSQL.
  • Familiarity with Change Data Capture (CDC) mechanisms and practices.
  • Solid understanding of data pipeline architecture, ETL processes, and data integration techniques.

Collaboration and Communication:

  • Excellent collaboration skills to work closely with Data Engineers, Data Scientists, Analysts, and stakeholders.
  • Strong communication skills to effectively convey technical concepts to both technical and non-technical audiences.
  • Ability to collaborate with cross-functional teams and promote a culture of knowledge sharing and continuous improvement.

Problem-solving and Troubleshooting:

  • Proven ability to identify and resolve complex technical issues related to data ingestion, processing, and analysis.
  • Experience in performance tuning, optimizing data storage and retrieval, and addressing scalability challenges.
  • Strong analytical and problem-solving skills to diagnose and troubleshoot system-level issues.

Automation and Infrastructure as Code (IaC):

  • Proficiency in infrastructure automation using tools like Terraform, CloudFormation
  • Experience in managing and administering Kubernetes on-premises or EKS in AWS
  • Experience with version control systems (e.g., Git) and CI/CD pipelines for automated deployments.
  • Understanding of Infrastructure as Code (IaC) principles to maintain reproducible and scalable environments.
  • Proficient in programming languages such as Python, Golang, Java

Minimum Qualifications

  • Bachelor's Degree in Computer Science, Information Systems Technology, or Software Engineering
  • More than 7 years of relevant experience in Information Technology, especially in the field of DevOps
  • Relevant work experience in the Financial Services and/or Technology sectors would be an added advantage
  • Excellent in both English and Bahasa Malaysia

  • Devops Engineer

    1 day ago

    Malaysia InfoDrive Solutions Pte. Full time $60,000 - $120,000 per year

    DevOps Engineer Direct Contract - 2 Positions .SPR /Singaporean Prefered.DT requires strong engineers for the Build-Run teams across grades. For day-to-day work, engineers are positioned inside the multi-disciplinary teams and work to achieve business goals. In addition, engineers are part of the development practice, specialized in areas like Java,...

  • DevOps Engineer

    1 day ago

    Malaysia Razorpay Full time 48,000 - 72,000 per year

    Razorpay is one of India's leading full-stack financial technology companies, powering the way businesses move, manage, and grow money. Founded in 2014 by Harshil Mathur and Shashank Kumar with a simple vision — to simplify payments for Indian businesses — we've since grown into a fintech powerhouse driving India's digital payment revolution.Razorpay...

  • DevOps

    1 day ago

    Malaysia Trustana Singapore Pte. Ltd Full time 90,000 - 120,000 per year

    Trustana - DevOpsAbout TrustanaTrustana is a SaaS platform helping retailers, distributors, and brand owners manageand activate product data. We're building AI-native tools that power better workflows,from onboarding to enrichment to syndication.What You'll Do• Own the practice and help in creating the devOps culture at Trustana• Contribute in designing,...

  • DevOps and ETL Engineer with Azure

    1 day ago

    Petaling Jaya, Malaysia ARRK Engineering Full time 80,000 - 150,000 per year

    DevOps and ETL Engineer with Azure (m/f/x)WHAT TO EXPECTAre you creative, with a passion to put your ideas and expertise to good use? Then welcome to ARRK Engineering. We offer you excellent career prospects, a challenging range of tasks, independence, as well as a welcoming and respectful working environment. Come and join our teamYOUR TASKSDevelopment and...

  • DevOps Engineer

    1 day ago

    Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, , Malaysia MVC Resources Full time 80,000 - 120,000 per year

    • Work closely with Developers, QA and DevOps • Configure, document, optimize and support the components of the DevOps infrastructure • Design and develop the business's infrastructure architecture • Build automated deployments using configuration management technologies • Provide support and maintain Production, Staging and Dev environments...

  • Platform Reliability Engineer

    1 day ago

    Malaysia HCLTech Full time 90,000 - 120,000 per year

    Job PurposePlatform Reliability Engineer (PRE) is responsible for engineering, operating, and maintaining GELs internal container platform and its supporting infrastructure, with a strong focus on reliability, resiliency, and security. As a Senior PRE within GELs Infrastructure team, you will play a pivotal role in designing, building, and operating...

  • Senior Software Engineer

    1 day ago

    Malaysia Revolab Full time 120,000 - 240,000 per year

    Job SummaryWe are seeking an experienced Senior Software Engineer to lead the design, development, and optimization of high-performance backend systems and APIs. You will take ownership of core infrastructure components, shape backend architecture decisions, and drive backend integration of AI functionalities across services. You'll collaborate closely with...

  • Sr. Software Engineer

    1 day ago

    Malaysia Ttms My Full time $60,000 - $120,000 per year

    Senior Software Engineer (BE NodeJS)Job Description: As our new software engineer, you'll be working as a senior contributor with other dedicated and talented technical staff to deliver next generation Web3 Identity applications. You will be collaborating with global and diverse teams in the design and implementation of high quality, reliable, maintainable...

  • Senior Engineer

    1 day ago

    Malaysia Gamuda Berhad Full time 60,000 - 120,000 per year

    Job Summary The Senior Engineer – Software Development is responsible for designing, developing, and maintaining high-quality software applications that align with business needs. This role involves active collaboration with developers, testers, and various stakeholders throughout the software development lifecycle. The Senior Executive will also...

  • Senior Engineer

    1 day ago

    Malaysia Gamuda Berhad Full time 90,000 - 120,000 per year

    Job Summary The Senior Engineer – Software Development is responsible for designing, developing, and maintaining high-quality software applications that align with business needs. This role involves active collaboration with developers, testers, and various stakeholders throughout the software development lifecycle. The Senior Executive will also...