Data Engineer

Found in: Talent MY C2 - 2 weeks ago

Petaling Jaya, Malaysia REV Media Group Full time

Job Description

As a Data Engineer, you will be responsible for extracting data from various media social platforms and APIs, developing and operating data pipelines, implementing MLOps practices, serving APIs, performing web scraping, and automating data processes. Your expertise in machine learning and proficiency in technology stacks such as GCP, Linux, BigQuery, and Airflow will be essential in delivering high-quality data solutions.

Key Accountabilities

Extract data from media social platforms (e.g., Facebook, Twitter, Instagram) and APIs using appropriate tools and techniques. Develop, deploy, and maintain scalable and efficient data pipelines to ingest, transform, and load data from various sources into the data warehouse. Collaborate with data scientists and analysts to understand data requirements and design optimal solutions. Implement MLOps practices, including model deployment, monitoring, and version control, to ensure smooth integration of machine learning models into production environments. Serve APIs to enable real-time access to data for internal and external stakeholders. Perform web scraping to gather relevant data from websites and integrate it into the data ecosystem. Automate data processes, ensuring efficiency, reliability, and accuracy in data handling and processing. Monitor and optimize data pipelines and workflows for performance, reliability, and scalability. Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to implement end-to-end data solutions. Stay up-to-date with emerging technologies, industry trends, and best practices in data engineering, machine learning, and cloud platforms.

Skills/ Qualifications/ Experience

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 3+ years of professional experience as a Data Engineer or a similar role. Proficiency in data extraction from media social platforms (e.g., Facebook Graph API, Twitter API, Instagram API) and other external data sources. Strong experience in developing and operating data pipelines using tools like Apache Airflow or similar workflow management systems. Solid understanding of MLOps principles and experience deploying machine learning models into production environments. Knowledge of web scraping techniques and tools (e.g., Beautiful Soup, Scrapy). Strong programming skills in languages such as Python, SQL, and familiarity with Linux environments. Experience working with cloud platforms, especially Google Cloud Platform (GCP), including services like BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Ability to design, optimize, and tune data pipelines for performance, scalability, and reliability. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills to work effectively in a cross-functional team environment.

Preferred

Experience with cloud platforms, such as GCP, AWS, or Azure. Knowledge of machine learning concepts and experience working with ML frameworks (e.g., TensorFlow, PyTorch). Familiarity with containerization technologies (e.g., Docker, Kubernetes).

Our Offer

Work with a young and vibrant team in a fast-paced startup environment, embracing new and exciting challenges daily. Opportunity to work on exciting projects, leveraging your skills in media social data extraction, data pipeline development, MLops, web scraping and automation. Stay ahead of the curve by upskilling your tech knowledge and adapting to the latest technologies in the field. Experience upgrading career development within the company, unlocking new and exciting opportunities. Enjoy an attractive remuneration package that rewards your dedication and commitment. Benefit from flexible working arrangements, including a hybrid mode setup Engage in monthly team events/activities that foster camaraderie and create lasting memories. Join a team that values work-life balance and supports you in finding the perfect equilibrium

If this opportunity captures your interest, we welcome you to share your CV/Resume along with your introduction, notice period (if applicable), and your expected salary range to .

  • Data Engineer Intern

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Hilti Full time

    What's the role? In the role of Data Engineer intern, you will be developing, deploying, and maintaining data pipelines to support analytics and data science on a Hilti group level. Embedded in the global enterprise data lake team you will work closely with leading experts in the field of data engineering. You will interact with key stakeholders from...

  • Data Engineer, Ikano Retail

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia IKEA Full time

    Jobbeskrivning Company description The IKEA vision is to create a better everyday life for the many people. We do this by offering a wide range of well-designed, functional home furnishing products at prices so low that as many people as possible can afford them. We operate in Singapore, Malaysia, Thailand and...

  • Data Architect

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Hastings Deering Full time

    Company : Sime Darby Auto Bavaria Sdn. Bhd.Responsibilities• Understand the Sime Darby Motor’s overall data estate, IT/business priorities and measures of success to design cloud-based data architectures using your deep technical knowledge.• Lead Architecture Design Sessions, Workshops, Rapid Prototypes, and Hackathons to accelerate the technical...

  • Data Scientist(Data Analyst)

    2 days ago

    Petaling Jaya, Malaysia Optimum Infosolutions (M) Sdn Bhd Full time

    We're committed to revolutionizing the consumer experience across our platform in Southeast Asia. Our Consumer Experience Team spearheads efforts to enhance user growth, retention, and engagement through innovative strategies and data-driven insights. We're seeking a dynamic Data Scientist (Analytics) to join our team, focusing on product experimentation,...

  • Data Scientist, Asia

    3 weeks ago

    Petaling Jaya, Malaysia QBE Insurance Full time

    **Primary Details** Time Type: Full time Worker Type: Employee **Primary Responsibilities** - Develop and refine analytical use cases with internal business customers in alignment with Analytics leads and partners. - Play an active role on projects of diverse scope, range, priority and urgency within the insurance domain - Translate between business and...

  • Data Scientist, Asia

    3 weeks ago

    Petaling Jaya, Malaysia QBE Full time

    Primary Details Time Type: Full time Worker Type: Employee Primary Responsibilities - Develop and refine analytical use cases with internal business customers in alignment with Analytics leads and partners. - Play an active role on projects of diverse scope, range, priority and urgency within the insurance domain - Translate between business and...

  • Regional Data Privacy Counsel

    2 days ago

    Petaling Jaya, Malaysia Grab Full time

    **Company Description** Life at Grab** At Grab, every Grabber is guided by The Grab Way, which spells out our mission, how we believe we can achieve it, and our operating principles - the 4Hs: Heart, Hunger, Honour and Humility. These principles guide and help us make decisions as we work to create economic empowerment for the people of Southeast...

  • Business Account Manager

    5 days ago

    Petaling Jaya, Malaysia JAC Malaysia Full time

    Location: - Petaling Jaya- Specialisation: - Engineering & Manufacturing- Salary: - MYR 60,000 - 72,000 (Annual)- Reference: - PR/156284- Contact details: - Penny Bun- Job published: - November 14, 2023 20:24**JOB RESPONSIBILITIES** - Develop business opportunities in Data Center industry which include infrastructure solutioning and Maintenance Services. -...

  • Staff Engineer, Product Design Engineering

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Western Digital Full time

    Company Description At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible. At our core, Western Digital is a company of problem solvers. People achieve extraordinary things given the right technology. For decades, we’ve been doing just that. Our...

  • Intern 2 - Engineering (Jan 2024)

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Siemens Energy Full time

    Intern 2 - Engineering (Jan 2024) About the Role Location Malaysia Selangor Petaling Jaya Company Siemens Energy Sdn. Bhd. Organization Gas Services Business Unit Service Asia Pacific Full / Part time Full-time Experience Level Student (Not Yet Graduated) LET’S TALK ABOUT YOU Your profile Undergraduate Degree Engineering in...

  • Senior/Staff Engineer, Product Design Engineering

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Western Digital Full time

    Company Description At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible. At our core, Western Digital is a company of problem solvers. People achieve extraordinary things given the right technology. For decades, we’ve been doing just that. Our...

  • Network Supply Chain Data Steward

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Elanco Full time

    At Elanco (NYCE: ELAN) – it all starts with animals!As a global leader in animal health, we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets. We’re driven by our vision of ‘Food and Companionship Enriching Life’ and our approach to sustainability – the Elanco Healthy Purpose –...

  • Electrical Engineer

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Aurecon Full time

    Demonstrates excellent mathematical, analytical and problem solving skills, in area of discipline. Assists in establishing design related hypothesis for testing through data analysis. Has the required experience to undertake packages of design work with less supervision. Produces and /or reviews technical drawings, 3D models, plans schematics and...

  • Solution Architect

    Found in: beBee S MY - 1 week ago

    Petaling Jaya, Malaysia Tech Data (Singapore) Pte. Ltd. Full time

    Job Purpose:   To support the organization to grow profitable growth for our partners by actively enabling them, building end to end solutions to drive sales opportunities for the Security and Cloud Security domain and engaging the partner to accelerate wins through the provision and application of technical expertise across multiple vendors,...

  • Executive, Data Science

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia REV Media Group Full time

    Job Description The Data Science & Analytics Executive will help us make smarter decisions and deliver even better products. Our team drives initiatives to improve performance across a variety of media platforms while delivering consumer analytics efforts to better understand how users engage with our digital products. You will increase efficiency...

  • Product Engineer

    Found in: beBee S MY - 7 days ago

    Petaling Jaya, Malaysia JAC Recruitment Malaysia Full time

    JOB RESPONSIBILITIES  Responsible for engineering aspects of any related repair component within the product portfolio and support to New Product Introduction (NPI) programs Update and implement repair scopes into client existing repair capability Prepare written instructions and procedures for the individual repairs and publish for production...

  • Staff Engineer, Product Design Engineering

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Western Digital Full time

    Job DescriptionCompletes assigned tasks that meet quality, functionality and schedule objectives.Collects and analyzes data for functional design reviews.Helps prepare Readiness review materials and preview content with the Lead Engineer.Requires only general supervision and little guidance.Provide input to program / project technical strategy.Has broad...

  • Machine Learning Engineer

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia PlayStation Full time

    Why PlayStation? PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of products and services including PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, acclaimed PlayStation software titles from...

  • Level 3 Windows Engineer

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Agensi Pekerjaan BTC Sdn Bhd Full time

    Job DescriptionOpen Position: Level 3 Windows Engineer (MNC IT Company) An MNC IT Company is currently hiring for Level 3 Windows Engineer in the Selangor office to support and manage the Active Directory, Windows 10, Office365 and Virtualization platforms. Key responsibilities include:Good experience in supporting and administrating Windows and...

  • Staff Engineer, Firmware Engineering

    Found in: Talent MY C2 - 2 weeks ago

    Petaling Jaya, Malaysia Western Digital Full time

    Job DescriptionRoles / Responsibilities  Design, develop, test, integrate and maintain quality firmware for eHDD using best practices like unit test, CI and Agile methodologies.  Design and implementation of data structures, software algorithms, data path, and drivers for hardware cores using latest standards C++ and Python.  Participate in Scrum &...