Data Engineer

Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

about the companyleading public listed company with 5 subsidiaries specializing in property development, investment & trading rspectivelyabout the jobdesigning, development and maintaining data pipelines from various sources responsible for data ingestion and transformationwork closely with data scientist and data analyst to implement data transformations...

Role: Data Engineer (Cantonese Speaker)Location: KL, Malaysia Mandatory:Azure SQL, Azure Databricks, Azure DevOps, Azure Pipeline.Secondary:Java, Kafka, API, MS SQL Server, ADFDescription:Data Analysis of new and existing inhouse systems.Data analysis of heterogeneous external source systems.Query, analyse and transform complex data sets with the goal of...

about the companyboutique consulting data and analytics services and solutioning company, providing end to end services including data strategy, data engineering, data visualization, data analytics and application development. about the jobResponsible to design, build and maintain data pipelines Responsible to perform ETL process with data from various...

Job Purpose: • Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. • Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. • Monitoring Jobs Workflow and working with technical teams to derive permanent fix. • Hands on Experience in Building, Trouble...

about the companyPioneering marketing-tech in ASEAN, this firm's mission is to simplify and leverage data to connect with millions of ASEAN consumers. Specializing in Consumers, Media & E-Commerce, it leads innovation in the industry. Join the journey to redefine marketing-tech and unlock the full potential of data-driven insights about the roleThis...

Job Purpose: Should be able to troubleshoot errors on Informatica, Teradata, Hadoop platforms and supports applications built on top of it. Strong problem solving knowledge on Databases like Hadoop, Teradata & SQL. Monitoring Jobs Workflow and working with technical teams to derive permanent fix. Hands on Experience in Building, Trouble Shooting...

about the companycourier service provider that provides universal postal services, providing services to both end users and corporate clients. They also provide services within the logistics and aviation industry about the jobResponsible for creating and maintaining data pipeline architecture Tansforming structured and unstructured data that is extracted...

about the companyPioneering marketing-tech in ASEAN, this firm's mission is to simplify and leverage data to connect with millions of ASEAN consumers. Specializing in Consumers, Media & E-Commerce, it leads innovation in the industry. Join the journey to redefine marketing-tech and unlock the full potential of data-driven insights! about the roleThis...

Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in...

Open Position: Data Architect (MNC IT Services Provider) An MNC IT Services Provider is seeking for Data Architect to join the team and be based in the Kuala Lumpur officeKey requirements include: Proven experience as a Data Architect Experience in areas relevant to data engineering, including data management, custom ETL design, data mining and data modeling...

**Our vision** Rotate is the go-to team in the cargo industry for commercial decision-making tools and solutions. We help airlines turn data into action and improve their day-to-day commercial decision-making. **What you’ll be doing** We build data-driven solutions in collaboration with airlines around the world. Data is the core asset of our business,...

Job description Responsibilities: You will oversee the complete software delivery process within the data analytics domain, covering requirement analysis, solution design, development, testing, implementation, and production support in Finance & Risk Analytics. Analyze user requirements and translate them into solution design documents; effectively...

**About the Role**: - Client: Oil and Gas Reputable Company - Number of Vacancies: 8 - Based Location: Onsite - Kuala Lumpur - Joining Date: Immediate / 1 Month - Note: Only open to local talents due to project requirements - Salary range: RM8,000 - RM10,000 **Data Engineer Skills**: - 5+ years of experience in large-scale data warehouse and lakehouse...

Data Analysis and Modeling: Employ advanced statistical techniques and machine learning algorithms to analyze user behavior, platform performance, and market trends. - Insight Generation: Translate complex data findings into clear, actionable insights that inform product development, marketing strategies, and user experience enhancements. - Predictive...

Employ tools and techniques used to understand and analyze how Oil & Gas company should collect, update, store and exchange data - Define and employ data modeling and design standards, tools, best practices, and related development methodologies - Designs, reviews and maintains data models - Performs the data analysis activities to capture data requirements...

**In this role you will be responsible for**: - Maintaining positive relationships with customers. - Leading the service delivery team, managing conflict, and ensuring the team's processes and tasks are carried out efficiently. - Managing finances and budgets. - Identifying customer needs and overseeing service delivery within the business context. -...

about the jobrole:Perform a variety of complicated work related tasksPerform technical training to MU EngineersCapable of working with little supervision based upon trainingIn all aspect of the job, need to have a higher standard of conduct.technical:Render Onsite and phone assistance to customers and fellow associatesSupport Customer Engineer MU for...

Data Analyst will create user story on DevOps, during sprint grooming Data Analyst will brief on the Database Engineer(DBE) task - All the information and requirement of the data will be on the user story - In every sprint DBE will work and complete the task within the sprint - DBE role involves in updating and ingesting data on masterDB - DBE also works on...

Data Engineer Skills: - 5+ years of experience in large-scale data warehouse and lakehouse design, implementation, and maintenance. - Experience with big data management and processing tools like Hadoop and Apache Spark. - Experience with data transformation tools such as AWS Glue, Talend, and Databrick (SQL, Python, and Scala). - Experience with SQL and...