Big Data Engineer
1 week ago
Required Technical Skill Set: Hadoop, PySpark, Spark SQL, HIVE
Hands-on experience of Hadoop, PySpark, Spark SQL, Hive, Hadoop Big Data
Eco System Tools.
Should be able to develop, tweak queries and work on performance
enhancement.
Solid understanding of object-oriented programming and HDFS concepts
The candidate will be responsible for delivering code, setting up
environment, connectivity, deploying the code in production after testing.
Good-to-Have
Preferable to have good DWH/ Data Lake knowledge.
Conceptual and creative problem-solving skills, ability to work with
considerable ambiguity, ability to learn new and complex concepts quickly.
Experience in working with teams in a complex organization involving
multiple reporting lines
The candidate should have good DevOps and Agile Development Framework
knowledge.
Responsibility of / Expectations from the Role;
Need to work as a developer in Cloudera Hadoop.
Work on Hadoop, PySpark, Spark SQL, Hive, Bigdata Eco System Tools.
Experience in working with teams in a complex organization involving multiple reporting lines.
The candidate should have strong functional and technical knowledge to deliver what is required and
he/she should be well acquainted with Banking terminologies.
The candidate should have strong DevOps and Agile Development Framework knowledge.
Create PySpark jobs for data transformation and aggregation.
Experience with stream-processing systems like Spark-Streaming.
-
Big Data Engineer
6 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia POWER IT SERVICES Full time· Hands-on experience of Hadoop, PySpark, Spark SQL, Hive, Hadoop Big Data Eco System Tools.· Should be able to develop, tweak queries and work on performance enhancement.· Solid understanding of object-oriented programming and HDFS conceptsThe candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in...
-
Data Engineer
1 week ago
Kuala Lumpur, Kuala Lumpur, Malaysia Inter Island Manpower Pte Ltd Full timeDesign, develop, and maintain offline and real-time ETL pipelines for the game advertising domain, including performance tuning and scalability improvements.Analyze ad conversion performance and produce customized/personalized reports and dashboards.Build and maintain Python-based backend systems for data crawling, web scraping, and data ingestion Job...
-
Data Engineer
1 week ago
Kuala Lumpur, Kuala Lumpur, Malaysia Agensi Pekerjaan WOBB Sdn Bhd Full time-Design, develop, and maintain offline and real-time ETL pipelines for the game advertising domain, including performance tuning and scalability improvements.-Analyze ad conversion performance and produce customized/personalized reports and dashboards.-Build and maintain Python-based backend systems for data crawling, web scraping, and data...
-
Data Engineer
1 week ago
Kuala Lumpur, Kuala Lumpur, Malaysia Atomic Recruitment SEA Full timeJob Title: Data Engineer (Mid to Senior)Key ResponsibilitiesPartner with product owners, managers, and engineers to define project scopes and shape Minimum Viable Products (MVPs).Collaborate with cross-functional teams to design and implement big data solutions using technologies such as Databricks, Azure Data Factory, Spark, PySpark, Python , and ...
-
Data Engineer
1 week ago
Kuala Lumpur, Kuala Lumpur, Malaysia HCLTech Full timeSummaryWe are seeking a highly skilledData Engineerwith strong experience in data warehousing and big data technologies. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and solutions that enable efficient data processing and analytics.ResponsibilitiesDesign, develop, and maintain data pipelines and ETL...
-
Data engineer
7 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Nexperia Full timeNexperiais a world-class company in semiconductor development and in-house production. A proven global player with an entrepreneurial mentality. At our core is an 13,000+ strong international network with a singular focus. Built on passion and commitment to our work, belief in our goals and a drive to succeed regardless of the challenges we face. We support,...
-
Data engineer
7 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Nexperia Germany GmbH Full timeNexperia is a world-class company in semiconductor development and in-house production. We form a global network of talent, with passion and performance, perseverance and professionalism. Join TeamNexperia and become part of a leading company that supports, rewards and challenges you equally, in a dynamic environment, working for world-class results. Talk to...
-
Data Engineer
7 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia Asgard Resources Sdn Bhd Full timeRole OverviewWe are seeking a skilled Data Engineer to design and build scalable big data processing platforms that enable real-time decision-making and AI-driven automation. You will be responsible for developing robust data pipelines, ensuring high data quality, and optimizing system performance and resource usage. Your work will directly contribute to...
-
Data Engineer
1 week ago
Kuala Lumpur, Kuala Lumpur, Malaysia Axross (YC W22) Full timeData EngineerOffice Location :Kuala Lumpur, MalaysiaType :Full-TimeAbout AxrossAtAxross, we developAI-powered HVAC optimization platforms that help industrial clients, including those in pharmaceuticals, semiconductors, and precision manufacturing to monitor, control, and reduce their energy usage. Our systems rely on high-quality, real-time data from IoT...
-
Data Engineer
3 days ago
Kuala Lumpur, Kuala Lumpur, Malaysia VCB Malaysia Berhad Full timeThe Data Engineer designs, builds, and maintains data infrastructure (pipelines, databases, systems) to collect, transform, and store large datasets, making them accessible and usable for analysts and scientists to drive business insights, focusing on scalability, quality, and security using tools like Python, SQL, and big data tech (Spark, Hadoop). You're...