Manager Data Engineering

JOB PURPOSE
:

• Build a cost-effective and highly scalable "single version of truth" data repository for storing both organization's structured & unstructured data, as well as data from third party and publicly available sources.
• Improve overall digital competence and harness AI computational capabilities to reduce redundancy and increase productivity. AI technologies will be applied to big data, to accelerate digital transformation and adapt swiftly to disruption in various sectors.
• Lead research and experimentation of new technologies to provide technical leadership in developing applications, analysing business requirements, and keeping the technology optimal and up to standards

PRINCIPAL ACCOUNTABILITIES:

PROJECT MANAGEMENT

• Lead and manage MISC Group project delivery, application management & support for Data Analytics, with role of Resource-Workplan, Project Assessment-Scoping, Design, Budget, Estimation, Tracking and Development Verification of data resources, data models, and data pipelines in production.
• Manage resources, budget planning and ensuring the KPI targets are achieved for Data Engineering team.
• Manage deliveries of multiple simultaneous projects on-time within budget and targeted zero defects.

APPLICATIONS IMPLEMENTATION AND DEVELOPMENTS

• Establish strong relationship and collaboration with various stakeholders (internal and external) to gain understanding of their strategies, objectives, and tactics to develop a comprehensive corporate executive dashboard.
• Engage stakeholders to identify and understand organization's needs for suitable data analytics-reporting tools.
• Identify business and operational data requirements and present ideas on data usage and analysis methodologies to various audiences.
• Collaborate with Data Analytics teams to translate business requirements to functional requirement
• Provide technical leadership and guidance for data visualization and data analytics platforms improvement.
• Manage enhancement and improvement of MISC data platform to become a virtual self-serve data platform that be utilized in different levels within the organizations as well as various vertical industries.
• Optimize Azure Cloud utilization and explore more efficient ways for data ingestion, storage, and consumption
• Lead design, build, test development, maintenance, expand, and optimizing data pipeline architecture, data sets, data flow, and collection for cross functional teams.

APPLICATIONS SUPPORT AND MAINTENANCE

• Manage the implementation of In-House pilot projects for big data in MISC and the identified subsidiaries. The pilot projects refer to the roll out of the data analytics platform and its applications to support MISC Center of Excellence (CoE) initiative in big data.
• Manage, Identify, analyse, evaluate, and resolve productivity and data issues or discrepancies and implements processes improvements to ensure data quality, integrity, and reliability.
• Monitor, track and resolve ICT incidents and problems to support restoration of services as quickly as possible while limiting business impact.

TENDER MANAGEMENT

• Manage the process to produce and deliver bid or tender documents to get the best proposal with value for money for the organisation.
• Implement effective tender strategies to manage user's requirements whilst complying with the relevant policies and governance.

PEOPLE DEVELOPMENT

• Build In-House capability to provide services and operational support by develop a training plan for Transfer of Knowledge (TOK) in Big Data.
• Ensures team maintains appropriate skills and competencies required to conduct operations timely, effectively and in compliance.
• Develop, mentor, and coach development teams to build a strong development team, increase team effectiveness, and promote individual team members' growth

REQUIREMENT & QUALIFICATION:

• At least 10 years working experience as an ETL developer or data engineer within the data and analytics domain with technical project management experience
• Hands-on experience in data engineering, data management, data mining, ETL design, building, maintaining, and optimizing data pipeline, data architecture and data models
• Hands-on experience with Azure Data Lake, Azure Data Factory, Synapse and Databricks
• Hands on experience using databases, data integration tools and related technologies/toolset experience (such as Microsoft SSIS, Informatica or Talend)
• Hands-on experience with SQL, ETL, database management and transformation.
• Experience with delivering small, medium, and large integration and Data analytics projects
• Strong logical thinking, analysis, problem solving skills and ability to prioritize tasks.
• Knowledge of programming languages (e.g., Java and Python) is an advantage
• Experience in ERP is an advantage
• Strong leadership, interpersonal, and communication skills (written and oral) with ability to communicate with stakeholders
• Bachelor's Degree, Post Graduate Diploma, Professional Degree, Master's Degree or equivalent
• Data analytics/engineering certification is an advantage