Jobplacements Cloud Data Engineer Jobs in South Africa
Jobplacements Cloud Data Engineer Jobs in South Africa
Job Description PBT Group has an opportunity for a Data Engineer to improve profitability by supporting the IT Strategy through the automation of data acquisition and provisioning, the development of Analytics and Business Information, to support the Business in their decision making. Responsible for the Data Ingestion, Transformation, ETL, Data Modelling, Data Architecture and Storage management.
One of the key responsibilities will be the translation of business requirements into usable cloud hosted data architecture, which will include an enterprise data model, associated metadata and common business glossary that are used to guide enterprise solution development and achieve consistency of data assets.
The Data Engineer will be responsible to take business requirements, knowledge of current and future state architecture on data platform design and business capabilities, knowledge of enterprise data standards and deep data expertise into account, to design data architecture solutions that can be implemented in a cost- effective manner. The specific tasks performed will include analyzing business requirements and translate them into data solutions to address complex business needs. The Lead is required to be innovate and creative in their solutioning and frequently involve multiple platforms, software, hardware, technologies, and tools.
Provide month-end production rotational support to ensure data is consumed and ingested to ensure reports are generated within agreed SLAs with business. Resolve production incidents and conduct root cause analysis for improvement.
ETL development into staging and data warehouse environments. Develop new data extracts and modify ETL processes as required to improve reporting datasets.
Develop and maintain data sets, ETL processes and reports related in order to support operations and decision making related to commercial and personal insurance, provide direct support to end-users.
Collaborate with business users and application developers to provide required data. Estimate the time and resource requirements of ETL development work. Validate data and test routines developed & provision of ongoing maintenance and support of assigned ETL applications
Analyse the systems environment to understand how the business systems enable these business processes and how the related data is captured and stored. Analyse the structures in which the data is stored to understand what data can be extracted and how it would be done in an efficient manner.
Analyse the existing reporting environment to understand what reporting is available and how this can be utilized or amended to inform the specific Business decisions involved.
Test all developments for data accuracy, performance and system impact & engage relevant Business users, train them on report usage and guide them in doing user testing.
Schedule data extracts and report runs as required to deliver the required information to users at the necessary frequency. Ensure that scheduled procedures are handed over for monitoring and support by the appropriate resources. Update report specifications to reflect the as-built situation.
Update technical documentation on data extracts and report functionality to facilitate future understanding to the extent required for ongoing support. Respond to user queries, error logging and further enhancement requests to ensure reports are used and serve their intended purpose.
Provide OLAP support and end-user training on the various cubes used for reporting downstream
Data Modelling - emphasizes on what data is needed and how it should be organized instead of what operations need to be performed on the data. Data Model is like architect''s building plan which helps to build a conceptual model and set the relationship between data items. This data capability is required in preparation of the Data Platform implementation, and will also align with the approach taken by Group Data to
implement ERWIN as a tool of choice for Data Modelling
Data Architecture – ensures that we have composed of models, policies, rules or standards that govern which data is collected, and how it is stored, arranged, integrated, and put to use in data systems and in organizations. This data capability is also aligned with the direction that Group Data is taking
Project Related Deliverables and Tasks
Assist the Data Engineering Lead on the below-listed tasks:
Select and implement the appropriate tools, software, applications, and systems to support cloud data technology goals from the chosen MS Azure stack.
Oversee the mapping of data sources, data movement, interfaces, and analytics, with the goal of ensuring good data quality.
Collaborate with Project & Data Stream Leads, Consultants and business unit leaders for all exercises pertaining to the Data Platform Program.
Create and maintain data model and metadata policies and procedures for functional design.
Provide technical recommendations and engage with ETL/BI Architects, Business SMEs and other stakeholders throughout the Solution/Data Architecture and implementation lifecycle and recommend effective solutions to develop high performance and highly scalable data solutions (data marts/warehouse and data mining and advanced analytics)
Raise and ensure data-related problems in regard to systems integration, compatibility, and multiple-platform integration are addressed.
Develop and implement key components as needed to create testing criteria in order to guarantee the reliability and performance of data architecture. Ensure the testing process incorporates Test Automation.
Drive a Data Platform environment that enables maintenance of the current and accurate view of the larger data picture, an environment that supports a single version of the truth and is scalable to support future analytical needs.
Identify and develop opportunities for data reuse, migration, or retirement and platform upgrades.
Communicate with customer, project team in a timely manner and escalates issues & risks appropriately.
5+ years’ experience of delivering Business Intelligence projects using Microsoft & Informatica tools, Visualization Tools (QlikView, SSRS, Power BI). Insurance background and knowledge preferred.
5 years + Experience in cloud computing infrastructure (e.g., MS Azure, Amazon Web Services etc.) and considerations for scalable, distributed systems
5 – 7 years’ experience delivering business capabilities in the short-term insurance business, including hands on experience in the development and design of functional and non-functional technical specifications for complex systems
Short-term insurance business is a key requirement and not negotiable.
Deep knowledge of contemporary architectural principles across the data architectural domain
Understanding of the enterprise architecture to ensure on-going alignment, driving the technical roadmap for key applications and platforms.
Knowledge of different SDLC Methodologies, preferably Agile
Ability to produce solutions using:
Microsoft SQL Integration Services, MS SQL Analysis Services, MS SQL Reporting Services, MS PowerBI, QlikView, Informatica (PowerCenter & PWX CDC)
Knowledge of & Scaled Agile Framework (SAFe) practices will be advantageous
Knowledge of Cloud Services (Azure & AWS) is critical
BSc Computer Science, Data Informatics, Information Technology, or any other related degree.
Cloud Certification is a key requirement.
How to Apply
For more information and job application details, see; Jobplacements Cloud Data Engineer Jobs in South Africa
Find daily jobs in South Africa. Jobs - South Africa jobs. Search our career portal & find the latest South African job positions, career opportunities & jobs in South Africa.
Jobs in South Africa - banking jobs, IT jobs, accounting jobs, NGO jobs, business administration, ICT, UN jobs, procurement jobs, education jobs, hospital jobs, human resources jobs, engineering, teaching jobs, and other careers in South Africa.
Find your dream job from 1000s of vacancies in South Africa posted and updated daily - click here!
Click here to post comments
Join in and write your own page! It's easy to do. How? Simply click here to return to African Jobs.