body {font: normal 400 13px/16px 'Open Sans','Helvetica Neue',Helvetica,Arial,sans-serif;color:#333;margin:10px;}p,span,div,b,i,u{ line-height: 120% !important; font-family: 'Open Sans','Helvetica Neue',Helvetica,Arial,sans-serif !important; }
Job Description
Job Title:
|
Senior Data Engineer
|
Grade:
|
|
Department:
|
IT
|
Reports To:
|
Head of Data Engineering
|
Purpose of the role
The Senior Data Engineer manages the data engineers, to ensure the delivery of data flows/data sets to connect operational systems data for business intelligence and analytics that are easy to use. They will proactively and strategically collaborate with all parts of the business to design and oversee delivery of solutions for predictive analytics, using innovative ways to connect multiple data sources to draw insights from data.
|
Main duties
- Develop Business Intelligence and analytical solutions, prototypes for functional and enterprise use, including but not limited to testing, deployment and maintenance.
- Working with the architecture and infrastructure function, take the lead on architecture decisions and optimisation of data pipelines.
- Providing KPIs on data engineering team performance.
Supporting the team and actively delivering such responsibilities as:
- Develop data pipelines for ingestion, storage and transformation.
- Data acquisition and migration to Azure data platform, enterprise data warehouse, including conformance to enterprise data model.
- Provide technical support in development and delivery of data catalogue, lineage and data classification.
- Creation and maintenance of enterprise data views /data marts in enterprise data warehouse.
- Continuously seek opportunities to enhance data quality and reliability of data.
- Develop consistent documentation for technical processes.
|
Supervisory responsibilities / position in structure
Working conditions
Office-based, with flexibility through our Hybrid Working Policy
Off-site visits as appropriate
|
Employee’s signature:
|
Date:
|
Manager’s signature:
|
Date:
|
Person Specification
Post:
|
|
|
Senior Data Engineer
|
|
|
Department:
|
|
|
IT
|
|
|
Requirements
|
Essential
|
Desirable
|
Educational attainment
|
- Degree Level Qualification in Computer science, IT or equivalent.
- Microsoft Certified: Azure Data Engineer Associate.
|
- Certification in Agile PM
|
Knowledge required
|
- Expert knowledge of Azure Data tech stack, specifically hands on experience of delivering solutions in Azure
DB, ADF pipelines, SSAS, SSIS, SQL Server DB.
- Expert knowledge of database design, relational and dimensional modelling, star schema and snow flake scheme.
- Working knowledge of Data and Visualisation tools, primarily Power BI.
- Working knowledge of Power Platform.
|
- Use of Salesforce
- Microsoft Office365
- Data Storytelling through reporting and visualisation
- DevOps/DataOps
|
Experience required
|
- Autonomous and optimised delivery of ETL and Data solutions in cloud-based infrastructure.
- Operational experience with metadata management data quality, and experience in the use of associated technologies.
- Technical expertise in data mining and segmentation.
- Hands on experience with SQL querying.
- Experience of using API’s to get data.
- Experience of working with Agile methodologies.
|
- Experience in Utility sector.
- Experience in Data catalog, data quality management platforms.
- Experience in reverse-engineer data models from a live system.
|
Skills and competencies required
|
- Communication skills in data, you know how to communicate between technical and non-technical stakeholders.
- Data analysis and synthesis, you know how to undertake data profiling and source system analysis.
- Ability to prioritise tasks aligned to bigger objective, raise risks and provide resolutions.
- Ability to understand data and turn data from various sources into business information.
- Demonstrate experience in working well within teams showing strong collaborations and resourcefulness.
|
|
Personal qualities required
|
- Enthusiasm to lead a team for optimal performance, identifying team matters and effectively resolving.
- Self-driven and team player.
- Attention to detail and accuracy.
- Drive and ability to learn new technologies quickly to stay up-to-date in an ever-changing environment Committed to providing the highest level of customer service.
- Able to analyse complex situations and derive workable actions.
|
- Ability to understand and integrate cultural differences and work effectively with virtual cross-cultural, cross-border teams.
- Experience developing and managing new and existing partnerships with 3rd party vendors.
|
Other
|
|
|