SENIOR DATA ENGINEER

Our Client, Aberdeen based Oil and Gas Operator is seeking a Senior Data Engineer to join their Aberdeen team on a Permanent staff basis. Azure Data factory/Data Lake, PySpark are essential skills for this role.

RESPONSIBILITIES

Supporting Data Platform Program: Collaborate with cross-functional teams to

maintain and enhance our modern data platform, leveraging your expertise in

Synapse and data engineering techniques.

Analyse, Model and Organise Data: Work with a range of stakeholders and

business users to understand the use and utility of datasets and systems to

then analyse, model and organise data from their respective source data

systems into the medallion data lake for further use in reporting.

Ensure data quality and data reliability: Drive improvements in data quality

assessments, and ensure that data is processed effectively, efficiently,

robustly and timely.

Maintaining Data Governance: Ensuring that data governance policies and

procedures are followed, and that data lineage and cataloguing is maintained

for data discoverability

Deliver Business Insights: Support and deliver business insight, intelligence

and predictive analytics reporting which creates real business value

Performance Management: Looking at wider trends across the data

processing infrastructure to identify improvements.

Project Scoping and Management: Defining project scopes and timelines for

delivery of a variety of projects, in collaboration with the Digital Technology

Partners and the Data and Analytics Lead.

Data Governance: Working with the Data and Analytics Lead to improve Data

Governance policies and procedures and its enforcement across the data

estate

QUALIFICATIONS & EXPERIENCE

Appropriate professional qualification or equivalent experience

Proven competency working with data warehousing, ETL/ELT, integration

tools and business intelligence solutions that will help to deliver the data and

analytics strategy.

Skills with Synapse (notebooks and data flows) is essential for Senior Data

Engineer.

Working knowledge of PySpark is essential for Senior Data Engineer

Capability working with Azure Data Lake Storage is essential for Senior Data

Engineer

Working knowledge of medallion data Lake house architecture is essential for

Senior Data Engineer

Strong background in data analytics, with a focus on data transformation and

modelling.

Competency of Master Data Management principles and implementations is

essential for Senior Data Engineer

Oil & Gas industry exposure is not required; however, a passion for working

with data is a must.

Familiarity with Power BI is desirable but not essential.