Senior Data Engineer

About this role

The key purpose of this role is to deliver new, and implement changes to existing data solutions, data extraction and transform (ETL), using the full Microsoft SQL stack, for identified and agreed business requirements. In addition, the Senior Data Engineer will be responsible for translating business requirements into Azure Cloud-based big data solutions for our Data Transformation programme. This will include building complex data pipelines, data warehouses and the data lakes, using Azure services such as Azure Data Factory, Azure Data Bricks and Azure Synapse Analytics. Your responsibilities will include… Leading the design, development, delivery and maintenance of technical on-premises SQL and Azure Cloud data engineering solutions, ensuring alignment with business priorities and best practice Implementing robust ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines and Azure Databricks (PySpark/Spark SQL) to support batch and streaming data processing Designing and delivering real-time and batch data ingestion solutions using Azure Event Hubs, Kafka, Databricks Structured Streaming and Azure Stream Analytics Developing and maintaining modern data platforms, including Delta Lake/Lakehouse architectures on ADLS Gen2, curated datasets, dimensional models and Azure Synapse Dedicated SQL Pools Analysing current business practices, processes and procedures, identifying opportunities to leverage Microsoft Azure Data & Analytics Services to improve business outcomes and data processing efficiency Maintaining the integrity of data architecture, championing high-quality data standards and the effective use of data repositories, relational models and data warehouse solutions to deliver accurate, consistent and reliable data Designing and delivering performance enhancements, application migrations, version upgrades and data platform modernisation initiatives, including migrations from on-premises to public cloud environments Championing and mentoring colleagues on Data Engineering best practices, while developing reusable code, libraries, patterns and frameworks for Azure cloud-based data warehousing and data pipelines Contributing to the development and continuous improvement of database management services, processes and standards relating to the delivery of data solutions What's in it for you? We offer a competitive base salary depending on experience from £55,000 to £70,000 and a competitive benefits package including: Annual discretionary bonus opportunity: up to 17.5% 30 days annual leave Choose to contribute 3% or 5% pension, with employer contributions of 6% or 8% respectively Enhanced family-focused benefits Hybrid-working Please use this link to see the fantastic benefits available at OSB: OSB Careers About us At OSB Group, we understand how much our people bring to our organisation, which is why we try our best to give back too! Our Purpose is to help our customers, colleagues and communities prosper and we are on a transformation journey to become ‘the bank of the future’. Our commitment to professional development, flexible working, and employee well-being fosters a dynamic and supportive workplace. Do you have the skills? We are looking for talented individuals who have the experience and knowledge set out below: Extensive experience with Data Engineering / ETL development experience is essential with a regulated environment, preferably Financial Services Significant experience with data solution design experience in an MI / BI / Analytics environment (Kimball, lake house, data lake) is essential Significant experience using: Azure Data Factory, Azure Synapse Analytics, Azure SQL, Azure Data Lake, Datra bricks, Purview and Azure App Service is essential Proficiency in Python/SQL/SparkSQL/PySpark is essential Strong experience of Azure delivery experience including analysis / development / configuration/ deployments essential Expert level technical skill set in as Transact SQL language and relational databases is essential Next steps If this sounds like you, please apply now! For internal applications please visit the internal careers page to apply. Still on the fence? Hear from our team or explore our process: OSB Careers Shortlisted candidates will go through a personalised recruitment process, that is relevant and conversational. If you need any adjustments or support, we’re here to make sure you can show your best self. We are proud to be a Disability Confident employer and are committed to creating an inclusive and accessible workplace where everyone can thrive. We welcome applications from people of all backgrounds and encourage candidates with disabilities and long-term health conditions to apply. If you meet the minimum criteria for the role and would like to be considered under our Disability Confident Scheme, please indicate this on your application. Diversity, Equity & Inclusion Our team value spending time together in the office, typically 3 days a week to support collaboration and connection with colleagues, but we’re happy to have a conversation about what flexibility might look like for you. Not sure if you meet the spec? Let us decide. Research tells us that those from marginalised groups feel like they need to meet 100% of the criteria to apply. Here at OSB, we are committed to inclusivity and understand the value different experiences and perspectives can bring, so please don’t feel like you need to check every box to apply for a role internally. We champion diversity at all levels, with Board-level Diversity Champions tracking our progress. We are proud to be signed up to the Women in Finance Charter to actively support the growth and development of senior women in our sector and are dedicated to treating all our employees and job applicants equally, opposed to discrimination on any grounds.

What this role is, and what else it is called

Employers in the UK advertise this kind of work as Data Engineer, Data Analyst, AI Engineer and Data Scientist too, so it is worth searching more than one wording. It is a senior Data, AI & Machine Learning role in the UK, advertised as hybrid, splitting time between home and the office.

How this role compares to the market

110 live UK roles list Python right now, across 76 source domains. The median annual salary midpoint is £55,000. 67% of 61 roles with a known arrangement are remote. Browse Python roles.

72 live UK roles list Azure right now, across 63 source domains. 43% of 37 roles with a known arrangement are remote. Browse Azure roles.

Senior roles make up 831 of the live UK IT market and have a median annual salary midpoint of £62,500.

Market figures are today's snapshot of reportable live UK roles on public careers and vacancy pages; see hiring trends.

Technologies mentioned

Detected on OSB Group's careers page. ProdReady Recruitment lists this vacancy as an aggregator and is not the employer; applications go to the employer's own site.