Data Engineer

Job Title: Data Engineer

Location: London
Working Pattern: Hybrid (3-4 days / week in office)
Salary: £55,000 - £70,000 (+ Strong Benefits Package)

Overview

We are seeking a highly skilled and proactive Data Engineer to join a growing technology team within a fast-paced insurance environment. This role will focus on designing, building, and optimising scalable data infrastructure and automation solutions that support operational workflows, reporting, and business-critical analytics.

The position offers the opportunity to work across modern cloud-based data platforms, workflow automation, and emerging AI-assisted technologies, with exposure to projects involving intelligent document processing, operational automation, and practical applications of LLM tooling within the business.

This is an excellent opportunity for someone who enjoys combining strong Data Engineering fundamentals with modern automation technologies in a highly collaborative environment.

Key Responsibilities

Data Engineering & Architecture

• Design, develop, and maintain scalable and reliable data pipelines using Python and SQL.
• Build and optimise modern data architectures, including data lakes and warehouses.
• Support the ongoing migration and modernisation of legacy/on-premise data infrastructure into Azure cloud services.
• Develop robust ETL/ELT pipelines and API integrations across multiple internal and external data sources.

Automation & Intelligent Workflows

• Support automation initiatives aimed at improving operational efficiency and reducing manual processing tasks.
• Contribute to AI-assisted and intelligent workflow projects involving structured and unstructured data processing.
• Work with modern automation tooling and explore practical applications of LLM technologies within operational processes.
• Collaborate with stakeholders to identify opportunities for process optimisation through automation and data-driven solutions.

Data Quality, Reporting & Governance

• Implement automated validation, monitoring, and data quality controls across datasets and pipelines.
• Ensure solutions align with governance, security, and GDPR/DPA requirements.
• Optimise database performance and query efficiency to support reporting and analytics.
• Develop and maintain reporting and dashboarding solutions using Power BI.

Stakeholder Collaboration

• Work closely with business stakeholders to gather requirements and translate them into scalable technical solutions.
• Present technical findings and recommendations clearly to both technical and non-technical audiences.
• Act as a key bridge between operational teams and technology functions.

Required Skills & Experience

Technical Skills

• Strong experience with Python and SQL for Data Engineering and automation.
• Experience building and maintaining scalable ETL/ELT pipelines.
• Strong understanding of relational and non-relational databases.
• Experience with Azure data technologies such as Data Factory, Synapse, or Fabric.
• Familiarity with orchestration and transformation tooling such as Dagster and dbt.
• Experience working with APIs and workflow automation tooling.
• Exposure to AI-assisted technologies, automation tooling, or LLM concepts would be advantageous.
• Experience with Power BI and reporting solutions.
• Familiarity with Docker/Kubernetes and CI/CD practices is beneficial.

Industry Experience

• Experience working within insurance or financial services environments is highly desirable.
• Experience handling complex operational or transactional datasets would be advantageous.

Soft Skills

• Strong analytical and problem-solving abilities.
• Excellent communication and stakeholder management skills.
• Collaborative and proactive mindset.
• Interest in modern automation technologies and emerging tooling.

Package & Benefits

• Annual bonus
• Strong pension contribution
• Private healthcare
• Hybrid working model (3-4 days per week in the London office)
• Exposure to modern cloud, automation, and AI-driven projects
• Collaborative and growing technology environment
• Opportunity to influence greenfield technical initiatives and modernisation projects

Oscar Associates (UK) Limited is acting as an Employment Agency in relation to this vacancy.

To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website.