Data Engineer - Hybrid (East Yorkshire - 1 day/week on-site) - £70,000 with great benefits We're looking for a Data Engineer to join a fast-growing technology business that builds and runs the data platforms behind a global operation supporting thousands of customers. This is a genuine opportunity to get hands-on with a modern Azure and Snowflake-based stack, working alongside a collaborative data team that's actively investing in better tooling, cleaner pipelines, and smarter ways of turning data into decisions. You'll be involved in designing, building, and improving data pipelines and warehouse solutions, not maintaining legacy spaghetti, but contributing to a platform that's evolving, with real scope to bring in new ideas around Azure Fabric, Azure Data Factory, and even AI-driven tooling like Snowflake Cortex if that's an area that interests you. The team is small enough that your work will have visible impact, and supportive enough that you won't be thrown in the deep end as there's a genuine "ask for help, share what you know" culture. We're more interested in attitude than a perfect tick-list: curious, proactive, happy to dig into a problem. What you'll be doing Designing, building, and optimising data pipelines and ETL/ELT workflows across SQL Server, Azure SQL, and Snowflake Owning small-to-medium pieces of work end-to-end, with support from more experienced colleagues when you need it Collaborating with the wider data team on architecture, code quality, and best practice Helping shape how the platform evolves, including exploring newer tools like Azure Fabric and Snowflake Cortex Supporting and sharing knowledge with colleagues earlier in their data engineering journey What we're looking for Solid hands-on experience with T-SQL and SQL Server Experience building real-world data pipelines pulling from varied sources (APIs, FTP, direct integrations) Some exposure to Snowflake, or a genuine appetite to get stuck in A curious, proactive mindset, comfortable owning problems but happy to ask for help when needed What's in it for you Hybrid working with just one day a week in the office Extra holiday that grows with service, plus your birthday off Enhanced family leave (maternity, paternity) and sick pay Wellbeing support, including local gym membership and an EAP Free on-site parking If you're a data engineer who wants to do meaningful, modern work without the bureaucracy of a huge corporate, we'd love to hear from you.
Jun 11, 2026
Full time
Data Engineer - Hybrid (East Yorkshire - 1 day/week on-site) - £70,000 with great benefits We're looking for a Data Engineer to join a fast-growing technology business that builds and runs the data platforms behind a global operation supporting thousands of customers. This is a genuine opportunity to get hands-on with a modern Azure and Snowflake-based stack, working alongside a collaborative data team that's actively investing in better tooling, cleaner pipelines, and smarter ways of turning data into decisions. You'll be involved in designing, building, and improving data pipelines and warehouse solutions, not maintaining legacy spaghetti, but contributing to a platform that's evolving, with real scope to bring in new ideas around Azure Fabric, Azure Data Factory, and even AI-driven tooling like Snowflake Cortex if that's an area that interests you. The team is small enough that your work will have visible impact, and supportive enough that you won't be thrown in the deep end as there's a genuine "ask for help, share what you know" culture. We're more interested in attitude than a perfect tick-list: curious, proactive, happy to dig into a problem. What you'll be doing Designing, building, and optimising data pipelines and ETL/ELT workflows across SQL Server, Azure SQL, and Snowflake Owning small-to-medium pieces of work end-to-end, with support from more experienced colleagues when you need it Collaborating with the wider data team on architecture, code quality, and best practice Helping shape how the platform evolves, including exploring newer tools like Azure Fabric and Snowflake Cortex Supporting and sharing knowledge with colleagues earlier in their data engineering journey What we're looking for Solid hands-on experience with T-SQL and SQL Server Experience building real-world data pipelines pulling from varied sources (APIs, FTP, direct integrations) Some exposure to Snowflake, or a genuine appetite to get stuck in A curious, proactive mindset, comfortable owning problems but happy to ask for help when needed What's in it for you Hybrid working with just one day a week in the office Extra holiday that grows with service, plus your birthday off Enhanced family leave (maternity, paternity) and sick pay Wellbeing support, including local gym membership and an EAP Free on-site parking If you're a data engineer who wants to do meaningful, modern work without the bureaucracy of a huge corporate, we'd love to hear from you.
Senior Data Engineer / Architect (Legal Tech) Location: London / Remote Position Type: Full-time, Permanent About Our Client Our client is a globally operational professional services organisation dedicated to delivering top-tier strategic, advisory, and technological solutions to a prestigious international clientele. As they continue to modernise their global data infrastructure, they are seeking a visionary and execution-focused Senior Data Engineer / Architect with a specialised background in the legal sector to drive their enterprise data strategy. Position Overview In this pivotal role, you will bridge the gap between enterprise data architecture and legal tech execution. You will be responsible for designing, building, and optimising a scalable global data estate that integrates critical legal practice management systems with cutting-edge analytics platforms. The ideal candidate possesses deep expertise in Aderant (expert-level understanding of its underlying data structures and schemas) and a proven track record of architecting modern, cloud-native data solutions using Microsoft Fabric . Key Responsibilities Enterprise Data Architecture: Architect, build, and maintain the global data infrastructure, transitioning legacy data warehouses into a modern, unified data lakehouse environment using MS Fabric . Legal Tech Integration: Serve as the subject matter expert for Aderant data structures. Design and implement robust ETL/ELT pipelines to extract, transform, and load data from Aderant Expert/Sierra and other legal tech systems (e.g., iManage, Intapp) into the central data ecosystem. Data Modelling & Governance: Design high-performance relational and dimensional data models tailored for legal metrics (e.g., lockup, realisation rates, WIP, billable hours, and utilisation). Ensure strict data governance, security, and compliance across global jurisdictions. Analytics Enabler: Partner with Business Intelligence (BI) teams to deliver clean, curated, and near-real-time data products, enabling advanced reporting and AI-driven insights via Power BI. Stakeholder Collaboration: Act as a technical liaison between global legal operations, finance teams, and IT leadership to translate complex business requirements into scalable technical solutions. Required Experience & Qualifications Industry Experience: Minimum of 5+ years of data engineering or architecture experience specifically within the legal sector (top-tier law firms or legal professional services firms). Aderant Expertise: Deep, hands-on experience navigating and querying the Aderant database schema . You must thoroughly understand how legal financial data, timekeeping, and billing workflows map to the back-end tables. Microsoft Fabric Mastery: Proven experience working within the MS Fabric ecosystem (OneLake, Data Factory, Synapse Data Engineering/Data Science, and Real-Time Analytics). Core Data Stack: High proficiency in advanced SQL , Python/PySpark, and data lakehouse architectures (Delta Lake). Cloud Infrastructure: Strong understanding of Microsoft Azure data services (Azure Data Factory, Azure Synapse, Azure SQL, Key Vault) as they relate to Fabric integrations. Legal Data Domain Knowledge: Strong familiarity with legal operations terminology and financial metrics (KPIs for partners, practice groups, and matter management). Preferred Qualifications Certifications such as Microsoft Certified: Azure Data Engineer Associate or Fabric Analytics Engineer Associate . Experience migrating on-premise Aderant environments to cloud-based setups (Aderant Expert Sierra). Familiarity with international data privacy laws (GDPR, UK DPA 2018) within a legal framework. What We Offer Exposure to cutting-edge AI and data analytics tools within the Microsoft ecosystem. Highly competitive compensation package, flexible working arrangements (Hybrid/Remote), and clear paths for executive-level career progression.
Jun 11, 2026
Full time
Senior Data Engineer / Architect (Legal Tech) Location: London / Remote Position Type: Full-time, Permanent About Our Client Our client is a globally operational professional services organisation dedicated to delivering top-tier strategic, advisory, and technological solutions to a prestigious international clientele. As they continue to modernise their global data infrastructure, they are seeking a visionary and execution-focused Senior Data Engineer / Architect with a specialised background in the legal sector to drive their enterprise data strategy. Position Overview In this pivotal role, you will bridge the gap between enterprise data architecture and legal tech execution. You will be responsible for designing, building, and optimising a scalable global data estate that integrates critical legal practice management systems with cutting-edge analytics platforms. The ideal candidate possesses deep expertise in Aderant (expert-level understanding of its underlying data structures and schemas) and a proven track record of architecting modern, cloud-native data solutions using Microsoft Fabric . Key Responsibilities Enterprise Data Architecture: Architect, build, and maintain the global data infrastructure, transitioning legacy data warehouses into a modern, unified data lakehouse environment using MS Fabric . Legal Tech Integration: Serve as the subject matter expert for Aderant data structures. Design and implement robust ETL/ELT pipelines to extract, transform, and load data from Aderant Expert/Sierra and other legal tech systems (e.g., iManage, Intapp) into the central data ecosystem. Data Modelling & Governance: Design high-performance relational and dimensional data models tailored for legal metrics (e.g., lockup, realisation rates, WIP, billable hours, and utilisation). Ensure strict data governance, security, and compliance across global jurisdictions. Analytics Enabler: Partner with Business Intelligence (BI) teams to deliver clean, curated, and near-real-time data products, enabling advanced reporting and AI-driven insights via Power BI. Stakeholder Collaboration: Act as a technical liaison between global legal operations, finance teams, and IT leadership to translate complex business requirements into scalable technical solutions. Required Experience & Qualifications Industry Experience: Minimum of 5+ years of data engineering or architecture experience specifically within the legal sector (top-tier law firms or legal professional services firms). Aderant Expertise: Deep, hands-on experience navigating and querying the Aderant database schema . You must thoroughly understand how legal financial data, timekeeping, and billing workflows map to the back-end tables. Microsoft Fabric Mastery: Proven experience working within the MS Fabric ecosystem (OneLake, Data Factory, Synapse Data Engineering/Data Science, and Real-Time Analytics). Core Data Stack: High proficiency in advanced SQL , Python/PySpark, and data lakehouse architectures (Delta Lake). Cloud Infrastructure: Strong understanding of Microsoft Azure data services (Azure Data Factory, Azure Synapse, Azure SQL, Key Vault) as they relate to Fabric integrations. Legal Data Domain Knowledge: Strong familiarity with legal operations terminology and financial metrics (KPIs for partners, practice groups, and matter management). Preferred Qualifications Certifications such as Microsoft Certified: Azure Data Engineer Associate or Fabric Analytics Engineer Associate . Experience migrating on-premise Aderant environments to cloud-based setups (Aderant Expert Sierra). Familiarity with international data privacy laws (GDPR, UK DPA 2018) within a legal framework. What We Offer Exposure to cutting-edge AI and data analytics tools within the Microsoft ecosystem. Highly competitive compensation package, flexible working arrangements (Hybrid/Remote), and clear paths for executive-level career progression.
Microsoft Fabric Azure Lakehouse Data Engineering Not all Data Engineering roles are created equal. Some involve maintaining legacy ETL processes and producing reports nobody reads. This isn't one of those roles You will help shape and enhance a modern cloud-based data platform that's central to how a large, complex organisation makes decisions, improves services and drives transformation. You'll be joining a well-established data function where Data Governance, Architecture, Engineering and BI all work together to build something genuinely valuable. The foundations are already in place. Now it's about taking things to the next level. What you'll be doing You'll play a key role in designing, building and optimising a modern Microsoft data platform centred around Fabric, Lakehouse architecture and scalable data pipelines. Working closely with your data colleagues and wider technology teams, you'll help ensure high-quality data flows seamlessly across the organisation. Your responsibilities will include: Building and maintaining data pipelines using Microsoft Fabric Designing and optimising Lakehouse and data storage solutions Developing ETL and data transformation processes Integrating data from multiple business-critical applications Creating scalable and efficient data models Improving data quality, governance and reliability Supporting testing, performance monitoring and continuous improvement initiatives Collaborating with technical and non-technical stakeholders to turn business requirements into robust data solutions What we're looking for We're less interested in job titles and more interested in capability. You'll likely have experience in several of the following: Microsoft Fabric Azure Data Factory Advanced SQL Data Warehousing / Data Lakes / Lakehouse Architecture ETL Development Data Modelling Power BI You'll also be someone who enjoys solving complex problems, improving processes and working collaboratively within a modern technology environment. This is a 2 year Fixed Term Contract where you will visit the central London offices once a fortnight. The ideal person You'll thrive here if you: Enjoy building rather than maintaining Like working on enterprise-scale data challenges Can translate business requirements into technical solutions Care about data quality and engineering best practice Enjoy working with architects, analysts and stakeholders across the business Want to help shape the future direction of a growing data platform Why apply? This is an opportunity to work with one of the most modern Microsoft data stacks available today, including Microsoft Fabric, while helping evolve a large-scale data environment that continues to grow in both complexity and importance. If you're a Data Engineer who enjoys building scalable cloud-based solutions and wants to make a genuine impact rather than simply keeping the lights on, we'd love to hear from you. Apply now for a confidential conversation.
Jun 11, 2026
Full time
Microsoft Fabric Azure Lakehouse Data Engineering Not all Data Engineering roles are created equal. Some involve maintaining legacy ETL processes and producing reports nobody reads. This isn't one of those roles You will help shape and enhance a modern cloud-based data platform that's central to how a large, complex organisation makes decisions, improves services and drives transformation. You'll be joining a well-established data function where Data Governance, Architecture, Engineering and BI all work together to build something genuinely valuable. The foundations are already in place. Now it's about taking things to the next level. What you'll be doing You'll play a key role in designing, building and optimising a modern Microsoft data platform centred around Fabric, Lakehouse architecture and scalable data pipelines. Working closely with your data colleagues and wider technology teams, you'll help ensure high-quality data flows seamlessly across the organisation. Your responsibilities will include: Building and maintaining data pipelines using Microsoft Fabric Designing and optimising Lakehouse and data storage solutions Developing ETL and data transformation processes Integrating data from multiple business-critical applications Creating scalable and efficient data models Improving data quality, governance and reliability Supporting testing, performance monitoring and continuous improvement initiatives Collaborating with technical and non-technical stakeholders to turn business requirements into robust data solutions What we're looking for We're less interested in job titles and more interested in capability. You'll likely have experience in several of the following: Microsoft Fabric Azure Data Factory Advanced SQL Data Warehousing / Data Lakes / Lakehouse Architecture ETL Development Data Modelling Power BI You'll also be someone who enjoys solving complex problems, improving processes and working collaboratively within a modern technology environment. This is a 2 year Fixed Term Contract where you will visit the central London offices once a fortnight. The ideal person You'll thrive here if you: Enjoy building rather than maintaining Like working on enterprise-scale data challenges Can translate business requirements into technical solutions Care about data quality and engineering best practice Enjoy working with architects, analysts and stakeholders across the business Want to help shape the future direction of a growing data platform Why apply? This is an opportunity to work with one of the most modern Microsoft data stacks available today, including Microsoft Fabric, while helping evolve a large-scale data environment that continues to grow in both complexity and importance. If you're a Data Engineer who enjoys building scalable cloud-based solutions and wants to make a genuine impact rather than simply keeping the lights on, we'd love to hear from you. Apply now for a confidential conversation.
Data Engineer 6 month Contract Hybrid - 1 day per week in office (Wiltshire) We are currently working in partnership with a housing association who are recruiting for an IT Data Engineer on a contract basis. The role focuses on designing, building and delivering solutions across the Microsoft cloud stack, with a strong emphasis on Microsoft Fabric and Azure data platform. Experience required: Hands-on experience delivering end-to-end data solutions across Microsoft Fabric and Azure, including OneLake, Lakehouse or Warehouse, Dataflows Gen2, Pipelines, Synapse and SQL Experience designing and building lakehouse and pipeline solutions from ingestion through to consumption ETL and ELT design experience, including data modelling using lakehouse patterns and star or snowflake schemas Experience migrating or integrating legacy data sources such as Dataverse and SQL into modern analytics architectures Skills, knowledge and expertise required: Strong practical capability across Microsoft Fabric and Azure data services, including Dataflows Gen2, Fabric Pipelines, Data Factory, Synapse and SQL Advanced SQL skills, including complex joins, query optimisation and performance tuning Strong Python or PySpark skills for data transformation and automation Strong ETL and ELT design capability with experience building batch pipelines James Andrews is acting as an employment agency and business in relation to this role. At James Andrews Recruitment Solutions we try to respond to all applications personally, however, due to the high volume of applications this is not always possible. If you have not heard back from us within 72 hours, please assume that your application has been unsuccessful on this occasion. Don t forget our recommendation scheme: Recommend a friend or colleague to us and receive up to £100 each once they have completed 20 days in a role via James Andrews! Terms and conditions apply, contact us for details.
Jun 10, 2026
Contractor
Data Engineer 6 month Contract Hybrid - 1 day per week in office (Wiltshire) We are currently working in partnership with a housing association who are recruiting for an IT Data Engineer on a contract basis. The role focuses on designing, building and delivering solutions across the Microsoft cloud stack, with a strong emphasis on Microsoft Fabric and Azure data platform. Experience required: Hands-on experience delivering end-to-end data solutions across Microsoft Fabric and Azure, including OneLake, Lakehouse or Warehouse, Dataflows Gen2, Pipelines, Synapse and SQL Experience designing and building lakehouse and pipeline solutions from ingestion through to consumption ETL and ELT design experience, including data modelling using lakehouse patterns and star or snowflake schemas Experience migrating or integrating legacy data sources such as Dataverse and SQL into modern analytics architectures Skills, knowledge and expertise required: Strong practical capability across Microsoft Fabric and Azure data services, including Dataflows Gen2, Fabric Pipelines, Data Factory, Synapse and SQL Advanced SQL skills, including complex joins, query optimisation and performance tuning Strong Python or PySpark skills for data transformation and automation Strong ETL and ELT design capability with experience building batch pipelines James Andrews is acting as an employment agency and business in relation to this role. At James Andrews Recruitment Solutions we try to respond to all applications personally, however, due to the high volume of applications this is not always possible. If you have not heard back from us within 72 hours, please assume that your application has been unsuccessful on this occasion. Don t forget our recommendation scheme: Recommend a friend or colleague to us and receive up to £100 each once they have completed 20 days in a role via James Andrews! Terms and conditions apply, contact us for details.
Data Engineer Chippenham 5 days onsite We're working with a forward-thinking, data-driven organisation looking to hire a Data Engineer to join their growing technology team. This is a fantastic opportunity for someone with a few years of experience who wants to deepen their expertise and progress into Microsoft Fabric, working on modern data platforms and scalable integration solutions. What You'll Be Doing You'll play a key role in designing, building, and supporting robust data pipelines and system integrations that power business-critical analytics and operations. Key areas include: Building and maintaining ETL/ELT pipelines for structured, reliable data Developing integrations using REST APIs across multiple platforms Designing automated workflows to reduce manual processes Working with Microsoft Fabric to ingest, transform, and publish datasets Supporting and improving existing data solutions (BAU + project work) Ensuring data quality, validation, and error handling Collaborating with stakeholders to deliver scalable, future-proof solutions Tech Stack & Experience We're looking for someone comfortable working across a modern Microsoft data ecosystem: SQL Server (T-SQL, stored procedures, performance tuning) Microsoft Fabric (Dataflows, Power Query, Data Warehouse) - or a strong desire to grow into it Azure (Logic Apps, Function Apps) APIs & data formats (JSON, XML, CSV) Scripting / programming: Python, T-SQL, VBScript (bonus: PowerShell, Node.js, DAX) Understanding of automation, scheduling, and orchestration Exposure to SAP Business One is a plus Why This Role? Clear opportunity to build hands-on experience with Microsoft Fabric Work on modernising data architecture and integration patterns Blend of project delivery + real-world operational impact ? to influence automation and efficiency across the business Supportive environment with scope to learn, grow, and take ownership Who This Suits An early-career to mid-level data/integration engineer Someone who enjoys problem-solving and improving systems A professional looking to step into next-gen data platforms (Fabric) A strong communicator who can bridge technical and business teams If you're interested in taking the next step in your data engineering career and want to build expertise in Microsoft Fabric , apply now or get in touch to learn more.
Jun 07, 2026
Full time
Data Engineer Chippenham 5 days onsite We're working with a forward-thinking, data-driven organisation looking to hire a Data Engineer to join their growing technology team. This is a fantastic opportunity for someone with a few years of experience who wants to deepen their expertise and progress into Microsoft Fabric, working on modern data platforms and scalable integration solutions. What You'll Be Doing You'll play a key role in designing, building, and supporting robust data pipelines and system integrations that power business-critical analytics and operations. Key areas include: Building and maintaining ETL/ELT pipelines for structured, reliable data Developing integrations using REST APIs across multiple platforms Designing automated workflows to reduce manual processes Working with Microsoft Fabric to ingest, transform, and publish datasets Supporting and improving existing data solutions (BAU + project work) Ensuring data quality, validation, and error handling Collaborating with stakeholders to deliver scalable, future-proof solutions Tech Stack & Experience We're looking for someone comfortable working across a modern Microsoft data ecosystem: SQL Server (T-SQL, stored procedures, performance tuning) Microsoft Fabric (Dataflows, Power Query, Data Warehouse) - or a strong desire to grow into it Azure (Logic Apps, Function Apps) APIs & data formats (JSON, XML, CSV) Scripting / programming: Python, T-SQL, VBScript (bonus: PowerShell, Node.js, DAX) Understanding of automation, scheduling, and orchestration Exposure to SAP Business One is a plus Why This Role? Clear opportunity to build hands-on experience with Microsoft Fabric Work on modernising data architecture and integration patterns Blend of project delivery + real-world operational impact ? to influence automation and efficiency across the business Supportive environment with scope to learn, grow, and take ownership Who This Suits An early-career to mid-level data/integration engineer Someone who enjoys problem-solving and improving systems A professional looking to step into next-gen data platforms (Fabric) A strong communicator who can bridge technical and business teams If you're interested in taking the next step in your data engineering career and want to build expertise in Microsoft Fabric , apply now or get in touch to learn more.
Data Engineer Chippenham 5 days onsite We re working with a forward-thinking, data-driven organisation looking to hire a Data Engineer to join their growing technology team. This is a fantastic opportunity for someone with a few years of experience who wants to deepen their expertise and progress into Microsoft Fabric, working on modern data platforms and scalable integration solutions. What You ll Be Doing You ll play a key role in designing, building, and supporting robust data pipelines and system integrations that power business-critical analytics and operations. Key areas include: Building and maintaining ETL/ELT pipelines for structured, reliable data Developing integrations using REST APIs across multiple platforms Designing automated workflows to reduce manual processes Working with Microsoft Fabric to ingest, transform, and publish datasets Supporting and improving existing data solutions (BAU + project work) Ensuring data quality, validation, and error handling Collaborating with stakeholders to deliver scalable, future-proof solutions Tech Stack & Experience We re looking for someone comfortable working across a modern Microsoft data ecosystem: SQL Server (T-SQL, stored procedures, performance tuning) Microsoft Fabric (Dataflows, Power Query, Data Warehouse) or a strong desire to grow into it Azure (Logic Apps, Function Apps) APIs & data formats (JSON, XML, CSV) Scripting / programming: Python, T-SQL, VBScript (bonus: PowerShell, Node.js, DAX) Understanding of automation, scheduling, and orchestration Exposure to SAP Business One is a plus Why This Role? Clear opportunity to build hands-on experience with Microsoft Fabric Work on modernising data architecture and integration patterns Blend of project delivery + real-world operational impact Influence automation and efficiency across the business Supportive environment with scope to learn, grow, and take ownership Who This Suits An early-career to mid-level data/integration engineer Someone who enjoys problem-solving and improving systems A professional looking to step into next-gen data platforms (Fabric) A strong communicator who can bridge technical and business teams If you're interested in taking the next step in your data engineering career and want to build expertise in Microsoft Fabric , apply now or get in touch to learn more.
Jun 06, 2026
Full time
Data Engineer Chippenham 5 days onsite We re working with a forward-thinking, data-driven organisation looking to hire a Data Engineer to join their growing technology team. This is a fantastic opportunity for someone with a few years of experience who wants to deepen their expertise and progress into Microsoft Fabric, working on modern data platforms and scalable integration solutions. What You ll Be Doing You ll play a key role in designing, building, and supporting robust data pipelines and system integrations that power business-critical analytics and operations. Key areas include: Building and maintaining ETL/ELT pipelines for structured, reliable data Developing integrations using REST APIs across multiple platforms Designing automated workflows to reduce manual processes Working with Microsoft Fabric to ingest, transform, and publish datasets Supporting and improving existing data solutions (BAU + project work) Ensuring data quality, validation, and error handling Collaborating with stakeholders to deliver scalable, future-proof solutions Tech Stack & Experience We re looking for someone comfortable working across a modern Microsoft data ecosystem: SQL Server (T-SQL, stored procedures, performance tuning) Microsoft Fabric (Dataflows, Power Query, Data Warehouse) or a strong desire to grow into it Azure (Logic Apps, Function Apps) APIs & data formats (JSON, XML, CSV) Scripting / programming: Python, T-SQL, VBScript (bonus: PowerShell, Node.js, DAX) Understanding of automation, scheduling, and orchestration Exposure to SAP Business One is a plus Why This Role? Clear opportunity to build hands-on experience with Microsoft Fabric Work on modernising data architecture and integration patterns Blend of project delivery + real-world operational impact Influence automation and efficiency across the business Supportive environment with scope to learn, grow, and take ownership Who This Suits An early-career to mid-level data/integration engineer Someone who enjoys problem-solving and improving systems A professional looking to step into next-gen data platforms (Fabric) A strong communicator who can bridge technical and business teams If you're interested in taking the next step in your data engineering career and want to build expertise in Microsoft Fabric , apply now or get in touch to learn more.
Senior / Lead Data Engineer Location: London (Hybrid) Duration: 6-Month Contract ( High potential for 1+ year extension or perm conversion ) Day rate - 370 - 450 per day Inside IR35 The Role My Client is financial service is launching a new divisional data team to build a next-generation enterprise data platform. Reporting to the AVP of Data Engineering, you will define engineering best practices, build data-intensive pipelines, and bridge the gap between global business units and technical delivery. Key Responsibilities Build & Scale: Design, test, and maintain robust data pipelines and data warehouse architecture. Governance & Quality: Lead code/architecture reviews, enforce IT controls, and optimize system quality. Mentorship: Provide technical guidance and assistance to junior development staff. Collaboration: Partner with global stakeholders to translate business needs into technical outputs. Requirements & Tech Stack Core Technical Skills Databases: Expert SQL skills; extensive experience with Snowflake and MS SQL Server . ETL & Modeling: Strong experience with dbt and at least one ETL tool ( Matillion, Fivetran, SNP Glue, or Informatica ). CI/CD: Hands-on experience with Azure DevOps (or similar) and shell scripting. Engineering Principles: Deep understanding of data modeling, curation, orchestration, and TDD/unit testing. Soft Skills & Nice-to-Haves Agile approach, excellent stakeholder communication, and a results-oriented mindset. Pluses: Insurance/Reinsurance industry experience, PowerBI/Tableau, SAP, or NoSQL (DynamoDB/Cosmos). This is an urgent vacancy where the hiring manager is looking to interview immediately. If interested then apply with a copy of your CV or send the CV to khushboo .co .uk Randstad Technologies is acting as an Employment Business in relation to this vacancy.
Jun 05, 2026
Contractor
Senior / Lead Data Engineer Location: London (Hybrid) Duration: 6-Month Contract ( High potential for 1+ year extension or perm conversion ) Day rate - 370 - 450 per day Inside IR35 The Role My Client is financial service is launching a new divisional data team to build a next-generation enterprise data platform. Reporting to the AVP of Data Engineering, you will define engineering best practices, build data-intensive pipelines, and bridge the gap between global business units and technical delivery. Key Responsibilities Build & Scale: Design, test, and maintain robust data pipelines and data warehouse architecture. Governance & Quality: Lead code/architecture reviews, enforce IT controls, and optimize system quality. Mentorship: Provide technical guidance and assistance to junior development staff. Collaboration: Partner with global stakeholders to translate business needs into technical outputs. Requirements & Tech Stack Core Technical Skills Databases: Expert SQL skills; extensive experience with Snowflake and MS SQL Server . ETL & Modeling: Strong experience with dbt and at least one ETL tool ( Matillion, Fivetran, SNP Glue, or Informatica ). CI/CD: Hands-on experience with Azure DevOps (or similar) and shell scripting. Engineering Principles: Deep understanding of data modeling, curation, orchestration, and TDD/unit testing. Soft Skills & Nice-to-Haves Agile approach, excellent stakeholder communication, and a results-oriented mindset. Pluses: Insurance/Reinsurance industry experience, PowerBI/Tableau, SAP, or NoSQL (DynamoDB/Cosmos). This is an urgent vacancy where the hiring manager is looking to interview immediately. If interested then apply with a copy of your CV or send the CV to khushboo .co .uk Randstad Technologies is acting as an Employment Business in relation to this vacancy.
Pricing & Market Data (Migration Specialist) The Opportunity We are seeking a high-calibre Technical Lead to own the evolution of our pricing ecosystem. You will work closely with the Architect on migration from Gresham Asset Control to Prime EDM (Cloud) including implement features that meet business needs and are aligned with strategic objectives. You will sit at the intersection of Trading, Supply, and Technology, ensuring our desks have the high-fidelity data needed to move global energy markets. Core Responsibilities Legacy-to-Cloud Migration: Lead the technical execution of the move to Prime Cloud Service. You will be responsible for mapping Legacy Gresham schemas to the new Prime data model while maintaining data lineage and auditability. Customization Engineering: Directly manage the implementation of critical STS business logic, pricing mechanisms and complex curve remarking. Project Sizing & Strategy: Provide expert estimates on project duration, technical debt, and resource requirements. You will define the "Definition of Done" for the migration. Stakeholder Face-off: Drive technical discussions with Front Office Traders, Quants, and Risk Managers to translate complex business needs into scalable technical specs. Technical Governance: Own the ETL pipelines and data parsers. Ensure the system is capable of handling increasing volumetric data demands without compromising latency. Mentorship & Hiring: Define the technical bar for the team. You will suggest the ideal skill mix for new hires and mentor existing engineers in EDM best practices. Team management: Proven team leadership/supervisory experience Required Experience & Technical Skillset Proven Track Record: At least 8-10 years in technical roles, with 2+ years in a Lead capacity within Commodities Trading (Oil, Gas, or Power). Technology Stack: Deep Mastery: Gresham Asset Control (Legacy) and Prime EDM. Architecture: Cloud-native migrations (AWS/Azure), API design, and SQL/NoSQL performance tuning. Scripting: Python (preferred) or Java for custom business logic and automation. Pricing Logic: Strong understanding of EOD (End of Day) vs. Real Time pricing, forward curve construction, and basis risk calculations. Agile Leadership: Experience driving delivery within Azure DevOps environments using SCRUM or Kanban. Preferred Qualifications Previous experience in a "Greenfield" migration or a major vendor-to-vendor system swap. Familiarity with other market data providers (eg, Bloomberg, Refinitiv, Platts, Argus). A "Build-First" mindset: The ability to decide when to use out-of-the-box Prime functionality vs. building custom modules.
Mar 30, 2026
Contractor
Pricing & Market Data (Migration Specialist) The Opportunity We are seeking a high-calibre Technical Lead to own the evolution of our pricing ecosystem. You will work closely with the Architect on migration from Gresham Asset Control to Prime EDM (Cloud) including implement features that meet business needs and are aligned with strategic objectives. You will sit at the intersection of Trading, Supply, and Technology, ensuring our desks have the high-fidelity data needed to move global energy markets. Core Responsibilities Legacy-to-Cloud Migration: Lead the technical execution of the move to Prime Cloud Service. You will be responsible for mapping Legacy Gresham schemas to the new Prime data model while maintaining data lineage and auditability. Customization Engineering: Directly manage the implementation of critical STS business logic, pricing mechanisms and complex curve remarking. Project Sizing & Strategy: Provide expert estimates on project duration, technical debt, and resource requirements. You will define the "Definition of Done" for the migration. Stakeholder Face-off: Drive technical discussions with Front Office Traders, Quants, and Risk Managers to translate complex business needs into scalable technical specs. Technical Governance: Own the ETL pipelines and data parsers. Ensure the system is capable of handling increasing volumetric data demands without compromising latency. Mentorship & Hiring: Define the technical bar for the team. You will suggest the ideal skill mix for new hires and mentor existing engineers in EDM best practices. Team management: Proven team leadership/supervisory experience Required Experience & Technical Skillset Proven Track Record: At least 8-10 years in technical roles, with 2+ years in a Lead capacity within Commodities Trading (Oil, Gas, or Power). Technology Stack: Deep Mastery: Gresham Asset Control (Legacy) and Prime EDM. Architecture: Cloud-native migrations (AWS/Azure), API design, and SQL/NoSQL performance tuning. Scripting: Python (preferred) or Java for custom business logic and automation. Pricing Logic: Strong understanding of EOD (End of Day) vs. Real Time pricing, forward curve construction, and basis risk calculations. Agile Leadership: Experience driving delivery within Azure DevOps environments using SCRUM or Kanban. Preferred Qualifications Previous experience in a "Greenfield" migration or a major vendor-to-vendor system swap. Familiarity with other market data providers (eg, Bloomberg, Refinitiv, Platts, Argus). A "Build-First" mindset: The ability to decide when to use out-of-the-box Prime functionality vs. building custom modules.
Data Engineer- £45,000- Remote About the Role As a Data Engineer , you will be a key member of our agile delivery team, working closely with clients to unlock the full value of their data. This is a hands-on role where you'll be designing and implementing data solutions using cutting-edge tools in the Azure ecosystem. You'll have the opportunity to develop your technical expertise while contributing to high-impact projects across a variety of industries. We operate with a Winning from Anywhere® philosophy, offering flexibility in where you work while maintaining a strong team culture through regular client site visits, company events, and collaboration opportunities. Key Responsibilities Deliver end-to-end data solutions, including acquisition, engineering, modelling, analysis, and visualisation. Lead and participate in workshops to gather requirements and engage with clients on both technical and business levels. Design and implement scalable, robust ETL/ELT pipelines using Microsoft/Azure technologies such as Azure Data Factory, Synapse, Databricks, or Fabric. Build and optimise data lake solutions using medallion architecture. Support cloud migration of on-premises SQL Server-based data platforms (SQL, SSIS, SSAS, SSRS). Develop reports, dashboards, and analytics solutions using Power BI. Provide ongoing support and enhancements to solutions post-deployment. Skills and Experience Essential: Proven experience in a Data Engineering or Data Warehouse Development role. Strong hands-on expertise with Azure/Microsoft and/or SQL Server technology stacks. Proficiency in ETL/ELT development using tools like Azure Synapse, Data Factory, Databricks, or Fabric. Advanced SQL and Python skills (DDL, DML, Stored Procedures, Notebooks). Understanding of lakehouse architecture and medallion design principles. Ability to work with large, complex datasets from multiple sources. Strong knowledge of BI and data warehousing concepts. Experience with Power BI for reporting and data visualisation. Excellent communication and client engagement skills. What We Offer Remote-first working model (Winning from Anywhere®) 25 days annual holiday Monthly home working allowance Set-up allowance for home office 24/7 virtual GP access Employee Assistance Programme (available 24/7) Company sick pay scheme Life assurance (4x base salary) Private health insurance after 1 year of service Enhanced parental leave and pay Cyclescheme and electric car scheme Opportunity to work with a 3 World Class Best Company* To apply for this role please submit your CV or contact Dillon Blackburn (see below) Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
Oct 07, 2025
Full time
Data Engineer- £45,000- Remote About the Role As a Data Engineer , you will be a key member of our agile delivery team, working closely with clients to unlock the full value of their data. This is a hands-on role where you'll be designing and implementing data solutions using cutting-edge tools in the Azure ecosystem. You'll have the opportunity to develop your technical expertise while contributing to high-impact projects across a variety of industries. We operate with a Winning from Anywhere® philosophy, offering flexibility in where you work while maintaining a strong team culture through regular client site visits, company events, and collaboration opportunities. Key Responsibilities Deliver end-to-end data solutions, including acquisition, engineering, modelling, analysis, and visualisation. Lead and participate in workshops to gather requirements and engage with clients on both technical and business levels. Design and implement scalable, robust ETL/ELT pipelines using Microsoft/Azure technologies such as Azure Data Factory, Synapse, Databricks, or Fabric. Build and optimise data lake solutions using medallion architecture. Support cloud migration of on-premises SQL Server-based data platforms (SQL, SSIS, SSAS, SSRS). Develop reports, dashboards, and analytics solutions using Power BI. Provide ongoing support and enhancements to solutions post-deployment. Skills and Experience Essential: Proven experience in a Data Engineering or Data Warehouse Development role. Strong hands-on expertise with Azure/Microsoft and/or SQL Server technology stacks. Proficiency in ETL/ELT development using tools like Azure Synapse, Data Factory, Databricks, or Fabric. Advanced SQL and Python skills (DDL, DML, Stored Procedures, Notebooks). Understanding of lakehouse architecture and medallion design principles. Ability to work with large, complex datasets from multiple sources. Strong knowledge of BI and data warehousing concepts. Experience with Power BI for reporting and data visualisation. Excellent communication and client engagement skills. What We Offer Remote-first working model (Winning from Anywhere®) 25 days annual holiday Monthly home working allowance Set-up allowance for home office 24/7 virtual GP access Employee Assistance Programme (available 24/7) Company sick pay scheme Life assurance (4x base salary) Private health insurance after 1 year of service Enhanced parental leave and pay Cyclescheme and electric car scheme Opportunity to work with a 3 World Class Best Company* To apply for this role please submit your CV or contact Dillon Blackburn (see below) Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
Type: Full-time, Permanent The OpportunityWe're recruiting on behalf of a leading organisation undergoing a major digital transformation. This is a hands-on, senior engineering role for someone who thrives on solving complex data challenges, building scalable platforms, and integrating operational systems across a diverse business landscape. You'll work closely with stakeholders in Logistics, Operations, Finance, and Compliance to modernise data infrastructure, automate workflows, and embed AI into BI and operational processes. If you're ready to take ownership of high-impact projects and shape the future of data in logistics, this is the role for you. What You'll Be DoingData Platform & BI Engineering Architect and implement cloud-native data platforms (AWS S3, Glue, Athena, Redshift, QuickSight). Build reliable, governed data pipelines with CI/CD and infrastructure as code. Design dimensional models and deliver robust SQL/Python transformations. Systems Integration & Application Support Provide expert-level support for transport, warehouse, and fleet systems (TMS/WMS/FMS). Develop and maintain integrations using REST/SOAP APIs, EDI (XML/JSON), and flat-file interfaces. Implement observability, error-handling, and retry logic for mission-critical interfaces. Automation & Process Improvement Replace manual, spreadsheet-driven processes with governed datasets and internal tools. Build lightweight portals, scripts, and APIs to streamline business workflows. AI & Advanced Analytics Integrate AI services into BI dashboards and operational workflows (eg, anomaly detection, natural language Q&A). Implement semantic search and intelligent alerting using AWS Bedrock or Azure equivalents. Security, Governance & Resilience Enforce least-privilege access, RBAC, and secrets management. Apply data governance across AWS/Microsoft estates and contribute to DR strategies. What You'll BringEssential Experience 5+ years in SQL (T-SQL), Python, and BI/data platform engineering. Strong hands-on experience with AWS analytics stack and Power BI. Proven track record in designing and deploying production-grade ETL/ELT pipelines. Experience supporting and integrating operational systems (TMS/WMS/FMS). Solid understanding of data modelling, performance tuning, and infrastructure as code. Desirable Skills & Certifications AWS or Microsoft certifications (eg, Data Analytics Speciality, DP-203, PL-300). Experience with Azure Data Factory, Kafka/Kinesis, or message brokers. Familiarity with LLMs (eg, Claude, Azure OpenAI) and vector databases. Why You Should Apply Be part of a company driving innovation and sustainability in logistics. Lead and deliver high-impact digital transformation initiatives. Work in a collaborative, forward-thinking environment. Competitive salary and benefits, with professional development opportunities. If you would like more information or some career advice, please do not hesitate to reach out directly. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.
Oct 06, 2025
Full time
Type: Full-time, Permanent The OpportunityWe're recruiting on behalf of a leading organisation undergoing a major digital transformation. This is a hands-on, senior engineering role for someone who thrives on solving complex data challenges, building scalable platforms, and integrating operational systems across a diverse business landscape. You'll work closely with stakeholders in Logistics, Operations, Finance, and Compliance to modernise data infrastructure, automate workflows, and embed AI into BI and operational processes. If you're ready to take ownership of high-impact projects and shape the future of data in logistics, this is the role for you. What You'll Be DoingData Platform & BI Engineering Architect and implement cloud-native data platforms (AWS S3, Glue, Athena, Redshift, QuickSight). Build reliable, governed data pipelines with CI/CD and infrastructure as code. Design dimensional models and deliver robust SQL/Python transformations. Systems Integration & Application Support Provide expert-level support for transport, warehouse, and fleet systems (TMS/WMS/FMS). Develop and maintain integrations using REST/SOAP APIs, EDI (XML/JSON), and flat-file interfaces. Implement observability, error-handling, and retry logic for mission-critical interfaces. Automation & Process Improvement Replace manual, spreadsheet-driven processes with governed datasets and internal tools. Build lightweight portals, scripts, and APIs to streamline business workflows. AI & Advanced Analytics Integrate AI services into BI dashboards and operational workflows (eg, anomaly detection, natural language Q&A). Implement semantic search and intelligent alerting using AWS Bedrock or Azure equivalents. Security, Governance & Resilience Enforce least-privilege access, RBAC, and secrets management. Apply data governance across AWS/Microsoft estates and contribute to DR strategies. What You'll BringEssential Experience 5+ years in SQL (T-SQL), Python, and BI/data platform engineering. Strong hands-on experience with AWS analytics stack and Power BI. Proven track record in designing and deploying production-grade ETL/ELT pipelines. Experience supporting and integrating operational systems (TMS/WMS/FMS). Solid understanding of data modelling, performance tuning, and infrastructure as code. Desirable Skills & Certifications AWS or Microsoft certifications (eg, Data Analytics Speciality, DP-203, PL-300). Experience with Azure Data Factory, Kafka/Kinesis, or message brokers. Familiarity with LLMs (eg, Claude, Azure OpenAI) and vector databases. Why You Should Apply Be part of a company driving innovation and sustainability in logistics. Lead and deliver high-impact digital transformation initiatives. Work in a collaborative, forward-thinking environment. Competitive salary and benefits, with professional development opportunities. If you would like more information or some career advice, please do not hesitate to reach out directly. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.
Data Architect - Data Vault, Snowflake, ADF £Market rate (Inside IR35) London/Hybrid 6 months My client is an instantly recognisable Insurance brand who urgently require a Data Architect with expertise in Data Vault, Data Modelling, Data Engineering Design, strong Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI), Snowflake and Enterprise scale Data Sources to join a business-critical Programme ASAP. Key Requirements: Proven expertise in Data Architecture working on large, complex Data Programmes Strong Data Modelling experience (especially Conceptual Data Models) Demonstrable background in Data Engineering Design processes (ETL, ELT), with good knowledge of Data Vault, Inmon and Kimball Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Previous experience with large, Enterprise scale Data sets and sources Strong understanding of Data Governance principles (Data stewardship, Data quality and compliance guardrails as well as Data quality, lineage, life cycle management and security) Excellent communication and stakeholder management skills Flexible approach to hybrid working (attending workshops, possibly across differ locations if needed) Nice to have: Insurance industry experience Previous work on Data strategies Exposure to collaborative modelling tools such as Ellie.ai Immediate availability If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.
Oct 03, 2025
Contractor
Data Architect - Data Vault, Snowflake, ADF £Market rate (Inside IR35) London/Hybrid 6 months My client is an instantly recognisable Insurance brand who urgently require a Data Architect with expertise in Data Vault, Data Modelling, Data Engineering Design, strong Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI), Snowflake and Enterprise scale Data Sources to join a business-critical Programme ASAP. Key Requirements: Proven expertise in Data Architecture working on large, complex Data Programmes Strong Data Modelling experience (especially Conceptual Data Models) Demonstrable background in Data Engineering Design processes (ETL, ELT), with good knowledge of Data Vault, Inmon and Kimball Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Previous experience with large, Enterprise scale Data sets and sources Strong understanding of Data Governance principles (Data stewardship, Data quality and compliance guardrails as well as Data quality, lineage, life cycle management and security) Excellent communication and stakeholder management skills Flexible approach to hybrid working (attending workshops, possibly across differ locations if needed) Nice to have: Insurance industry experience Previous work on Data strategies Exposure to collaborative modelling tools such as Ellie.ai Immediate availability If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.
Role Overview We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders to translate requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering teams and communities, ensuring delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and platforms. Translate user requirements and data designs into effective, reusable, and standards-compliant data solutions. Define, deliver, and embed engineering standards across multiple platforms, keeping them updated and ensuring adherence across teams. Champion data validation methods and standards to ensure data quality from source to consumption. Standardise code, product, and service quality across engineering teams by implementing best practices and governance. Design and promote reusable metadata libraries and cross-business standards in collaboration with other technical disciplines. Partner with Lead Data Engineers, Data Architects, and Technologists to design and develop innovative solutions. Continually improve data engineering, automation, and scaling capabilities. Provide leadership and mentoring, helping to develop the skills and capabilities of the Data Engineer community. Carry out line management responsibilities, supporting the growth and development of Data Engineers. Ensure alignment and collaboration with teams across Digital Group, Data & Analytics, and Data Practice for consistency and scalability. Skills & Experience Required Practitioner Level: Proven ability to lead development and delivery of complex data pipelines using big data technologies (Apache Kafka, Spark, or similar) and cloud platforms (AWS, Azure). Technical leadership experience, setting team direction and ensuring adherence to data standards and strategic principles. Strong programming/coding expertise across Python, SQL, Proc SQL, and cloud technologies (Azure stack, AWS). Experience in designing and executing data/code quality assurance processes, troubleshooting, and resolving processing issues. Ability to apply standards and tools to design, code, test, correct, and document programs/scripts from agreed specifications. Knowledge of data modelling, with experience leading strategies for delivery to wider communities. Expert Level: Proven track record leading the development of ETL pipelines for large, complex, or high-volume datasets, with effective delegation and oversight. Advanced knowledge of data engineering standards, with the ability to establish, maintain, and enforce them across teams.
Oct 01, 2025
Role Overview We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders to translate requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering teams and communities, ensuring delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and platforms. Translate user requirements and data designs into effective, reusable, and standards-compliant data solutions. Define, deliver, and embed engineering standards across multiple platforms, keeping them updated and ensuring adherence across teams. Champion data validation methods and standards to ensure data quality from source to consumption. Standardise code, product, and service quality across engineering teams by implementing best practices and governance. Design and promote reusable metadata libraries and cross-business standards in collaboration with other technical disciplines. Partner with Lead Data Engineers, Data Architects, and Technologists to design and develop innovative solutions. Continually improve data engineering, automation, and scaling capabilities. Provide leadership and mentoring, helping to develop the skills and capabilities of the Data Engineer community. Carry out line management responsibilities, supporting the growth and development of Data Engineers. Ensure alignment and collaboration with teams across Digital Group, Data & Analytics, and Data Practice for consistency and scalability. Skills & Experience Required Practitioner Level: Proven ability to lead development and delivery of complex data pipelines using big data technologies (Apache Kafka, Spark, or similar) and cloud platforms (AWS, Azure). Technical leadership experience, setting team direction and ensuring adherence to data standards and strategic principles. Strong programming/coding expertise across Python, SQL, Proc SQL, and cloud technologies (Azure stack, AWS). Experience in designing and executing data/code quality assurance processes, troubleshooting, and resolving processing issues. Ability to apply standards and tools to design, code, test, correct, and document programs/scripts from agreed specifications. Knowledge of data modelling, with experience leading strategies for delivery to wider communities. Expert Level: Proven track record leading the development of ETL pipelines for large, complex, or high-volume datasets, with effective delegation and oversight. Advanced knowledge of data engineering standards, with the ability to establish, maintain, and enforce them across teams.
Data Solution Architect - Azure, ADF, Snowflake, Insurance £Market rate (Inside IR35) London / Hybrid 6 Months My client is an instantly recognisable Insurance brand who urgently require a Data Solution Architect with expertise in Data Modelling, Data Engineering Design, strong Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI), Snowflake and Enterprise scale Data Sources to join a business-critical Programme ASAP. Key Requirements: Proven expertise in Data Solution Architecture working on large, complex Data Programmes Strong Data Modelling experience (especially Conceptual Data Models) Demonstrable background in Data Engineering Design processes (ETL, ELT), with good knowledge of Data Vault, Inmon and Kimball Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Previous experience with large, Enterprise scale Data sets and sources Strong understanding of Data Governance principles (Data stewardship, Data quality and compliance guardrails as well as Data quality, lineage, lifecycle management and security) Excellent communication and stakeholder management skills Flexible approach to hybrid working (attending workshops, possibly across differ locations if needed) Nice to have: Insurance industry experience Previous work on Data strategies Exposure to collaborative modelling tools such as Ellie.ai Immediate availability If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk
Sep 22, 2025
Full time
Data Solution Architect - Azure, ADF, Snowflake, Insurance £Market rate (Inside IR35) London / Hybrid 6 Months My client is an instantly recognisable Insurance brand who urgently require a Data Solution Architect with expertise in Data Modelling, Data Engineering Design, strong Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI), Snowflake and Enterprise scale Data Sources to join a business-critical Programme ASAP. Key Requirements: Proven expertise in Data Solution Architecture working on large, complex Data Programmes Strong Data Modelling experience (especially Conceptual Data Models) Demonstrable background in Data Engineering Design processes (ETL, ELT), with good knowledge of Data Vault, Inmon and Kimball Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Previous experience with large, Enterprise scale Data sets and sources Strong understanding of Data Governance principles (Data stewardship, Data quality and compliance guardrails as well as Data quality, lineage, lifecycle management and security) Excellent communication and stakeholder management skills Flexible approach to hybrid working (attending workshops, possibly across differ locations if needed) Nice to have: Insurance industry experience Previous work on Data strategies Exposure to collaborative modelling tools such as Ellie.ai Immediate availability If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk
