Data Engineer - Python / SQL / Spark / Databricks is required by highly successful and fast growing technology consultancy. As a Data Engineer, you ll be part of a client team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. You re also an effective communicator and a strong team player. Together with your team, you ll thrive in a fast-paced engineering environment, delivering outstanding results and exciting projects. Preferred skills: Designing and building data-intensive applications and pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 at a top tier university Excellent training and career development opportunities exist for the right candidate. Based Newcastle upon Tyne Basic salary £(phone number removed) + bonus + excellent benefits
May 26, 2026
Full time
Data Engineer - Python / SQL / Spark / Databricks is required by highly successful and fast growing technology consultancy. As a Data Engineer, you ll be part of a client team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. You re also an effective communicator and a strong team player. Together with your team, you ll thrive in a fast-paced engineering environment, delivering outstanding results and exciting projects. Preferred skills: Designing and building data-intensive applications and pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 at a top tier university Excellent training and career development opportunities exist for the right candidate. Based Newcastle upon Tyne Basic salary £(phone number removed) + bonus + excellent benefits
Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Join Our Team as a Senior Data Engineer! Are you a passionate Data Engineer with a flair for innovation? Do you thrive in a dynamic environment where your skills can shape the future of data architecture? If so, we have the perfect opportunity for you! Our client, a leader in the Utilities sector, is seeking a Senior Data Engineer for a temporary role of 3 months. Role: Senior Data Engineer Duration: 3 Months (extension options) Location: Warwick (Hybrid - 1 day on site) Rate: 500- 550 per day (umbrella) Role Overview: As a Senior Data Engineer, you will play a pivotal role in enhancing the Interconnectors Data Platform (ICDP), a cloud-based data warehouse essential for commercial, financial modeling, and operational decision-making. With the platform evolving towards a modernized Medallion Architecture and Azure-native ingestion patterns, your expertise will drive architectural direction and technical leadership. Key Responsibilities: Data Architecture & Platform Engineering: Lead the design and implementation of scalable data architectures using Bronze/Silver/Gold layered models. Shape the platform's architectural roadmap, ensuring alignment with cutting-edge engineering practices. Develop secure and observable ingestion and transformation pipelines. Pipeline Development & Operations: Spearhead the migration from legacy ETL tools to modern Azure-based pipelines, using Azure Functions, Azure Data Factory (ADF), and event-driven frameworks. Build and maintain high-performance SQL transformations, curated layers, and reusable data models. Embed CI/CD, testing, version control, and observability into workflows. Data Quality & Governance: Ensure robust data validation, reconciliation, profiling, and auditability across platform layers. Collaborate with business stakeholders to guarantee analytical and operational needs are met. Leadership: Mentor fellow data engineers, fostering technical growth within the ICDP team. Collaborate with Product teams, IT&D, and external partners to achieve high-quality outcomes. Serve as a technical authority on engineering approaches, patterns, and standards. Required Skills & Experience: Essential Technical Skills: Python: Strong hands-on experience in building production-grade data pipelines and orchestration. Advanced SQL: Expert-level skills in analytical SQL, query optimization, and data modeling. Azure Cloud: Familiarity with Azure Functions, Azure Data Factory, Azure Storage, and cloud security fundamentals. Data Warehousing: In-depth understanding of data architecture principles and scalable enterprise data design. Version Control: Proficient in Git, CI/CD, automated testing, and modern engineering practices. Pipeline Design: Experience with API ingestion, SFTP ingestion, and resilient pipeline design. Soft Skills: Exceptional problem-solving and architectural thinking abilities. Strong communication and stakeholder collaboration skills. Capability to lead and provide clarity in complex technical environments. Desirable Experience: Involvement in data-platform re-architecture programs. Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems. Experience in regulated or high-assurance data environments. Why Join Us? This is your chance to be part of a transformative journey in the Utilities industry! Not only will you be enhancing your skills, but you will also contribute to a vital platform that impacts decision-making at every level. If you're ready to take on this exciting challenge and make a significant impact, we want to hear from you! Apply now and become a key player in our client's innovative team! Candidates will ideally show evidence of the above in their CV to be considered. Please be advised if you haven't heard from us within 48 hours then unfortunately your application has not been successful on this occasion, we may however keep your details on file for any suitable future vacancies and contact you accordingly. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.
May 26, 2026
Contractor
Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Join Our Team as a Senior Data Engineer! Are you a passionate Data Engineer with a flair for innovation? Do you thrive in a dynamic environment where your skills can shape the future of data architecture? If so, we have the perfect opportunity for you! Our client, a leader in the Utilities sector, is seeking a Senior Data Engineer for a temporary role of 3 months. Role: Senior Data Engineer Duration: 3 Months (extension options) Location: Warwick (Hybrid - 1 day on site) Rate: 500- 550 per day (umbrella) Role Overview: As a Senior Data Engineer, you will play a pivotal role in enhancing the Interconnectors Data Platform (ICDP), a cloud-based data warehouse essential for commercial, financial modeling, and operational decision-making. With the platform evolving towards a modernized Medallion Architecture and Azure-native ingestion patterns, your expertise will drive architectural direction and technical leadership. Key Responsibilities: Data Architecture & Platform Engineering: Lead the design and implementation of scalable data architectures using Bronze/Silver/Gold layered models. Shape the platform's architectural roadmap, ensuring alignment with cutting-edge engineering practices. Develop secure and observable ingestion and transformation pipelines. Pipeline Development & Operations: Spearhead the migration from legacy ETL tools to modern Azure-based pipelines, using Azure Functions, Azure Data Factory (ADF), and event-driven frameworks. Build and maintain high-performance SQL transformations, curated layers, and reusable data models. Embed CI/CD, testing, version control, and observability into workflows. Data Quality & Governance: Ensure robust data validation, reconciliation, profiling, and auditability across platform layers. Collaborate with business stakeholders to guarantee analytical and operational needs are met. Leadership: Mentor fellow data engineers, fostering technical growth within the ICDP team. Collaborate with Product teams, IT&D, and external partners to achieve high-quality outcomes. Serve as a technical authority on engineering approaches, patterns, and standards. Required Skills & Experience: Essential Technical Skills: Python: Strong hands-on experience in building production-grade data pipelines and orchestration. Advanced SQL: Expert-level skills in analytical SQL, query optimization, and data modeling. Azure Cloud: Familiarity with Azure Functions, Azure Data Factory, Azure Storage, and cloud security fundamentals. Data Warehousing: In-depth understanding of data architecture principles and scalable enterprise data design. Version Control: Proficient in Git, CI/CD, automated testing, and modern engineering practices. Pipeline Design: Experience with API ingestion, SFTP ingestion, and resilient pipeline design. Soft Skills: Exceptional problem-solving and architectural thinking abilities. Strong communication and stakeholder collaboration skills. Capability to lead and provide clarity in complex technical environments. Desirable Experience: Involvement in data-platform re-architecture programs. Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems. Experience in regulated or high-assurance data environments. Why Join Us? This is your chance to be part of a transformative journey in the Utilities industry! Not only will you be enhancing your skills, but you will also contribute to a vital platform that impacts decision-making at every level. If you're ready to take on this exciting challenge and make a significant impact, we want to hear from you! Apply now and become a key player in our client's innovative team! Candidates will ideally show evidence of the above in their CV to be considered. Please be advised if you haven't heard from us within 48 hours then unfortunately your application has not been successful on this occasion, we may however keep your details on file for any suitable future vacancies and contact you accordingly. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.
Lead Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Lead Data Engineer, you'll be part of a team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. You're also an effective communicator and a strong team player. Together with your team, you'll thrive in a fast-paced engineering environment, delivering outstanding results and exciting projects Your role: As a Lead Data Engineer you will lead and manage a small team, working closely with the business to understand and define their data needs, ensuring that data capabilities support the business strategy. You will play a key part in the continuing development and support of their data platform. Preferred skills: Designing and building data-intensive applications and pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training and career development opportunities exist for the right candidate. Based Newcastle upon Tyne Basic salary (phone number removed) + bonus + excellent benefits
May 26, 2026
Full time
Lead Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Lead Data Engineer, you'll be part of a team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. You're also an effective communicator and a strong team player. Together with your team, you'll thrive in a fast-paced engineering environment, delivering outstanding results and exciting projects Your role: As a Lead Data Engineer you will lead and manage a small team, working closely with the business to understand and define their data needs, ensuring that data capabilities support the business strategy. You will play a key part in the continuing development and support of their data platform. Preferred skills: Designing and building data-intensive applications and pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training and career development opportunities exist for the right candidate. Based Newcastle upon Tyne Basic salary (phone number removed) + bonus + excellent benefits
About the Role We are seeking an experienced Technical Architect with strong expertise in automation and AI to provide technical leadership across complex projects. You will define and implement technical architectures, influence technology strategy, and ensure solutions align with business goals and enterprise standards. Key Responsibilities: Technical Leadership Lead and guide project and service teams on complex technical solutions. Define and document architectures, data flows, and integrations. Recommend technologies, conduct feasibility studies, and ensure alignment with enterprise standards. Solution Design & Innovation Design scalable, robust solutions that meet business needs. Maintain technical roadmaps and promote continuous improvement. Evaluate emerging technologies and develop proof of concepts. Project Delivery Support all phases of the project lifecycle. Collaborate with PMs, BAs, engineers, and stakeholders. Manage technical risks and communicate impacts effectively. Operational Excellence Improve operational efficiency and reduce technical debt. Identify opportunities for automation and process optimisation. Provide technical guidance to operations teams. M&A Support Conduct technical due diligence and integration planning. Assess and integrate acquired systems and processes. Here's What You'll Need Proven experience as a Technical Architect across diverse technology domains. Knowledge of ITIL, Prince2, TOGAF, Archimate. Strong analytical, communication, and problem solving skills. Experience in matrixed environments and fast paced project delivery. Good organisational and project management capabilities. Expertise in multiple enterprise technologies, including: Automation : Power Platform, UIPath, BluePrism, AutomationAnywhere AI : LLMs, coding copilots, MS Foundry/Copilot Studio Data : MS Fabric, Databricks ITSM : ServiceNow EUC : Intune, SCCM Applications : CRM, ERP, HCM, Finance Infrastructure : servers (cloud/on prem), networking, storage, backup Cloud : Azure Cyber Security : SIEM, XDR, IPS/IDS, NIST, ISO27001
May 26, 2026
Full time
About the Role We are seeking an experienced Technical Architect with strong expertise in automation and AI to provide technical leadership across complex projects. You will define and implement technical architectures, influence technology strategy, and ensure solutions align with business goals and enterprise standards. Key Responsibilities: Technical Leadership Lead and guide project and service teams on complex technical solutions. Define and document architectures, data flows, and integrations. Recommend technologies, conduct feasibility studies, and ensure alignment with enterprise standards. Solution Design & Innovation Design scalable, robust solutions that meet business needs. Maintain technical roadmaps and promote continuous improvement. Evaluate emerging technologies and develop proof of concepts. Project Delivery Support all phases of the project lifecycle. Collaborate with PMs, BAs, engineers, and stakeholders. Manage technical risks and communicate impacts effectively. Operational Excellence Improve operational efficiency and reduce technical debt. Identify opportunities for automation and process optimisation. Provide technical guidance to operations teams. M&A Support Conduct technical due diligence and integration planning. Assess and integrate acquired systems and processes. Here's What You'll Need Proven experience as a Technical Architect across diverse technology domains. Knowledge of ITIL, Prince2, TOGAF, Archimate. Strong analytical, communication, and problem solving skills. Experience in matrixed environments and fast paced project delivery. Good organisational and project management capabilities. Expertise in multiple enterprise technologies, including: Automation : Power Platform, UIPath, BluePrism, AutomationAnywhere AI : LLMs, coding copilots, MS Foundry/Copilot Studio Data : MS Fabric, Databricks ITSM : ServiceNow EUC : Intune, SCCM Applications : CRM, ERP, HCM, Finance Infrastructure : servers (cloud/on prem), networking, storage, backup Cloud : Azure Cyber Security : SIEM, XDR, IPS/IDS, NIST, ISO27001
Location: Swansea This Lead Data Engineer role sits within DVLA's data platform team, working on modern, large-scale data systems that drive better decisions, insights and digital services. Why this role stands out Lead engineering for high-impact data products across DVLA Work with modern technologies including Databricks, Spark, and lakehouse architectures Shape standards and best practice across a growing data function Collaborate with product teams, analysts and data scientists Play a key role in improving digital services at national scale What you'll be doing Leading the design and build of data pipelines and data products Developing robust data models and integrations across systems Ensuring data is processed efficiently for analytics and business intelligence Driving best practice and standards across data engineering teams Supporting performance optimisation and balancing cost, scalability and reliability Working across teams to enable reuse of data and improve delivery Who this role could suit This role could be a strong fit if experience includes: Leading data engineering or data platform delivery Strong SQL and Python development skills Experience with big data technologies (e.g. Spark, Databricks ) Data modelling, warehousing and large-scale data processing Mentoring teams and setting engineering standards Interested? This partner post gives you the overview. Click through to the full Civil Service Jobs advert to see full details and apply.
May 26, 2026
Full time
Location: Swansea This Lead Data Engineer role sits within DVLA's data platform team, working on modern, large-scale data systems that drive better decisions, insights and digital services. Why this role stands out Lead engineering for high-impact data products across DVLA Work with modern technologies including Databricks, Spark, and lakehouse architectures Shape standards and best practice across a growing data function Collaborate with product teams, analysts and data scientists Play a key role in improving digital services at national scale What you'll be doing Leading the design and build of data pipelines and data products Developing robust data models and integrations across systems Ensuring data is processed efficiently for analytics and business intelligence Driving best practice and standards across data engineering teams Supporting performance optimisation and balancing cost, scalability and reliability Working across teams to enable reuse of data and improve delivery Who this role could suit This role could be a strong fit if experience includes: Leading data engineering or data platform delivery Strong SQL and Python development skills Experience with big data technologies (e.g. Spark, Databricks ) Data modelling, warehousing and large-scale data processing Mentoring teams and setting engineering standards Interested? This partner post gives you the overview. Click through to the full Civil Service Jobs advert to see full details and apply.
Location: Newport Join the Intellectual Property Office (IPO) and help shape the systems that support businesses, creators and innovators across the UK and beyond. This is a brilliant opportunity to work on enterprise-scale data services , driving improvements that keep systems reliable, scalable and ready for the future. You'll be part of a forward-thinking Digital, Data and Technology team, working with modern tools and approaches to deliver high-quality services that make a real difference. About the role As a Senior Data Engineer, you'll play a key role in designing, building and improving IPO's data infrastructure. Working within a multidisciplinary delivery team, you'll develop robust data services and solutions that support both internal teams and external users. This is a hands-on technical role where you'll build and optimise data pipelines, support cloud-based platforms, and help ensure data is accessible, reliable and reusable across the organisation. You'll also have the opportunity to explore new technologies and contribute to building a strong, modern data engineering capability. The role follows a hybrid working model, with time split between home working and the Newport office. What you'll be doing Lead and deliver data enhancements , using the team's tools and expertise to drive improvements Build, own and maintain data pipelines and data engineering solutions Develop and optimise ETL processes to improve performance and efficiency Support integration of data across internal and external systems Work closely with Data Management and Business Intelligence teams to improve data access and usability Collaborate with stakeholders to understand user needs and shape data solutions Apply data engineering approaches to solve complex business challenges Support the organisation's wider vision for how data is used across IPO Contribute to building a high-performing data engineering capability What we're looking for Strong experience with: Azure Data Factory (ADF), Databricks, Python and other data tools Designing, coding, testing and documenting programs or scripts Data cleansing, preparation and transformation Knowledge of: Designing scalable, future-proof data solutions Data platforms, pipelines and integration Experience of: Delivering technical solutions as part of large or complex projects Working in Agile environments (e.g. Scrum) Applying DevOps principles in data engineering Using Azure DevOps or similar tooling Interested? This partner post gives you a quick overview Click through to the full Civil Service Jobs advert to find out more and apply.
May 26, 2026
Full time
Location: Newport Join the Intellectual Property Office (IPO) and help shape the systems that support businesses, creators and innovators across the UK and beyond. This is a brilliant opportunity to work on enterprise-scale data services , driving improvements that keep systems reliable, scalable and ready for the future. You'll be part of a forward-thinking Digital, Data and Technology team, working with modern tools and approaches to deliver high-quality services that make a real difference. About the role As a Senior Data Engineer, you'll play a key role in designing, building and improving IPO's data infrastructure. Working within a multidisciplinary delivery team, you'll develop robust data services and solutions that support both internal teams and external users. This is a hands-on technical role where you'll build and optimise data pipelines, support cloud-based platforms, and help ensure data is accessible, reliable and reusable across the organisation. You'll also have the opportunity to explore new technologies and contribute to building a strong, modern data engineering capability. The role follows a hybrid working model, with time split between home working and the Newport office. What you'll be doing Lead and deliver data enhancements , using the team's tools and expertise to drive improvements Build, own and maintain data pipelines and data engineering solutions Develop and optimise ETL processes to improve performance and efficiency Support integration of data across internal and external systems Work closely with Data Management and Business Intelligence teams to improve data access and usability Collaborate with stakeholders to understand user needs and shape data solutions Apply data engineering approaches to solve complex business challenges Support the organisation's wider vision for how data is used across IPO Contribute to building a high-performing data engineering capability What we're looking for Strong experience with: Azure Data Factory (ADF), Databricks, Python and other data tools Designing, coding, testing and documenting programs or scripts Data cleansing, preparation and transformation Knowledge of: Designing scalable, future-proof data solutions Data platforms, pipelines and integration Experience of: Delivering technical solutions as part of large or complex projects Working in Agile environments (e.g. Scrum) Applying DevOps principles in data engineering Using Azure DevOps or similar tooling Interested? This partner post gives you a quick overview Click through to the full Civil Service Jobs advert to find out more and apply.
Data Platform Engineer (Contract) Azure / Databricks Location: Manchester city centre Working pattern: Minimum 2 days per week in office Contract: 3 months - Outside IR35 Day rate: Competitive Were looking for an experienced Data Platform Engineer to help build and support a modern Azure data platform environment, enabling scalable and secure data products across the business click apply for full job details
May 26, 2026
Contractor
Data Platform Engineer (Contract) Azure / Databricks Location: Manchester city centre Working pattern: Minimum 2 days per week in office Contract: 3 months - Outside IR35 Day rate: Competitive Were looking for an experienced Data Platform Engineer to help build and support a modern Azure data platform environment, enabling scalable and secure data products across the business click apply for full job details
Python Developer / Backend Software Engineer (FastAPI SQL Databricks) London to £95k Are you a data centric Python Developer with strong SQL and FastAPI skills? You could be progressing your career in a senior, hands-on role at a fast growing, global Insurance Underwriting technology provider that focusses on developing a complex SaaS calculation platform for rapidly growing Cyber Security insurance click apply for full job details
May 26, 2026
Full time
Python Developer / Backend Software Engineer (FastAPI SQL Databricks) London to £95k Are you a data centric Python Developer with strong SQL and FastAPI skills? You could be progressing your career in a senior, hands-on role at a fast growing, global Insurance Underwriting technology provider that focusses on developing a complex SaaS calculation platform for rapidly growing Cyber Security insurance click apply for full job details
Platform Engineer (AWS / Databricks) London (Hybrid) 6 Month Contract £600/day (Inside IR35) Platform Engineer needed with strong AWS, Databricks and Unity Catalog experience. Start ASAP in May/June 2026. 6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office. Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London . A chance to work with a leading global IT transformation business specialising in large-scale Government projects: Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms. Design and support secure integration across AWS S3, Databricks and downstream data platforms. Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns. Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls. Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access. Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns. Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls. Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog. Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations. Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns. Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration. Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.
May 25, 2026
Contractor
Platform Engineer (AWS / Databricks) London (Hybrid) 6 Month Contract £600/day (Inside IR35) Platform Engineer needed with strong AWS, Databricks and Unity Catalog experience. Start ASAP in May/June 2026. 6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office. Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London . A chance to work with a leading global IT transformation business specialising in large-scale Government projects: Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms. Design and support secure integration across AWS S3, Databricks and downstream data platforms. Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns. Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls. Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access. Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns. Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls. Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog. Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations. Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns. Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration. Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.
Finance Data Design Lead - Insurance Transformation Contract Outside IR35 London (Hybrid) We are supporting a large-scale insurance transformation programme entering a critical delivery phase and are looking to engage an experienced Finance Data Design Lead. This role sits at the centre of delivery, bridging architecture and engineering, and will play a key part in shaping and implementing complex finance and actuarial data solutions. The Role You will be responsible for translating high-level architecture into detailed, implementable designs across finance, actuarial and regulatory reporting data domains. Key responsibilities include: Designing finance data models (including IFRS17, actuarial and sub-ledger structures) Defining data pipelines and processing logic within cloud data platforms Establishing reconciliation and control frameworks across reporting outputs Working closely with architecture, engineering and platform teams to ensure alignment Embedding data quality, governance and auditability across solutions Experience Required Strong experience in insurance data environments (essential) Proven track record delivering finance or actuarial data solutions Experience with IFRS17, regulatory or statutory reporting Hands-on exposure to Databricks, Spark and Python-based pipelines Ability to operate effectively within large-scale, complex programmes Engagement Details Contract: Outside IR35 Day Rate: 900 - 1,100 (flexible depending on experience) Duration: 6-12 months Location: London (3 days per week onsite) This opportunity would suit someone who is comfortable operating in a fast-paced delivery environment, taking ownership of detailed design and driving outcomes. If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.
May 25, 2026
Contractor
Finance Data Design Lead - Insurance Transformation Contract Outside IR35 London (Hybrid) We are supporting a large-scale insurance transformation programme entering a critical delivery phase and are looking to engage an experienced Finance Data Design Lead. This role sits at the centre of delivery, bridging architecture and engineering, and will play a key part in shaping and implementing complex finance and actuarial data solutions. The Role You will be responsible for translating high-level architecture into detailed, implementable designs across finance, actuarial and regulatory reporting data domains. Key responsibilities include: Designing finance data models (including IFRS17, actuarial and sub-ledger structures) Defining data pipelines and processing logic within cloud data platforms Establishing reconciliation and control frameworks across reporting outputs Working closely with architecture, engineering and platform teams to ensure alignment Embedding data quality, governance and auditability across solutions Experience Required Strong experience in insurance data environments (essential) Proven track record delivering finance or actuarial data solutions Experience with IFRS17, regulatory or statutory reporting Hands-on exposure to Databricks, Spark and Python-based pipelines Ability to operate effectively within large-scale, complex programmes Engagement Details Contract: Outside IR35 Day Rate: 900 - 1,100 (flexible depending on experience) Duration: 6-12 months Location: London (3 days per week onsite) This opportunity would suit someone who is comfortable operating in a fast-paced delivery environment, taking ownership of detailed design and driving outcomes. If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.
Platform Engineer (Palantir Foundry) London (Hybrid) 6 Month Contract £600/day (Inside IR35) Platform Engineer needed with strong Palantir Foundry and Databricks on AWS. Start ASAP in May/June 2026. 6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office. Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London . A chance to work with a leading global IT transformation business specialising in large-scale Government projects: Configure + support secure integration between Palantir Foundry and Databricks on AWS. Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed by Foundry using the Databricks connector or approved ingestion patterns. Hands-on Palantir Foundry experience, including connectors, Data Connection, datasets, syncs, projects and permissions. Experience configuring or supporting the Palantir Foundry Databricks connectors. Strong Databricks on AWS experience, including SQL Warehouse, clusters, tables, views and access controls. Good understanding of Hive Metastore and Unity Catalog, including catalogs, schemas, grants, storage credentials and external locations. Strong AWS IAM, S3, KMS, bucket policy and cross-account access experience. Set up and validate the Foundry Databricks connector for approved SQL Warehouses, tables, views and Unity Catalog-governed objects. Support end-to-end access from AWS S3 sources through Hive Metastore and Unity Catalog into Foundry datasets or products. Configure Foundry Data Connection, datasets, syncs, projects, permissions and lineage as required. Work with AWS teams to define IAM roles, S3 bucket policies, KMS permissions and approved cross account access patterns. Troubleshoot Foundry connector failures, Databricks authentication issues, Unity Catalog grants, schema mismatches and query failures. Technical Environment : Palantir Foundry, Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder, Code Repositories, AWS, Databricks, Terraform, IaC, Delta Lake, Parquet, Iceberg, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.
May 25, 2026
Contractor
Platform Engineer (Palantir Foundry) London (Hybrid) 6 Month Contract £600/day (Inside IR35) Platform Engineer needed with strong Palantir Foundry and Databricks on AWS. Start ASAP in May/June 2026. 6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office. Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London . A chance to work with a leading global IT transformation business specialising in large-scale Government projects: Configure + support secure integration between Palantir Foundry and Databricks on AWS. Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed by Foundry using the Databricks connector or approved ingestion patterns. Hands-on Palantir Foundry experience, including connectors, Data Connection, datasets, syncs, projects and permissions. Experience configuring or supporting the Palantir Foundry Databricks connectors. Strong Databricks on AWS experience, including SQL Warehouse, clusters, tables, views and access controls. Good understanding of Hive Metastore and Unity Catalog, including catalogs, schemas, grants, storage credentials and external locations. Strong AWS IAM, S3, KMS, bucket policy and cross-account access experience. Set up and validate the Foundry Databricks connector for approved SQL Warehouses, tables, views and Unity Catalog-governed objects. Support end-to-end access from AWS S3 sources through Hive Metastore and Unity Catalog into Foundry datasets or products. Configure Foundry Data Connection, datasets, syncs, projects, permissions and lineage as required. Work with AWS teams to define IAM roles, S3 bucket policies, KMS permissions and approved cross account access patterns. Troubleshoot Foundry connector failures, Databricks authentication issues, Unity Catalog grants, schema mismatches and query failures. Technical Environment : Palantir Foundry, Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder, Code Repositories, AWS, Databricks, Terraform, IaC, Delta Lake, Parquet, Iceberg, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.
Finance Data Engineering Lead - Insurance Programme Contract Outside IR35 London (Hybrid) We are working with a leading insurance organisation seeking a Finance Data Engineering Lead to join a major programme at a critical stage of delivery. This is a hands-on role focused on building and delivering data solutions within an established cloud data environment. The Role You will play a key role in developing and deploying finance and actuarial data pipelines, supporting reporting, analytics and reconciliation capabilities. Key responsibilities include: Developing Python / PySpark data pipelines within cloud platforms Building datasets and models for finance, actuarial and risk reporting Integrating with existing data ingestion and orchestration frameworks Supporting reconciliation, validation and data quality processes Collaborating with design and architecture teams to deliver aligned solutions Experience Required Strong experience as a Data Engineer within insurance (essential) Proficiency in Python, PySpark and Spark-based processing Experience working with Databricks or similar cloud data platforms Exposure to finance, actuarial or regulatory reporting data Ability to operate within live programme environments and deliver at pace Engagement Details Contract: Outside IR35 Day Rate: 750 - 950 (flexible for strong profiles) Duration: 6-12 months Location: London (3 days per week onsite) This role is ideal for someone who enjoys hands-on delivery, working within established environments, and contributing to high-impact programmes. If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.
May 25, 2026
Contractor
Finance Data Engineering Lead - Insurance Programme Contract Outside IR35 London (Hybrid) We are working with a leading insurance organisation seeking a Finance Data Engineering Lead to join a major programme at a critical stage of delivery. This is a hands-on role focused on building and delivering data solutions within an established cloud data environment. The Role You will play a key role in developing and deploying finance and actuarial data pipelines, supporting reporting, analytics and reconciliation capabilities. Key responsibilities include: Developing Python / PySpark data pipelines within cloud platforms Building datasets and models for finance, actuarial and risk reporting Integrating with existing data ingestion and orchestration frameworks Supporting reconciliation, validation and data quality processes Collaborating with design and architecture teams to deliver aligned solutions Experience Required Strong experience as a Data Engineer within insurance (essential) Proficiency in Python, PySpark and Spark-based processing Experience working with Databricks or similar cloud data platforms Exposure to finance, actuarial or regulatory reporting data Ability to operate within live programme environments and deliver at pace Engagement Details Contract: Outside IR35 Day Rate: 750 - 950 (flexible for strong profiles) Duration: 6-12 months Location: London (3 days per week onsite) This role is ideal for someone who enjoys hands-on delivery, working within established environments, and contributing to high-impact programmes. If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.
Join an award-winning B2B consultancy at the forefront of enterprise AI, building and owning the cloud-native platform infrastructure that powers production-grade conversational and generative AI products at scale. The role This is a platform and infrastructure engineering role - not a data science or ML engineering position. You'll own the runtime, infrastructure, and operational layers that RAG pipelines, LLM orchestration, vector search, and evaluation workflows run on, across AWS and Databricks. The focus is on building scalable, observable, secure, and cost-efficient platform infrastructure that enables AI engineering teams to ship and operate AI products reliably in production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases) and embedding pipelines Build and maintain CI/CD pipelines for inference services, retrievers, ingestion workflows, and RAG components Implement observability across AI workloads using CloudWatch, MLflow, and OpenTelemetry - covering latency, throughput, cost, and system health Apply secure-by-design principles including IAM, encryption, network controls, and audit logging Work closely with AI engineers to translate prototypes and proof-of-concepts into production-ready, well-architected platform components What we're looking for Proven experience in platform, infrastructure, or software engineering roles delivering production-grade systems on AWS Strong hands-on Kubernetes experience, specifically with EKS (Elastic Kubernetes Service) and ECS (Elastic Container Service) in production environments Strong Terraform experience for infrastructure-as-code, provisioning and managing cloud infrastructure at scale Experience operating containerised services, managing CI/CD pipelines, and owning observability and reliability Familiarity with vector databases or search infrastructure (OpenSearch, Algolia) is a strong advantage Python proficiency for scripting, automation, and deploying production services Solid grasp of distributed systems, cloud-native architecture, microservices, and API design Ownership mindset - comfortable operating autonomously across reliability, performance, cost, and security Why join? You'll own the foundational platform infrastructure behind a growing suite of generative AI products, working directly with senior AI and engineering leaders. This is a deep technical ownership role with long-term architectural impact, within an organisation investing heavily in AI at scale. INDAM The Portfolio Group are acting on behalf of our client in recruiting for this position.
May 25, 2026
Full time
Join an award-winning B2B consultancy at the forefront of enterprise AI, building and owning the cloud-native platform infrastructure that powers production-grade conversational and generative AI products at scale. The role This is a platform and infrastructure engineering role - not a data science or ML engineering position. You'll own the runtime, infrastructure, and operational layers that RAG pipelines, LLM orchestration, vector search, and evaluation workflows run on, across AWS and Databricks. The focus is on building scalable, observable, secure, and cost-efficient platform infrastructure that enables AI engineering teams to ship and operate AI products reliably in production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases) and embedding pipelines Build and maintain CI/CD pipelines for inference services, retrievers, ingestion workflows, and RAG components Implement observability across AI workloads using CloudWatch, MLflow, and OpenTelemetry - covering latency, throughput, cost, and system health Apply secure-by-design principles including IAM, encryption, network controls, and audit logging Work closely with AI engineers to translate prototypes and proof-of-concepts into production-ready, well-architected platform components What we're looking for Proven experience in platform, infrastructure, or software engineering roles delivering production-grade systems on AWS Strong hands-on Kubernetes experience, specifically with EKS (Elastic Kubernetes Service) and ECS (Elastic Container Service) in production environments Strong Terraform experience for infrastructure-as-code, provisioning and managing cloud infrastructure at scale Experience operating containerised services, managing CI/CD pipelines, and owning observability and reliability Familiarity with vector databases or search infrastructure (OpenSearch, Algolia) is a strong advantage Python proficiency for scripting, automation, and deploying production services Solid grasp of distributed systems, cloud-native architecture, microservices, and API design Ownership mindset - comfortable operating autonomously across reliability, performance, cost, and security Why join? You'll own the foundational platform infrastructure behind a growing suite of generative AI products, working directly with senior AI and engineering leaders. This is a deep technical ownership role with long-term architectural impact, within an organisation investing heavily in AI at scale. INDAM The Portfolio Group are acting on behalf of our client in recruiting for this position.
Data Solutions Architect Salary: 90K - 100K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio of data initiatives. The Opportunity This is a senior architecture role focused on shaping how data solutions are designed and delivered across a complex enterprise data estate. You will work closely with product owners, engineering leads, data teams and senior stakeholders to understand business requirements and translate them into clear, robust high-level designs for engineering teams to build. The role is not focused on hands-on delivery. Instead, you will be responsible for articulating solution designs, documenting key decisions, defining reusable patterns and ensuring consistency across a shared data platform. You will support a modern cloud data platform, with exposure to areas such as analytics, reporting, data science, AI use cases and increasingly real-time data capabilities. Skills and experience Strong experience designing secure, scalable data solutions in complex environments Experience working with Azure-based data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale cloud data platform, please submit your CV for initial screening and further details. Data Solutions Architect
May 24, 2026
Full time
Data Solutions Architect Salary: 90K - 100K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio of data initiatives. The Opportunity This is a senior architecture role focused on shaping how data solutions are designed and delivered across a complex enterprise data estate. You will work closely with product owners, engineering leads, data teams and senior stakeholders to understand business requirements and translate them into clear, robust high-level designs for engineering teams to build. The role is not focused on hands-on delivery. Instead, you will be responsible for articulating solution designs, documenting key decisions, defining reusable patterns and ensuring consistency across a shared data platform. You will support a modern cloud data platform, with exposure to areas such as analytics, reporting, data science, AI use cases and increasingly real-time data capabilities. Skills and experience Strong experience designing secure, scalable data solutions in complex environments Experience working with Azure-based data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale cloud data platform, please submit your CV for initial screening and further details. Data Solutions Architect
An exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start date: ASAP Salary: Up to £75k per annum The Job As the Lead Data Engineer , your responsibilities will include: Leading the design and delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring and leading a small team of Data Engineers and working closely with Analytics Engineers and Data Scientists Remaining hands-on with complex technical delivery, architecture decisions and code reviews Defining CI/CD, testing, observability and infrastructure-as-code standards for data pipelines Ensuring strong data governance, security controls and compliance across all datasets Partnering with Product and commercial teams on data initiatives and client data onboarding Supporting analytics, BI and AI/ML use cases with well-structured, documented and reliable data models You 5+ years' experience in data engineering or data platform roles Strong hands-on experience with SQL, Python and distributed data processing Proven experience building and operating modern cloud data platforms Experience with technologies such as Snowflake, Databricks and Power BI Strong understanding of CI/CD, infrastructure-as-code and data quality practices Solid knowledge of data security, access controls and governance Comfortable operating as a hands-on technical leader , mentoring others and influencing standards Strong stakeholder communication skills Apply Now You can apply for the Lead Data Engineer position now by sending us your CV or by calling us today. Don't forget to register as a candidate too. Amy Brown Principal Managing Consultant Sphere Digital Recruitment currently has a variety of job opportunities across digital, so feel free to get in touch to find out how we can help you. Please take a look at our website. Sphere is an equal opportunities employer. We encourage applications regardless of ethnic origin, race, religious beliefs, age, disability, gender or sexual orientation, and any other protected status as required by applicable law. Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free to get in touch with us to find out how we can help you. Please take a look at our website. Sphere is an equal opportunities employer. We encourage applications regardless of ethnic origin, race, religious beliefs, age, disability, gender or sexual orientation, and any other protected status as required by applicable law. If you require any adjustments or additional support during the recruitment process for any reason whatsoever, please let us know.
May 24, 2026
Full time
An exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start date: ASAP Salary: Up to £75k per annum The Job As the Lead Data Engineer , your responsibilities will include: Leading the design and delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring and leading a small team of Data Engineers and working closely with Analytics Engineers and Data Scientists Remaining hands-on with complex technical delivery, architecture decisions and code reviews Defining CI/CD, testing, observability and infrastructure-as-code standards for data pipelines Ensuring strong data governance, security controls and compliance across all datasets Partnering with Product and commercial teams on data initiatives and client data onboarding Supporting analytics, BI and AI/ML use cases with well-structured, documented and reliable data models You 5+ years' experience in data engineering or data platform roles Strong hands-on experience with SQL, Python and distributed data processing Proven experience building and operating modern cloud data platforms Experience with technologies such as Snowflake, Databricks and Power BI Strong understanding of CI/CD, infrastructure-as-code and data quality practices Solid knowledge of data security, access controls and governance Comfortable operating as a hands-on technical leader , mentoring others and influencing standards Strong stakeholder communication skills Apply Now You can apply for the Lead Data Engineer position now by sending us your CV or by calling us today. Don't forget to register as a candidate too. Amy Brown Principal Managing Consultant Sphere Digital Recruitment currently has a variety of job opportunities across digital, so feel free to get in touch to find out how we can help you. Please take a look at our website. Sphere is an equal opportunities employer. We encourage applications regardless of ethnic origin, race, religious beliefs, age, disability, gender or sexual orientation, and any other protected status as required by applicable law. Sphere Digital Recruitment currently have a variety of job opportunities across digital so feel free to get in touch with us to find out how we can help you. Please take a look at our website. Sphere is an equal opportunities employer. We encourage applications regardless of ethnic origin, race, religious beliefs, age, disability, gender or sexual orientation, and any other protected status as required by applicable law. If you require any adjustments or additional support during the recruitment process for any reason whatsoever, please let us know.
Role: Data Solutions Architect (SC Cleared) Contract: 3-6 months initial Day rate: 500pd- 550pd (Inside IR35) Location: London (Hybrid working) We are working with a large-scale consultancy who require a Data Solutions Architect to work on an Azure Data project. The role will require someone who is SC Cleared and will be hybrid working, based in London. Responsibilities: Design secure, scalable data solutions across application, data, integration, infrastructure and security domains. Architect cloud data platforms and analytics stacks (e.g. Azure Databricks, Microsoft Fabric) including distributed processing (Spark). Translate functional and non-functional requirements (security, performance, availability, resilience) into resilient target architectures. Define current-state, target-state and transition architectures, including phased roadmaps and dependency-aware migration plans. Apply platform engineering practices (IaC, CI/CD, DevOps) aligned to landing-zone/enterprise-scale guardrails (e.g. Azure CAF). Design modern enterprise integration patterns (APIs, event-driven and service-based approaches). Produce clear, auditable artefacts for governance and assurance (HLD/LLD, ADRs, options appraisals). Act as design authority lead design reviews/ARBs, communicate trade-offs, and support build-phase conformance. Support delivery reporting/RAID, knowledge transfer, capability uplift, and exit/transition planning with complete handover documentation. Essential requirements Active SC clearance and experience working in regulated environments. Strong solution architecture background across data, cloud, security and integration. Hands-on knowledge of Azure data services, Databricks/Fabric, and modern analytics patterns. Ability to create and defend architecture artefacts and influence senior technical stakeholders. Please note, to be successful for the role and due to time frames, you must hold active SC Clearance. If you are interested in the role provide an up to date CV for consideration and apply now!
May 23, 2026
Contractor
Role: Data Solutions Architect (SC Cleared) Contract: 3-6 months initial Day rate: 500pd- 550pd (Inside IR35) Location: London (Hybrid working) We are working with a large-scale consultancy who require a Data Solutions Architect to work on an Azure Data project. The role will require someone who is SC Cleared and will be hybrid working, based in London. Responsibilities: Design secure, scalable data solutions across application, data, integration, infrastructure and security domains. Architect cloud data platforms and analytics stacks (e.g. Azure Databricks, Microsoft Fabric) including distributed processing (Spark). Translate functional and non-functional requirements (security, performance, availability, resilience) into resilient target architectures. Define current-state, target-state and transition architectures, including phased roadmaps and dependency-aware migration plans. Apply platform engineering practices (IaC, CI/CD, DevOps) aligned to landing-zone/enterprise-scale guardrails (e.g. Azure CAF). Design modern enterprise integration patterns (APIs, event-driven and service-based approaches). Produce clear, auditable artefacts for governance and assurance (HLD/LLD, ADRs, options appraisals). Act as design authority lead design reviews/ARBs, communicate trade-offs, and support build-phase conformance. Support delivery reporting/RAID, knowledge transfer, capability uplift, and exit/transition planning with complete handover documentation. Essential requirements Active SC clearance and experience working in regulated environments. Strong solution architecture background across data, cloud, security and integration. Hands-on knowledge of Azure data services, Databricks/Fabric, and modern analytics patterns. Ability to create and defend architecture artefacts and influence senior technical stakeholders. Please note, to be successful for the role and due to time frames, you must hold active SC Clearance. If you are interested in the role provide an up to date CV for consideration and apply now!
Data Platform Manager UK / Remote Circa 70k per annum + 15% bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where you'll combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric / Azure Synapse), ensuring it delivers real business value, scalability, and innovation. If you're passionate about data, leadership, and building robust data solutions-this is one you don't want to miss. What you'll be doing Own the end-to-end lifecycle of a core data platform, from design and build through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise, building and optimising PySpark pipelines Ensure data is secure, high-quality, accessible, and structured for maximum business value Drive best practice in data governance, cataloguing, lineage, and standards across the organisation Promote data re-use and reduce duplication across systems Oversee ETL processes, data integration, and BI architecture Manage and develop a small, high-performing data team, including mentoring, 1:1s, and continuous improvement initiatives Work closely with stakeholders across operations, analytics, and reporting teams Ensure compliance with data protection regulations and internal policies What you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelines Experience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such as Power BI or Tableau Knowledge of DevOps practices (Git, Azure DevOps, CI/CD pipelines) Strong Python skills and experience with APIs/data integration tools Understanding of data protection regulations Leadership experience with the ability to mentor and develop teams Excellent communication, problem-solving, and stakeholder management skills Desirable: Experience with project management methodologies, SDLC tools, and awareness of emerging data trends If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Product Manager, Data Engineering Lead, Lead Data Engineer, Azure Data Engineer, Data Platform Manager, Analytics Engineering Manager, Cloud Data Engineer, BI & Data Lead, PySpark Engineer, Databricks Engineer, Head of Data Engineering. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate 1 to The Born Free Foundation. We are a Climate Action Workforce in partnership with Ecologi. If this role isn't right for you, explore our referral reward program with payouts at interview and placement milestones. Visit our website for details. Deerfoot Recruitment Solutions Ltd is acting as an Employment Agency in relation to this vacancy.
May 23, 2026
Full time
Data Platform Manager UK / Remote Circa 70k per annum + 15% bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where you'll combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric / Azure Synapse), ensuring it delivers real business value, scalability, and innovation. If you're passionate about data, leadership, and building robust data solutions-this is one you don't want to miss. What you'll be doing Own the end-to-end lifecycle of a core data platform, from design and build through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise, building and optimising PySpark pipelines Ensure data is secure, high-quality, accessible, and structured for maximum business value Drive best practice in data governance, cataloguing, lineage, and standards across the organisation Promote data re-use and reduce duplication across systems Oversee ETL processes, data integration, and BI architecture Manage and develop a small, high-performing data team, including mentoring, 1:1s, and continuous improvement initiatives Work closely with stakeholders across operations, analytics, and reporting teams Ensure compliance with data protection regulations and internal policies What you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelines Experience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such as Power BI or Tableau Knowledge of DevOps practices (Git, Azure DevOps, CI/CD pipelines) Strong Python skills and experience with APIs/data integration tools Understanding of data protection regulations Leadership experience with the ability to mentor and develop teams Excellent communication, problem-solving, and stakeholder management skills Desirable: Experience with project management methodologies, SDLC tools, and awareness of emerging data trends If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Product Manager, Data Engineering Lead, Lead Data Engineer, Azure Data Engineer, Data Platform Manager, Analytics Engineering Manager, Cloud Data Engineer, BI & Data Lead, PySpark Engineer, Databricks Engineer, Head of Data Engineering. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate 1 to The Born Free Foundation. We are a Climate Action Workforce in partnership with Ecologi. If this role isn't right for you, explore our referral reward program with payouts at interview and placement milestones. Visit our website for details. Deerfoot Recruitment Solutions Ltd is acting as an Employment Agency in relation to this vacancy.
Delivery Lead Enterprise Data Platform London Hybrid £90,000 £100,000 + Benefits VIQU is working with a leading financial services organisation to recruit a Delivery Lead to own the end-to-end delivery of complex data engineering and platform initiatives on their Azure-based Enterprise Data Platform. This role will focus on delivering platform enhancements, automation, and data governance , ensuring alignment with the business and regulatory requirements, and driving measurable business outcomes. Key Responsibilities: • Lead delivery of Azure cloud platform enhancements and automation, including integration with RDM/MDM and data quality tooling • Implement and operationalize data governance and data cataloguing using Microsoft Purview and Ataccama, including RBAC/ABAC, PII/DLP, metadata standards, business glossaries, and schema evolution • Define scope and objectives for platform and data engineering initiatives, and deliver structured, risk-managed, and Agile delivery plans • Oversee incremental release of platform features, ensuring alignment with timelines, scope, and budgets • Identify, manage, and mitigate risks, interdependencies, and issues across multiple workstreams • Act as the primary point of contact for stakeholders, ensuring alignment between business and technical teams • Support change management processes for new feature releases • Apply insurance domain knowledge to guide delivery of compliant and reliable data solutions Key Requirements: • Proven experience delivering data governance and data cataloguing initiatives end-to-end • Hands-on experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory • Hands-on data engineering experience (Spark / PySpark, Delta Lake) • Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC • Experience leading Agile teams and managing risks, dependencies, and senior stakeholders • Strong communication skills and ability to collaborate across cross-functional teams To apply: Please reach out via LinkedIn to Phoebe Rees or apply via the VIQU website. Know someone suitable? You could earn up to £1,000 if your referral is successful (T&Cs apply).
May 23, 2026
Full time
Delivery Lead Enterprise Data Platform London Hybrid £90,000 £100,000 + Benefits VIQU is working with a leading financial services organisation to recruit a Delivery Lead to own the end-to-end delivery of complex data engineering and platform initiatives on their Azure-based Enterprise Data Platform. This role will focus on delivering platform enhancements, automation, and data governance , ensuring alignment with the business and regulatory requirements, and driving measurable business outcomes. Key Responsibilities: • Lead delivery of Azure cloud platform enhancements and automation, including integration with RDM/MDM and data quality tooling • Implement and operationalize data governance and data cataloguing using Microsoft Purview and Ataccama, including RBAC/ABAC, PII/DLP, metadata standards, business glossaries, and schema evolution • Define scope and objectives for platform and data engineering initiatives, and deliver structured, risk-managed, and Agile delivery plans • Oversee incremental release of platform features, ensuring alignment with timelines, scope, and budgets • Identify, manage, and mitigate risks, interdependencies, and issues across multiple workstreams • Act as the primary point of contact for stakeholders, ensuring alignment between business and technical teams • Support change management processes for new feature releases • Apply insurance domain knowledge to guide delivery of compliant and reliable data solutions Key Requirements: • Proven experience delivering data governance and data cataloguing initiatives end-to-end • Hands-on experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory • Hands-on data engineering experience (Spark / PySpark, Delta Lake) • Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC • Experience leading Agile teams and managing risks, dependencies, and senior stakeholders • Strong communication skills and ability to collaborate across cross-functional teams To apply: Please reach out via LinkedIn to Phoebe Rees or apply via the VIQU website. Know someone suitable? You could earn up to £1,000 if your referral is successful (T&Cs apply).
We are seeking a Data & AI Technical Lead to drive the Discovery & Design phase of a large-scale M&A program for a Retail & CPG client. This role will lead the technical direction across a complex, multi-cloud data landscape spanning Azure, AWS, GCP, Databricks, and Snowflake. You will oversee and guide senior Data Architects, ensuring architectural alignment, technical quality, and business relevance. The role sits at the intersection of business strategy, data architecture, and platform engineering, acting as a key liaison between client stakeholders, IT teams, and the Chief Data Office. Required Skills & Experience Core Technical Expertise 15+ years in Data & Analytics, with 5+ years in leadership roles Strong hands-on experience across: Azure cloud, ADF, DevOps, Power BI, Fabric workspaces AWS cloud, S3, cross-cloud connectivity, API Gateways GCP (BigQuery, GCS, Dataflow) Deep expertise in: Databricks (Lakehouse architecture, Delta Lake, Unity Catalog, Delta Sharing, Pyspark, Spark SQL etc.) Snowflake (data warehousing & data sharing, Iceberg, ) Strong understanding of: Data architecture patterns, industry benchmarking, Data integration patterns (ETL/ELT, streaming, CDC, APIs) Data governance & metadata management Architecture & M&A Experience Proven experience in M&A data integration, platform consolidation, or carve-outs Experience designing multi-cloud or hybrid data architectures Familiarity with enterprise architecture frameworks (TOGAF or equivalent) Leadership & Stakeholder Skills Experience managing or leading senior architects or technical teams Strong communication skills with the ability to influence C-level stakeholders Ability to bridge business strategy and technical execution Experience working in consulting or client-facing roles
May 23, 2026
Contractor
We are seeking a Data & AI Technical Lead to drive the Discovery & Design phase of a large-scale M&A program for a Retail & CPG client. This role will lead the technical direction across a complex, multi-cloud data landscape spanning Azure, AWS, GCP, Databricks, and Snowflake. You will oversee and guide senior Data Architects, ensuring architectural alignment, technical quality, and business relevance. The role sits at the intersection of business strategy, data architecture, and platform engineering, acting as a key liaison between client stakeholders, IT teams, and the Chief Data Office. Required Skills & Experience Core Technical Expertise 15+ years in Data & Analytics, with 5+ years in leadership roles Strong hands-on experience across: Azure cloud, ADF, DevOps, Power BI, Fabric workspaces AWS cloud, S3, cross-cloud connectivity, API Gateways GCP (BigQuery, GCS, Dataflow) Deep expertise in: Databricks (Lakehouse architecture, Delta Lake, Unity Catalog, Delta Sharing, Pyspark, Spark SQL etc.) Snowflake (data warehousing & data sharing, Iceberg, ) Strong understanding of: Data architecture patterns, industry benchmarking, Data integration patterns (ETL/ELT, streaming, CDC, APIs) Data governance & metadata management Architecture & M&A Experience Proven experience in M&A data integration, platform consolidation, or carve-outs Experience designing multi-cloud or hybrid data architectures Familiarity with enterprise architecture frameworks (TOGAF or equivalent) Leadership & Stakeholder Skills Experience managing or leading senior architects or technical teams Strong communication skills with the ability to influence C-level stakeholders Ability to bridge business strategy and technical execution Experience working in consulting or client-facing roles
Lead Data Platform Specialist - Up to 85k + c.15% Bonus Fully Remote - Condensed & flexible hours available (4 day working week available - 9 out of 10, etc.) My client, a nation-wide organisation with a reputation for excellence and a supportive, inclusive culture, is seeking a Lead Data Platform Engineer to join their Data Engineering and Machine Learning team. This is a high-impact, senior role, ideal for someone with deep experience in modern cloud data platforms, looking to shape and deliver a scalable, secure, and innovative data platform. You need to have strong experience working with Databricks You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions are scalable, secure, and aligned with business needs. Hands-on experience with CI/CD, automation, and infrastructure-as-code (Terraform, ARM templates) is essential. Experience in machine learning platforms or ML engineering is a bonus. Key Responsibilities: Build and maintain the Data Lakehouse platform in a secure Azure environment Develop automation for cluster management, integration runtimes, and networking Lead architectural design and ensure platform scalability, reliability, and governance Write efficient, maintainable code in PySpark, Python, and SQL Implement CI/CD pipelines and cloud infrastructure via Terraform/ARM Collaborate with data engineers, architects, and business stakeholders Mentor and coach engineers, fostering a culture of learning and excellence Essential Skills: Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture Strong solution architecture and data platform engineering skills DevOps and automation expertise, including CI/CD, monitoring, and code quality Infrastructure-as-code (Terraform or ARM templates) for cloud resource provisioning Excellent communication and mentoring skills It's not often a role comes along in a team like this, where you get the chance to flex or condense hours, receive a strong salary with a bonus, potential for growth, independence and autonomy, and a clear pathway of progression. You'll get Private medical options, 25 days holiday, plus bank holiday, and the chance to buy/sell holiday. This is a rare opportunity to join a forward-thinking team at a leading organisation, working fully remotely with flexibility and excellent benefits. You'll be shaping the future of their data platform while collaborating with a talented and diverse team. To apply, please submit your CV as we are looking to move quickly on this role. Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law. Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers. By applying for this role your details will be submitted to Modis International Ltd and/ or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.
May 23, 2026
Full time
Lead Data Platform Specialist - Up to 85k + c.15% Bonus Fully Remote - Condensed & flexible hours available (4 day working week available - 9 out of 10, etc.) My client, a nation-wide organisation with a reputation for excellence and a supportive, inclusive culture, is seeking a Lead Data Platform Engineer to join their Data Engineering and Machine Learning team. This is a high-impact, senior role, ideal for someone with deep experience in modern cloud data platforms, looking to shape and deliver a scalable, secure, and innovative data platform. You need to have strong experience working with Databricks You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions are scalable, secure, and aligned with business needs. Hands-on experience with CI/CD, automation, and infrastructure-as-code (Terraform, ARM templates) is essential. Experience in machine learning platforms or ML engineering is a bonus. Key Responsibilities: Build and maintain the Data Lakehouse platform in a secure Azure environment Develop automation for cluster management, integration runtimes, and networking Lead architectural design and ensure platform scalability, reliability, and governance Write efficient, maintainable code in PySpark, Python, and SQL Implement CI/CD pipelines and cloud infrastructure via Terraform/ARM Collaborate with data engineers, architects, and business stakeholders Mentor and coach engineers, fostering a culture of learning and excellence Essential Skills: Deep experience in Databricks, Azure Data Factory, and Lakehouse architecture Strong solution architecture and data platform engineering skills DevOps and automation expertise, including CI/CD, monitoring, and code quality Infrastructure-as-code (Terraform or ARM templates) for cloud resource provisioning Excellent communication and mentoring skills It's not often a role comes along in a team like this, where you get the chance to flex or condense hours, receive a strong salary with a bonus, potential for growth, independence and autonomy, and a clear pathway of progression. You'll get Private medical options, 25 days holiday, plus bank holiday, and the chance to buy/sell holiday. This is a rare opportunity to join a forward-thinking team at a leading organisation, working fully remotely with flexibility and excellent benefits. You'll be shaping the future of their data platform while collaborating with a talented and diverse team. To apply, please submit your CV as we are looking to move quickly on this role. Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law. Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers. By applying for this role your details will be submitted to Modis International Ltd and/ or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.