We're hiring an experienced AI Platform Engineer to design, build and operate a production-grade Generative AI platform powering next-generation intelligent products. This is a hands-on engineering role focused on taking AI solutions from prototype to scalable, reliable services used in real-world environments. You'll sit at the intersection of DevOps, cloud infrastructure and applied AI owning the full lifecycle of Retrieval-Augmented Generation (RAG) and LLM-powered systems across modern cloud architecture. This role is about engineering, not research. You will architect and run the infrastructure that enables AI to perform securely, reliably and at scale ensuring performance, cost control and operational maturity as adoption grows. You'll work closely with AI engineers, security teams, and product stakeholders to transform experimental models into hardened, production-ready services while shaping a reusable AI platform capable of supporting multiple products. What You'll Be Doing Design and optimise scalable RAG pipelines and vector search systems Orchestrate multi-model AI services with a focus on latency, resilience and performance Productionise GenAI workflows and ensure they operate reliably under real usage Build and run AI services across AWS and Databricks Develop ingestion, embedding and retrieval pipelines Deploy containerised workloads via Kubernetes and Helm Implement Infrastructure-as-Code using Terraform Introduce end-to-end monitoring, tracing and alerting for AI workloads Improve inference and retrieval performance while reducing operational cost Establish fault-tolerant, scalable infrastructure patterns Embed security, evaluation and governance into the AI lifecycle Build CI/CD pipelines and automation to support continuous model deployment Create reusable platform components to accelerate future AI initiatives Strong experience in: Cloud infrastructure engineering (AWS-focused environments) Kubernetes, containerisation, and distributed systems Terraform / Infrastructure-as-Code CI/CD, automation, and platform reliability Running production workloads with high availability requirements Plus, experience with one or more of the following: MLOps or ML platform engineering RAG architectures, embeddings, or vector search Model serving, observability or performance optimisation Data / AI workflow orchestration in Databricks or similar ecosystems Why Join? Work on real-world AI systems operating at scale Own platform design decisions and influence long-term architecture Blend modern DevOps practices with cutting-edge Generative AI use cases Be part of a growing, innovation-driven engineering environment Opportunity to define how AI is operationalised across multiple products If you're excited by building the infrastructure that makes AI usable, scalable and reliable in production, we'd love to hear from you. 49914MSR3 INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.
Jun 12, 2026
Full time
We're hiring an experienced AI Platform Engineer to design, build and operate a production-grade Generative AI platform powering next-generation intelligent products. This is a hands-on engineering role focused on taking AI solutions from prototype to scalable, reliable services used in real-world environments. You'll sit at the intersection of DevOps, cloud infrastructure and applied AI owning the full lifecycle of Retrieval-Augmented Generation (RAG) and LLM-powered systems across modern cloud architecture. This role is about engineering, not research. You will architect and run the infrastructure that enables AI to perform securely, reliably and at scale ensuring performance, cost control and operational maturity as adoption grows. You'll work closely with AI engineers, security teams, and product stakeholders to transform experimental models into hardened, production-ready services while shaping a reusable AI platform capable of supporting multiple products. What You'll Be Doing Design and optimise scalable RAG pipelines and vector search systems Orchestrate multi-model AI services with a focus on latency, resilience and performance Productionise GenAI workflows and ensure they operate reliably under real usage Build and run AI services across AWS and Databricks Develop ingestion, embedding and retrieval pipelines Deploy containerised workloads via Kubernetes and Helm Implement Infrastructure-as-Code using Terraform Introduce end-to-end monitoring, tracing and alerting for AI workloads Improve inference and retrieval performance while reducing operational cost Establish fault-tolerant, scalable infrastructure patterns Embed security, evaluation and governance into the AI lifecycle Build CI/CD pipelines and automation to support continuous model deployment Create reusable platform components to accelerate future AI initiatives Strong experience in: Cloud infrastructure engineering (AWS-focused environments) Kubernetes, containerisation, and distributed systems Terraform / Infrastructure-as-Code CI/CD, automation, and platform reliability Running production workloads with high availability requirements Plus, experience with one or more of the following: MLOps or ML platform engineering RAG architectures, embeddings, or vector search Model serving, observability or performance optimisation Data / AI workflow orchestration in Databricks or similar ecosystems Why Join? Work on real-world AI systems operating at scale Own platform design decisions and influence long-term architecture Blend modern DevOps practices with cutting-edge Generative AI use cases Be part of a growing, innovation-driven engineering environment Opportunity to define how AI is operationalised across multiple products If you're excited by building the infrastructure that makes AI usable, scalable and reliable in production, we'd love to hear from you. 49914MSR3 INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.
Senior Data Engineer (Contract) Duration: 6 Months (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile We are seeking a highly skilled Senior Data Engineer with strong expertise in Python and Databricks to design, build, and optimise scalable data pipelines and platforms. You will play a key role in enabling data-driven decision-making by delivering reliable, efficient, and high-quality data solutions. Key Responsibilities Design, develop, and maintain scalable data pipelines using Python and Databricks Build and optimise ETL/ELT workflows leveraging Databricks (Spark, Delta Lake) Develop robust data models and data architectures on Lakehouse platforms Implement and manage data workflows within the Databricks ecosystem Ensure high data quality, governance, and reliability across pipelines Optimise performance of large-scale distributed data processing Collaborate with data scientists and analysts to support analytics and ML Implement monitoring, logging, and alerting for data systems Mentor junior engineers and drive engineering best practices Skills & Experience Extensive experience in data engineering Strong programming expertise in Python Hands-on experience with Databricks (workflows, notebooks, jobs, Delta Lake) Strong experience with Apache Spark / PySpark Experience building scalable ETL pipelines Proficiency in SQL and relational databases Experience with cloud platforms (AWS / Azure / GCP) Experience with modern data warehousing solutions (e.g., Snowflake, BigQuery, Redshift) Familiarity with orchestration tools (e.g., Airflow, Databricks Workflows) Strong understanding of data modelling and lakehouse architecture Databricks certifications (e.g., Databricks Certified Data Engineer) Experience with streaming data pipelines (Kafka, Structured Streaming) Experience with CI/CD and DevOps practices Knowledge of Delta Lake features (time travel, CDC, optimisation) Experience with containerisation (Docker, Kubernetes) Exposure to ML pipelines on Databricks Candidates will need to show evidence of the above in their CV in order to be considered. If you feel you have the skills and experience and want to hear more about this role 'apply now' to declare your interest in this opportunity with our client. Your application will be observed by our dedicated team. We will respond to all successful applicants ASAP however, please be advised that we will always look to contact you further from this time should we need further applicants or if other opportunities arise relevant to your skillset. Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. As part of our standard hiring process to manage risk, please note background screening checks will be conducted on all hires before commencing employment. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.
Jun 12, 2026
Contractor
Senior Data Engineer (Contract) Duration: 6 Months (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile We are seeking a highly skilled Senior Data Engineer with strong expertise in Python and Databricks to design, build, and optimise scalable data pipelines and platforms. You will play a key role in enabling data-driven decision-making by delivering reliable, efficient, and high-quality data solutions. Key Responsibilities Design, develop, and maintain scalable data pipelines using Python and Databricks Build and optimise ETL/ELT workflows leveraging Databricks (Spark, Delta Lake) Develop robust data models and data architectures on Lakehouse platforms Implement and manage data workflows within the Databricks ecosystem Ensure high data quality, governance, and reliability across pipelines Optimise performance of large-scale distributed data processing Collaborate with data scientists and analysts to support analytics and ML Implement monitoring, logging, and alerting for data systems Mentor junior engineers and drive engineering best practices Skills & Experience Extensive experience in data engineering Strong programming expertise in Python Hands-on experience with Databricks (workflows, notebooks, jobs, Delta Lake) Strong experience with Apache Spark / PySpark Experience building scalable ETL pipelines Proficiency in SQL and relational databases Experience with cloud platforms (AWS / Azure / GCP) Experience with modern data warehousing solutions (e.g., Snowflake, BigQuery, Redshift) Familiarity with orchestration tools (e.g., Airflow, Databricks Workflows) Strong understanding of data modelling and lakehouse architecture Databricks certifications (e.g., Databricks Certified Data Engineer) Experience with streaming data pipelines (Kafka, Structured Streaming) Experience with CI/CD and DevOps practices Knowledge of Delta Lake features (time travel, CDC, optimisation) Experience with containerisation (Docker, Kubernetes) Exposure to ML pipelines on Databricks Candidates will need to show evidence of the above in their CV in order to be considered. If you feel you have the skills and experience and want to hear more about this role 'apply now' to declare your interest in this opportunity with our client. Your application will be observed by our dedicated team. We will respond to all successful applicants ASAP however, please be advised that we will always look to contact you further from this time should we need further applicants or if other opportunities arise relevant to your skillset. Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. As part of our standard hiring process to manage risk, please note background screening checks will be conducted on all hires before commencing employment. We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.
Overview We are seeking a Senior Data Architect to join one of our client and lead the design and delivery of modern data platforms and analytics architectures within a fast-paced, client-facing environment. You will act as the Databricks champion within the business, shaping best practice, guiding delivery teams, and supporting stakeholders through pre-sales and solution definition. Key Responsibilities Own end-to-end data architecture across lakehouse, warehouse, and streaming patterns, ensuring scalability, security, and governance. Act as Databricks champion: define standards, reference architectures, accelerators, and reusable assets. Lead architectural design for Databricks (workspaces, clusters, jobs, Delta Lake, Unity Catalogue, MLflow) and integrations with cloud services. Partner with pre-sales teams to shape propositions, run discovery, produce high-quality proposals, and present solutions to senior client audiences (pre-sales experience is essential). Translate business requirements into target-state data models, ingestion patterns, and semantic layers. Guide engineers on implementation, performance optimisation, cost control, CI/CD, and operational readiness. Ensure compliance with data governance, privacy, and security controls (RBAC, encryption, auditing, lineage). Essential Requirements Significant Databricks experience required, including production-scale deployments and optimisation. Strong hands-on capability with Spark/SQL, Delta Lake, orchestration, and data engineering patterns. Extensive experience designing cloud data platforms (AWS, Azure, or GCP) and integrating with enterprise systems. Proven stakeholder management and ability to communicate architecture to both technical and non-technical audiences. Experience with data modelling (dimensional, Data Vault, and/or domain-oriented approaches) and metadata management. Working knowledge of DevOps practices, infrastructure as code, and automated testing for data pipelines. Desirable Databricks Certifications highly desired (eg, Data Engineer, Data Analyst, Machine Learning, or Architect). Experience delivering governance frameworks, catalogue implementations, and operating models. Exposure to MLOps and analytics enablement.
Jun 12, 2026
Full time
Overview We are seeking a Senior Data Architect to join one of our client and lead the design and delivery of modern data platforms and analytics architectures within a fast-paced, client-facing environment. You will act as the Databricks champion within the business, shaping best practice, guiding delivery teams, and supporting stakeholders through pre-sales and solution definition. Key Responsibilities Own end-to-end data architecture across lakehouse, warehouse, and streaming patterns, ensuring scalability, security, and governance. Act as Databricks champion: define standards, reference architectures, accelerators, and reusable assets. Lead architectural design for Databricks (workspaces, clusters, jobs, Delta Lake, Unity Catalogue, MLflow) and integrations with cloud services. Partner with pre-sales teams to shape propositions, run discovery, produce high-quality proposals, and present solutions to senior client audiences (pre-sales experience is essential). Translate business requirements into target-state data models, ingestion patterns, and semantic layers. Guide engineers on implementation, performance optimisation, cost control, CI/CD, and operational readiness. Ensure compliance with data governance, privacy, and security controls (RBAC, encryption, auditing, lineage). Essential Requirements Significant Databricks experience required, including production-scale deployments and optimisation. Strong hands-on capability with Spark/SQL, Delta Lake, orchestration, and data engineering patterns. Extensive experience designing cloud data platforms (AWS, Azure, or GCP) and integrating with enterprise systems. Proven stakeholder management and ability to communicate architecture to both technical and non-technical audiences. Experience with data modelling (dimensional, Data Vault, and/or domain-oriented approaches) and metadata management. Working knowledge of DevOps practices, infrastructure as code, and automated testing for data pipelines. Desirable Databricks Certifications highly desired (eg, Data Engineer, Data Analyst, Machine Learning, or Architect). Experience delivering governance frameworks, catalogue implementations, and operating models. Exposure to MLOps and analytics enablement.
Lead Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Lead Data Engineer, you'll be part of a team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. You're also an effective communicator and a strong team player. Together with your team, you'll thrive in a fast-paced engineering environment, delivering outstanding results and exciting projects Your role: As a Lead Data Engineer you will lead and manage a small team, working closely with the business to understand and define their data needs, ensuring that data capabilities support the business strategy. You will play a key part in the continuing development and support of their data platform. Preferred skills: Designing and building data-intensive applications and pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training and career development opportunities exist for the right candidate. Based Newcastle upon Tyne Basic salary £80-130,000 + bonus + excellent benefits
Jun 12, 2026
Full time
Lead Data Engineer - Python/SQL/Spark/Databricks is required by highly successful and fast growing technology consultancy. As a Lead Data Engineer, you'll be part of a team building innovative products. You should be skilled in problem-solving and experienced in designing scalable, resilient, and fault-tolerant architectures. You're also an effective communicator and a strong team player. Together with your team, you'll thrive in a fast-paced engineering environment, delivering outstanding results and exciting projects Your role: As a Lead Data Engineer you will lead and manage a small team, working closely with the business to understand and define their data needs, ensuring that data capabilities support the business strategy. You will play a key part in the continuing development and support of their data platform. Preferred skills: Designing and building data-intensive applications and pipelines One or more programming languages, typically Python and SQL Some or all of the following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training and career development opportunities exist for the right candidate. Based Newcastle upon Tyne Basic salary £80-130,000 + bonus + excellent benefits
Power Apps Developer Duration: Until end of November 2026 Location: Remote working with occasional travel to the West Midlands (Candidates must be UK based) Rate: 440.00 per day - Outside IR35 Our manufacturing client is partway through a data platform programme consolidating a large number of source systems into a modern Lakehouse built on Microsoft Fabric. The programme now needs a dedicated Power Apps Developer to design and build an operations and administration application - a "warehouse manager" front end - so the platform can be run day-to-day without engineers diving into workflows, reading logs, or hand-writing SQL. You will own the build of a Power Apps-based administration tool sitting over the Fabric data platform. An outline specification/framework will be provided by the client's technical lead, but the successful candidate will be expected to shape the detail, make sensible design decisions independently, and deliver at pace with minimal hand-holding. Essential Skills & Experience Power Apps expertise: Strong, demonstrable commercial experience building Power Apps, including apps that write back to SQL databases (executing/parameterising SQL statements, updating records) rather than display-only apps. Data engineering: Solid grounding as a data engineer - strong SQL, understanding of data warehouse/lakehouse concepts (medallion architecture, reference data, metadata-driven pipelines), and comfort working directly with platform configuration. Power BI integration: Experience integrating or embedding Power BI content within Power Apps, and working within the wider Power Platform (e.g. Power Automate for workflow triggering). Microsoft Fabric/Azure: Hands-on familiarity with Microsoft Fabric (or closely comparable Azure data platform experience, e.g. Synapse/Databricks with Spark notebooks) and an ability to get productive in a Fabric environment quickly. Screening will include a technical conversation; candidates should be prepared to evidence specific Power Apps builds (ideally with SQL writeback) they have personally delivered. If your profile demonstrates strong and recent experience in the above areas - please submit your application to Jackie Dean at TXP for consideration. Please note due to the high volume of applications and to ensure a fair process, we are unable to accept phone calls. All applications must be submitted online. Rest assured, our team will review your application and provide an update via email as soon as possible.
Jun 12, 2026
Contractor
Power Apps Developer Duration: Until end of November 2026 Location: Remote working with occasional travel to the West Midlands (Candidates must be UK based) Rate: 440.00 per day - Outside IR35 Our manufacturing client is partway through a data platform programme consolidating a large number of source systems into a modern Lakehouse built on Microsoft Fabric. The programme now needs a dedicated Power Apps Developer to design and build an operations and administration application - a "warehouse manager" front end - so the platform can be run day-to-day without engineers diving into workflows, reading logs, or hand-writing SQL. You will own the build of a Power Apps-based administration tool sitting over the Fabric data platform. An outline specification/framework will be provided by the client's technical lead, but the successful candidate will be expected to shape the detail, make sensible design decisions independently, and deliver at pace with minimal hand-holding. Essential Skills & Experience Power Apps expertise: Strong, demonstrable commercial experience building Power Apps, including apps that write back to SQL databases (executing/parameterising SQL statements, updating records) rather than display-only apps. Data engineering: Solid grounding as a data engineer - strong SQL, understanding of data warehouse/lakehouse concepts (medallion architecture, reference data, metadata-driven pipelines), and comfort working directly with platform configuration. Power BI integration: Experience integrating or embedding Power BI content within Power Apps, and working within the wider Power Platform (e.g. Power Automate for workflow triggering). Microsoft Fabric/Azure: Hands-on familiarity with Microsoft Fabric (or closely comparable Azure data platform experience, e.g. Synapse/Databricks with Spark notebooks) and an ability to get productive in a Fabric environment quickly. Screening will include a technical conversation; candidates should be prepared to evidence specific Power Apps builds (ideally with SQL writeback) they have personally delivered. If your profile demonstrates strong and recent experience in the above areas - please submit your application to Jackie Dean at TXP for consideration. Please note due to the high volume of applications and to ensure a fair process, we are unable to accept phone calls. All applications must be submitted online. Rest assured, our team will review your application and provide an update via email as soon as possible.
Data Engineer Hybrid South Wales 6 months initially IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and platform that enable them to make data -driven decisions. You ll work closely with the Head of Data Engineering to grow out this data function with the recruitment of further data engineering colleagues. You ll be exposed to a wide range of projects that include internal and external suppliers. Essential Skills Proven experience as a Data Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery. Robust understanding of data governance, data quality, and metadata management. Experience of communicating technical information and data to a non-technical audience and working collaboratively with analysts, architects, and product owners to deliver data solutions that meet user and organisational needs. Key Responsibilities (at a glance): Lead on the introduction of foundational data management capabilities to improve trust, accessibility, and efficiency in an organisation that has limited data management capability, lacks data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data processing, meeting the organisation s evolving analytical and operational demands. Work closely with data analysts, architects, devops Engineers, and business stakeholders through regular communication and collaborative planning to ensure data solutions are closely aligned with business objectives and effectively meet user needs. Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information Managing the aspirations of a variety of stakeholders to enable successful project delivery can be challenging, especially when their priorities may differ or even conflict and require reconciliation to meet business and project needs. Role overview Senior Data Engineer To come in and hit the ground running and start delivering quickly Expected 6-month project (with potential for extension or even temp to perm for the right candidate) To be based in their modern offices 2 days per week with the wider team A chance to truly contribute to large scale digitalisation projects within Wales. Start date asap Interviews likely to commence w/c 15th onwards IR35 status to be determined For more information click APPLY now or for a confidential chat call Nathan Handley on (phone number removed). This role is commutable from Swansea, Bridgend, Cardiff, Newport and Bristol.
Jun 11, 2026
Contractor
Data Engineer Hybrid South Wales 6 months initially IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and platform that enable them to make data -driven decisions. You ll work closely with the Head of Data Engineering to grow out this data function with the recruitment of further data engineering colleagues. You ll be exposed to a wide range of projects that include internal and external suppliers. Essential Skills Proven experience as a Data Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery. Robust understanding of data governance, data quality, and metadata management. Experience of communicating technical information and data to a non-technical audience and working collaboratively with analysts, architects, and product owners to deliver data solutions that meet user and organisational needs. Key Responsibilities (at a glance): Lead on the introduction of foundational data management capabilities to improve trust, accessibility, and efficiency in an organisation that has limited data management capability, lacks data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data processing, meeting the organisation s evolving analytical and operational demands. Work closely with data analysts, architects, devops Engineers, and business stakeholders through regular communication and collaborative planning to ensure data solutions are closely aligned with business objectives and effectively meet user needs. Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information Managing the aspirations of a variety of stakeholders to enable successful project delivery can be challenging, especially when their priorities may differ or even conflict and require reconciliation to meet business and project needs. Role overview Senior Data Engineer To come in and hit the ground running and start delivering quickly Expected 6-month project (with potential for extension or even temp to perm for the right candidate) To be based in their modern offices 2 days per week with the wider team A chance to truly contribute to large scale digitalisation projects within Wales. Start date asap Interviews likely to commence w/c 15th onwards IR35 status to be determined For more information click APPLY now or for a confidential chat call Nathan Handley on (phone number removed). This role is commutable from Swansea, Bridgend, Cardiff, Newport and Bristol.
We are partnering with an established organisation currently investing significantly in its AI and generative search capabilities. They are looking to appoint a Senior AI Engineer to play a key role in designing and delivering production-grade AI systems focused on accuracy, scalability, and real-world impact. This position sits within a growing AI function and will focus heavily on Retrieval-Augmented Generation (RAG), agentic workflows, evaluation frameworks, and LLM optimisation. Key Responsibilities: Design and develop scalable RAG pipelines and generative AI workflows Build solutions using LangChain, LangGraph, and LlamaIndex Implement retrieval strategies including reranking, chunking, and retrieval fusion Develop agentic workflows with a focus on robustness and maintainability Contribute to experimentation, evaluation, and AI quality frameworks Support fine-tuning, instruction tuning, and model optimisation initiatives Mentor junior engineers and contribute to technical best practices Key Requirements: Strong Python engineering experience Commercial experience building production-grade AI/ML systems Hands-on experience with RAG architectures and LLM workflows Experience with LangChain, LangGraph, and/or Llama Index Understanding of evaluation methodologies for generative AI Experience working within scalable cloud environments (AWS preferred) Ability to operate in a senior or technical leadership capacity Desirable: Graph-RAG experience Databricks exposure Experience deploying customer-facing AI systems This is an excellent opportunity to join a forward-thinking organisation where AI is a genuine strategic priority and engineering quality is highly valued. 51752MS INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.
Jun 11, 2026
Full time
We are partnering with an established organisation currently investing significantly in its AI and generative search capabilities. They are looking to appoint a Senior AI Engineer to play a key role in designing and delivering production-grade AI systems focused on accuracy, scalability, and real-world impact. This position sits within a growing AI function and will focus heavily on Retrieval-Augmented Generation (RAG), agentic workflows, evaluation frameworks, and LLM optimisation. Key Responsibilities: Design and develop scalable RAG pipelines and generative AI workflows Build solutions using LangChain, LangGraph, and LlamaIndex Implement retrieval strategies including reranking, chunking, and retrieval fusion Develop agentic workflows with a focus on robustness and maintainability Contribute to experimentation, evaluation, and AI quality frameworks Support fine-tuning, instruction tuning, and model optimisation initiatives Mentor junior engineers and contribute to technical best practices Key Requirements: Strong Python engineering experience Commercial experience building production-grade AI/ML systems Hands-on experience with RAG architectures and LLM workflows Experience with LangChain, LangGraph, and/or Llama Index Understanding of evaluation methodologies for generative AI Experience working within scalable cloud environments (AWS preferred) Ability to operate in a senior or technical leadership capacity Desirable: Graph-RAG experience Databricks exposure Experience deploying customer-facing AI systems This is an excellent opportunity to join a forward-thinking organisation where AI is a genuine strategic priority and engineering quality is highly valued. 51752MS INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.
Data Engineering Manager - London (Hybrid) - Databricks/ Fabric - £competitive This is an opportunity to join a growing, highly regarded data consultancy that is delivering cutting-edge data engineering solutions across a range of industries. They have built a strong reputation for combining hands-on technical excellence with strategic delivery, working closely with clients to design and implement modern data platforms across Azure, Databricks and Microsoft Fabric. What makes them stand out is their ability to offer true variety and progression, you'll work across multiple clients, influence strategy and play a key role in shaping both solutions and teams. It's a great fit for someone who enjoys client engagement, leadership responsibility and staying close to the tech. You Will Work With Leading end-to-end Data Engineering delivery across multiple client engagements Designing and building data pipelines, lakehouse architectures and data platforms Working hands-on with Spark, SQL and Python Leveraging Azure Data Services, Databricks and Microsoft Fabric Engaging directly with clients to gather requirements and shape solutions Driving and supporting pre-sales activities (solution design, proposals, demos) Managing and mentoring data engineering teams Facilitating workshops and presenting solutions to technical and non-technical stakeholders Ensuring best practices across data governance, architecture and delivery Benefits Strong focus on career progression into senior leadership roles Investment in training, certifications and professional development Exposure to cutting-edge technologies (Fabric, Databricks, AI-driven platforms) Varied, high-impact projects across multiple industries Collaborative, high-performing team environment Flexible hybrid working model Key Experience Proven experience in Data Engineering, with strong hands-on expertise Recent experience working in a consultancy environment Demonstrated people management and leadership experience Strong client-facing and stakeholder engagement skills Experience designing and delivering: Data pipelines, data lakes / lakehouse architectures & data warehouses Strong knowledge of Azure Data Services (Synapse, Data Factory, Databricks, Fabric) Proficiency in SQL and Python Experience contributing to pre-sales / solution design Ability to balance hands-on delivery with leadership and strategy Apply Now If you're looking to step into a lead role within a growing consultancy, where you can shape strategy, lead teams and work hands-on with modern data platforms.
Jun 11, 2026
Full time
Data Engineering Manager - London (Hybrid) - Databricks/ Fabric - £competitive This is an opportunity to join a growing, highly regarded data consultancy that is delivering cutting-edge data engineering solutions across a range of industries. They have built a strong reputation for combining hands-on technical excellence with strategic delivery, working closely with clients to design and implement modern data platforms across Azure, Databricks and Microsoft Fabric. What makes them stand out is their ability to offer true variety and progression, you'll work across multiple clients, influence strategy and play a key role in shaping both solutions and teams. It's a great fit for someone who enjoys client engagement, leadership responsibility and staying close to the tech. You Will Work With Leading end-to-end Data Engineering delivery across multiple client engagements Designing and building data pipelines, lakehouse architectures and data platforms Working hands-on with Spark, SQL and Python Leveraging Azure Data Services, Databricks and Microsoft Fabric Engaging directly with clients to gather requirements and shape solutions Driving and supporting pre-sales activities (solution design, proposals, demos) Managing and mentoring data engineering teams Facilitating workshops and presenting solutions to technical and non-technical stakeholders Ensuring best practices across data governance, architecture and delivery Benefits Strong focus on career progression into senior leadership roles Investment in training, certifications and professional development Exposure to cutting-edge technologies (Fabric, Databricks, AI-driven platforms) Varied, high-impact projects across multiple industries Collaborative, high-performing team environment Flexible hybrid working model Key Experience Proven experience in Data Engineering, with strong hands-on expertise Recent experience working in a consultancy environment Demonstrated people management and leadership experience Strong client-facing and stakeholder engagement skills Experience designing and delivering: Data pipelines, data lakes / lakehouse architectures & data warehouses Strong knowledge of Azure Data Services (Synapse, Data Factory, Databricks, Fabric) Proficiency in SQL and Python Experience contributing to pre-sales / solution design Ability to balance hands-on delivery with leadership and strategy Apply Now If you're looking to step into a lead role within a growing consultancy, where you can shape strategy, lead teams and work hands-on with modern data platforms.
Data Engineer £60,000-£65,000 Manchester City Centre- Hybrid We are looking for highly skilled and experienced Azure Data Engineer to join a newly established team with a strong focus on data. In this role, you will play a key part in delivering a complex, high-impact project within the Financial Services / Capital Markets domain. The position centres on designing and building robust, scalable, and reusable data pipelines, transforming raw data into well-structured relational models. You will work with large, complex, multi-source datasets, including loan servicing platforms, property and valuation systems, collections tools, and third-party data providers-ensuring data is reliable, auditable, and delivered at scale. Data Engineer Responsibilities Act as the subject matter expert across ADF, Databricks, Python, PySpark, and Spark SQL Manage the daily ingestion and processing of raw data into enterprise data platforms Collaborate with the wider team to define data flows and establish data standards Deliver trusted datasets to support analytics, asset strategy, finance, and risk functions Oversee end-to-end data ingestion and integration, from source systems through to data lakes and warehouses Optimise and performance-tune data pipelines and integration processes Work closely with Data Stewards and Business Analysts to understand data requirements and design optimal pipeline solutions Ensure all solutions align with the target-state data architecture About You Degree in Computer Science, Information Systems, Data Science, or a related discipline (preferred) Strong hands-on experience building resilient and reusable data pipelines A proactive, self-driven individual with the ability to collaborate across business and technical teams Excellent analytical, communication, and problem-solving skills Experience working with financial data domains (e.g., IBOR/ABOR, transactions, market data, reference data) Background in Real Estate, Credit, Banking, or NPL Asset Management Microsoft certifications are advantageous Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates
Jun 11, 2026
Full time
Data Engineer £60,000-£65,000 Manchester City Centre- Hybrid We are looking for highly skilled and experienced Azure Data Engineer to join a newly established team with a strong focus on data. In this role, you will play a key part in delivering a complex, high-impact project within the Financial Services / Capital Markets domain. The position centres on designing and building robust, scalable, and reusable data pipelines, transforming raw data into well-structured relational models. You will work with large, complex, multi-source datasets, including loan servicing platforms, property and valuation systems, collections tools, and third-party data providers-ensuring data is reliable, auditable, and delivered at scale. Data Engineer Responsibilities Act as the subject matter expert across ADF, Databricks, Python, PySpark, and Spark SQL Manage the daily ingestion and processing of raw data into enterprise data platforms Collaborate with the wider team to define data flows and establish data standards Deliver trusted datasets to support analytics, asset strategy, finance, and risk functions Oversee end-to-end data ingestion and integration, from source systems through to data lakes and warehouses Optimise and performance-tune data pipelines and integration processes Work closely with Data Stewards and Business Analysts to understand data requirements and design optimal pipeline solutions Ensure all solutions align with the target-state data architecture About You Degree in Computer Science, Information Systems, Data Science, or a related discipline (preferred) Strong hands-on experience building resilient and reusable data pipelines A proactive, self-driven individual with the ability to collaborate across business and technical teams Excellent analytical, communication, and problem-solving skills Experience working with financial data domains (e.g., IBOR/ABOR, transactions, market data, reference data) Background in Real Estate, Credit, Banking, or NPL Asset Management Microsoft certifications are advantageous Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates
Join an award-winning B2B consultancy at the forefront of enterprise AI, building and owning the cloud-native platform infrastructure that powers production-grade conversational and generative AI products at scale. The role This is a platform and infrastructure engineering role - not a data science or ML engineering position. You'll own the runtime, infrastructure, and operational layers that RAG pipelines, LLM orchestration, vector search, and evaluation workflows run on, across AWS and Databricks. The focus is on building scalable, observable, secure, and cost-efficient platform infrastructure that enables AI engineering teams to ship and operate AI products reliably in production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases) and embedding pipelines Build and maintain CI/CD pipelines for inference services, retrievers, ingestion workflows, and RAG components Implement observability across AI workloads using CloudWatch, MLflow, and OpenTelemetry - covering latency, throughput, cost, and system health Apply secure-by-design principles including IAM, encryption, network controls, and audit logging Work closely with AI engineers to translate prototypes and proof-of-concepts into production-ready, well-architected platform components What we're looking for Proven experience in platform, infrastructure, or software engineering roles delivering production-grade systems on AWS Strong hands-on Kubernetes experience, specifically with EKS (Elastic Kubernetes Service) and ECS (Elastic Container Service) in production environments Strong Terraform experience for infrastructure-as-code, provisioning and managing cloud infrastructure at scale Experience operating containerised services, managing CI/CD pipelines, and owning observability and reliability Familiarity with vector databases or search infrastructure (OpenSearch, Algolia) is a strong advantage Python proficiency for scripting, automation, and deploying production services Solid grasp of distributed systems, cloud-native architecture, microservices, and API design Ownership mindset - comfortable operating autonomously across reliability, performance, cost, and security Why join? You'll own the foundational platform infrastructure behind a growing suite of generative AI products, working directly with senior AI and engineering leaders. This is a deep technical ownership role with long-term architectural impact, within an organisation investing heavily in AI at scale. INDAM The Portfolio Group are acting on behalf of our client in recruiting for this position.
Jun 11, 2026
Full time
Join an award-winning B2B consultancy at the forefront of enterprise AI, building and owning the cloud-native platform infrastructure that powers production-grade conversational and generative AI products at scale. The role This is a platform and infrastructure engineering role - not a data science or ML engineering position. You'll own the runtime, infrastructure, and operational layers that RAG pipelines, LLM orchestration, vector search, and evaluation workflows run on, across AWS and Databricks. The focus is on building scalable, observable, secure, and cost-efficient platform infrastructure that enables AI engineering teams to ship and operate AI products reliably in production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases) and embedding pipelines Build and maintain CI/CD pipelines for inference services, retrievers, ingestion workflows, and RAG components Implement observability across AI workloads using CloudWatch, MLflow, and OpenTelemetry - covering latency, throughput, cost, and system health Apply secure-by-design principles including IAM, encryption, network controls, and audit logging Work closely with AI engineers to translate prototypes and proof-of-concepts into production-ready, well-architected platform components What we're looking for Proven experience in platform, infrastructure, or software engineering roles delivering production-grade systems on AWS Strong hands-on Kubernetes experience, specifically with EKS (Elastic Kubernetes Service) and ECS (Elastic Container Service) in production environments Strong Terraform experience for infrastructure-as-code, provisioning and managing cloud infrastructure at scale Experience operating containerised services, managing CI/CD pipelines, and owning observability and reliability Familiarity with vector databases or search infrastructure (OpenSearch, Algolia) is a strong advantage Python proficiency for scripting, automation, and deploying production services Solid grasp of distributed systems, cloud-native architecture, microservices, and API design Ownership mindset - comfortable operating autonomously across reliability, performance, cost, and security Why join? You'll own the foundational platform infrastructure behind a growing suite of generative AI products, working directly with senior AI and engineering leaders. This is a deep technical ownership role with long-term architectural impact, within an organisation investing heavily in AI at scale. INDAM The Portfolio Group are acting on behalf of our client in recruiting for this position.
Senior Data Architect - £700-£750 - Inside IR35 - initial contract until 30/07/2027 - Hybrid working from a site near Euston Station - 3 days a week on site. We're currently partnering with a well-established organisation in the construction and infrastructure sector to appoint a highly capable Data Architect to join their growing technology function. This is a key hire for the business as they continue to modernise and optimise their data landscape. This is a hands-on technical role suited to someone with deep expertise across Microsoft Fabric, enterprise data architecture, and modern analytics platforms. The successful candidate will play a critical role in reviewing the existing analytics ecosystem, identifying opportunities for improvement, and driving scalable, high-performing, and cost-efficient solutions across the organisation. The Opportunity - You'll be responsible for assessing and improving the current analytics and data environment, including: Microsoft Fabric architecture Enterprise data warehouse structures ETL / ELT pipelines and data flows Semantic models Power BI reporting architecture and optimisation Following your review, you'll provide clear, prioritised recommendations and lead improvements focused on: Scalability and maintainability Performance and reliability Reduction of technical debt Operational and platform cost optimisation This role will suit someone who enjoys operating at both strategic and technical depth - capable of shaping architecture while remaining hands-on with implementation. Key Experience Required- Advanced hands-on experience with Microsoft Fabric, including end-to-end implementations Strong experience designing and implementing ETL / ELT pipelines Expertise in Power BI architecture and semantic model optimisation Strong understanding of modern enterprise data architecture principles Experience with data lake technologies, ideally Databricks Strong integration and interface management experience Experience operating within enterprise-scale analytics environments Technical Skills Advanced SQL / T-SQL Python for data engineering, automation, and transformation DAX for Power BI semantic modelling PySpark / Spark (highly desirable) Microsoft Azure ecosystem knowledge Our client is looking for someone who combines strong technical depth with excellent communication and stakeholder engagement skills. You'll be proactive, delivery-focused, and comfortable operating within a dynamic and evolving environment. Key traits include: Strong communication skills across technical and non-technical audiences Collaborative and relationship-driven approach Passion for quality, governance, and best practice Adaptability and problem-solving mindset Desire to mentor others and stay current with emerging technologies
Jun 11, 2026
Contractor
Senior Data Architect - £700-£750 - Inside IR35 - initial contract until 30/07/2027 - Hybrid working from a site near Euston Station - 3 days a week on site. We're currently partnering with a well-established organisation in the construction and infrastructure sector to appoint a highly capable Data Architect to join their growing technology function. This is a key hire for the business as they continue to modernise and optimise their data landscape. This is a hands-on technical role suited to someone with deep expertise across Microsoft Fabric, enterprise data architecture, and modern analytics platforms. The successful candidate will play a critical role in reviewing the existing analytics ecosystem, identifying opportunities for improvement, and driving scalable, high-performing, and cost-efficient solutions across the organisation. The Opportunity - You'll be responsible for assessing and improving the current analytics and data environment, including: Microsoft Fabric architecture Enterprise data warehouse structures ETL / ELT pipelines and data flows Semantic models Power BI reporting architecture and optimisation Following your review, you'll provide clear, prioritised recommendations and lead improvements focused on: Scalability and maintainability Performance and reliability Reduction of technical debt Operational and platform cost optimisation This role will suit someone who enjoys operating at both strategic and technical depth - capable of shaping architecture while remaining hands-on with implementation. Key Experience Required- Advanced hands-on experience with Microsoft Fabric, including end-to-end implementations Strong experience designing and implementing ETL / ELT pipelines Expertise in Power BI architecture and semantic model optimisation Strong understanding of modern enterprise data architecture principles Experience with data lake technologies, ideally Databricks Strong integration and interface management experience Experience operating within enterprise-scale analytics environments Technical Skills Advanced SQL / T-SQL Python for data engineering, automation, and transformation DAX for Power BI semantic modelling PySpark / Spark (highly desirable) Microsoft Azure ecosystem knowledge Our client is looking for someone who combines strong technical depth with excellent communication and stakeholder engagement skills. You'll be proactive, delivery-focused, and comfortable operating within a dynamic and evolving environment. Key traits include: Strong communication skills across technical and non-technical audiences Collaborative and relationship-driven approach Passion for quality, governance, and best practice Adaptability and problem-solving mindset Desire to mentor others and stay current with emerging technologies
Performance Analyst 12 months Location - London/Remote 465 per day inside IR35 - Umbrella only Job Spec: As a Performance Analyst, your role is to support product teams by utilising data tools to create insight and actionable outputs for product managers, designers, and developers. You will be developing and maintaining Adobe Analytics and Power BI reports to enable data driven decisions across the programme. The role involves partnering with product teams to define reporting needs and translate them into clear KPIs and robust data solutions, delivering ad hoc analysis to inform product improvements, and applying measurement frameworks to shape future analytics capability. You will design and optimise dashboards with consistent metrics and meaningful time based comparisons, while ensuring data quality, governance, and alignment across data sources. Collaboration with product, analytics, and data engineering teams is central to continuously improving data, reporting, and insight delivery. Key Technical Skills: Advanced PowerBI Visualisation or equivalent (2 years) Database or platform experience in tools such as Databricks or equivalent (2 years) Applied experience in Python & SQL (2 years) Optimising costs on exceedingly large queries + cluster management Soft Skills: Independent Self Starter, managing your own work and workstreams Strong stakeholder management skills with the ability to translate analytics requirements into reports Proactive Attitude in handling multiple workstreams Experience with working in a cross functional teams varying from waterfall and Agile Experience working in the Software Development Cycle Nice to have Skills: Adobe Analytics or Web-based Analytics Tools experience Experience in working in NHS's Federated Data Platform or Palantir Foundry Exposure to Data Lake functionality and architecture (strong relational database skills would be a Good alternative) Experience in working in Generative AI projects Experience in working in Healthcare or digital applications If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.
Jun 11, 2026
Contractor
Performance Analyst 12 months Location - London/Remote 465 per day inside IR35 - Umbrella only Job Spec: As a Performance Analyst, your role is to support product teams by utilising data tools to create insight and actionable outputs for product managers, designers, and developers. You will be developing and maintaining Adobe Analytics and Power BI reports to enable data driven decisions across the programme. The role involves partnering with product teams to define reporting needs and translate them into clear KPIs and robust data solutions, delivering ad hoc analysis to inform product improvements, and applying measurement frameworks to shape future analytics capability. You will design and optimise dashboards with consistent metrics and meaningful time based comparisons, while ensuring data quality, governance, and alignment across data sources. Collaboration with product, analytics, and data engineering teams is central to continuously improving data, reporting, and insight delivery. Key Technical Skills: Advanced PowerBI Visualisation or equivalent (2 years) Database or platform experience in tools such as Databricks or equivalent (2 years) Applied experience in Python & SQL (2 years) Optimising costs on exceedingly large queries + cluster management Soft Skills: Independent Self Starter, managing your own work and workstreams Strong stakeholder management skills with the ability to translate analytics requirements into reports Proactive Attitude in handling multiple workstreams Experience with working in a cross functional teams varying from waterfall and Agile Experience working in the Software Development Cycle Nice to have Skills: Adobe Analytics or Web-based Analytics Tools experience Experience in working in NHS's Federated Data Platform or Palantir Foundry Exposure to Data Lake functionality and architecture (strong relational database skills would be a Good alternative) Experience in working in Generative AI projects Experience in working in Healthcare or digital applications If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.
Senior Data Engineer Hybrid: 3 days in office, Warwick Duration: 6-Month Contract Rate: 450/day (Inside IR35) A leading organization is seeking a Senior Data Engineer to join their cloud data platform team on a hybrid basis (3 days in office, Warwick). This is a 6-month contracting role offering competitive daily rates and the opportunity to contribute to a modern, cloud-native data platform. The Role You will be responsible for driving the design and implementation of scalable, high-performing data architectures and pipelines. Working with the Interconnectors Data Platform (ICDP), you will provide both technical leadership and hands-on development, supporting the transition to modern Azure-based ingestion patterns and Medallion Architecture. Key Responsibilities Lead the design and implementation of scalable data architectures and layered models (Bronze/Silver/Gold). Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools. Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks). Build performant SQL transformations and reusable data models. Implement CI/CD, automated testing, version control, and observability in workflows. Ensure data quality, validation, reconciliation, and auditability across platform layers. Collaborate with business and product teams to deliver high-quality analytical outputs. Mentor junior data engineers and contribute to team capability development. Required Skills & Experience Strong hands-on experience with Python for production-grade pipelines. Expert-level SQL , including optimization and data modelling. Azure Cloud experience (ADF, Functions, Storage, Key Vault). Deep understanding of data warehousing, dimensional modelling, and scalable architectures . Proficiency in Git, CI/CD, automated testing, and modern engineering best practices. Experience with API and SFTP ingestion and resilient pipeline design. Strong problem-solving, communication, and stakeholder collaboration skills. Desirable Experience with Medallion/Lakehouse patterns or Databricks-style ecosystems. Experience in regulated or high-assurance data environments. Collaboration with modeling teams in engineering-modelling interfaces
Jun 11, 2026
Contractor
Senior Data Engineer Hybrid: 3 days in office, Warwick Duration: 6-Month Contract Rate: 450/day (Inside IR35) A leading organization is seeking a Senior Data Engineer to join their cloud data platform team on a hybrid basis (3 days in office, Warwick). This is a 6-month contracting role offering competitive daily rates and the opportunity to contribute to a modern, cloud-native data platform. The Role You will be responsible for driving the design and implementation of scalable, high-performing data architectures and pipelines. Working with the Interconnectors Data Platform (ICDP), you will provide both technical leadership and hands-on development, supporting the transition to modern Azure-based ingestion patterns and Medallion Architecture. Key Responsibilities Lead the design and implementation of scalable data architectures and layered models (Bronze/Silver/Gold). Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools. Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks). Build performant SQL transformations and reusable data models. Implement CI/CD, automated testing, version control, and observability in workflows. Ensure data quality, validation, reconciliation, and auditability across platform layers. Collaborate with business and product teams to deliver high-quality analytical outputs. Mentor junior data engineers and contribute to team capability development. Required Skills & Experience Strong hands-on experience with Python for production-grade pipelines. Expert-level SQL , including optimization and data modelling. Azure Cloud experience (ADF, Functions, Storage, Key Vault). Deep understanding of data warehousing, dimensional modelling, and scalable architectures . Proficiency in Git, CI/CD, automated testing, and modern engineering best practices. Experience with API and SFTP ingestion and resilient pipeline design. Strong problem-solving, communication, and stakeholder collaboration skills. Desirable Experience with Medallion/Lakehouse patterns or Databricks-style ecosystems. Experience in regulated or high-assurance data environments. Collaboration with modeling teams in engineering-modelling interfaces
Data Architect Contract Dublin 6-12 Months. My client a leading global firm is in urgent need of a talented and experienced Data Architect to join them on a contract basis. My client is looking for you to formulate and design the solutions to deliver to the requirements coming from different business lines and operational departments that have data provision, reporting, and analytics use cases. This is to keep us aligned with the longer term agreed strategies at a business, data, and technical level. Technical Data Architect is responsible for designing, implementing, and maintaining the data architecture of the organisation. This role involves collaborating with cross-functional teams to ensure data is organised, accessible, and secure, aligning with business goals and compliance requirements. The role will be responsible for developing solution designs for a portfolio of projects across the my clients EMEA entity and overseeing solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. Successful candidates have deep and broad experience of developing technical data solutions in large or medium sized enterprises in a similar role. You will be defining technical strategy and roadmaps for delivery in medium to large enterprises. You will have strong knowledge of database systems,Demonstrable data modelling experience across multiple techniques, Proven experience with multiple data integration technologies,Event driven architectures. You will have strong experience of different data architectures including hub and spoke, data lakes, data fabrics, lakehouses. It would be idea if you have experience of databricks. This is very much a hands on role, my client is looking for candidates to get involved in many different aspects of this role. If this sounds of interest drop me a CV so that we can speak in more detail.
Jun 11, 2026
Contractor
Data Architect Contract Dublin 6-12 Months. My client a leading global firm is in urgent need of a talented and experienced Data Architect to join them on a contract basis. My client is looking for you to formulate and design the solutions to deliver to the requirements coming from different business lines and operational departments that have data provision, reporting, and analytics use cases. This is to keep us aligned with the longer term agreed strategies at a business, data, and technical level. Technical Data Architect is responsible for designing, implementing, and maintaining the data architecture of the organisation. This role involves collaborating with cross-functional teams to ensure data is organised, accessible, and secure, aligning with business goals and compliance requirements. The role will be responsible for developing solution designs for a portfolio of projects across the my clients EMEA entity and overseeing solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. Successful candidates have deep and broad experience of developing technical data solutions in large or medium sized enterprises in a similar role. You will be defining technical strategy and roadmaps for delivery in medium to large enterprises. You will have strong knowledge of database systems,Demonstrable data modelling experience across multiple techniques, Proven experience with multiple data integration technologies,Event driven architectures. You will have strong experience of different data architectures including hub and spoke, data lakes, data fabrics, lakehouses. It would be idea if you have experience of databricks. This is very much a hands on role, my client is looking for candidates to get involved in many different aspects of this role. If this sounds of interest drop me a CV so that we can speak in more detail.
Solutions Architect Salary: 100K - 110K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Solutions Architect to provide design and architecture guidance across a broad portfolio of data initiatives. The Opportunity This is a senior architecture role focused on shaping how solutions are designed and delivered across a complex enterprise data estate. You will work closely with product owners, engineering leads, data teams and senior stakeholders to understand business requirements and translate them into clear, robust high-level designs for engineering teams to build. The role is not focused on hands-on delivery. Instead, you will be responsible for articulating solution designs, documenting key decisions, defining reusable patterns and ensuring consistency across a shared data platform. You will support a modern cloud data platform, with exposure to areas such as analytics, reporting, data science, AI use cases and increasingly real-time data capabilities. Skills and experience Strong experience designing secure, scalable data solutions in complex environments Experience working with Azure-based data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale cloud data platform, please submit your CV for initial screening and further details. Solutions Architect
Jun 11, 2026
Full time
Solutions Architect Salary: 100K - 110K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Solutions Architect to provide design and architecture guidance across a broad portfolio of data initiatives. The Opportunity This is a senior architecture role focused on shaping how solutions are designed and delivered across a complex enterprise data estate. You will work closely with product owners, engineering leads, data teams and senior stakeholders to understand business requirements and translate them into clear, robust high-level designs for engineering teams to build. The role is not focused on hands-on delivery. Instead, you will be responsible for articulating solution designs, documenting key decisions, defining reusable patterns and ensuring consistency across a shared data platform. You will support a modern cloud data platform, with exposure to areas such as analytics, reporting, data science, AI use cases and increasingly real-time data capabilities. Skills and experience Strong experience designing secure, scalable data solutions in complex environments Experience working with Azure-based data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale cloud data platform, please submit your CV for initial screening and further details. Solutions Architect
Hays are now looking for a Databricks Consultant / SME for one of our local clients: Flexible rate - Outside IR35 1 day a week in Swindon, the rest is WFH Initial 6 month contract (extensions likely) We're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from legacy setups using DBFS-mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise. What you'll be doing Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog Define and implement a scalable, standardised migration approach across teams Support teams with ad-hoc Databricks issues related to migration and platform usage Optimise the Databricks environment for structure, access, and governance Automate infrastructure and deployments using Terraform and/or CloudFormation Build and maintain data pipelines using Python, SQL and Databricks APIs Monitor platform performance using tools such as CloudWatch, Grafana, and Kibana Collaborate with engineering teams, stakeholders, and platform users What we're looking for Strong hands-on experience with Databricks in an AWS environment Proven experience with Unity Catalog and Databricks migrations Strong Python skills and experience working with Databricks APIs Solid understanding of data pipelines, SQL, and data platform architecture Experience with Infrastructure as Code (Terraform or CloudFormation) Knowledge of monitoring and observability tools (e.g. CloudWatch, Grafana, Kibana) Strong problem-solving skills and ability to work independently Excellent communication and stakeholder engagement skills Exposure to Databricks Apps or AI/ML workloads (nice to have) If you have previously led migrations to Unity Catalogue and you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or please send a copy of your CV to Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)
Jun 10, 2026
Contractor
Hays are now looking for a Databricks Consultant / SME for one of our local clients: Flexible rate - Outside IR35 1 day a week in Swindon, the rest is WFH Initial 6 month contract (extensions likely) We're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from legacy setups using DBFS-mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise. What you'll be doing Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog Define and implement a scalable, standardised migration approach across teams Support teams with ad-hoc Databricks issues related to migration and platform usage Optimise the Databricks environment for structure, access, and governance Automate infrastructure and deployments using Terraform and/or CloudFormation Build and maintain data pipelines using Python, SQL and Databricks APIs Monitor platform performance using tools such as CloudWatch, Grafana, and Kibana Collaborate with engineering teams, stakeholders, and platform users What we're looking for Strong hands-on experience with Databricks in an AWS environment Proven experience with Unity Catalog and Databricks migrations Strong Python skills and experience working with Databricks APIs Solid understanding of data pipelines, SQL, and data platform architecture Experience with Infrastructure as Code (Terraform or CloudFormation) Knowledge of monitoring and observability tools (e.g. CloudWatch, Grafana, Kibana) Strong problem-solving skills and ability to work independently Excellent communication and stakeholder engagement skills Exposure to Databricks Apps or AI/ML workloads (nice to have) If you have previously led migrations to Unity Catalogue and you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or please send a copy of your CV to Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)
The RoleWe're looking for a SAS Viya 4 Architect to lead the design and delivery of cloud-based analytics platforms. You'll own end-to-end architecture, drive migrations from SAS 9.4/Viya 3.5, and shape modern, scalable solutions across AWS/Azure. What You'll Do Define and lead SAS architecture strategy and design Architect and deploy SAS Viya 4 (CAS, Studio, Visual Analytics, Model Studio) Design Kubernetes-based deployment patterns Lead migration and transformation to cloud-native solutions Drive DevOps, CI/CD, and automation best practices Engage senior stakeholders and ensure governance standards What You BringEssential: Strong SAS architecture experience, including Viya 4 Deep knowledge of SAS DI, Visual Analytics, Studio/EG Experience with AWS/Azure and Kubernetes Proven delivery of large-scale migration programmes Desirable: CI/CD and DevOps experience Integration with tools like Airflow, Snowflake, Databricks Experience in regulated/public sector environments What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)
Jun 10, 2026
Contractor
The RoleWe're looking for a SAS Viya 4 Architect to lead the design and delivery of cloud-based analytics platforms. You'll own end-to-end architecture, drive migrations from SAS 9.4/Viya 3.5, and shape modern, scalable solutions across AWS/Azure. What You'll Do Define and lead SAS architecture strategy and design Architect and deploy SAS Viya 4 (CAS, Studio, Visual Analytics, Model Studio) Design Kubernetes-based deployment patterns Lead migration and transformation to cloud-native solutions Drive DevOps, CI/CD, and automation best practices Engage senior stakeholders and ensure governance standards What You BringEssential: Strong SAS architecture experience, including Viya 4 Deep knowledge of SAS DI, Visual Analytics, Studio/EG Experience with AWS/Azure and Kubernetes Proven delivery of large-scale migration programmes Desirable: CI/CD and DevOps experience Integration with tools like Airflow, Snowflake, Databricks Experience in regulated/public sector environments What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)
Senior Data Engineer - Azure Central government Outside IR35 Remote 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience working with Azure Databricks Experience working with geospatial, mapping or location intelligence datasets Central UK government experience within recent 5 years Experience developing large-scale distributed data processing workloads. Strong Python and SQL development skills. Experience working with Spark-based technologies. Knowledge of modern cloud data platform patterns and architectures. Experience building and supporting automated data pipelines. Familiarity with CI/CD practices and modern software engineering principles. Strong troubleshooting and performance optimisation skills. Details Outside IR35 450 a day Remote based 6 month contract Strong likelihood of extension Please apply with a copy of your CV and Emma from SR2 will contact potential applicants regarding next steps.
Jun 10, 2026
Contractor
Senior Data Engineer - Azure Central government Outside IR35 Remote 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience working with Azure Databricks Experience working with geospatial, mapping or location intelligence datasets Central UK government experience within recent 5 years Experience developing large-scale distributed data processing workloads. Strong Python and SQL development skills. Experience working with Spark-based technologies. Knowledge of modern cloud data platform patterns and architectures. Experience building and supporting automated data pipelines. Familiarity with CI/CD practices and modern software engineering principles. Strong troubleshooting and performance optimisation skills. Details Outside IR35 450 a day Remote based 6 month contract Strong likelihood of extension Please apply with a copy of your CV and Emma from SR2 will contact potential applicants regarding next steps.
Data Platform Manager London Up to £85,000 This is a high impact opportunity for a Data Platform Manager to take genuine ownership within a business that sees data as a core commercial driver. You will play a key role in shaping and managing a modern enterprise data platform, supporting large scale analytics, AI, and self service capabilities across international markets. The Company They are a fast growing, value driven telecommunications business focused on scaling through digital, data, and analytics. Data and analytics are viewed as critical to long term enterprise value, with ongoing investment into real time data, AI enabled use cases, and self service analytics. The Role Own and manage the strategic direction of the enterprise data platform, ensuring it is scalable, reliable, and aligned to business priorities Drive platform roadmap planning and continuous improvement initiatives across data infrastructure, tooling, governance, and operational processes Work closely with data engineering, analytics, architecture, and business teams to deliver a high performing and accessible data environment Oversee the management and optimisation of the Databricks platform and wider cloud data ecosystem Promote best practice across platform architecture, data governance, security, monitoring, and operational support Support platform ownership responsibilities including incident management, service performance, and operational governance Enable scalable self service analytics capabilities for business users and market teams Collaborate with senior stakeholders to prioritise platform enhancements and communicate progress, risks, and outcomes clearly Ensure the platform supports evolving analytics, reporting, and AI driven use cases across the organisation Your Skills & Experience Strong commercial experience managing or developing modern cloud based data platforms Hands on exposure to Databricks, with the ability to challenge and guide technical decisions Broader understanding of cloud data ecosystems, with exposure to platforms such as Azure Synapse Analytics or Snowflake being beneficial Strong understanding of data platform architecture, governance, scalability, and operational management Comfortable working across engineering, analytics, architecture, and business teams Confident communicator able to influence senior stakeholders and manage complex discussions Experience supporting large scale data platform, data warehouse, or data lake transformation programmes Understanding of enabling self service analytics and improving platform adoption across a business No sponsorship offered How to Apply If you are looking for an Analytics Engineer role where you can shape a data platform from the ground up in a creative, globally operating organisation, please apply to learn more.
Jun 10, 2026
Full time
Data Platform Manager London Up to £85,000 This is a high impact opportunity for a Data Platform Manager to take genuine ownership within a business that sees data as a core commercial driver. You will play a key role in shaping and managing a modern enterprise data platform, supporting large scale analytics, AI, and self service capabilities across international markets. The Company They are a fast growing, value driven telecommunications business focused on scaling through digital, data, and analytics. Data and analytics are viewed as critical to long term enterprise value, with ongoing investment into real time data, AI enabled use cases, and self service analytics. The Role Own and manage the strategic direction of the enterprise data platform, ensuring it is scalable, reliable, and aligned to business priorities Drive platform roadmap planning and continuous improvement initiatives across data infrastructure, tooling, governance, and operational processes Work closely with data engineering, analytics, architecture, and business teams to deliver a high performing and accessible data environment Oversee the management and optimisation of the Databricks platform and wider cloud data ecosystem Promote best practice across platform architecture, data governance, security, monitoring, and operational support Support platform ownership responsibilities including incident management, service performance, and operational governance Enable scalable self service analytics capabilities for business users and market teams Collaborate with senior stakeholders to prioritise platform enhancements and communicate progress, risks, and outcomes clearly Ensure the platform supports evolving analytics, reporting, and AI driven use cases across the organisation Your Skills & Experience Strong commercial experience managing or developing modern cloud based data platforms Hands on exposure to Databricks, with the ability to challenge and guide technical decisions Broader understanding of cloud data ecosystems, with exposure to platforms such as Azure Synapse Analytics or Snowflake being beneficial Strong understanding of data platform architecture, governance, scalability, and operational management Comfortable working across engineering, analytics, architecture, and business teams Confident communicator able to influence senior stakeholders and manage complex discussions Experience supporting large scale data platform, data warehouse, or data lake transformation programmes Understanding of enabling self service analytics and improving platform adoption across a business No sponsorship offered How to Apply If you are looking for an Analytics Engineer role where you can shape a data platform from the ground up in a creative, globally operating organisation, please apply to learn more.
ANALYTICS ENGINEER LONDON/HYBRID UP TO £60,000 This is a rare opportunity to join an organisation at an early stage of its data journey, where you will have genuine influence over how data is designed, modelled, and used across the business. You will sit at the heart of a growing data function, working end to end from ingestion through to reporting, with strong exposure to both technical delivery and stakeholder engagement. ROLES AND RESPONSIBILITIES: The Analytics Engineer will: Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks. Integrate data from core business systems such as finance, HR, and operational platforms. Develop and improve a lakehouse architecture, supporting ingestion, transformation, and consumption layers. Create robust, well-structured data models using best practice approaches such as Kimball and star schema. Work closely with business stakeholders to translate requirements into clear, usable data assets. Support and enhance the Power BI reporting layer, including semantic models and DAX. Help establish data standards, patterns, and ways of working as the data function grows. YOUR SKILLS AND EXPERIENCE: The ideal candidate will have the following skills and experience: Strong commercial experience working in a cloud-based data environment, ideally Azure. Solid SQL capability with experience building reliable, scalable data models. Hands-on experience with Power BI, including data modelling and reporting. Experience working with modern data platforms and concepts such as lakehouse or medallion architecture. Exposure to Databricks for data transformation and pipeline development is highly desirable. Confident communicator who can work effectively with both technical and non-technical stakeholders. APPLY BELOW!
Jun 10, 2026
Full time
ANALYTICS ENGINEER LONDON/HYBRID UP TO £60,000 This is a rare opportunity to join an organisation at an early stage of its data journey, where you will have genuine influence over how data is designed, modelled, and used across the business. You will sit at the heart of a growing data function, working end to end from ingestion through to reporting, with strong exposure to both technical delivery and stakeholder engagement. ROLES AND RESPONSIBILITIES: The Analytics Engineer will: Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks. Integrate data from core business systems such as finance, HR, and operational platforms. Develop and improve a lakehouse architecture, supporting ingestion, transformation, and consumption layers. Create robust, well-structured data models using best practice approaches such as Kimball and star schema. Work closely with business stakeholders to translate requirements into clear, usable data assets. Support and enhance the Power BI reporting layer, including semantic models and DAX. Help establish data standards, patterns, and ways of working as the data function grows. YOUR SKILLS AND EXPERIENCE: The ideal candidate will have the following skills and experience: Strong commercial experience working in a cloud-based data environment, ideally Azure. Solid SQL capability with experience building reliable, scalable data models. Hands-on experience with Power BI, including data modelling and reporting. Experience working with modern data platforms and concepts such as lakehouse or medallion architecture. Exposure to Databricks for data transformation and pipeline development is highly desirable. Confident communicator who can work effectively with both technical and non-technical stakeholders. APPLY BELOW!