51 jobs found

Data Engineer - Azure databricks - python - pyspark - Azure Data Factory - Azure Data Lake - CI/CD FTC role - 12 Months Salary - Up to £50,000 + Benefits Location - Remote As a Junior Data Engineer, you will play a key role in the development and evolution of our cloud-based data platform. Leveraging technologies including Azure Databricks, Azure Data Factory and PySpark, you will design and deliver scalable data pipelines and lakehouse solutions that enable trusted, high-quality data across the organisation. Working within a modern Azure environment, you will help ensure data is efficiently managed, readily available and governed to support analytics, reporting and business decision-making. Key Responsibilities Design, build and support scalable data platforms, pipelines and lakehouse solutions using Azure Databricks, Azure Data Factory and Python/PySpark. Partner with business stakeholders, analysts and technical teams to understand data requirements and deliver robust data solutions that support reporting, analytics and operational needs. Develop and maintain data ingestion, transformation and orchestration processes, integrating data from a variety of internal and external sources. Ensure data solutions are performant, reliable and maintainable, applying best practices in data engineering, automation and distributed processing. Monitor, troubleshoot and optimise data pipelines, proactively addressing issues relating to data quality, availability and performance. Skills & Experience Commercial experience in a Data Engineering role, with strong expertise in Python/PySpark and the Azure data ecosystem. Hands-on experience with Azure Databricks, Azure Data Factory, Azure SQL, Azure Data Lake and related cloud technologies. Strong understanding of data modelling, ETL/ELT development and data integration principles. Knowledge of modern cloud-based data architectures, distributed computing concepts and large-scale data processing. Experience using Infrastructure as Code tools such as Terraform or Bicep, alongside CI/CD practices and Azure DevOps. Excellent communication and stakeholder management skills, with the ability to engage effectively with both technical and business audiences.

Python Technical Lead Employment Type: Permanent Location: London - Hybrid (3 days in the office) Salary: £90,000 - £105,000 + benefits and bonus About the Client Our client is a leading specialist insurance provider, recognised for its innovative approach to technology and data. Operating globally, they develop cutting-edge digital platforms that support underwriting and risk management, with technology at the heart of their continued growth. Role Overview As a Technical Lead, you'll be responsible for leading the successful delivery of complex engineering solutions, providing technical direction across the full development life cycle from design through to deployment. You'll work closely with Product Owners and key stakeholders to define technical requirements, shape solution architecture and ensure delivery aligns with business objectives. Alongside leading a team of engineers, you'll provide hands-on technical leadership through mentoring, code reviews and promoting engineering best practices. You'll also play a key role in improving development processes, managing technical debt, mitigating technical risks and championing quality through automation, testing and CI/CD, ensuring the team delivers scalable, high-quality solutions. Key Responsibilities Lead and mentor a team of engineers, supporting the successful delivery of technical projects from design through to deployment. Define technical solutions and contribute to architectural decisions across multiple applications. Work closely with Product Owners and business stakeholders to prioritise work and deliver against business objectives. Drive engineering best practices through code reviews, technical mentoring and continuous improvement initiatives. Identify and address technical debt, architectural improvements and delivery risks. Champion software quality through automation, testing, CI/CD and development best practices. Key Requirements Strong commercial experience developing software using Python - experience within Financial Services is advantageous. Previous experience leading or mentoring engineering teams within an Agile environment. Excellent SQL skills, including experience with PostgreSQL, SQL Server and Databricks. Strong understanding of software architecture, engineering best practices and CI/CD. Comfortable working directly with SQL and relational databases without relying on ORMs. Excellent communication skills with the ability to engage both technical and non-technical stakeholders. Why Join Opportunity to shape the technical direction of modern, data-driven platforms. Hands-on leadership role combining engineering with technical strategy. Collaborative engineering culture focused on innovation, quality and continuous improvement. Competitive salary, bonus and comprehensive benefits package. Hybrid working from a modern London office. Additional Notes This is a permanent opportunity based in London, operating on a hybrid working model with three days per week in the office. The role may require occasional out-of-hours support and limited travel where necessary. Data & Application Notice We process personal data submitted as part of your application for recruitment purposes in line with UK GDPR. All applications are reviewed by a member of our team, we do not use automated decision-making in our selection process. Your application will be assessed against the requirements of this role. By applying to this advert, you consent to receiving future relevant roles and industry news and insights from us. To opt out of this, please contact: (see below) For more information on how we use your data, including how long we retain it & your rights, please refer to our Privacy Policy

Data Platform Manager UK / Remote Circa 65k - 75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where you'll combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric / Azure Synapse), ensuring it delivers real business value, scalability, and innovation. If you're passionate about data, leadership, and building robust data solutions-this is one you don't want to miss. What you'll be doing Own the end-to-end lifecycle of a core data platform, from design and build through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise, building and optimising PySpark pipelines Ensure data is secure, high-quality, accessible, and structured for maximum business value Drive best practice in data governance, cataloguing, lineage, and standards across the organisation Promote data re-use and reduce duplication across systems Oversee ETL processes, data integration, and BI architecture Manage and develop a small, high-performing data team, including mentoring, 1:1s, and continuous improvement initiatives Work closely with stakeholders across operations, analytics, and reporting teams Ensure compliance with data protection regulations and internal policies What you'll bring Strong hands-on experience in data engineering, including PySpark and production data pipelines Experience with Microsoft Fabric, Azure Synapse, or similar platforms (e.g. Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such as Power BI or Tableau Knowledge of DevOps practices (Git, Azure DevOps, CI/CD pipelines) Strong Python skills and experience with APIs/data integration tools Understanding of data protection regulations Leadership experience with the ability to mentor and develop teams Excellent communication, problem-solving, and stakeholder management skills Desirable: Experience with project management methodologies, SDLC tools, and awareness of emerging data trends What's in it for you? Performance-related bonus Private healthcare and life assurance 33 days annual leave (rising to 38 with service) Discounts across major retailers, restaurants, and holidays Generous family benefits and staff discounts Award-winning training and clear career progression Comprehensive wellbeing support for you and your family If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Product Manager, Data Engineering Lead, Lead Data Engineer, Azure Data Engineer, Data Platform Manager, Analytics Engineering Manager, Cloud Data Engineer, BI & Data Lead, PySpark Engineer, Databricks Engineer, Head of Data Engineering. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate 1 to The Born Free Foundation. We are a Climate Action Workforce in partnership with Ecologi. If this role isn't right for you, explore our referral reward program with payouts at interview and placement milestones. Visit our website for details. Deerfoot Recruitment Solutions Ltd is acting as an Employment Agency in relation to this vacancy.

Must have active enhanced DV (West) Clearance Junior to Lead levels available £45k to £95k DoE plus 15% clearance bonus Must be willing to be full-time on-site in Cheltenham Skills required in machine learning, GenAI, NLP, Customer Engagement/Consultancy Who are we? We are recruiting Junior, Senior and Lead Data Scientists with AI specialism and enhanced DV Clearance for a prestigious client to work on a portfolio of public and private sector projects. Our client is a global leader in technology, consulting, and engineering services at the forefront of innovation to evolve the world of digital, cloud, and platforms. You'll experience excellent career progression opportunities to develop your skillset and personal profile in an inclusive culture. What will the Data Scientist be doing? Our client is seeking individuals with strong technical expertise in machine learning, GenAI, computer vision, and data science, alongside solid skills in solution architecture and software engineering to design and scale impactful solutions. This role involves working closely with clients to identify challenges, define solutions, communicate their value clearly, and lead teams to successful delivery. There are also opportunities to publish whitepapers and represent the organisation at conferences, all within an inclusive and diverse working environment. Key Skills and Requirements Proficient in AI techniques including machine learning, GenAI, NLP, deep learning, graph analytics, and time series analysis. Strong communicator with the ability to simplify complex concepts, manage stakeholders, and motivate/lead Agile teams to deliver robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. To be Considered: Please either apply by clicking online or emailing me directly at . For further information please call me on or - I can make myself available outside of normal working hours to suit from 7 am until 10 pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process & submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to connect with me on LinkedIn, just search for Henry Clay-Davies. I look forward to hearing from you. KEY SKILLS: Data Science / Data Scientist / AI Engineer / AI / Machine Learning / ML / NLP / GenAI / Stakeholder Engagement / Customer Engagement / AWS / Azure / Cloud / Docker / Kubernetes / CI/CD / Deep Learning

An impressive multinational firm is looking for an accomplished Azure Data Engineer to join its team. Please note the role is hybrid - you will work from the office 3 days per week with 2 from home.In this role, you will be responsible for designing, developing, and maintaining scalable data solutions that provide clean, structured, and accessible data to internal teams, stakeholders, and external partners. Working closely with developers, analysts, and business teams, you will help deliver cloud-based data platforms that support reporting, analytics, and data-driven innovation.In order to be suitable for this role you must be an accomplished Data Engineer with hands-on experience with Microsoft Fabric and Azure data services, including technologies such as Databricks, Data Factory, Azure SQL Managed Instances, and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported by advanced SQL and reporting experience.The successful Data Engineer will design, build, and maintain a modern cloud-based data platform that supports analytics, reporting, and operational systems across the organisation. Working closely with Data Science, development, and business teams, you will develop scalable data pipelines, manage SQL Server databases across on-premises and Azure environments, and ensure data is secure, reliable, and accessible.You will play a key role in shaping the organisation's data architecture, identifying opportunities to improve data acquisition, automation, and performance, while helping to deliver a robust and scalable data ecosystem that supports future growth.This is an outstanding opportunity for a personable Data Engineer to join a market leading business that offers an excellent range of benefits.

Python Developer - Exposure Analytics £80,000-£90,000 + Benefits Permanent London Hybrid (2-3 Days per Week Onsite) We're supporting a leading London Market insurer in the search for a Python Developer to join their Exposure Analytics team.This is a fantastic opportunity to build innovative analytics and exposure management tools that directly influence underwriting decisions, portfolio optimisation, and catastrophe risk management, while helping drive the adoption of AI-enabled solutions across the business.Key Responsibilities Develop web-based analytics tools delivering exposure, loss simulation and risk insights to underwriting teams Build and integrate solutions within a modern data lake architecture Design bespoke exposure calculation engines using Open Exposure Data (OED) formats Support AI-driven initiatives, including natural language querying and agentic workflows Collaborate with Data, Infrastructure, Claims, Pricing and Underwriting teams Contribute to the development of a reinsurance results data warehouse and portfolio analytics capability Improve data quality, reconciliation processes and reporting frameworks Skills & Experience 3-5 years' software development experience Strong Python development skills with FastAPI, Flask or Django Experience building full-stack applications using React, JavaScript/TypeScript and Node.js Knowledge of GitHub, CI/CD, automated testing and Agile delivery methodologies Databricks experience highly desirable, including Lakehouse architecture and Delta tables Exposure to geospatial data and spatial analysis beneficial Interest in AI technologies and AI-assisted development tools London Market Insurance or Reinsurance experience desirable Package & Working Arrangement Permanent position £80,000-£90,000 base salary Hybrid working model - 2-3 days per week onsite in London Opportunity to work on cutting-edge analytics, data and AI initiatives Direct exposure to underwriting, exposure management and business-critical decision making If you're a Python Developer looking to work at the intersection of software engineering, analytics, data platforms and AI within the insurance sector, I'd be keen to speak with you.

An impressive multinational firm is looking for an accomplished Data Engineer to join its team. Please note the role is hybrid - you will work from the office 3 days per week with 2 from home.In this role, you will be responsible for designing, developing, and maintaining scalable data solutions that provide clean, structured, and accessible data to internal teams, stakeholders, and external partners. Working closely with developers, analysts, and business teams, you will help deliver cloud-based data platforms that support reporting, analytics, and data-driven innovation.In order to be suitable for this role you must be an accomplished Data Engineer with hands-on experience with Microsoft Fabric and Azure data services, including technologies such as Databricks, Data Factory, Azure SQL Managed Instances, and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported by advanced SQL and reporting experience.The successful Data Engineer will design, build, and maintain a modern cloud-based data platform that supports analytics, reporting, and operational systems across the organisation. Working closely with Data Science, development, and business teams, you will develop scalable data pipelines, manage SQL Server databases across on-premises and Azure environments, and ensure data is secure, reliable, and accessible.You will play a key role in shaping the organisation's data architecture, identifying opportunities to improve data acquisition, automation, and performance, while helping to deliver a robust and scalable data ecosystem that supports future growth.This is an outstanding opportunity for a personable Data Engineer to join a market leading business that offers an excellent range of benefits.

Data Warehouse Architect £75,000+ benefits Bury (Hybrid) We are seeking a Data Warehouse Architect to design, establish, and govern a modern enterprise data platform. This role will bridge complex raw data and business insights by creating scalable, high-performance lakehouse and data warehouse architectures. You will play a key role in consolidating data assets, eliminating silos, and ensuring a single, source of truth to support advanced analytics and AI. Data Warehouse Architect Responsibilities: Design and implement enterprise-wide data architecture across Microsoft Fabric (OneLake) and Databricks (Unity Catalog) Build scalable lakehouse and warehouse solutions using Databricks SQL and Fabric SQL endpoints Develop robust data pipelines with Databricks Workflows, Delta Live Tables (DLT), and Fabric Data Factory Define and implement cross-platform data strategies using Delta Lake to minimise duplication Establish data governance frameworks, including access controls, lineage, and Row-Level Security (RLS) Manage and optimise compute resources across Fabric and Databricks environments Lead CI/CD implementation using Azure DevOps, GitHub, and Databricks Asset Bundles Drive adoption of best practices in data modelling and architecture patterns As Data Warehouse Architect, you will have: Strong expertise in Microsoft Fabric (OneLake) and Databricks (Unity Catalog) architecture Proven experience building modern lakehouse and data warehouse platforms Hands-on experience with: Databricks SQL & Fabric SQL Databricks Workflows & Delta Live Tables (DLT) Fabric Data Factory Deep knowledge of Delta Lake and cross-platform data strategies Solid experience in data governance, including lineage, access control, and RLS Experience managing multi-engine compute environments CI/CD experience with Azure DevOps, GitHub, and Databricks Asset Bundles Strong programming skills in PySpark, Databricks SQL, and T-SQL Understanding of Medallion Architecture and modern data modelling approaches (Star Schema, Data Vault 2.0) Experience with performance optimisation in Databricks and integration with Power BI (Direct Lake) Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates

ESSENTIAL ROLES & RESPONSIBILITIES Identify and understand customer data-centric use cases within regulated financial services environments Design and implement data ingestion, processing, and transformation pipelines on Azure Build and maintain data pipelines for cleaning, normalisation, enrichment, and preparation Apply appropriate data modelling techniques and architecture patterns, with a strong focus on medallion architecture Orchestrate, monitor, and optimise Azure Databricks jobs and Azure Data Factory pipelines across development, UAT, and production environments Configure platforms, clusters, and compute resources to optimise performance, cost, and reliability Use automated CI/CD pipelines to manage, deploy, and version data artefacts and pipelines Operationalise workflows developed by analysts and data scientists Support customers in adopting Azure data, analytics, and machine learning services Ensure secure storage, processing, and quality of customer data Ensure networking and security best practices are applied when designing and operating data solutions Design solutions for processing large volumes of data using batch and streaming approaches Collaborate with analytics teams on data visualisation best practices and reporting enablement Ensure all solutions are well-documented, including pipelines, schemas, transformations, and operational runbooks GOVERNANCE & REPORTING Maintain accurate documentation of data pipelines, schemas, transformations, and deployment processes Support data governance initiatives including lineage, metadata management, and access control Contribute to service reporting, risk tracking, and continuous improvement actions Ensure data environments are audit-ready and aligned with governance standards TECHNOLOGY STACK (AZURE) Cloud Platform: Microsoft Azure Data Engineering & Analytics: Azure Databricks (development, UAT, and production) Azure Data Factory Azure Synapse Analytics (where applicable) Machine Learning & AI : Azure Machine Learning (limited non-production usage) Azure Document Intelligence Databases: Microsoft SQL Server / Azure SQL Database (primary platforms) PostgreSQL (limited use) MySQL (limited use) Data Processing: Batch and streaming data pipelines Security & Governance: Role-based access control (RBAC) Data encryption and key management Audit logging and monitoring DevOps: CI/CD pipelines for data artefacts and infrastructure BEHAVIOURAL COMPETENCIES - ORGANISATIONAL & BEHAVIOURAL FIT Positive mindset and enthusiasm for learning new technologies Collaborative and supportive team player Strong sense of ownership and accountability Methodical, analytical approach to problem-solving Strong understanding of ethical data usage in regulated environments CRITICAL COMPETENCIES - TECHNICAL FIT Essential: Strong SQL skills Programming experience with Python and/or Scala Hands-on experience with Azure-based data platforms Experience designing, building, and maintaining data pipelines Strong understanding of data modelling (relational and analytical), including medallion architecture Experience orchestrating and optimising Databricks and Data Factory workloads Experience using CI/CD pipelines for data and analytics solutions Strong awareness of security, networking best practices, GDPR, and PII handling Desirable: Experience with Azure Databricks in production environments Familiarity with Azure Machine Learning and AI services Exposure to data visualisation tools (e.g. Power BI) Experience with big data frameworks (Spark, Kafka) Knowledge of data governance, lineage, and metadata tooling SHIFT & WORKING PATTERN Standard business hours, with participation in an on-call rota as required Occasional weekend engineering coverage will be required, typically limited to a small number of planned weekends per year to support business continuity, resilience testing, or disaster recovery activities

Location: Newcastle upon Tyne (primarily remote, occasional travel) Contract Type: Contract (Outside IR35) Day Rate: Up to 800 per day The Opportunity We're partnering with a highly respected Software business to find an experienced Data Engineer to support a major client engagement. This is a hands-on, client-facing role where you'll play a key part in shaping and delivering modern data platforms and pipelines. You'll work closely with stakeholders to unlock the value of data, building scalable solutions that support analytics, reporting, and advanced use cases such as machine learning. Role responsibilities: Lead the design and delivery of robust, scalable data platforms and pipelines Work alongside client teams to understand requirements and translate them into effective technical solutions Build and optimise data ingestion, transformation, and storage processes Develop integrated data models to enable reporting, analytics, and AI use cases Provide technical leadership and guidance to engineers within the delivery team Contribute to architectural decisions and best practices across the project lifecycle Key Skills & Experience we're looking for: Strong background in data engineering and software development Proven experience working with Databricks (essential) Hands-on expertise with tools such as Python, PySpark, Spark, and SQL Experience building and maintaining data pipelines and data platforms Solid understanding of data modelling and data architecture principles Experience working with cloud platforms (AWS, Azure, or GCP) Comfortable working in client-facing environments Why Apply? Great flexible working arrangement Opportunity to work on complex, high-impact data projects Collaborative, engineering-led culture with a focus on quality

Principal Engineer (Payments) Our long-term trusted partner, a leading financial services corporation, is hiring a Principal Engineer to drive the development and design of several greenfield retail banking platforms as our client continues on their digital transformation journey. This is a senior leadership position where the chosen engineer will lead real-time architectural decision making leading vision & strategy across Faster Payments, Real-Time Payments, Card payments, BACS, mobile wallets and APIs. Our client is paying a basic salary up to 110,000 (circa) + 25% bonus + benefits to be based in London, Chatham (Kent) or Wolverhampton onsite 2 days per week. Our client is seeking experienced engineers with recent retail / digital banking experience who can design new product roadmaps, focus on architectural challenges, and provide hands-on technical leadership to a team of engineers. Your responsibilities will include: Lead the development and implementation of a modern cloud foundation and data platform that is robust, scalable, fully automated, secure, and can support the growth of the business. Build Scalable Architectures: Leverage modern technologies to design and implement scalable, secure, and high-performing cloud-native solutions. API Development and Integration: Design and build secure RESTful and GraphQL APIs, ensuring seamless integration with core banking systems (e.g., Mambu) and external services like Open Banking platforms. Data Engineering and Analytics: Work closely with data teams to define robust data pipelines and scalable cloud-based data platforms using tools like Apache Kafka, Snowflake, or Databricks. Monitoring and Performance Tuning: Implement advanced monitoring and observability solutions using tools like Prometheus, Grafana, or Datadog to proactively identify and resolve performance bottlenecks. Code and System Optimisation: Proactively analyse and optimise existing systems for improved performance, scalability, and maintainability. Core skill set for this position: Strong experience building and scaling banking payment systems including either Faster Payments, Real-Time Payments, Card payments, BACS, mobile wallets and APIs is a must have. Experience leading upon architectural challenges, system scalability, and guidance of engineering teams is a must. A background in Java, C#, Python, or React development with experience providing hands-on technical leadership is a must. Strong background in core banking systems/platforms (Mambu), cloud-native architectures, microservices and DevOps practices Solid understanding of regulatory, risk and compliance requirements (e.g. PSD2, PCI DSS, GDPR) Experience with cloud platforms (AWS, Azure or GCP) and modern data platforms Benefits: 110,000 crica / 25% bonus / 28 days holiday / Holiday Purchase Scheme / Occasional travel / Health Insurance / 13% pension / plus much more. Principal Engineer (Payments)

Principal Engineer (Payments) Our long-term trusted partner, a leading financial services corporation, is hiring a Principal Engineer to drive the development and design of several greenfield retail banking platforms as our clients rebuild their product portfolio as they continue on their digitial transformation journey. This is a senior leadership position where the chosen engineer will lead real-time architectural decision making leading vision & strategy across Faster Payments, Real-Time Payments, Card payments, BACS, mobile wallets and APIs. Our client is paying a basic salary up to 110,000 (circa) + 25% bonus + benefits to be based in London, Chatham (Kent) or Wolverhampton onsite 2 days per week. Our client is seeking experienced engineers with recent retail / digital banking experience who can design new product roadmaps, focus on architectural challenges, and provide hands-on technical leadership to a team of engineers. Your responsibilities will include: Lead the development and implementation of a modern cloud foundation and data platform that is robust, scalable, fully automated, secure, and can support the growth of the business. Build Scalable Architectures: Leverage modern technologies to design and implement scalable, secure, and high-performing cloud-native solutions. API Development and Integration: Design and build secure RESTful and GraphQL APIs, ensuring seamless integration with core banking systems (e.g., Mambu) and external services like Open Banking platforms. Data Engineering and Analytics: Work closely with data teams to define robust data pipelines and scalable cloud-based data platforms using tools like Apache Kafka, Snowflake, or Databricks. Monitoring and Performance Tuning: Implement advanced monitoring and observability solutions using tools like Prometheus, Grafana, or Datadog to proactively identify and resolve performance bottlenecks. Code and System Optimisation: Proactively analyse and optimise existing systems for improved performance, scalability, and maintainability. Core skill set for this position: Strong experience building and scaling banking payment systems including either Faster Payments, Real-Time Payments, Card payments, BACS, mobile wallets and APIs is a must have. Experience leading upon architectural challenges, system scalability, and guidance of engineering teams is a must. A background in Java, C#, Python, or React development with experience providing hands-on technical leadership is a must. Strong background in core banking systems/platforms (Mambu), cloud-native architectures, microservices and DevOps practices Solid understanding of regulatory, risk and compliance requirements (e.g. PSD2, PCI DSS, GDPR) Experience with cloud platforms (AWS, Azure or GCP) and modern data platforms Benefits: 110,000 crica / 25% bonus / 28 days holiday / Holiday Purchase Scheme / Occasional travel / Health Insurance / 13% pension / plus much more. Principal Engineer (Payments)

data engineer - 3 days - Skipton - £460 inside IR35 Exalto consulting are currently recruiting for a contract data engineer, this is inside IR35, paying £460 per day inside IR35, initially until the end of the year. Developing and maintaining data pipelines to ingest data from legacy systems and operational platforms into the Azure Lakehouse environment. Designing and implementing data transformation processes using Databricks, supporting Bronze, Silver, and Gold data layers in line with Medallion Architecture best practices. Building scalable ETL/ELT solutions to support enterprise reporting, analytics, and regulatory requirements. Creating and optimising data models and datasets for consumption by Power BI and other reporting tools. Ensuring data quality, consistency, and integrity through automated validation, monitoring, and testing processes. Supporting data migration activities from legacy platforms to cloud native Azure services. Contributing to the adoption of engineering best practices, including CI/CD, Infrastructure as Code, automated testing, and version control. If you have the above experience please send your CV for immediate consideration as our client are looking to hire ASAP data engineer - 3 days - Skipton - £460 inside IR35

Data Architect Contract Dublin 6-12 Months. My client a leading global firm is in urgent need of a talented and experienced Data Architect to join them on a contract basis. My client is looking for you to formulate and design the solutions to deliver to the requirements coming from different business lines and operational departments that have data provision, reporting, and analytics use cases. This is to keep us aligned with the longer term agreed strategies at a business, data, and technical level. Technical Data Architect is responsible for designing, implementing, and maintaining the data architecture of the organisation. This role involves collaborating with cross-functional teams to ensure data is organised, accessible, and secure, aligning with business goals and compliance requirements. The role will be responsible for developing solution designs for a portfolio of projects across the my clients EMEA entity and overseeing solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. Successful candidates have deep and broad experience of developing technical data solutions in large or medium sized enterprises in a similar role. You will be defining technical strategy and roadmaps for delivery in medium to large enterprises. You will have strong knowledge of database systems,Demonstrable data modelling experience across multiple techniques, Proven experience with multiple data integration technologies,Event driven architectures. You will have strong experience of different data architectures including hub and spoke, data lakes, data fabrics, lakehouses. It would be idea if you have experience of databricks. This is very much a hands on role, my client is looking for candidates to get involved in many different aspects of this role. If this sounds of interest drop me a CV so that we can speak in more detail.

Solutions Architect Salary: 100K - 110K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Solutions Architect to provide design and architecture guidance across a broad portfolio of data initiatives. The Opportunity This is a senior architecture role focused on shaping how solutions are designed and delivered across a complex enterprise data estate. You will work closely with product owners, engineering leads, data teams and senior stakeholders to understand business requirements and translate them into clear, robust high-level designs for engineering teams to build. The role is not focused on hands-on delivery. Instead, you will be responsible for articulating solution designs, documenting key decisions, defining reusable patterns and ensuring consistency across a shared data platform. You will support a modern cloud data platform, with exposure to areas such as analytics, reporting, data science, AI use cases and increasingly real-time data capabilities. Skills and experience Strong experience designing secure, scalable data solutions in complex environments Experience working with Azure-based data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale cloud data platform, please submit your CV for initial screening and further details. Solutions Architect

AI Solution Architect - Senior Manager/Associate Director Capital Markets Location: Manchester Working pattern: Hybrid Salary: Compensation aligned to experience and seniority Ref: J13119 Senior AI Solution Architects are required to support the design, implementation and scaling of advanced AI solutions within financial services and capital markets environments. This role would suit an experienced professional with a strong background in AI, cloud and data architecture, with experience designing enterprise AI solutions and translating business requirements into scalable technical architectures. You will play a key role in shaping AI architecture strategy, leading technical teams and supporting organisations as they move from strategy and experimentation through to enterprise deployment. You will work closely with AI Engineers, Data Scientists, Enterprise Architects, MLOps teams, business stakeholders and senior leadership to design, deliver and scale AI solutions that drive measurable business outcomes. Key responsibilities: Translating business objectives into AI architecture strategies, roadmaps and scalable solution designs Designing and implementing end to end AI and ML architectures across enterprise environments Defining scalable, performant and cost optimised deployment patterns across cloud, containerised and GPU enabled environments Supporting AI implementation programmes from proof of concept through to enterprise deployment and optimisation Evaluating and selecting technologies across open source and commercial platforms Designing and integrating AI solutions into existing enterprise systems and applications Working with AI Engineers, Data Scientists and technical teams to support AI delivery and scaling initiatives Supporting AI governance, security, risk and regulatory considerations throughout the delivery lifecycle Supporting architecture governance, technical review boards and design authorities Building relationships with technical and business stakeholders across large scale transformation programmes Producing solution design documentation, implementation plans and technical proposals Providing technical leadership and mentoring within multidisciplinary teams Experience Required: Experience designing AI, ML or modern data architectures within enterprise environments Strong understanding of cloud platforms such as AWS, Azure, GCP, Databricks or similar technologies Experience architecting scalable AI and ML solutions across serverless, containerised or GPU enabled environments Experience with LLMs, prompt engineering, embeddings, semantic search and RAG patterns Exposure to vector databases and agent frameworks such as LangChain, LangGraph or similar technologies Understanding of MLOps, LLMOps and model lifecycle management principles Experience designing APIs and integrating AI solutions into enterprise environments Strong understanding of modern data architectures and platform design principles Experience presenting architectural designs to technical and business stakeholders Financial services experience within capital markets or broader banking environments This is a strong opportunity for an AI architecture professional who wants to work on high impact AI and data transformation programmes within complex financial services environments. For more information make an application today! Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data UK. For more information visit our website: (url removed)

Senior AI Engineer Manager/Associate Director Capital Markets Location: London Working pattern: Hybrid Salary: Compensation aligned to experience and seniority Ref: J13114 Senior AI Engineering professionals are required to support the design, build and delivery of advanced AI solutions within financial services and capital markets environments. This role would suit an experienced professional with a strong background in AI engineering and enterprise solution delivery within complex environments. You will play a key role in shaping AI strategy, leading teams and delivering enterprise AI solutions, helping organisations solve complex operational, technical and regulatory challenges through AI adoption at scale. You will work across multidisciplinary teams, collaborating with data scientists, architects, MLOps/LLMOps engineers, business stakeholders and senior leadership to design, deliver and scale AI products, agentic AI solutions and data driven applications. Key responsibilities: Building and deploying AI prototypes, products and production ready solutions Designing and implementing end to end AI solutions that integrate with enterprise systems Working with LLMs, prompt engineering, RAG patterns, embeddings and fine tuning Developing AI agents and agentic workflows using modern frameworks Working with vector databases, APIs and modern data platforms Supporting AI deployment, serving patterns, evaluation frameworks and integration design Using Python and SQL to build robust, scalable AI and data solutions Working with cloud platforms such as AWS, Azure, GCP or Databricks Supporting MLOps, LLMOps, CI/CD and software engineering best practice Collaborating with technical and non-technical stakeholders across complex programmes Helping identify technical, delivery, security, data privacy and regulatory risks Contributing to technical documentation, solution design and delivery planning Supporting AI implementation and scaling initiatives across complex environments Leading and developing teams, supporting capability growth through mentoring, coaching and creating a collaborative, high performing environment Experience Required: Strong Python and SQL experience Applied AI engineering, ML engineering or software engineering background Experience with LLMs, RAG, embeddings, prompt engineering or fine tuning Exposure to LangChain, LangGraph, Agent Development Kit or similar agent frameworks Experience with vector databases such as Pinecone, Chroma or similar API development experience, ideally with FastAPI or similar frameworks Knowledge of MLOps, LLMOps, CI/CD or production deployment practices Experience designing or supporting evaluation frameworks for AI or agentic systems Experience working with modern data architectures and cloud platforms Understanding of AI risk, governance, security and regulatory considerations Financial services experience within capital markets or broader banking environments This is a strong opportunity for an AI engineering professional who wants to work on high impact AI and data transformation programmes within complex financial services environments. Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data UK. For more information visit our website: (url removed)

Senior AI Engineer Manager/Associate Director Capital Markets Location: Manchester Working pattern: Hybrid Salary: Compensation aligned to experience and seniority Ref: J13116 Senior AI Engineering professionals are required to support the design, build and delivery of advanced AI solutions within financial services and capital markets environments. This role would suit an experienced professional with a strong background in AI engineering and enterprise solution delivery within complex environments. You will play a key role in shaping AI strategy, leading teams and delivering enterprise AI solutions, helping organisations solve complex operational, technical and regulatory challenges through AI adoption at scale. You will work across multidisciplinary teams, collaborating with data scientists, architects, MLOps/LLMOps engineers, business stakeholders and senior leadership to design, deliver and scale AI products, agentic AI solutions and data driven applications. Key responsibilities: Building and deploying AI prototypes, products and production ready solutions Designing and implementing end to end AI solutions that integrate with enterprise systems Working with LLMs, prompt engineering, RAG patterns, embeddings and fine tuning Developing AI agents and agentic workflows using modern frameworks Working with vector databases, APIs and modern data platforms Supporting AI deployment, serving patterns, evaluation frameworks and integration design Using Python and SQL to build robust, scalable AI and data solutions Working with cloud platforms such as AWS, Azure, GCP or Databricks Supporting MLOps, LLMOps, CI/CD and software engineering best practice Collaborating with technical and non-technical stakeholders across complex programmes Helping identify technical, delivery, security, data privacy and regulatory risks Contributing to technical documentation, solution design and delivery planning Supporting AI implementation and scaling initiatives across complex environments Leading and developing teams, supporting capability growth through mentoring, coaching and creating a collaborative, high performing environment Experience Required: Strong Python and SQL experience Applied AI engineering, ML engineering or software engineering background Experience with LLMs, RAG, embeddings, prompt engineering or fine tuning Exposure to LangChain, LangGraph, Agent Development Kit or similar agent frameworks Experience with vector databases such as Pinecone, Chroma or similar API development experience, ideally with FastAPI or similar frameworks Knowledge of MLOps, LLMOps, CI/CD or production deployment practices Experience designing or supporting evaluation frameworks for AI or agentic systems Experience working with modern data architectures and cloud platforms Understanding of AI risk, governance, security and regulatory considerations Financial services experience within capital markets or broader banking environments This is a strong opportunity for an AI engineering professional who wants to work on high impact AI and data transformation programmes within complex financial services environments. Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data UK. For more information visit our website: (url removed)

Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python / Databricks) Contract: 6 months - Potentially extension. Location: London Hybrid (5 days in 10 in the office) Rate: Highly competitive Status: Inside IR35 Working pattern: Full time We are seeking an experienced Technical Delivery Lead with strong expertise in Python, Databricks, and Apache Spark to lead the successful delivery of enterprise-scale data engineering initiatives This is a hands-on leadership role combining technical delivery, solution design, and data engineering expertise. The successful candidate will lead the delivery of a greenfield data platform while remaining actively involved in development activities. Essential Skills Proven experience in Data Engineering or Software Engineering. Previous experience in a Technical Lead, Lead Data Engineer, or Technical Delivery Lead position. Strong hands-on expertise with Python. Extensive experience with Databricks, including Workflows, Notebooks, and Delta Lake. Strong experience with Apache Spark /PySpark. Proven track record building and optimising large-scale ETL/ELT pipelines. Strong understanding of modern data architecture and Lakehouse principles. Excellent SQL skills and experience working with distributed data systems. Experience working with cloud platforms such as AWS, Azure, or GCP. Strong Agile delivery experience. Experience leading technical teams and delivering complex projects. Expected split: 30-50% hands-on coding + technical problem-solving Key Responsibilities Lead end-to-end delivery of data engineering solutions. Design and build scalable data pipelines using Databricks and Azure. Develop and optimise solutions using Python and PySpark. Drive engineering best practices, code reviews, and technical standards. Work closely with architecture, business, and technology stakeholders. Mentor and support engineers within the team. Contribute to data platform and Lakehouse architecture decisions. What We're Looking For Approximately 60% hands-on engineering and 40% technical leadership. Proven experience leading data engineering teams. Strong stakeholder management and communication skills. Experience delivering greenfield data platform initiatives. This is an excellent opportunity to join a high-profile programme with significant scope for extension and future team growth. Why Join Us? Work on innovative projects that make a difference in the financial sector. Collaborate with a talented team in a vibrant environment. Enjoy a competitive daily rate and flexible working arrangements. If you are ready to take your career to the next level and contribute to exciting projects, apply now! We can't wait to meet you! Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

We're hiring an experienced AI Platform Engineer to design, build and operate a production-grade Generative AI platform powering next-generation intelligent products. This is a hands-on engineering role focused on taking AI solutions from prototype to scalable, reliable services used in real-world environments. You'll sit at the intersection of DevOps, cloud infrastructure and applied AI owning the full lifecycle of Retrieval-Augmented Generation (RAG) and LLM-powered systems across modern cloud architecture. This role is about engineering, not research. You will architect and run the infrastructure that enables AI to perform securely, reliably and at scale ensuring performance, cost control and operational maturity as adoption grows. You'll work closely with AI engineers, security teams, and product stakeholders to transform experimental models into hardened, production-ready services while shaping a reusable AI platform capable of supporting multiple products. What You'll Be Doing Design and optimise scalable RAG pipelines and vector search systems Orchestrate multi-model AI services with a focus on latency, resilience and performance Productionise GenAI workflows and ensure they operate reliably under real usage Build and run AI services across AWS and Databricks Develop ingestion, embedding and retrieval pipelines Deploy containerised workloads via Kubernetes and Helm Implement Infrastructure-as-Code using Terraform Introduce end-to-end monitoring, tracing and alerting for AI workloads Improve inference and retrieval performance while reducing operational cost Establish fault-tolerant, scalable infrastructure patterns Embed security, evaluation and governance into the AI lifecycle Build CI/CD pipelines and automation to support continuous model deployment Create reusable platform components to accelerate future AI initiatives Strong experience in: Cloud infrastructure engineering (AWS-focused environments) Kubernetes, containerisation, and distributed systems Terraform / Infrastructure-as-Code CI/CD, automation, and platform reliability Running production workloads with high availability requirements Plus, experience with one or more of the following: MLOps or ML platform engineering RAG architectures, embeddings, or vector search Model serving, observability or performance optimisation Data / AI workflow orchestration in Databricks or similar ecosystems Why Join? Work on real-world AI systems operating at scale Own platform design decisions and influence long-term architecture Blend modern DevOps practices with cutting-edge Generative AI use cases Be part of a growing, innovation-driven engineering environment Opportunity to define how AI is operationalised across multiple products If you're excited by building the infrastructure that makes AI usable, scalable and reliable in production, we'd love to hear from you. 49914MSR3 INDLON The Portfolio Group are acting on behalf of our client in recruiting for this position.