Data Engineer London / remote 429 per day inside IR35 6 months duration Active SC clearance We are seeking a Senior Data Engineer to join a high-performing team delivering large-scale cloud and data transformation programmes. This is an exciting opportunity to work on complex data platforms, leveraging modern cloud technologies and best-in-class engineering practices to build scalable, secure, and high-quality data solutions. You'll play a key role in designing and developing data pipelines, integrating data from multiple sources, and helping organisations unlock the value of their data through robust engineering and architecture. What You'll Be Doing Designing, developing, and optimising enterprise-scale data pipelines. Building cloud-native data solutions using AWS and Azure. Developing and supporting ETL/ELT processes using Informatica. Working with large datasets to ensure data quality, performance, and reliability. Collaborating with architects, developers, analysts, and business stakeholders. Supporting CI/CD, automation, and DevOps best practices. Contributing to Agile delivery teams and driving engineering excellence. What We're Looking For Essential Skills Strong experience with Informatica. Proven delivery experience on data engineering or data transformation projects. Hands-on AWS experience. Experience working within Azure environments. Strong SQL skills and understanding of modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab and modern software development practices. API integration and data services. Data warehousing, dimensional modelling, and dbt. Power BI familiarity. Experience working within government or highly regulated environments. What's In It For You? Opportunity to work on impactful, large-scale data programmes. Exposure to modern cloud and data technologies. Collaborative and supportive engineering culture. Ongoing professional development and certification opportunities. Flexible working arrangements and excellent career progression opportunities. If you're passionate about building scalable cloud data solutions and want to work on complex, high-profile programmes, we'd love to hear from you. If this Data Engineer role is of interest, apply now or email your CV to me at (url removed)
Jun 20, 2026
Contractor
Data Engineer London / remote 429 per day inside IR35 6 months duration Active SC clearance We are seeking a Senior Data Engineer to join a high-performing team delivering large-scale cloud and data transformation programmes. This is an exciting opportunity to work on complex data platforms, leveraging modern cloud technologies and best-in-class engineering practices to build scalable, secure, and high-quality data solutions. You'll play a key role in designing and developing data pipelines, integrating data from multiple sources, and helping organisations unlock the value of their data through robust engineering and architecture. What You'll Be Doing Designing, developing, and optimising enterprise-scale data pipelines. Building cloud-native data solutions using AWS and Azure. Developing and supporting ETL/ELT processes using Informatica. Working with large datasets to ensure data quality, performance, and reliability. Collaborating with architects, developers, analysts, and business stakeholders. Supporting CI/CD, automation, and DevOps best practices. Contributing to Agile delivery teams and driving engineering excellence. What We're Looking For Essential Skills Strong experience with Informatica. Proven delivery experience on data engineering or data transformation projects. Hands-on AWS experience. Experience working within Azure environments. Strong SQL skills and understanding of modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab and modern software development practices. API integration and data services. Data warehousing, dimensional modelling, and dbt. Power BI familiarity. Experience working within government or highly regulated environments. What's In It For You? Opportunity to work on impactful, large-scale data programmes. Exposure to modern cloud and data technologies. Collaborative and supportive engineering culture. Ongoing professional development and certification opportunities. Flexible working arrangements and excellent career progression opportunities. If you're passionate about building scalable cloud data solutions and want to work on complex, high-profile programmes, we'd love to hear from you. If this Data Engineer role is of interest, apply now or email your CV to me at (url removed)
Snowflake Data Modeller Location: Remote (Mostly remote with some occasional travel to Hemel Hempstead) Contract: Outside IR35 Day rate: Up to £550 per day Duration: 6 months Start date: ASAP Key skills: Snowflake, DBT, SQL, Python, AWS and Kimball The Client who are in the process of migrating to SnowFlake therefore require extra support. As a result, they require someone from a strong SQL & Python development background with excellent working knowledge of Data Build Tool (DBT). You will be undertaking aspects of the development life cycle and be experienced in data modelling, process design, development, and testing. And whilst this company is going through a large-scale migration, this will present you with an opportunity to be at the cutting edge of data engineering. YOUR SKILLS AND EXPERIENCE A successful Senior Data Engineer here will have experience in the following: - Advanced SQL knowledge - SnowFlake (ideally certified) - Python development - AWS cloud experience essential, relating to data tooling and development - Working knowledge of Data Build Tool (DBT). o Develop staging, intermediate and marts in DBT to achieve analytics requirements o Optimize existing models to make it more reusable by following DBT best practices o Spot opportunities for the models to be incremental over full refresh o Organize sources and document sources in DBT o Develop DBT macros for most frequently repeated tasks - Knowledge of Continuous Integration and Continuous Deployment (CI/CD) - Development experience in one or more object-oriented programming languages (eg Python) - Ability to work with senior stakeholders across multiple verticals
Oct 03, 2025
Contractor
Snowflake Data Modeller Location: Remote (Mostly remote with some occasional travel to Hemel Hempstead) Contract: Outside IR35 Day rate: Up to £550 per day Duration: 6 months Start date: ASAP Key skills: Snowflake, DBT, SQL, Python, AWS and Kimball The Client who are in the process of migrating to SnowFlake therefore require extra support. As a result, they require someone from a strong SQL & Python development background with excellent working knowledge of Data Build Tool (DBT). You will be undertaking aspects of the development life cycle and be experienced in data modelling, process design, development, and testing. And whilst this company is going through a large-scale migration, this will present you with an opportunity to be at the cutting edge of data engineering. YOUR SKILLS AND EXPERIENCE A successful Senior Data Engineer here will have experience in the following: - Advanced SQL knowledge - SnowFlake (ideally certified) - Python development - AWS cloud experience essential, relating to data tooling and development - Working knowledge of Data Build Tool (DBT). o Develop staging, intermediate and marts in DBT to achieve analytics requirements o Optimize existing models to make it more reusable by following DBT best practices o Spot opportunities for the models to be incremental over full refresh o Organize sources and document sources in DBT o Develop DBT macros for most frequently repeated tasks - Knowledge of Continuous Integration and Continuous Deployment (CI/CD) - Development experience in one or more object-oriented programming languages (eg Python) - Ability to work with senior stakeholders across multiple verticals
About Scrumconnect Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK's most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. Role Overview We are seeking an experienced Senior Data Engineer to develop, maintain, and optimise data products and a Strategic Data Platform. You will be part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of scalable data solutions. The role requires strong technical expertise in Azure data tools, SQL, Python, and modern engineering practices, with a focus on migration, data governance, and advanced analytics capabilities. Key Responsibilities Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse. Manage the end-to-end data development life cycle within Agile delivery teams. Integrate and automate workflows into Azure DevOps pipelines. Create and maintain dimension data models and semantic models for Power BI integration. Develop advanced dashboards, visualisations, and reporting solutions using Power BI. Implement data governance, quality checks, and profiling to ensure accuracy and compliance. Lead the migration of Legacy data capabilities to modern Azure-based platforms. Apply dbt with SQL databases for data transformation, modelling, and workflow optimisation. Collaborate with stakeholders to translate business requirements into robust technical solutions. Coach and mentor team members, fostering best practices in data engineering. Essential Skills & Experience Active SC Clearance (mandatory at application stage). Proven expertise in: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure ecosystem Power BI (including semantic models) Python (incl. PySpark) and advanced SQL dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Strong experience with both structured and unstructured data. Delivery track record in Agile environments. Business analysis skills to capture and translate service needs into technical solutions. Proven success in Legacy migration projects within complex organisations. Excellent communication and collaboration skills across technical and non-technical teams. Desirable Azure certifications (Data Engineer, Data Scientist, or related). Knowledge of GDPR compliance, data security, and governance best practices.
Oct 01, 2025
Contractor
About Scrumconnect Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK's most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. Role Overview We are seeking an experienced Senior Data Engineer to develop, maintain, and optimise data products and a Strategic Data Platform. You will be part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of scalable data solutions. The role requires strong technical expertise in Azure data tools, SQL, Python, and modern engineering practices, with a focus on migration, data governance, and advanced analytics capabilities. Key Responsibilities Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse. Manage the end-to-end data development life cycle within Agile delivery teams. Integrate and automate workflows into Azure DevOps pipelines. Create and maintain dimension data models and semantic models for Power BI integration. Develop advanced dashboards, visualisations, and reporting solutions using Power BI. Implement data governance, quality checks, and profiling to ensure accuracy and compliance. Lead the migration of Legacy data capabilities to modern Azure-based platforms. Apply dbt with SQL databases for data transformation, modelling, and workflow optimisation. Collaborate with stakeholders to translate business requirements into robust technical solutions. Coach and mentor team members, fostering best practices in data engineering. Essential Skills & Experience Active SC Clearance (mandatory at application stage). Proven expertise in: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure ecosystem Power BI (including semantic models) Python (incl. PySpark) and advanced SQL dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Strong experience with both structured and unstructured data. Delivery track record in Agile environments. Business analysis skills to capture and translate service needs into technical solutions. Proven success in Legacy migration projects within complex organisations. Excellent communication and collaboration skills across technical and non-technical teams. Desirable Azure certifications (Data Engineer, Data Scientist, or related). Knowledge of GDPR compliance, data security, and governance best practices.
