Senior Data Engineer - Microsoft Fabric We're looking for an experienced Senior Data Engineer to join a growing team building a modern Microsoft Fabric data platform . This is a hands-on role designing and delivering scalable data pipelines, Lakehouse solutions, and analytics models within the Azure ecosystem . What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance Leverage AI-assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric & Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack What's on Offer: Salary: 70,000 Excellent benefits & annual leave package Strong progression & development opportunities Opportunity to work on a modern, AI-enabled data platform Real ownership and influence in a growing, forward-thinking data team If you're an experienced Data Engineer with solid Microsoft Fabric and Azure experience, we'd love to hear from you!
Apr 18, 2026
Full time
Senior Data Engineer - Microsoft Fabric We're looking for an experienced Senior Data Engineer to join a growing team building a modern Microsoft Fabric data platform . This is a hands-on role designing and delivering scalable data pipelines, Lakehouse solutions, and analytics models within the Azure ecosystem . What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance Leverage AI-assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric & Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack What's on Offer: Salary: 70,000 Excellent benefits & annual leave package Strong progression & development opportunities Opportunity to work on a modern, AI-enabled data platform Real ownership and influence in a growing, forward-thinking data team If you're an experienced Data Engineer with solid Microsoft Fabric and Azure experience, we'd love to hear from you!
Senior Data Engineer - Anti-Fraud Technology Location: Manchester or London (Hybrid, 3 days per week onsite) Contract: 12 months Rate : up to £600 p/d (DOE) Join a forward-thinking cybersecurity and fraud prevention team working at the cutting edge of technology. This role offers the opportunity to design and build innovative data solutions that help detect and prevent financial crime, protecting hundreds of thousands of users across the UK and Europe. As a Senior Data Engineer, you will design and implement robust, scalable data pipelines that power real-time analytics and critical decision-making systems. You'll work across the full data lifecycle, building ELT pipelines from source to presentation, while ensuring high standards of code quality, testing, and documentation. You'll collaborate closely with cross-functional teams including developers, product owners, and scrum masters, contributing to solution design and continuous improvement of engineering practices. The role also involves owning deployments across environments and supporting systems in production. Key skills and experience: Strong experience as a Data Engineer Advanced Python and SQL skills Experience with cloud platforms (AWS preferred) Proficiency in PySpark and/or Pandas Familiarity with data quality tools (e.g., Great Expectations) Experience with infrastructure as code (Terraform or CloudFormation) Understanding of modern development best practices and agile methodologies Experience with graph databases is a plus but not essential. This is an excellent opportunity for someone who enjoys solving complex problems, building future-proof solutions, and continuously developing both technical and interpersonal skills within a collaborative, agile environment. Please apply today to be considered McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.
Apr 08, 2026
Contractor
Senior Data Engineer - Anti-Fraud Technology Location: Manchester or London (Hybrid, 3 days per week onsite) Contract: 12 months Rate : up to £600 p/d (DOE) Join a forward-thinking cybersecurity and fraud prevention team working at the cutting edge of technology. This role offers the opportunity to design and build innovative data solutions that help detect and prevent financial crime, protecting hundreds of thousands of users across the UK and Europe. As a Senior Data Engineer, you will design and implement robust, scalable data pipelines that power real-time analytics and critical decision-making systems. You'll work across the full data lifecycle, building ELT pipelines from source to presentation, while ensuring high standards of code quality, testing, and documentation. You'll collaborate closely with cross-functional teams including developers, product owners, and scrum masters, contributing to solution design and continuous improvement of engineering practices. The role also involves owning deployments across environments and supporting systems in production. Key skills and experience: Strong experience as a Data Engineer Advanced Python and SQL skills Experience with cloud platforms (AWS preferred) Proficiency in PySpark and/or Pandas Familiarity with data quality tools (e.g., Great Expectations) Experience with infrastructure as code (Terraform or CloudFormation) Understanding of modern development best practices and agile methodologies Experience with graph databases is a plus but not essential. This is an excellent opportunity for someone who enjoys solving complex problems, building future-proof solutions, and continuously developing both technical and interpersonal skills within a collaborative, agile environment. Please apply today to be considered McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.
Senior AWS Data Engineer - London - 125,000 Please note - this role will require you to work from the London based office. You must have the unrestricted right to work in the UK to be eligible for this role. This organisation is not able to offer sponsorship. An exciting opportunity to join a greenfield initiative focused on transforming how market data is accessed and utilised. As a Senior AWS Data Engineer, you'll play a key role in designing and building a cutting-edge data platform using technologies like Databricks, Snowflake, and AWS Glue. Key Responsibilities: Build and maintain scalable data pipelines, warehouses, and lakes. Design secure, high-performance data architectures. Develop processing and analysis algorithms for complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and analysis. Deep understanding of data governance, quality, and security. Knowledge of market data and its business applications. Desirable Experience: Experience with Databricks and Snowflake. Familiarity with machine learning and data science concepts. Strategic thinking and ability to influence cross-functional teams. This role offers the chance to work across multiple business areas, solve complex data challenges, and contribute to long-term strategic goals. You'll be empowered to lead, collaborate, and innovate in a dynamic environment. To apply for this role please submit your CV or contact David Airey on (phone number removed) or at (url removed). Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
Oct 06, 2025
Full time
Senior AWS Data Engineer - London - 125,000 Please note - this role will require you to work from the London based office. You must have the unrestricted right to work in the UK to be eligible for this role. This organisation is not able to offer sponsorship. An exciting opportunity to join a greenfield initiative focused on transforming how market data is accessed and utilised. As a Senior AWS Data Engineer, you'll play a key role in designing and building a cutting-edge data platform using technologies like Databricks, Snowflake, and AWS Glue. Key Responsibilities: Build and maintain scalable data pipelines, warehouses, and lakes. Design secure, high-performance data architectures. Develop processing and analysis algorithms for complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and analysis. Deep understanding of data governance, quality, and security. Knowledge of market data and its business applications. Desirable Experience: Experience with Databricks and Snowflake. Familiarity with machine learning and data science concepts. Strategic thinking and ability to influence cross-functional teams. This role offers the chance to work across multiple business areas, solve complex data challenges, and contribute to long-term strategic goals. You'll be empowered to lead, collaborate, and innovate in a dynamic environment. To apply for this role please submit your CV or contact David Airey on (phone number removed) or at (url removed). Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.
AWS Data Engineer - VP Level Location: London (Canary Wharf) Salary: (phone number removed) - (phone number removed) A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities: Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies. Implement robust data governance, quality, and security practices. Collaborate with data scientists to deploy machine learning models. Lead or contribute to strategic planning, risk management, and stakeholder engagement. Drive innovation through advanced analytics and research-based problem solving. To be successful you should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing and analysis using Python and SQL. Experience with data governance, data quality, and data security best practices. Strong knowledge of market data and its applications. Some other highly valued skills may include: Experience with other data engineering tools and technologies. Knowledge of machine learning and data science concepts. Familiarity with Barclays' data strategy and practices. Please send me your CV is you meet these requirements and we can then arrange call
Oct 06, 2025
Full time
AWS Data Engineer - VP Level Location: London (Canary Wharf) Salary: (phone number removed) - (phone number removed) A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities: Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies. Implement robust data governance, quality, and security practices. Collaborate with data scientists to deploy machine learning models. Lead or contribute to strategic planning, risk management, and stakeholder engagement. Drive innovation through advanced analytics and research-based problem solving. To be successful you should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing and analysis using Python and SQL. Experience with data governance, data quality, and data security best practices. Strong knowledge of market data and its applications. Some other highly valued skills may include: Experience with other data engineering tools and technologies. Knowledge of machine learning and data science concepts. Familiarity with Barclays' data strategy and practices. Please send me your CV is you meet these requirements and we can then arrange call
Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with hands-on expertise in Python, T-SQL, and PySpark. Your leadership and mentoring skills will be key, alongside your ability to collaborate across teams and drive strategic decisions. Essential Skills Include: Proven leadership and mentoring experience in senior data engineering roles Expertise in Azure Data Factory, Azure Databricks, and lakehouse architecture Strong programming skills (Python, T-SQL, PySpark) and test-driven development Deep understanding of data security, compliance, and tools like Microsoft Purview Excellent communication and stakeholder management skills Experience with containerisation and orchestration (eg, Kubernetes, Azure Container Instances) would be desirable AI/ML integration within data platforms would be advantageous What you'll get in return You'll be part of a dynamic and inclusive team, working on cutting-edge data solutions that make a real impact. The organisation offers a competitive salary up to £81K, excellent benefits including 8% cash payment on top of the salary, bonus scheme, and opportunities for professional development. You'll also enjoy flexible working arrangements, generous annual leave, public sector pension and a supportive environment that values innovation and collaboration. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.
Oct 06, 2025
Full time
Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with hands-on expertise in Python, T-SQL, and PySpark. Your leadership and mentoring skills will be key, alongside your ability to collaborate across teams and drive strategic decisions. Essential Skills Include: Proven leadership and mentoring experience in senior data engineering roles Expertise in Azure Data Factory, Azure Databricks, and lakehouse architecture Strong programming skills (Python, T-SQL, PySpark) and test-driven development Deep understanding of data security, compliance, and tools like Microsoft Purview Excellent communication and stakeholder management skills Experience with containerisation and orchestration (eg, Kubernetes, Azure Container Instances) would be desirable AI/ML integration within data platforms would be advantageous What you'll get in return You'll be part of a dynamic and inclusive team, working on cutting-edge data solutions that make a real impact. The organisation offers a competitive salary up to £81K, excellent benefits including 8% cash payment on top of the salary, bonus scheme, and opportunities for professional development. You'll also enjoy flexible working arrangements, generous annual leave, public sector pension and a supportive environment that values innovation and collaboration. What you need to do now If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found on our website.
About Scrumconnect Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK's most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. Role Overview We are seeking an experienced Senior Data Engineer to develop, maintain, and optimise data products and a Strategic Data Platform. You will be part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of scalable data solutions. The role requires strong technical expertise in Azure data tools, SQL, Python, and modern engineering practices, with a focus on migration, data governance, and advanced analytics capabilities. Key Responsibilities Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse. Manage the end-to-end data development life cycle within Agile delivery teams. Integrate and automate workflows into Azure DevOps pipelines. Create and maintain dimension data models and semantic models for Power BI integration. Develop advanced dashboards, visualisations, and reporting solutions using Power BI. Implement data governance, quality checks, and profiling to ensure accuracy and compliance. Lead the migration of Legacy data capabilities to modern Azure-based platforms. Apply dbt with SQL databases for data transformation, modelling, and workflow optimisation. Collaborate with stakeholders to translate business requirements into robust technical solutions. Coach and mentor team members, fostering best practices in data engineering. Essential Skills & Experience Active SC Clearance (mandatory at application stage). Proven expertise in: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure ecosystem Power BI (including semantic models) Python (incl. PySpark) and advanced SQL dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Strong experience with both structured and unstructured data. Delivery track record in Agile environments. Business analysis skills to capture and translate service needs into technical solutions. Proven success in Legacy migration projects within complex organisations. Excellent communication and collaboration skills across technical and non-technical teams. Desirable Azure certifications (Data Engineer, Data Scientist, or related). Knowledge of GDPR compliance, data security, and governance best practices.
Oct 01, 2025
Contractor
About Scrumconnect Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK's most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. Role Overview We are seeking an experienced Senior Data Engineer to develop, maintain, and optimise data products and a Strategic Data Platform. You will be part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of scalable data solutions. The role requires strong technical expertise in Azure data tools, SQL, Python, and modern engineering practices, with a focus on migration, data governance, and advanced analytics capabilities. Key Responsibilities Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse. Manage the end-to-end data development life cycle within Agile delivery teams. Integrate and automate workflows into Azure DevOps pipelines. Create and maintain dimension data models and semantic models for Power BI integration. Develop advanced dashboards, visualisations, and reporting solutions using Power BI. Implement data governance, quality checks, and profiling to ensure accuracy and compliance. Lead the migration of Legacy data capabilities to modern Azure-based platforms. Apply dbt with SQL databases for data transformation, modelling, and workflow optimisation. Collaborate with stakeholders to translate business requirements into robust technical solutions. Coach and mentor team members, fostering best practices in data engineering. Essential Skills & Experience Active SC Clearance (mandatory at application stage). Proven expertise in: Azure Data Factory & Azure Synapse Azure DevOps & Microsoft Azure ecosystem Power BI (including semantic models) Python (incl. PySpark) and advanced SQL dbt with SQL DBs (data transformation & modelling) Dimension data modelling Terraform for infrastructure-as-code deployments Strong experience with both structured and unstructured data. Delivery track record in Agile environments. Business analysis skills to capture and translate service needs into technical solutions. Proven success in Legacy migration projects within complex organisations. Excellent communication and collaboration skills across technical and non-technical teams. Desirable Azure certifications (Data Engineer, Data Scientist, or related). Knowledge of GDPR compliance, data security, and governance best practices.
