Our client is a large UK housing provider managing over 21,000 homes across England. The organisation is currently making significant investment in its data and digital capabilities, including the implementation of a modern Microsoft Fabric based data platform and new CRM technologies to improve services across the business. This role sits at the centre of that transformation, offering the opportunity to help build and lead a brand new data engineering capability within a growing data team. The Role We are seeking a Lead Data Engineer to play a key role in developing a modern data platform while leading and mentoring a small engineering team. Reporting to the Head of Data, you will combine hands on technical delivery with team leadership, helping to design scalable data pipelines, support internal stakeholders, and enable faster insight across the organisation. This is a unique opportunity to shape how data engineering operates within a business that is early in its data maturity journey. Key Responsibilities Leadership & Team Development Lead and grow a new data engineering function Line manage and mentor two data engineers Promote modern engineering practices and tooling Establish data engineering as a core organisational capability Data Platform Development Design, build and maintain scalable data pipelines Contribute to the development of a Microsoft Fabric data platform Work with Lakehouse/medallion architecture Develop ETL/ELT pipelines using PySpark and SQL Ingest and transform data from SQL systems, flat files, and CSV sources Collaboration & Stakeholder Engagement Partner with teams across the organisation to deliver high-value data products Translate technical concepts into clear business language Support the organisation's wider data maturity journey Technical Delivery Deliver data solutions that enable faster time-to-value Support analytics and reporting teams with reliable, well-structured datasets Contribute to data modelling and architectural decisions Technology Stack The current data platform includes: Microsoft Fabric PySpark T-SQL Lakehouse/Medallion architecture Power BI Current workloads are primarily batch-based, with ambitions to move towards streaming capabilities in the future. Essential Skills & Experience Strong background in data engineering Experience building complex data pipelines Strong hands-on experience with PySpark and SQL Experience with Microsoft Fabric, Azure, or modern cloud data platforms Understanding of data modelling and architectural principles Experience mentoring or leading engineers Strong stakeholder engagement and communication skills Desirable Experience Microsoft certifications (eg DP-900 or Azure Data certifications) Experience contributing to data architecture design Exposure to machine learning pipelines Experience working within Agile delivery environments The Ideal Candidate A hands on technical leader Comfortable working in organisations early in their data maturity journey Strong mentoring and coaching capabilities Able to translate technical delivery into clear business value Motivated by the opportunity to build a function from the ground up
Mar 21, 2026
Full time
Our client is a large UK housing provider managing over 21,000 homes across England. The organisation is currently making significant investment in its data and digital capabilities, including the implementation of a modern Microsoft Fabric based data platform and new CRM technologies to improve services across the business. This role sits at the centre of that transformation, offering the opportunity to help build and lead a brand new data engineering capability within a growing data team. The Role We are seeking a Lead Data Engineer to play a key role in developing a modern data platform while leading and mentoring a small engineering team. Reporting to the Head of Data, you will combine hands on technical delivery with team leadership, helping to design scalable data pipelines, support internal stakeholders, and enable faster insight across the organisation. This is a unique opportunity to shape how data engineering operates within a business that is early in its data maturity journey. Key Responsibilities Leadership & Team Development Lead and grow a new data engineering function Line manage and mentor two data engineers Promote modern engineering practices and tooling Establish data engineering as a core organisational capability Data Platform Development Design, build and maintain scalable data pipelines Contribute to the development of a Microsoft Fabric data platform Work with Lakehouse/medallion architecture Develop ETL/ELT pipelines using PySpark and SQL Ingest and transform data from SQL systems, flat files, and CSV sources Collaboration & Stakeholder Engagement Partner with teams across the organisation to deliver high-value data products Translate technical concepts into clear business language Support the organisation's wider data maturity journey Technical Delivery Deliver data solutions that enable faster time-to-value Support analytics and reporting teams with reliable, well-structured datasets Contribute to data modelling and architectural decisions Technology Stack The current data platform includes: Microsoft Fabric PySpark T-SQL Lakehouse/Medallion architecture Power BI Current workloads are primarily batch-based, with ambitions to move towards streaming capabilities in the future. Essential Skills & Experience Strong background in data engineering Experience building complex data pipelines Strong hands-on experience with PySpark and SQL Experience with Microsoft Fabric, Azure, or modern cloud data platforms Understanding of data modelling and architectural principles Experience mentoring or leading engineers Strong stakeholder engagement and communication skills Desirable Experience Microsoft certifications (eg DP-900 or Azure Data certifications) Experience contributing to data architecture design Exposure to machine learning pipelines Experience working within Agile delivery environments The Ideal Candidate A hands on technical leader Comfortable working in organisations early in their data maturity journey Strong mentoring and coaching capabilities Able to translate technical delivery into clear business value Motivated by the opportunity to build a function from the ground up
Are you a hands on Data Engineering leader who loves building high impact data platforms while mentoring and growing teams? We're hiring a Data Engineering Manager to join a fast moving, product focused environment where collaboration is high, decisions are quick, and your work will directly shape real products used by the business. The Role This is a true player coach position, roughly 50% hands on engineering and 50% team leadership. You'll lead a small but growing team of Data Engineers (currently 5, mostly junior), helping them mature technically while remaining deeply involved in building and optimising modern data pipelines on Databricks. The team works in a highly collaborative office environment, enabling rapid delivery and close cross functional teamwork. What You'll Be Doing Leading and mentoring a team of Data Engineers Designing and building scalable data pipelines in Databricks Remaining hands on with Python/PySpark development Working closely with product, Front End, and Back End teams Integrating multiple data sources, including APIs Driving best practice across the data platform Helping shape the future data architecture What We're Looking For Essential: Strong commercial experience with Databricks Advanced Python and PySpark Solid SQL skills Experience building production data pipelines Experience working with API based data ingestion Familiarity with Azure storage connectivity Prior technical leadership or mentoring experience Nice to have: Experience with Dynamics integrations Background in product or startup environments Broader Azure ecosystem exposure Working Pattern Predominantly onsite role Expected 5 days/week initially to embed with the team Increased flexibility likely after initial onboarding Fast paced, highly collaborative office culture Why Join? High impact role in a growing data function Strong investment in people and development Free onsite restaurant (breakfast, lunch & snacks) Fully equipped onsite gym Collaborative, delivery focused culture Opportunity to shape and scale a modern Databricks platform If you are looking for your next exciting opportunity please apply today and I will be in touch!
Mar 17, 2026
Full time
Are you a hands on Data Engineering leader who loves building high impact data platforms while mentoring and growing teams? We're hiring a Data Engineering Manager to join a fast moving, product focused environment where collaboration is high, decisions are quick, and your work will directly shape real products used by the business. The Role This is a true player coach position, roughly 50% hands on engineering and 50% team leadership. You'll lead a small but growing team of Data Engineers (currently 5, mostly junior), helping them mature technically while remaining deeply involved in building and optimising modern data pipelines on Databricks. The team works in a highly collaborative office environment, enabling rapid delivery and close cross functional teamwork. What You'll Be Doing Leading and mentoring a team of Data Engineers Designing and building scalable data pipelines in Databricks Remaining hands on with Python/PySpark development Working closely with product, Front End, and Back End teams Integrating multiple data sources, including APIs Driving best practice across the data platform Helping shape the future data architecture What We're Looking For Essential: Strong commercial experience with Databricks Advanced Python and PySpark Solid SQL skills Experience building production data pipelines Experience working with API based data ingestion Familiarity with Azure storage connectivity Prior technical leadership or mentoring experience Nice to have: Experience with Dynamics integrations Background in product or startup environments Broader Azure ecosystem exposure Working Pattern Predominantly onsite role Expected 5 days/week initially to embed with the team Increased flexibility likely after initial onboarding Fast paced, highly collaborative office culture Why Join? High impact role in a growing data function Strong investment in people and development Free onsite restaurant (breakfast, lunch & snacks) Fully equipped onsite gym Collaborative, delivery focused culture Opportunity to shape and scale a modern Databricks platform If you are looking for your next exciting opportunity please apply today and I will be in touch!