Methods Business & Digital Technology Ltd

Salary: £40k - £60k Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. What You'll Be Doing as a Data Engineer: Work closely with cross functional teams, translating complex technical concepts into clear, accessible language for non technical audiences Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights Design and implement efficient ETL and ELT pipelines using modern tools such as Python, SQL, and Apache Airflow Build scalable data solutions leveraging cloud platforms and technologies Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting Implement best practices in data governance, security, and compliance to maintain data integrity Ensure data quality through rigorous QA processes, continuously refining and optimising data queries Develop intuitive dashboards that provide actionable insights to stakeholders Monitor and tune solution performance to enhance reliability, speed, and functionality of data systems Stay ahead of industry trends, continuously enhancing your skills with the latest data engineering tools and methodologies Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice Your Impact: Enable business leaders to make informed decisions with confidence through timely, accurate data insights Drive adoption of modern data architectures and platforms Deliver seamless data solutions that enhance user experience Help cultivate a data driven culture within the organisation You Will Demonstrate: Strong proficiency in SQL and Python for handling complex data problems Experience building and optimising ETL/ELT pipelines Hands on experience with Apache Spark (PySpark or Spark SQL) Experience with the Azure data stack Knowledge of workflow orchestration tools like Apache Airflow Experience with containerisation technologies (Docker) Ability to craft efficient and performant queries Proficiency in dimensional modelling techniques Experience with CI/CD pipelines for data solutions Familiarity with test driven development principles applied to data pipeline construction and validation Strong communications skills for translating technical concepts to non technical audiences Business requirements analysis and translation into technical specifications You may also have some of the desirable skills and experience: Experience with data visualisation tools like Power BI or Apache Superset Experience with other cloud data platforms like AWS, GCP or Oracle Experience with modern unified data platforms like Databricks or Microsoft Fabric Familiarity with modern data lakehouse architectures Knowledge of legacy ETL tools like SSIS Experience with Kubernetes for container orchestration Understanding of streaming technologies (Apache Kafka, event based architectures) Software engineering background with SOLID principles understanding Experience with data governance tools Experience with high performance, large scale data systems Familiarity with Agile development methodologies Knowledge of recent innovations in AI/ML and GenAI Defence or Public Sector experience Consultant experience Security Clearance: UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process. Some roles/projects may require Developed Vetting (DV) clearance; while not mandatory, a willingness to obtain DV clearance would be beneficial. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard (BPSS); details of the evidence required to apply may be found on the government website GOV.UK - Government baseline personnel security standard. If you are unable to meet this and any associated criteria, then your employment may be delayed, or rejected. Details of this will be discussed with you at interview. Our Hiring Process At Methods Analytics, we believe in a transparent hiring process. Here's what you can expect: Internal Application Review Initial Phone Screen Technical Interview Collaborative Pair Programming Exercise Final Interview Offer Working at MA Methods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people, sector specific insight, and technical excellence to provide our customers an end to end data service. We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust, and transformative. We value discussion and debate as part of our approach. We will question assumptions, ambition, and process - but do so with respect and humility. We relish difficult problems, and overcome them with innovation, creativity, and technical freedom to help us design optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic, but we strive for interactions that are engaging, informative and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers. We are passionate about our people; we want our colleagues to develop the things they are good at and enjoy. By joining us you can expect Autonomy to develop and grow your skills and experience Be part of exciting project work that is making a difference in society Strong, inspiring, and thought provoking leadership A supportive and collaborative environment As well as this, we offer: Development access to Pluralsight and LinkedIn Learning Wellness 24/7 Confidential employee assistance programme Social office parties, pizza Friday and commitment to charitable causes Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution Life Assurance of 4 times base salary Private Medical Insurance which is non contributory (spouse and dependants included) Worldwide Travel Insurance which is non contributory (spouse and dependants included)