Lead Data Platform Engineer, Perm, Remote

Lead Data Platform Engineer

Java, Kafka, AWS

Remote (UK-based)

Permanent - Up to £110,000 + Benefits

For this role, you must be eligible for SC Clearance. In this secure environment this means that you must be a British Citizen as some data is for UK Eyes Only.

We are looking for a hands-on Lead Data Platform Engineer to join a high-impact programme delivering scalable, Real Time data solutions. This role offers the opportunity to work on complex, mission-critical systems using modern technologies across streaming, cloud, and distributed data platforms.

The Role

As a Lead Data Platform Engineer, you will design and deliver batch and Real Time data pipelines that are highly available, low latency, and scalable.

You will collaborate with cross-functional teams to shape solutions, influence architecture, and ensure data is transformed into reliable, consumable outputs.

Key Responsibilities

• Design, build, and deploy data pipelines and Back End services
• Work with Real Time streaming technologies and event-driven architectures
• Champion engineering best practices including TDD, CI/CD, and clean code
• Collaborate with architects, analysts, and testers in Agile/BDD environments
• Take ownership of services in production, ensuring performance and reliability
• Drive continuous improvement across data platform capabilities
• Contribute to solution design, estimation, and delivery planning

Required Experience

• Strong production Java experience
• Experience with Kafka streaming technologies
• Hands-on experience with Spark, Flink, Kafka Streams, or similar
• Experience with Spring Boot and/or Python
• Strong experience with AWS (including Lambda and S3)
• Experience integrating with PostgreSQL, Redis, or similar
• Solid understanding of data pipelines and data modelling
• Passion for clean, testable, and maintainable code
• Experience working in Agile and/or DevOps environments

Desirable Skills

• Experience with Elasticsearch, OpenSearch, or Solr
• Familiarity with Terraform, Ansible, or Packer
• Experience with CI/CD tools such as Jenkins or Drone

This role is working for an SME who build and integrate highly secure data platforms across highly secure environments. The company are about 300 people strong, UK based and highly focused on the UK Government and national infrastructure. You will work alongside them, using your skills to build and implement their Data tools and services within critical Government clients.

You will work alongside internal experts and clients, side by side in integrated teams.

The client are a great place to work, super talented people and great benefits. You will work fully remotely (within the UK for security reasons) and will have flexibility and great benefits.

If this is of interest, please apply