Job Description
Lead Data Platform Engineer
- Remote (UK-based)
- SC Clearance Required (British Citizen)
- Permanent - Up to £110,000
We are looking for a hands-on Lead Data Platform Engineer to join a high-impact programme delivering scalable, Real Time data solutions. This role offers the opportunity to work on complex, mission-critical systems using modern technologies across streaming, cloud, and distributed data platforms.
The Role
As a Lead Data Platform Engineer, you will design and deliver batch and Real Time data pipelines that are highly available, low-latency, and scalable.
You will collaborate with cross-functional teams to shape solutions, influence architecture, and ensure data is transformed into reliable, consumable outputs.
Key Responsibilities
- Design, build, and deploy data pipelines and Back End services
- Work with Real Time streaming technologies and event-driven architectures
- Champion engineering best practices including TDD, CI/CD, and clean code
- Collaborate with architects, analysts, and testers in Agile/BDD environments
- Take ownership of services in production, ensuring performance and reliability
- Drive continuous improvement across data platform capabilities
- Contribute to solution design, estimation, and delivery planning
Required Experience
- Strong production Java experience
- Experience with Kafka, Kinesis, or similar streaming technologies
- Hands-on experience with Spark, Flink, Kafka Streams, or similar
- Experience with Spring Boot and/or Python
- Strong experience with AWS (including Lambda and S3)
- Experience integrating with PostgreSQL, Redis, or similar
- Solid understanding of data pipelines and data modelling
- Passion for clean, testable, and maintainable code
- Experience working in Agile and/or DevOps environments
Desirable Skills
- Experience with Elasticsearch, OpenSearch, or Solr
- Familiarity with Terraform, Ansible, or Packer
- Experience with CI/CD tools such as Jenkins or Drone
If you are interested, please apply or get in touch to discuss further.
