Join to apply for the Data Engineering Principal role at BT Group

Join to apply for the Data Engineering Principal role at BT Group

Leading inclusively and Safely

I inspire and build trust through self-awareness, honesty and integrity.

Recruiter: Daniel McCarthy

Career Grade: C

Internal Closing Date: 20/8/25

The Skills You’ll Need

DevOps

Data Storage

Data Engineering

Data Integration

Data Architecture

Programming/Scripting

Data Quality

Big Data Processing

Cloud Computing

Performance Monitoring

Agile Methodologies

Data Management

Data Acquisition

Data Risk

Data Model Management

Talent Management

Decision Making

Growth Mindset

Performance Management

Inclusive Leadership

Our leadership standards

Looking in:

Leading inclusively and Safely

I inspire and build trust through self-awareness, honesty and integrity.

Owning outcomes

I take the right decisions that benefit the broader organisation.

Looking out:

Delivering for the customer

I execute brilliantly on clear priorities that add value to our customers and the wider business.

Commercially savvy

I demonstrate strong commercial focus, bringing an external perspective to decision-making.

Looking to the future:

Growth mindset

I experiment and identify opportunities for growth for both myself and the organisation.

Building for the future

I build diverse future-ready teams where all individuals can be at their best.

With over 175 years of heritage, BT is now the flagship business brand of BT Group. We’ve brought together our best people and capabilities into a B2B powerhouse serving 1 -2 million business customers internationally.

We’re a global leader for secure connectivity and collaboration platforms for businesses of all shapes and sizes, from big household names and government departments, right through to sole traders and new start-ups. But it’s not just the technology that matters, it’s what it can do to help them build stronger, smarter, more secure businesses.

We value diversity and inclusion and believe in making a positive impact. We connect for good by championing digital inclusion and equipping people, businesses, and communities with digital skills to thrive.

As a member of our team, you will be part of an organisation that celebrates difference, fosters innovation and provides you with opportunities to be your best. With millions of businesses relying on us daily, joining BT means you can be part of a diverse and multi-skilled team that makes a significant impact to society.

Why this job matters

The Data Engineering Principal leads the AWS design, building and implementation of processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning the most complex business needs into the data that supports the DD Ops and BT group’s data strategies. This role involves both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality, scalable, and efficient data infrastructure.

What You’ll Be Doing – Your Accountabilities

• Lead the design and implementation of robust, scalable, and secure data solutions using AWS services such as S3, Glue, Lambda, Redshift, EMR, Kinesis, and more—covering data pipelines, warehousing, and lakehouse architectures.
• Drive the migration of legacy data workflows to Lakehouse architectures, leveraging Apache Iceberg to enable unified analytics and scalable data management.
• Operate as a subject matter expert across multiple data projects, providing strategic guidance on best practices in design, development, and implementation.
• Build and optimise data pipelines for ingestion, transformation, and loading from diverse sources, ensuring high standards of data quality, reliability, and performance.
• Own the development of automation and monitoring frameworks that capture operational KPIs and pipeline health metrics, enabling proactive performance management.
• Identify and resolve performance bottlenecks in data workflows, ensuring optimal resource utilisation and cost-efficiency.
• Collaborate closely with architects, Product Owners, and development teams to decompose solutions into Epics, leading the design and planning of technical components.
• Mentor and coach engineering professionals, fostering a culture of continuous learning, innovation, and technical excellence.
• Champion inclusive and open team culture, leading complex projects autonomously and facilitating high-impact technical discussions.
• Define and manage service level agreements (SLAs) for data products and production processes, ensuring reliability and accountability.
• Develop and optimise data science procedures, including storage strategies using distributed structures, databases, and other scalable technologies.
• Lead the implementation of continuous improvement initiatives, enhancing team processes and delivery capabilities.
• Serve as a trusted advisor to internal stakeholders, including data science and product teams, translating complex technical concepts into actionable solutions.
  
  

• Possess deep technical expertise in data engineering, with a strong command of modern practices and methodologies.
• Recognised as an expert in AWS cloud services, particularly in designing and implementing scalable data engineering solutions.
• Bring extensive experience in software architecture and solution design, ensuring robust and future-proof systems.
• Hold specialised proficiency in Python and Apache Spark, enabling efficient processing of large-scale data workloads.
• Demonstrate the ability to set technical direction, uphold high standards for code quality, and optimise performance in data-intensive environments.
• Adept at using automation tools and CI/CD pipelines to streamline development, testing, and deployment processes.
• An exceptional communicator, capable of translating complex technical concepts for diverse audiences including engineers, product managers, and senior leadership.
• Provide thought leadership within engineering teams, fostering a culture of quality, efficiency, and collaboration
• Experienced in mentoring engineers, guiding them in advanced coding practices, architectural thinking, and strategic problem-solving to elevate team capabilities.
  
  

• Former Principal Engineer with a proven track record of leading teams in best practices across design, development, and implementation. Known for mentoring engineers and cultivating a culture of continuous learning and innovation.
• Extensive background in software architecture and solution design, with deep expertise in microservices, distributed systems, and cloud-native architectures.
• Advanced proficiency in Python and Apache Spark, with a strong focus on ETL data processing and scalable data engineering workflows.
• In-depth technical knowledge of AWS data services, with hands-on experience implementing data pipelines using tools such as EMR, AWS Glue, AWS Lambda, Step Functions, API Gateway, and Athena.
• Proven experience in designing and delivering Lakehouse architectures, enabling unified analytics across structured and unstructured data.
  
  

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Education and Training

• Industries

  Telecommunications

Referrals increase your chances of interviewing at BT Group by 2x

Sign in to set job alerts for “Principal” roles.

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 4 weeks ago

Software Engineer-Full stack (All Levels)

London, England, United Kingdom 1 month ago

London, England, United Kingdom 3 days ago

Graduate Software Developer - Fully Remote

Hertford Heath, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 months ago

London, England, United Kingdom 20 hours ago

London, England, United Kingdom 1 year ago

London, England, United Kingdom 6 months ago

London, England, United Kingdom 1 day ago

Graduate Software Engineer 2025 - Platform

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 3 days ago

London, England, United Kingdom £55,000.00-£75,000.00 1 month ago

London, England, United Kingdom 20 hours ago

London, England, United Kingdom 1 week ago

Graduate Software Engineer 2025 - RegTech

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 4 days ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 2 years ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom $140,000.00-$180,000.00 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom $50,000.00-$200,000.00 8 months ago

London, England, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.