DevOps & Infrastructure
About this role
Back to All Positions MID LEVEL £40K-£55K ☁️ CLOUD TECH Data Engineer Build scalable data infrastructure, design efficient pipelines, and support AI/ML initiatives with cutting-edge cloud technologies. Competitive salary £40,000-£55,000 + benefits. Mid Level Remote/London Full-time £40K-£55K Apply Now Ask Questions Technology Stack & Tools Work with industry-leading technologies and tools that power modern data infrastructure and AI/ML systems. Programming Languages Python SQL Scala Java R Bash/Shell Cloud Platforms AWS Azure Google Cloud Snowflake Databricks Redshift Big Data & Processing Apache Spark Apache Kafka Hadoop Apache Airflow Prefect dbt Databases PostgreSQL MongoDB Redis Elasticsearch ClickHouse DynamoDB DevOps & Infrastructure Docker Kubernetes Terraform Jenkins GitLab CI Prometheus Analytics & Visualization Tableau Power BI Grafana Jupyter Apache Superset Looker Example Projects You'll Work On Get hands-on experience with real-world data engineering challenges and cutting-edge technologies. Real-time Analytics Pipeline Build streaming data pipeline processing 1M+ events/hour for real-time customer insights Apache Kafka Apache Spark AWS Kinesis PostgreSQL ML Data Infrastructure Design feature store and data pipeline supporting machine learning model training and inference Python Apache Airflow AWS S3 MLflow Data Lake Architecture Implement scalable data lake solution handling petabytes of structured and unstructured data AWS S3 Apache Spark AWS Glue Athena API Data Integration Develop microservices and APIs for seamless data integration across multiple business systems FastAPI Docker Kubernetes Redis Key Responsibilities Design and implement scalable data pipelines using Python, Apache Spark, and cloud technologies Build and maintain ETL/ELT processes for processing large volumes of structured and unstructured data Develop and optimize data warehouses and data lakes on AWS, Azure, or Google Cloud Platform Create and maintain real-time data streaming solutions using Apache Kafka, Apache Pulsar, and AWS Kinesis Support AI/ML initiatives by preparing and transforming data for machine learning models and analytics Implement data quality monitoring, validation, and governance frameworks across all data systems Collaborate with data scientists and analysts to understand data requirements and optimize query performance Maintain and optimize database systems including PostgreSQL, MongoDB, and distributed databases Develop APIs and microservices for data access and integration with various business applications Monitor system performance, troubleshoot issues, and implement solutions for data infrastructure Create comprehensive documentation for data processes, schemas, and system architectures Implement security best practices and ensure compliance with data protection regulations Participate in code reviews, testing, and deployment processes using CI/CD pipelines Stay current with emerging technologies and recommend improvements to existing data infrastructure Requirements & Qualifications Bachelor's degree in Computer Science, Engineering, Mathematics, or related technical field 2+ years of experience in data engineering, software development, or related technical roles Strong proficiency in Python programming with experience in data manipulation libraries (Pandas, NumPy) Solid understanding of SQL and experience with relational databases (PostgreSQL, MySQL, SQL Server) Experience with cloud platforms (AWS, Azure, or GCP) and their data services Knowledge of big data technologies such as Apache Spark, Hadoop, or similar distributed computing frameworks Familiarity with data pipeline orchestration tools (Apache Airflow, Prefect, or similar) Understanding of data modeling concepts and experience with both SQL and NoSQL databases Experience with version control systems (Git) and collaborative development workflows Strong problem-solving skills and ability to work with large, complex datasets Excellent communication skills and ability to work effectively in cross-functional teams Experience with containerization technologies (Docker, Kubernetes) is a plus Benefits & Perks COMPETITIVE SALARY - £40,000 - £55,000 per annum based on experience PERFORMANCE BONUSES - Annual bonus based on project delivery and team performance FLEXIBLE WORKING - Full remote work with optional London office collaboration LEARNING BUDGET - £2,500 annual budget for courses, certifications, and conferences ☁️ CUTTING-EDGE TECH - Work with latest cloud technologies and data engineering tools COMPREHENSIVE HEALTHCARE - Health, dental, and vision insurance coverage GENEROUS TIME OFF - 25 days annual leave plus bank holidays and wellness days TOP EQUIPMENT - Latest development hardware and premium software licenses CAREER GROWTH - Clear progression path to Senior Data Engineer and Lead roles AI/ML PROJECTS - Direct involvement in machine learning and AI infrastructure projects PROFESSIONAL DEVELOPMENT - Mentorship from senior engineers and technical leaders TEAM CULTURE - Regular team events, hackathons, and knowledge sharing sessions Ready to Build? Join our data engineering team and build the infrastructure that powers AI innovation. Email Application WhatsApp Questions Position Details Level Mid Level Salary Range £40K-£55K Experience 2+ years Work Model Remote/Hybrid Team Size 5-8 engineers Learning Budget £2,500/year Career Progression Data Engineer Senior Data Engineer Lead Data Engineer Head of Data Engineering Other Open Positions AI Marketing Intern Entry Level • Paid Training AI Marketing Expert Senior Level • £45K-£65K Ready to Build the Future of Data? Join our data engineering team and work on cutting-edge projects that power AI and machine learning innovations. How to Apply Email Application Send your resume, GitHub profile, and cover letter to info@devcircle.co.uk Subject: "Application for Data Engineer Position" Technical Questions Have questions about the tech stack, projects, or team structure? Message us on WhatsApp.
What this role is, and what else it is called
Employers in London advertise this kind of work as DevOps Engineer, Senior Platform Engineer, Senior DevOps Engineer and Site Reliability Engineer too, so it is worth searching more than one wording. It is a mid-level DevOps, Platform & SRE role in London, advertised as hybrid, splitting time between home and the office.
About hiring at Devcircle
Devcircle has 1 other live technology role on its careers page, across Data, AI & Machine Learning and DevOps, Platform & SRE. See all Devcircle roles, salaries and stack.
How this role compares to the market
1,965 live UK roles list Python right now, from 584 employers. The median advertised salary is £80,000; 30% are advertised as remote. Browse Python roles.
1,304 live UK roles list Java right now, from 330 employers. The median advertised salary is £90,000; 32% are advertised as remote. Browse Java roles.
London has 4,324 live IT vacancies across 1,366 employers, with a median advertised salary of £70,000. Browse London roles.
Market figures are today's snapshot of live UK roles on employer careers pages; see hiring trends.
Technologies mentioned
Detected on Devcircle's careers page. ProdReady Recruitment lists this vacancy as an aggregator and is not the employer; applications go to the employer's own site. More IT jobs in London.