Lead Data Engineer (x2) - London - Permanent - Hybrid

Lead Data Engineer (x2) - London - Permanent - Hybrid

This role requires hybrid working based in Moorgate, London

The salary for this role ranges between £65,000 - £74,000

Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well experienced Lead Data Engineer to come on board to spearhead agile data engineering initiatives, delivering data and insights products. This role involves understanding the business and IT strategy to align technical solutions with desired outcomes, developing APIs and integrations for data transfer between systems, and providing aggregated data solutions.

Key Responsibilities:

• Ability to lead complex data engineering projects
• Design, code, test, and document data applications
• Develop and manage scalable APIs, machine learning endpoints, data integration pipelines, and data storage solutions.
• Shape the information strategy and platform architecture
• Introduce new data engineering tools, frameworks, standards, and processes
• Ensure the application of agreed standards and tools
• Ensure technical solutions support the accessibility, retrievability, security, quality, retention, and ethical handling of data.
• Experience with strategies and design approaches for APIs and data pipelines.
• Experience in designing and implementing data-driven tools and solutions.
• Proficiency in developing scalable APIs in Python using frameworks like FastAPI or Flask.
• Proficiency in developing scalable data pipelines in Spark/Python using tools such as Airflow.
• Experience with SQL, Python, and other Scripting/programming languages
• Experience with diverse data infrastructure and systems, such as PostgreSQL, SQL Server, Azure Data Lakes, Databricks, and Kubernetes.
• Strong stakeholder management and communication skills at varying levels

Interested? Please submit your updated CV to (see below) for immediate consideration.

Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn £250 worth of vouchers!

Crimson is acting as an employment agency regarding this vacancy