Data Engineer x2
4mth contract - Hybrid working
212pd Inside IR35
Must be eligible for SC clearanceWe are looking for talented Data Engineers to join our team. In this role, you will focus on building robust, scalable data solutions and Python-based software that our production team can integrate into their operations. You'll be responsible for managing our Python codebase, creating intuitive user interfaces, and connecting to cloud databases, helping to ensure our systems remain efficient and safe.
You'll have a passion for combining data engineering principles with software development to create data products that enhance our ability to process, store, and retrieve information across various platforms. You will work closely with a multidisciplinary team of developers, engineers, and production staff, ensuring the smooth and efficient development and deployment of solutions.
KEY RESPONSIBILITIES
Design, develop, and maintain ETL pipelines and data processing workflows to manage and manipulate datasets, ensuring data quality, consistency, and accuracy.
Create intuitive and user-friendly interfaces for internal production teams, making sure that all software products are highly usable and meet the users? requirements.
Manage and enhance the Python codebase used for both data processing and user interface functionality, ensuring clean, maintainable, and well-documented code.
Build and maintain scalable, secure, and efficient cloud-based solutions, including designing database schemas and managing data flows.
Implement software development best practices, including version control (Git), continuous integration, testing, and deployment (CI/CD).
Troubleshoot and optimise existing data pipelines and software, ensuring performance improvements and resilience in production environments.
Collaborate with data scientists, analysts, and other teams to ensure efficient data integration, storage, and processing, and the transfer of appropriate data engineering knowledge.
ESSENTIAL SKILLS AND EXPERIENCEProficiency in Python, including experience with data manipulation libraries (Pandas).
Experience in designing, developing, and maintaining ETL pipelines and data flows in a cloud-based environment.
Understanding of relational databases, including experience with database design, query optimisation, and data warehousing.
Ability to create intuitive, user-friendly interfaces.
Excellent troubleshooting, problem-solving, and debugging skills.
Strong understanding of software testing, including unit testing, integration testing, and performance testing.
- SmartSourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all.
