Please answer the following questions in order to process your application.
Do you require a work permit/Visa to work in the country of this job? *
File Attachments:
(2MB file maximum. doc, docx, pdf, rtf or txt files only)
* denotes required field
Additional Information:
Availability/Notice
Hourly Rate GBP
Approximately how far are you willing to travel to work (in miles) ?
Key Privacy Information
When you apply for a job, JobServe will collect the information you provide in the application and disclose it to the advertiser of the job.
If the advertiser wishes to contact you they have agreed to use your information following data protection law.
JobServe will keep a copy of the application for 90 days.
More information about our Privacy Policy.
Job Details
Big Data Engineer (OpenSearch/PySpark/Kubernetes) (Contract)
Location: Amsterdam Country: Netherlands Rate: EUR100 per hour
Job Title: Data Engineer (OpenSearch/PySpark/Kubernetes)
Amsterdam - Hybrid - 2 days per week
12 Month Freelance Contract
€100 per hour excl vat
Brookwood is committed to driving innovation through data. We are looking for talented Data Engineers to join our dynamic team and support our migration project from on-premises systems to cloud-based solutions.
Position Overview:
We are seeking two Data Engineers with a strong background in Big Data technologies, particularly PySpark and Kubernetes. The successful candidates will inherit a project focused on migrating data from Hadoop and other on-premises solutions to cloud platforms, specifically AWS and Snowflake. Experience with OpenSearch or ElasticSearch is essential to facilitate efficient data ingestion and management.
Key Responsibilities:
- Participate in the migration of data from on-premises Hadoop systems to AWS and Snowflake.
- Design, develop, and maintain data ingestion pipelines using OpenSearch.
- Collaborate with cross-functional teams to ensure smooth data transition and integration.
- Implement and manage data processing workflows using PySpark and Kubernetes.
- Optimize data storage and retrieval processes to enhance performance and scalability.
- Troubleshoot and resolve data-related issues in a timely manner.
- Document processes and contribute to best practices for data management and migration.
Qualifications:- Experience with OpenSearch or ElasticSearch (years of experience not strictly required).
- Proficiency in Big Data technologies, specifically PySpark.
- Familiarity with Kubernetes for orchestration of containerized applications.
- Knowledge of AWS services and Snowflake is a plus.
- Strong problem-solving skills and the ability to work in a fast-paced environment.
- Excellent communication and collaboration skills.
Preferred Skills:- Experience with data migration projects.
- Understanding of data modelling and data warehousing concepts.
- Familiarity with agile methodologies and DevOps practices.
Posted Date: 17 Oct 2024
Reference: JSBH-10725
Employment Business: Brookwood
Contact: Kalvir Uppal