Join our team!
Junior/Mid
Data Engineer
Job Summary
We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining the data architecture of our organization. You will work closely with cross-functional teams to ensure that data is collected, stored, and analyzed in a timely and efficient manner.
Responsibilities
Design and implement scalable and efficient data pipelines that can handle large volumes of data
Build and maintain data infrastructure, including databases and data warehouses
Develop ETL processes to transform raw data into standardised format
Work closely with data scientists to ensure that data is easily accessible and understandable
Develop and maintain data quality standards and processes
Troubleshoot and optimize data pipelines to ensure efficient performance
Keep up-to-date with emerging technologies and incorporate them into our systems
Collaborate with cross-functional teams to identify and prioritize data needs
Requirements
Strong programming skills in Python
Experience in packages such as Pandas or similar packages
Experience with AWS
Familiarity with databases like PostgreSQL and ClickHouse
Familiarity with code versioning tools such as Git
Familiarity with containerization technologies such as Docker
Strong problem-solving and analytical skills
Excellent communication and collaboration skills