Position: Senior Data Engineer
The Role: As a Senior Data Engineer, you will play a pivotal role in our team. You will have the unique opportunity to shape the architecture and direction of our data infrastructure. This is not just a job; it's a chance to leave your mark and drive significant change within our organization.
The team will be focused on helping the organisations engineering improve their products as well as helping our customers manage their refrigeration transport business in a more efficient and reliable manner.
The ideal candidate will have a passion for working in white space, creating impact from the ground up, and transforming data driven outcomes into fully scalable and optimized solutions for always-on production environments. You will have extensive experience in data engineering, particularly within the cloud ecosystem (we are on AWS), and will be proficient in Python, SQL, and Linux. You will be responsible for designing, developing, and maintaining our data infrastructure, ensuring data quality, and supporting data-driven decision-making across the organization.
In this role you will have strong opportunities for both technical and personal growth, where you will be empowered to have the freedom to innovate, using data mining and Machine Learning technologies to gather data insights.
Your Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes using open source and AWS services.
- Implement best practices for data management, governance, and security.
- Optimize and scale our data infrastructure to support growing data needs.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance.
- Implement and manage CI/CD pipelines to automate the deployment and testing of data engineering solutions.
- Follow and implement industry best practices to ensure our data infrastructure is reliable, scalable, and secure.
- Develop and maintain documentation for data engineering processes and systems.
- Mentor and provide guidance to other team members
Your Qualifications:
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a related role.
• Strong proficiency in Python and SQL.
• Hands on experience with cloud-based architectures and software stacks
• Deep understanding of large always-on enterprise system architecture
• Proficiency in Linux server environments.
• Experience with containerization technologies such as Docker.
• Excellent problem-solving skills and attention to detail.
• Understanding of data governance and security
• Understanding of infrastructure-as-code
• Experience with monitoring and alerting systems
Important: If you are interested in learning more about this opportunity, please drop me a message, forward your CV using the apply button.
#LI-CF3