Data Architect
About the Knowledge Center:
The Knowledge Center, located in Gdańsk, is a hub for innovation and develop state-of-the-art business and technology solutions to help us navigate the future. And we want to do that together with you.
Team and Project overview:
We aim to build big data analytics platform for global shipping company - Hapag-Lloyd AG. In Gdańsk we established a Knowledge Center. Within it - Data Management Solutions for Analytics (DMSA). A group of top IT experts, designers and executors, will apply AWS cloud technology in maritime and shipping industry. We are quality-driven, have passion for cloud (especially AWS), analytics and power of positive changes, technology solutions bring to business globally.AWS Data Engineer will work closely with data analysts, data engineers, data scientists and other stakeholders to design and maintain data models.
Responsibilities:
- Designing architecture for our new technology software solutions
- Design secure, scalable, and highly available cloud infrastructure on AWS
- Recommend and assist the cross-functional development team in the automation, improvement, and management of the ETL (Extract, Transform and Load) and ELT (Extract, Load and Transform) work
- Data structure reviews, achieving highest possible system performance by conducting software optimizations
- Continually identifying and implementing improvements through technical debt reduction
- Meeting regulatory compliance standards
Requirements:
- Experience in similar role
- Knowledge of AWS Cloud: EC2, EKS, ECS
- Knowledge of technology: Docker, GitHub, Jenkins, Kubernetes, Spark, Terraform and deploying applications on AWS
- Ability to learn/use a wide variety of open source technologies and tools
Desirable Skills:
- Experience and passion to work in DevOps approach
- Practical knowledge of BI and Data Landscape concepts: data modeling, star-schema, shared nothing, partitioning, data-vault or any other
We offer: