Senior Big Data Engineer

About the role

GiG is hiring a Senior Big Data Engineer for its Data department in Malta. The role takes ownership of the analysis, design, building and support of major real-time big data projects, while contributing through code reviews, promoting best practices and delivering robust solutions across big data work.

Key responsibilities

• Design, create and maintain ETL processes, data integrations and data pipelines
• Handle large volumes of data and build high-performance services to process, store and analyse big datasets with optimised code
• Maintain data accuracy and reliability by designing and implementing data validation and quality checks tailored to business needs
• Troubleshoot live production systems regularly to ensure smooth operation and quick issue resolution
• Test and implement new technologies and stay up to date with advances relevant to current and future projects

Required profile

• Strong expertise in big data technologies such as Spark, Kafka, NiFi, ClickHouse and big data stores
• Strong understanding of schema design methodologies and data models
• Experience with cloud computing and/or distributed systems

Required skills

• SQL and SQL databases, including extracting large datasets
• Object-oriented programming, ideally Python and/or Java

What we offer

• Career development opportunities
• Hybrid working model
• International health insurance
• Health and wellbeing package (350 EUR per year)
• Birthday day off
• One extra day off per year