Senior Data Engineer - Real-Time & Distributed Systems (GCP) Remote

About the Role

We are seeking a Senior Data Engineer - Real-Time & Distributed Systems (GCP) Remote to join our innovative team. In this role, you will leverage your expertise in big data technologies and cloud computing to build and optimize real-time data pipelines. As a Senior Data Engineer, you will work with advanced machine learning and AI technologies, contributing to high-impact projects across various industries.

What You'll Do

• Design and implement scalable data pipelines using Google Cloud Platform (GCP) technologies.
• Develop and maintain data processing workflows with Apache Airflow and Google Cloud Composer.
• Utilize Apache Spark and Apache Beam for processing large datasets in real-time.
• Collaborate with data scientists and machine learning engineers to support data-driven decision-making.
• Ensure data quality and integrity through rigorous testing and validation processes.

Requirements

• 5+ years of experience as a Data Engineer, specifically in real-time and distributed systems.
• Proficiency in Python and experience with big data frameworks such as Apache Spark and Airflow.
• Hands-on experience with Google Cloud Platform services, particularly Google Cloud Spanner and Pub/Sub.
• Strong understanding of NoSQL databases and data storage solutions.
• Experience with machine learning concepts and statistical analysis.

Nice to Have

• Familiarity with additional programming languages such as Java, Rust, or Go.
• Experience in blockchain technology and distributed storage solutions.
• Knowledge of data annotation and localization processes.

What We Offer

• Opportunity to work with leading technology companies.
• Access to advanced machine learning and AI technologies.
• Work in a global team with diverse expertise.
• Contribute to high-impact projects across industries.
• Flexible working hours and a supportive remote work environment.