Talantix.io
Wave Talent•06.02.26
AI SCORE 8.5

Staff/​Principal Data Engineer - Remote Opportunity

$155K/year
RemoteCybersecurity SaaS
Python•Kafka•Spark•AWS•Apache Iceberg•Data Lake•PostgreSQL

About the Role

We are seeking a Staff/Principal Data Engineer to join our innovative team at Wave Talent. This remote position allows you to work from anywhere in Europe while contributing to cutting-edge cybersecurity solutions. As a key member of our team, you will take ownership of large-scale data systems that power AI-driven vulnerabilities and threat detection.

What You'll Do

  • Architect and build production-grade data pipelines capable of handling massive data volumes with high performance and reliability.
  • Design the data lake architecture, real-time ingestion pipelines, and transformation systems that enable our platform to process security and telemetry data at scale.
  • Collaborate with a team of ~30 professionals in a fast-paced startup environment focused on AI and cybersecurity.
  • Utilize your expertise in Kafka and Spark to ensure efficient data processing.
  • Implement best practices for data storage and management, leveraging AWS data services such as S3 and EMR.

Requirements

  • Strong software engineering background with mastery of Python.
  • Proven experience designing, building, and operating data pipelines that process gigabytes to terabytes of data per day.
  • Extensive experience with complex systems architecture and high proficiency in Kafka and Spark.
  • Deep expertise with AWS data services including S3, EMR, and building data lakes at scale.
  • Production experience with Apache Iceberg or similar lakehouse technologies.

Nice to Have

  • Experience with Temporal.io for workflow orchestration.
  • Familiarity with file formats like Parquet, ORC, or Hudi for optimized data storage.
  • Experience optimizing relational databases (e.g., PostgreSQL, RDS).
  • Previous experience in big tech or rapidly scaling startups.
  • Domain expertise in AI and/or Cyber Security.

What We Offer

  • Competitive salary of up to €155k per year.
  • Equity options valued at up to $450k.
  • Fully remote work with quarterly team gatherings.
  • Opportunity to work in a well-funded startup with $30m+ in funding.
  • Be part of a dynamic team focused on innovative solutions in cybersecurity.
Why This Job8.5 of 10

This role offers a unique opportunity to work in a cutting-edge cybersecurity startup with a competitive salary and equity options. The fully remote setup enhances work-life balance.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

→

Proficiency in building and optimizing data pipelines using Apache Kafka and Spark, with a strong understanding of data lake architecture and management to ensure efficient data flow and storage.

→

Self-motivated with proven experience in remote work environments, demonstrating strong time management skills and the ability to independently solve complex data engineering challenges.

→

Hands-on experience with AWS services, particularly in deploying and managing scalable data solutions, alongside a solid background in PostgreSQL for relational data management.

Learning Resources

→Python for Data Engineeringcourse
→Apache Kafka Documentationguide
→Building Data Lakes on AWSarticle

Career Path

Staff/Principal Data Engineer(Now)→Data Engineering Manager(1-2 years)→Director of Data Engineering(3-5 years)

Market Overview

Market Size 2024
$15.8B
Annual Growth
12.5%
AI Adoption
45%
Investment
+60%
Labour Demand
+20%
Avg Salary
$135K

Skills & Requirements

Required
PythonKafkaSpark
Growing in Demand
Machine LearningData EngineeringCloud Data Warehousing
Declining
Hadoop MapReducejQuery

Domain Trends

Rise of Real-Time Data Processing
With the increasing demand for immediate insights, the real-time data processing market is expected to grow by 25% by 2025, significantly impacting technologies like Kafka and Spark.
Shift Towards Serverless Architectures
Organizations are increasingly adopting serverless architectures on AWS, projected to increase by 30% in 2024, enabling scalable data processing without managing infrastructure.
Growing Importance of Data Governance
As data regulations tighten, 70% of companies are investing in data governance frameworks, highlighting the need for technologies like Apache Iceberg for data management.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.