About the Role
We are seeking a Senior Data Infrastructure Engineer to join our team remotely. In this role, you will be at the forefront of developing and maintaining our data infrastructure, ensuring the reliability and scalability of our data solutions. Your expertise will contribute significantly to our mission of delivering cutting-edge Spatial Intelligence solutions using 3D LiDAR data.
What You'll Do
- Automate deployment and testing of data pipelines using modern CI/CD practices.
- Implement and manage Infrastructure-as-Code (IaC) for the AWS cloud data platform, ensuring environment consistency.
- Design, implement, and maintain monitoring, alerting, and logging systems to track data quality, pipeline health, and system performance.
- Proactively optimize and tune the data platform for cost, performance, and reliability, ensuring 99.9% uptime.
- Operate and maintain the real-time and historical data layer, supporting the computation of low-latency operational metrics.
- Collaborate closely with 3+ data engineers to standardize operational procedures for data connectors and data lake access.
Requirements
- 5+ years of hands-on experience in a DataOps, Site Reliability Engineer (SRE), or similar operational role for data platforms.
- Expertise in IaC (Terraform or CloudFormation) for deploying AWS data services (S3, Glue, EMR) or Cloud Data Platforms (Snowflake, Databricks).
- Strong experience implementing CI/CD pipelines (e.g., GitLab CI, GitHub Actions) for data applications.
- Proven proficiency with orchestration tools like Airflow, Temporal, or Kubeflow.
- Deep experience with monitoring and logging solutions for data quality and system health.
- Operational knowledge of stream processing technologies (Spark Streaming/Flink).
- Familiarity with ELT tools (dbt) and SQL.
Nice to Have
- Experience with machine learning frameworks.
- Knowledge of data governance and compliance standards.
- Familiarity with data visualization tools.
What We Offer
- Competitive salary and benefits package.
- Flexible remote work environment.
- Opportunities for professional development and career growth.
- Work with a diverse and international team of experts.
- Be part of a pioneering company recognized for its innovation in Spatial Intelligence.
This role offers a unique opportunity to work remotely as a Senior Data Infrastructure Engineer with a leading company in Spatial Intelligence. You'll be part of an innovative team and work on cutting-edge technology.
Generating success profile...
Analyzing job requirements and market data
Loading market overview...
Analyzing market trends and skill demands
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months