Foureyes10.03.26
AI SCORE 8.5

Senior Software Engineer - Big Data & Data Lake Remote

$125K–$150K/year

About the Role

We are excited to announce an opening for a Senior Software Engineer (Big Data, Data Lake) remote position at Foureyes. As a remote-first company headquartered in Oregon, we focus on leveraging data-driven AI to revolutionize the automotive industry. You will play a crucial role in designing and implementing our core data platform, which is essential for our next-generation product architecture.

What You'll Do

  • Design and implement scalable data ingestion, transformation, and integration across various internal and external data sources using AWS-native services.
  • Establish a robust data lake and transformation layer that supports our APIs, microservices, and downstream analytics.
  • Collaborate with cross-functional teams, including product, engineering, and analytics, to ensure data availability, reliability, and performance.
  • Translate business requirements into system design and architecture diagrams, ensuring clear communication with diverse audiences.
  • Utilize strong problem-solving skills and knowledge of applied algorithms to efficiently address real-world challenges.
  • Participate in on-call rotations to address complex problems in real-time, ensuring services remain operational and highly available.

Requirements

  • 7-10 years of professional experience in software development, particularly with big data and data-rich applications.
  • 5+ years of experience working in an AWS cloud-native environment.
  • Strong hands-on experience with AWS data services such as S3, Glue, Athena, and Lambda.
  • Expertise in designing and optimizing data pipelines for high-volume ingestion of structured and semi-structured data.
  • Experience with data cleansing, quality checks, and anomaly detection.
  • Proficient in developing back-end distributed systems and data pipelines using Python, Pyspark, and SQL.
  • Excellent communication skills for presenting complex concepts clearly to various stakeholders.

Nice to Have

  • Prior experience in data-rich SaaS products.
  • Familiarity with data governance concepts and deployment experience using AWS CDK or CI/CD.
  • Exposure to generative AI or LLM-based data exploration tools.

What We Offer

  • Competitive salary and health benefits for eligible full-time employees.
  • 401k matching and a subsidy for internet or cell phone expenses.
  • Generous PTO days, including paid holidays to honor your heritage or culture.
  • Half Day Summer Fridays to promote work-life balance.
  • A commitment to diversity, equity, and inclusion in our workplace culture.
  • Opportunities for professional growth and development in a fast-paced, team-driven environment.
Why This Job8.5 of 10

Join Foureyes as a Senior Software Engineer focusing on Big Data and Data Lake. Enjoy a competitive salary, remote work flexibility, and a commitment to diversity.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

Proficient in AWS services such as S3, Glue, and EMR, with a strong background in designing scalable data lakes and pipelines that can handle large volumes of data efficiently.

Self-motivated and comfortable working in a fully remote environment, demonstrating the ability to manage time effectively and collaborate with cross-functional teams across different time zones.

Deep understanding of ETL processes and data engineering principles, with hands-on experience in Python and PySpark for data transformation and manipulation, ensuring data integrity and accessibility.

Learning Resources

AWS Big Data Blogarticle

Career Path

Senior Software Engineer - Big Data & Data Lake(Now)Lead Data Engineer(1-2 years)Data Engineering Manager(3-5 years)

Market Overview

Market Size 2024
$55B
Annual Growth
22.3%
AI Adoption
45%
Investment
+150%
Labour Demand
+30%
Avg Salary
$135K

Skills & Requirements

Required
AWSPythonPySpark
Growing in Demand
Apache KafkaMachine LearningAWS Lambda
Declining
Hadoop MapReduceOracle PL/SQL

Domain Trends

Increased Adoption of Serverless Architectures
Companies are shifting towards serverless architectures, with a 60% increase in usage of AWS Lambda for data processing tasks.
Rise of Real-Time Data Processing
Real-time data processing is gaining traction, with 70% of organizations planning to implement or upgrade their data pipelines to support real-time analytics.
Growing Importance of Data Governance
Data governance is becoming critical, with 65% of firms reporting that they are investing in tools and processes to ensure data quality and compliance.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.