Senior Software Engineer - Big Data & Data Lake Remote
About the Role
We are excited to announce an opening for a Senior Software Engineer (Big Data, Data Lake) remote position at Foureyes. As a remote-first company headquartered in Oregon, we focus on leveraging data-driven AI to revolutionize the automotive industry. You will play a crucial role in designing and implementing our core data platform, which is essential for our next-generation product architecture.
What You'll Do
- Design and implement scalable data ingestion, transformation, and integration across various internal and external data sources using AWS-native services.
- Establish a robust data lake and transformation layer that supports our APIs, microservices, and downstream analytics.
- Collaborate with cross-functional teams, including product, engineering, and analytics, to ensure data availability, reliability, and performance.
- Translate business requirements into system design and architecture diagrams, ensuring clear communication with diverse audiences.
- Utilize strong problem-solving skills and knowledge of applied algorithms to efficiently address real-world challenges.
- Participate in on-call rotations to address complex problems in real-time, ensuring services remain operational and highly available.
Requirements
- 7-10 years of professional experience in software development, particularly with big data and data-rich applications.
- 5+ years of experience working in an AWS cloud-native environment.
- Strong hands-on experience with AWS data services such as S3, Glue, Athena, and Lambda.
- Expertise in designing and optimizing data pipelines for high-volume ingestion of structured and semi-structured data.
- Experience with data cleansing, quality checks, and anomaly detection.
- Proficient in developing back-end distributed systems and data pipelines using Python, Pyspark, and SQL.
- Excellent communication skills for presenting complex concepts clearly to various stakeholders.
Nice to Have
- Prior experience in data-rich SaaS products.
- Familiarity with data governance concepts and deployment experience using AWS CDK or CI/CD.
- Exposure to generative AI or LLM-based data exploration tools.
What We Offer
- Competitive salary and health benefits for eligible full-time employees.
- 401k matching and a subsidy for internet or cell phone expenses.
- Generous PTO days, including paid holidays to honor your heritage or culture.
- Half Day Summer Fridays to promote work-life balance.
- A commitment to diversity, equity, and inclusion in our workplace culture.
- Opportunities for professional growth and development in a fast-paced, team-driven environment.
Join Foureyes as a Senior Software Engineer focusing on Big Data and Data Lake. Enjoy a competitive salary, remote work flexibility, and a commitment to diversity.
Who Will Succeed Here
Proficient in AWS services such as S3, Glue, and EMR, with a strong background in designing scalable data lakes and pipelines that can handle large volumes of data efficiently.
Self-motivated and comfortable working in a fully remote environment, demonstrating the ability to manage time effectively and collaborate with cross-functional teams across different time zones.
Deep understanding of ETL processes and data engineering principles, with hands-on experience in Python and PySpark for data transformation and manipulation, ensuring data integrity and accessibility.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months