Talantix.io
Oowlish Technology•06.03.26
AI SCORE 8.5

Remote Big Data Engineer - AWS & Python Specialist

$90K–$120K/year
RemoteSoftware Development
Python•AWS Glue•AWS Lambda•SQL•GitHub•Infrastructure as Code

About the Role

Join our team as a Remote Big Data Engineer at Oowlish Technology, one of Latin America's rapidly expanding software development companies. In this role, you will collaborate with premier clients from the United States and Europe, contributing to pioneering digital solutions. Our commitment to creating a nurturing work environment is recognized by our certification as a Great Place to Work, where you will have opportunities for professional development, growth, and a chance to make a significant international impact. We offer the convenience of remote work, allowing you to craft a work-life balance that suits your personal and professional needs.

What You'll Do

  • Develop and maintain data processing logic using Python.
  • Build, optimize, and support data pipelines using AWS Glue and Lambda.
  • Write and optimize complex SQL queries for analytics and operational workloads.
  • Support platform reliability and pipeline monitoring.
  • Contribute to CI/CD processes using GitHub and GitHub Actions.
  • Collaborate on infrastructure improvements using Infrastructure-as-Code principles.
  • Troubleshoot and resolve pipeline failures and performance issues.
  • Support data consumption layers used by BI tools.

Requirements

  • 4+ years of experience as a Data Engineer / Big Data Engineer.
  • Strong hands-on Python experience (data processing and application logic).
  • Advanced SQL skills (query optimization, performance tuning).
  • Production experience with AWS Lambda and AWS Glue.
  • Experience working with CI/CD tools (GitHub, GitHub Actions).
  • Familiarity with Snowflake and/or Aurora.
  • Understanding of Infrastructure-as-Code (IaC) concepts.
  • Comfortable working in the ET time zone.

Nice to Have

  • Experience with BI tools (Sigma preferred).
  • Experience with event-driven architectures.
  • Exposure to enterprise-scale data platforms.

What We Offer

  • Home office setup.
  • Competitive compensation based on experience.
  • Career plans to allow for extensive growth in the company.
  • International projects.
  • Oowlish English Program (Technical and Conversational).
  • Oowlish Fitness with Total Pass.
  • Games and competitions.
Language Requirements
EnglishC1
BasicIntermediateAdvancedNative
Why This Job8.5 of 10

This Remote Big Data Engineer position at Oowlish Technology offers a unique opportunity to work with cutting-edge technologies in a supportive environment. With competitive compensation and a focus on professional growth, this role is ideal for tech enthusiasts.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

→

Proficient in AWS services such as AWS Glue and AWS Lambda, with hands-on experience in building data pipelines and managing data workflows to ensure efficient processing and storage of large datasets.

→

Strong understanding of Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation, allowing for seamless deployment and management of cloud resources, which is essential for remote collaboration and efficiency.

→

Analytical mindset with a focus on optimizing SQL queries for performance and scalability, ensuring that data retrieval processes are efficient and can handle large volumes of data typical in big data environments.

Learning Resources

→AWS Glue Documentationguide
→Python for Data Engineeringcourse
→Infrastructure as Code (IaC) with AWS CloudFormationarticle

Career Path

Remote Big Data Engineer - AWS & Python Specialist(Now)→Data Engineering Lead(1-2 years)→Senior Data Architect(3-5 years)

Market Overview

Market Size 2024
$60B
Annual Growth
25.4%
AI Adoption
85%
Investment in Big Data
+40%
Labour Demand for Big Data Engineers
+30%
Avg Salary for Big Data Engineers
$120K

Skills & Requirements

Required
PythonAWS GlueAWS Lambda
Growing in Demand
Apache SparkData WarehousingMachine Learning
Declining
Hadoop MapReduceTraditional ETL Tools

Domain Trends

Rise of Serverless Architectures
The adoption of serverless computing, particularly with AWS Lambda, has increased by 35% among enterprises, allowing for more efficient data processing and cost reduction.
Integration of AI in Data Processing
85% of companies are integrating AI technologies into their big data strategies, enhancing predictive analytics capabilities and operational efficiencies.
Shift to Real-Time Data Processing
There is a growing demand for real-time data processing solutions, with a reported 50% increase in the use of technologies like AWS Glue for streaming data integration.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.