Senior Data Platform Engineer - Python/AWS for Finance
About the Role
We are seeking a Senior Data Platform Engineer to join our dynamic team in the finance sector. This Senior Data Platform Engineer remote position offers the opportunity to work with cutting-edge technologies such as Python and AWS, while contributing to innovative financial solutions. You will play a crucial role in designing and implementing data pipelines that support our data-driven decision-making processes.
What You'll Do
- Design and develop scalable data pipelines using Python and AWS.
- Implement data integration solutions to support various data sources and formats.
- Collaborate with cross-functional teams to ensure data quality and reliability.
- Utilize Docker and Kubernetes for containerization and orchestration of data services.
- Lead the development of DataOps practices to streamline data workflows.
- Monitor and optimize data processes for performance and efficiency.
- Contribute to the architecture of our data lakehouse and ensure best practices in data warehousing.
- Participate in incident management and site reliability engineering to maintain high availability of data services.
Requirements
- 5+ years of experience as a Data Platform Engineer or similar role.
- Strong proficiency in Python and experience with AWS services.
- Experience with data warehousing solutions and ETL processes.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Knowledge of SQL and data modeling techniques.
- Experience with CI/CD practices and tools.
- Strong problem-solving skills and ability to work independently.
- Excellent communication skills to collaborate with technical and non-technical stakeholders.
Nice to Have
- Experience with Ruby on Rails and React.
- Familiarity with DataOps methodologies.
- Knowledge of distributed systems and transaction-heavy architectures.
What We Offer
- 100% Remote Work with flexibility.
- Highly Competitive USD Pay.
- Paid Time Off policies for well-being.
- Autonomy in managing work time.
- Opportunities to work with Top American Companies.
This Senior Data Platform Engineer role offers a unique opportunity to work remotely in the finance sector, utilizing advanced technologies like Python and AWS. With competitive pay and flexible work arrangements, it's an attractive position for experienced data professionals.
Who Will Succeed Here
Proficient in building scalable ETL processes using Python and AWS services like Lambda, Glue, and S3, ensuring efficient data flow and storage.
Strong experience with container orchestration tools such as Docker and Kubernetes, enabling seamless deployment and management of microservices in a cloud environment.
Deep understanding of financial data structures and compliance requirements, coupled with a proactive mindset to innovate and optimize data warehousing solutions.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months