About the Role
We are seeking a Senior Data Engineer to join our team at Arrive Logistics. This Senior Data Engineer remote position is crucial for building and managing the data ecosystem that supports our analytics and data science initiatives. You will work in a collaborative environment, leveraging your expertise to enhance our data capabilities and drive impactful business decisions.
What You’ll Do
- Design, build, and optimize robust, scalable, and reliable data pipelines to ingest and process data from a wide variety of sources.
- Develop and maintain our data warehousing solutions, ensuring data quality and integrity through validation frameworks and monitoring systems.
- Architect and manage cloud-based data infrastructure, particularly in Microsoft Azure.
- Collaborate with data scientists and analysts to understand data requirements and deliver actionable solutions.
- Improve performance and optimize costs of existing data systems and processes.
- Lead and mentor team members, fostering a collaborative environment that drives solutions forward.
- Participate in incident management and define SLAs for our systems.
- Drive team adoption of AI coding agents and ensure best practices are maintained.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field or equivalent professional experience.
- 5+ years of experience in data engineering, with expert proficiency in SQL and strong programming skills in Python.
- Proven experience building and orchestrating data pipelines using dbt and Airflow.
- Hands-on experience developing data solutions in a major cloud environment, preferably Microsoft Azure.
- Solid understanding of BI-tooling integrations with cloud data warehouses, particularly PowerBI.
- Familiarity with event-driven architecture and messaging systems like Kafka.
- Experience with modern cloud data warehouses such as Snowflake or Databricks.
- Knowledge of data security/privacy best practices and role-based access control.
Nice to Have
- Experience with machine learning concepts and frameworks.
- Familiarity with CI/CD and microservice architecture.
- Experience in mentoring junior data engineers.
What We Offer
- Comprehensive benefits package including medical, dental, and vision coverage.
- Matching 401(k) program to invest in your future.
- Casual dress code and a fun, engaging work environment.
- On-site gym and wellness programs to support your health.
- Paid parental leave and relocation assistance for non-local candidates.
- Opportunities for professional development and career advancement.
This Senior Data Engineer position at Arrive Logistics offers a unique opportunity to work in a collaborative environment, build impactful data solutions, and enjoy a comprehensive benefits package.
Who Will Succeed Here
Proficiency in SQL and Python, with hands-on experience in building ETL pipelines using dbt and Airflow to orchestrate data workflows efficiently.
Strong self-motivation and discipline required for a remote work environment, with the ability to manage time effectively and deliver high-quality solutions without direct supervision.
Deep understanding of cloud data solutions, specifically Azure and Snowflake, to architect data storage and processing solutions that meet scalability and performance requirements.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months