Senior Azure Data Factory Application Developer - Remote
About the Role
We are looking for a Senior Azure Data Factory Application Developer to join our dynamic team remotely. In this role, you will design and build Azure data pipelines and data platforms, ensuring performance, security, and reliability of data workloads. You will work on exciting analytics and AI/ML use cases using Azure services.
What You'll Do
- Design and develop pipelines in Azure Data Factory (ADF) for data ingestion from multiple sources.
- Manage data lake structure in Azure Data Lake Storage (ADLS Gen2) and ensure proper partitioning and file formats.
- Develop PySpark/Spark SQL notebooks in Azure Databricks for scalable data transformations.
- Build and manage analytics solutions using Azure Synapse Analytics, supporting performance tuning for queries.
- Create strong data models based on reporting needs and maintain documentation for data mappings.
- Support ML use cases with data preparation and feature pipelines using Azure Machine Learning.
- Write optimized SQL and clean Python code for automation and data processing tasks.
- Implement security best practices for data access and storage, ensuring compliance with client policies.
Requirements
- 4+ years of experience as an Azure Data Engineer with strong hands-on experience in Azure Data Factory (ADF).
- Proficiency in Azure Data Lake Storage (ADLS Gen2) and Azure Databricks.
- Strong SQL skills for complex queries and troubleshooting.
- Experience with Python scripting and data processing, with exposure to ML being a plus.
- Understanding of data modeling and ETL processes.
- Experience integrating multiple Azure services for end-to-end data flow.
Nice to Have
- Familiarity with Power BI for dashboards and performance basics.
- Basic knowledge of Azure Functions or Logic Apps for automation.
- Understanding of big data technologies like Hadoop and Spark.
- Experience with Agile/Scrum methodologies.
- CI/CD exposure for data deployments using Azure DevOps.
What We Offer
- Competitive salary ranging from $120,000 to $150,000 annually.
- Flexible remote work environment.
- Opportunities for professional growth and development.
- Access to the latest tools and technologies in cloud data engineering.
- Supportive team culture with a focus on collaboration and innovation.
This role offers a unique opportunity to work with cutting-edge Azure technologies in a fully remote setting, providing excellent salary and growth potential.
Who Will Succeed Here
Extensive experience with Azure Data Factory, including hands-on knowledge of pipeline orchestration and integration with Azure Databricks and Azure Synapse Analytics to build robust data workflows.
Strong problem-solving mindset and self-motivated, with the ability to work independently in a remote environment while managing multiple projects and meeting deadlines.
Proficient in SQL and Python, with a solid understanding of data modeling and ETL processes, allowing for effective data transformation and analytics tailored to business needs.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months