Talantix.io
Lasting Change•28.02.26
AI SCORE 8.5

Lead Data Engineer - Microsoft Fabric Focus

$140K–$180K/year
RemoteAI/Big Data
Python•PySpark•Spark SQL•Delta Lake•T-SQL•Azure Data Factory•Power BI

About the Role

We are seeking a Lead Data Engineer to join our team remotely. In this role, you will play a critical part in designing, building, and managing our enterprise data lakehouse platform, Petra, built on Microsoft Fabric. As a Lead Data Engineer remote, you will ensure the delivery of reliable, high-quality data assets that empower analytics, reporting, and data-driven decision-making across the organization.

What You'll Do

  • Own and manage the organization’s Microsoft Fabric-based data lakehouse, ensuring data reliability and performance.
  • Design, build, and maintain robust ETL/ELT pipelines that curate high-quality datasets.
  • Implement and enforce Medallion Architecture standards (Bronze, Silver, Gold) across the platform.
  • Partner with analysts and stakeholders to deliver robust data products that meet business needs.
  • Develop analytical and dimensional data models optimized for reporting and self-service analytics.
  • Build and maintain Power BI semantic models, reports, and dashboards as required.
  • Design and curate an AI-assisted engineering workflow to enhance development velocity.
  • Lead and mentor contracted data engineers, providing clear architectural and coding standards.

Requirements

  • 7–10+ years of professional experience in data engineering, ETL orchestration, and multi-system data integration.
  • Strong experience with Azure data platforms, particularly Microsoft Fabric.
  • Deep understanding of data lakes, data warehouses, and lakehouse architectures.
  • Expertise in Medallion Architecture design and implementation.
  • High proficiency in Python, PySpark, Spark SQL, Delta Lake, and T-SQL.
  • Experience collaborating with stakeholders to gather requirements and deliver data solutions.
  • Demonstrated use of AI tools to enhance development and code quality.

Nice to Have

  • Experience building and maintaining Power BI reports and semantic models.
  • Microsoft or other cloud platform certifications.
  • Experience leading or mentoring other data engineers.

What We Offer

  • Competitive salary ranging from $140,000 to $180,000 annually.
  • Remote work flexibility, allowing you to work from anywhere.
  • Opportunities for continuous learning and professional growth.
  • Collaborative and innovative work environment.
  • Potential for leadership roles within the data engineering team.
Why This Job8.5 of 10

This Lead Data Engineer position offers a unique opportunity to work remotely on cutting-edge data solutions using Microsoft Fabric. The role emphasizes leadership and innovation in data engineering.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

→

Proficient in Microsoft Fabric technologies, particularly in creating and managing data pipelines using Azure Data Factory and Delta Lake, ensuring efficient data processing and storage.

→

Strong adaptability in a remote work environment, with a self-driven approach to problem-solving and the ability to lead cross-functional teams effectively through digital collaboration tools.

→

Demonstrated experience in architecting data solutions and mentoring junior engineers, showcasing a deep understanding of data engineering principles using Python, PySpark, and Spark SQL.

Learning Resources

→Data Engineering with Python and PySparkcourse
→Azure Data Factory Documentationguide
→Building Data Lakes on Azurearticle

Career Path

Lead Data Engineer - Microsoft Fabric Focus(Now)→Data Engineering Manager(1-2 years)→Director of Data Engineering(3-5 years)

Market Overview

Market Size 2024
$14.2B
Annual Growth
22.5%
AI Adoption
35%
Investment
+150%
Labour Demand
+30%
Avg Salary
$145K

Skills & Requirements

Required
PythonPySparkSpark SQL
Growing in Demand
Machine LearningData Engineering on DatabricksData Visualization with Power BI
Declining
HadoopTraditional ETL tools (e.g., Informatica)

Domain Trends

Rise of Data Mesh Architecture
Organizations are shifting towards data mesh architecture to decentralize data ownership, with 40% of enterprises expected to adopt this model by 2025.
Increased Use of Real-Time Data Processing
The demand for real-time data analytics is growing, with a projected increase of 35% in companies implementing streaming data solutions by 2025.
Integration of AI in Data Engineering
AI tools are increasingly being integrated into data engineering workflows, with 50% of data engineers reporting that AI aids in automating data cleansing and transformation tasks.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.