AI SCORE 8.5

Data Scientist - Big Data Engineer Remote

$90K–$120K/year

About the Role

We're hiring a Data Scientist - Big Data Engineer Remote to join our innovative team at Connect Tech+Talent. This is an exciting opportunity to work remotely and contribute to cutting-edge projects in the field of big data and analytics.

What You'll Do

  • Implement ETL/ELT workflows for both structured and unstructured data, ensuring efficient data processing.
  • Automate deployments using CI/CD tools to streamline operations and enhance productivity.
  • Collaborate with cross-functional teams, including data scientists, analysts, and stakeholders, to drive data-driven decisions.
  • Design and maintain data models, schemas, and database structures to support analytical and operational use cases.
  • Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses.
  • Implement data validation and quality checks to ensure accuracy and consistency in data processing.
  • Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging.
  • Implement data security measures, including encryption, access controls, and auditing, ensuring compliance with regulations and best practices.

Requirements

  • 4+ years of experience in data science and big data engineering.
  • Proficiency in Python and R programming languages.
  • Strong SQL querying and data manipulation skills.
  • Experience with Azure cloud platform and Databricks.
  • Hands-on experience with Apache Spark architecture, RDDs, DataFrames, and Spark SQL.
  • Experience with DevOps, CI/CD pipelines, and version control systems.
  • Strong troubleshooting and debugging capabilities.
  • Ability to work in agile, multicultural environments.

Nice to Have

  • Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow).
  • Databricks Certified Associate Developer for Apache Spark.
  • Azure Data Engineer Associate certification.

What We Offer

  • Competitive salary ranging from $90,000 to $120,000 per year.
  • Fully remote work environment with flexible hours.
  • Opportunity to work on innovative projects in big data and analytics.
  • Collaborative and inclusive company culture.
  • Professional development opportunities and access to training resources.
  • Health benefits and wellness programs.
Why This Job8.5 of 10

This Data Scientist - Big Data Engineer Remote role offers a competitive salary and the chance to work on innovative big data projects.

Salary Range
Required
0/1
Optional
0/1
Bonus
0/1

Who Will Succeed Here

Proficient in Python and R for data manipulation and analysis, with hands-on experience in using Apache Spark for processing large datasets in cloud environments like Azure.

Self-motivated and disciplined, capable of managing time effectively in a remote work setting, ensuring timely delivery of projects while collaborating with cross-functional teams.

Demonstrates a strong DevOps mindset, with practical experience in CI/CD pipelines and version control systems like Git, to automate and streamline data workflows.

Learning Resources

Python for Data Science Handbookguide

Career Path

Data Scientist - Big Data Engineer Remote(Now)Senior Data Engineer(1-2 years)Lead Data Architect(3-5 years)

Market Overview

Market Size 2024
$60.2B
Annual Growth
23.1%
AI Adoption
50%
Investment
+45%
Labour Demand
+30%
Avg Salary
$120K

Skills & Requirements

Required
PythonRSQL
Growing in Demand
Machine LearningData Visualization (e.g., Tableau, Power BI)Cloud Computing (AWS, GCP)
Declining
R (for general data analysis)Hadoop MapReduce

Domain Trends

Increased Demand for Real-Time Data Processing
With the rise of IoT and real-time analytics, companies are investing heavily in technologies like Apache Spark and Databricks, leading to a 40% increase in job postings for data engineers.
Shift Towards Cloud-Native Data Solutions
More organizations are migrating to cloud platforms, with Azure and AWS seeing a 35% increase in adoption for data storage and processing, emphasizing the need for cloud skills.
Focus on Ethical AI and Data Privacy
As regulations tighten, there’s a growing emphasis on ethical AI practices and data privacy, with 65% of companies prioritizing compliance in their data strategies.

Industry News

Loading latest industry news...

Finding relevant articles from the last 6 months

All job postings are automatically gathered by algorithms. We do not review or verify listings, be careful when applying and do not sign-in with iCloud or Google services.