Data Scientist - Big Data Engineer Remote
About the Role
We're hiring a Data Scientist - Big Data Engineer Remote to join our innovative team at Connect Tech+Talent. This is an exciting opportunity to work remotely and contribute to cutting-edge projects in the field of big data and analytics.
What You'll Do
- Implement ETL/ELT workflows for both structured and unstructured data, ensuring efficient data processing.
- Automate deployments using CI/CD tools to streamline operations and enhance productivity.
- Collaborate with cross-functional teams, including data scientists, analysts, and stakeholders, to drive data-driven decisions.
- Design and maintain data models, schemas, and database structures to support analytical and operational use cases.
- Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses.
- Implement data validation and quality checks to ensure accuracy and consistency in data processing.
- Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging.
- Implement data security measures, including encryption, access controls, and auditing, ensuring compliance with regulations and best practices.
Requirements
- 4+ years of experience in data science and big data engineering.
- Proficiency in Python and R programming languages.
- Strong SQL querying and data manipulation skills.
- Experience with Azure cloud platform and Databricks.
- Hands-on experience with Apache Spark architecture, RDDs, DataFrames, and Spark SQL.
- Experience with DevOps, CI/CD pipelines, and version control systems.
- Strong troubleshooting and debugging capabilities.
- Ability to work in agile, multicultural environments.
Nice to Have
- Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow).
- Databricks Certified Associate Developer for Apache Spark.
- Azure Data Engineer Associate certification.
What We Offer
- Competitive salary ranging from $90,000 to $120,000 per year.
- Fully remote work environment with flexible hours.
- Opportunity to work on innovative projects in big data and analytics.
- Collaborative and inclusive company culture.
- Professional development opportunities and access to training resources.
- Health benefits and wellness programs.
This Data Scientist - Big Data Engineer Remote role offers a competitive salary and the chance to work on innovative big data projects.
Who Will Succeed Here
Proficient in Python and R for data manipulation and analysis, with hands-on experience in using Apache Spark for processing large datasets in cloud environments like Azure.
Self-motivated and disciplined, capable of managing time effectively in a remote work setting, ensuring timely delivery of projects while collaborating with cross-functional teams.
Demonstrates a strong DevOps mindset, with practical experience in CI/CD pipelines and version control systems like Git, to automate and streamline data workflows.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months