Senior Software Engineer - Data Platform for Blockchain Analytics
About the Role
We are looking for a Senior Software Engineer - Data Platform to join our remote team at TRM Labs. In this role, you will help build a safer world by providing blockchain analytics and AI solutions that assist law enforcement, financial institutions, and cryptocurrency businesses in detecting and disrupting crypto-related fraud and financial crime. As a Senior Software Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, ultimately working to create a safer financial system for billions of people.
What You'll Do
- Develop highly reliable data services that integrate with dozens of blockchains.
- Build complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
- Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
- Oversee the deployment and monitoring of large database clusters, focusing on performance and high availability.
- Collaborate with data scientists, backend engineers, and product managers to design and implement innovative data models that enhance TRM’s products.
Requirements
- A Bachelor's degree (or equivalent) in Computer Science or a related field.
- 8+ years of hands-on experience in architecting distributed system architecture.
- Exceptional programming skills in Python and proficiency in SQL or SparkSQL.
- In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
- Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
- Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
- Experience deploying and monitoring infrastructure within public cloud platforms using Docker, Terraform, Kubernetes, and Datadog.
- Proven ability in loading, querying, and transforming extensive datasets.
Nice to Have
- Experience with observability tools and dashboards.
- Familiarity with AI and machine learning applications in data processing.
- Knowledge of security protocols and best practices in blockchain technology.
What We Offer
- Competitive salary ranging from $140,000 to $180,000 per year.
- Remote-first work culture with flexible hours.
- Opportunities for professional growth and development.
- Collaborative team environment with a focus on innovation.
- Access to cutting-edge technologies and tools.
This Senior Software Engineer role offers a unique opportunity to work with cutting-edge blockchain technology in a remote-first environment, focusing on impactful projects that enhance security and efficiency.
Who Will Succeed Here
Demonstrated expertise in Python, SQL, and SparkSQL, with a strong understanding of data processing frameworks and libraries, enabling efficient handling of large-scale blockchain data analytics.
Ability to work autonomously in a remote environment, showcasing self-discipline and proactive problem-solving skills, especially when collaborating with cross-functional teams across different time zones.
A strategic mindset with a focus on building scalable data solutions using technologies like Clickhouse, Elasticsearch, and dbt, alongside experience in implementing complex ETL workflows with Airflow.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months