Data Engineer

Responsibilities

• Build and optimize our data pipelines and architectures for ingesting, processing, and storing large volumes of structured and unstructured data from Github.
• Develop and maintain our robust ETL (Extract, Transform, Load) processes to ensure data integrity and consistency.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and schemas.
• Maintaining our data warehousing solutions, utilizing both traditional and emerging database technologies (e.g., Postgres & Clickhouse).
• Develop and maintain data processing workflows using programming languages such as Python and Rust.
• Continuously monitor and optimize data systems for performance, scalability, and reliability.
• Contribute to the development of data quality assurance processes and tools.

Requirements

• 4+ years of experience as a Data Engineer or in a similar role, working with large-scale data pipelines and architectures.
• Bachelor's degree in Computer Science, or a related field
• Strong proficiency in Python and Rust.
• Extensive experience with relational databases (e.g., PostgreSQL, MySQL)
• Familiarity with emerging and big data technologies and frameworks (e.g., Apache Spark, DuckDb, Clickhouse, Hadoop).
• Experience with data warehousing solutions (e.g., Snowflake, AWS Redshift, Google BigQuery).
• Knowledge of data modeling techniques and best practices.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.
• Familiarity with Docker and Kubernetes.

We are even more interested in chatting if you…

• Knowledge of cryptocurrency, blockchain technology, and the crypto ecosystem (e.g., DeFi, NFTs, L1s, L2s).
• Have experience in web scraping (puppeteer, selenium).
• Have experience with React and front-end development.
• Hands-on experience with cryptocurrency transactions and interacting with blockchain networks.

About Us

Electric Capital (www.electriccapital.com) is a top early-stage venture firm investing in cryptocurrencies, blockchain, fintech, and marketplaces. We are based in San Francisco, California with offices in New York City.