Data Engineer
Electric Capital
Software Engineering, Data Science
Posted on Tuesday, March 26, 2024
Responsibilities
- Build and optimize our data pipelines and architectures for ingesting, processing, and storing large volumes of structured and unstructured data from Github.
- Develop and maintain our robust ETL (Extract, Transform, Load) processes to ensure data integrity and consistency.
- Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and schemas.
- Maintaining our data warehousing solutions, utilizing both traditional and emerging database technologies (e.g., Postgres & Clickhouse).
- Develop and maintain data processing workflows using programming languages such as Python and Rust.
- Continuously monitor and optimize data systems for performance, scalability, and reliability.
- Contribute to the development of data quality assurance processes and tools.
Requirements
- 4+ years of experience as a Data Engineer or in a similar role, working with large-scale data pipelines and architectures.
- Bachelor's degree in Computer Science, or a related field
- Strong proficiency in Python and Rust.
- Extensive experience with relational databases (e.g., PostgreSQL, MySQL)
- Familiarity with emerging and big data technologies and frameworks (e.g., Apache Spark, DuckDb, Clickhouse, Hadoop).
- Experience with data warehousing solutions (e.g., Snowflake, AWS Redshift, Google BigQuery).
- Knowledge of data modeling techniques and best practices.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Familiarity with Docker and Kubernetes.
We are even more interested in chatting if you…
- Knowledge of cryptocurrency, blockchain technology, and the crypto ecosystem (e.g., DeFi, NFTs, L1s, L2s).
- Have experience in web scraping (puppeteer, selenium).
- Have experience with React and front-end development.
- Hands-on experience with cryptocurrency transactions and interacting with blockchain networks.
About Us
Electric Capital (www.electriccapital.com) is a top early-stage venture firm investing in cryptocurrencies, blockchain, fintech, and marketplaces. We are based in San Francisco, California with offices in New York City.