Market Data Engineer (Domain Trading Expertise Required)
Barcelona, Catalonia, Spain · Remote Solely
Senior
Company Description BHFT is a proprietary algorithmic trading firm. Our team manages the full trading cycle, from software development to creating and coding strategies and algorithms. Our trading operations cover key ex…
Skills: Data Engineering, Apache Iceberg, Python, Rust, Airflow
Company Description BHFT is a proprietary algorithmic trading firm. Our team manages the full trading cycle, from software development to creating and coding strategies and algorithms. Our trading operations cover key ex…
Skills: Execution Signals, Low-latency Order Book Analysis, Execution Modeling, Python, Rust
Market Data Engineer (Domain Trading Expertise Required)
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Full-time
Health Insurance, Professional Development
Posted 18d ago
~40 hrs/week
Responsibilities
The Data Engineering team is responsible for designing, building, and maintaining the Market Data Platform. This includes capturing and ingesting raw exchange feeds, managing storage and modeling, and ensuring reliability and observability of the data systems.
Requirements
Candidates should have 5+ years of experience building production-grade data systems and expertise in architecting data lakes or lakehouses. Familiarity with market data, network packet capture, and proficiency in Python and Rust are also important.
Full job description
Company Description
BHFT is a proprietary algorithmic trading firm. Our team manages the full trading cycle, from software development to creating and coding strategies and algorithms.
Our trading operations cover key exchanges. The firm trades across a broad range of asset classes, including equities, equity derivatives, options, commodity futures, rates futures, etc. We employ a diverse and growing array of algorithmic trading strategies, utilizing both High- and Medium-Frequency Trading approaches.
We’re a team of 200+ professionals, with a strong emphasis on technology—70% are technical specialists in development, infrastructure, testing, and analytics spheres. The remaining part of the team supports our business operations, such as Risks, Compliance, Legal, Operations and more.
With a strong focus on innovation and performance, BHFT is actively expanding its presence in traditional financial markets. We value a results-driven culture, emphasizing collaboration, transparency, and constant improvement, all while offering the flexibility of remote work and a globally distributed team.
Job Description
The Data Engineering team is responsible for designing, building, and maintaining the Market Data Platform — a lakehouse infrastructure spanning the full path from raw exchange feeds to reliable, petabyte-scale data for research, backtesting, and real-time trading.
Key Responsibilities
Capture & Ingestion. Own the full capture path from wire to lake: decode and normalize raw exchange feeds (pcap, multicast UDP / ITCH / FIX) and vendor sources (OneTick, Refinitiv, Bloomberg, ICE) into a unified canonical model with nanosecond timestamps. Build batch + stream pipelines (Airflow, Spark, dbt) for tick and reference data. Own L2/L3 order-book reconstruction with gap handling. Provide Python and Rust producer SDKs for internal feed handlers.
Storage & Modeling — Apache Iceberg. Own the Iceberg-over-S3 lakehouse: design partitioning, sort orders, and row-group layout for fast scans; manage schema evolution, snapshots, time travel, compaction, and TTL. Maintain reference data as slowly-changing tables with point-in-time correctness for backtests. Drive storage cost optimisation via compaction, tiering, and snapshot expiry.
Tooling & Libraries. Build libraries for schema management, data contracts, validation, and lineage on top of the Iceberg catalog. Develop shared access services (Spark + Polars) so Research, backtesting, and trading share one normalized data layer, including gap detection and pcap-vs-lake reconciliation.
Reliability & Observability. Embed monitoring, alerting, SLAs/SLOs, and CI/CD across capture and pipeline layers on Kubernetes (EKS). Own data-quality dashboards and incident runbooks for the capture fleet.
Collaboration. Partner with Quant Research, Data Science, Backend, and DevOps to translate requirements into platform capabilities and champion market-data engineering best practices.
Qualifications
5+ years building production-grade data systems, with proven expertise architecting and launching data lakes / lakehouses from scratch.
Hands-on experience with Apache Iceberg (or comparable table formats — Delta / Hudi): partitioning, schema evolution, snapshots, compaction, and catalog operations; familiarity with Apache Arrow for zero-copy, columnar in-memory interchange.
Experience with market data and/or network packet capture — decoding pcap, exchange feed protocols (ITCH, FIX/FAST, multicast UDP), order-book reconstruction, and time-series at scale (strong plus; willingness to learn required).
Experience normalizing market data from multiple vendors — e.g. OneTick, Refinitiv/Reuters, Bloomberg, ICE — into a unified schema and symbology (strong plus).
Expert-level Python (incl. Polars and/or PySpark); Rust a strong plus (relevant for high-performance capture/decoding).
Modern orchestration (Airflow) and distributed processing (Apache Spark).
BHFT is a proprietary algorithmic trading firm. Our team manages the full trading cycle, from software development to creating and coding strategies and algorithms. Our trading operations cover key exchanges. The firm trades across a broad range of asset classes, including equities, equity derivatives, options, commodity futures, rates futures, etc. We employ a diverse and growing array of algorithmic trading strategies, utilizing both High-Frequency Trading (HFT) and Medium-Frequency Trading (MFT) approaches. Looking ahead, we are expanding into new markets and products. As a dynamic company, we continuously experiment with new markets, tools, and technologies.
We’ve got a team of 200+ professionals, with a strong emphasis on technology—70% are technical specialists in development, infrastructure, testing, and analytics spheres. The remaining part of the team supports our business operations, such as Risks, Compliance, Legal, Operations and more. Our employees are located all around the world, from the United States to Hong Kong. Although we maintain office spaces, we currently operate as a 100% remote organization. At BHFT, clarity and transparency are at the core of our culture: we value open communication, ensuring that our processes are straightforward.
BHFT is a proprietary algorithmic trading firm. Our team manages the full trading cycle, from software development to creating and coding strategies and algorithms. Our trading operations cover key exchanges. The firm trades across a broad range of asset classes, including equities, equity derivatives, options, commodity futures, rates futures, etc. We employ a diverse and growing array of algorithmic trading strategies, utilizing both High-Frequency Trading (HFT) and Medium-Frequency Trading (MFT) approaches. Looking ahead, we are expanding into new markets and products. As a dynamic company, we continuously experiment with new markets, tools, and technologies.
We’ve got a team of 200+ professionals, with a strong emphasis on technology—70% are technical specialists in development, infrastructure, testing, and analytics spheres. The remaining part of the team supports our business operations, such as Risks, Compliance, Legal, Operations and more. Our employees are located all around the world, from the United States to Hong Kong. Although we maintain office spaces, we currently operate as a 100% remote organization. At BHFT, clarity and transparency are at the core of our culture: we value open communication, ensuring that our processes are straightforward.