These cookies are essential to the functionality of thebigjobsite.com

When you log in to the Internet Site the Company will set a cookie containing a randomly generated unique reference number. This anonymous number allows the Company to identify you. The Company will never store your personal information directly as a cookie. A persistent cookie will be set, persistent cookies are not deleted when you close your browser, and will allow the Internet Site to recognise you on your next visit.

Name	Expiration	Description
ATTBCookie* ATTBUserID ATTB_LinkedUserID	2 years 400 days 1 year	These cookies are used to remember a user’s choice about cookies on thebigjobsite.com. Where users have previously indicated a preference, that user’s preference will be stored in these cookies.
ATTBTracking*	Session	These cookies are used by ATTB to understand user interaction with the website.
last-search search redirect-stage original-keyword	1 day Session 1 hour 1 hour	These cookies are used by thebigjobsite.com to pass search data between our own pages.
datadome	1 year	DataDome is a cybersecurity solution to detect bot activity
jja*	1 days	Used to track if you have seen the Job Alerts prompt and hold settings for your profile. Job Alerts is a service you can subscribe to to receive information about new jobs.

Advanced features of the site use Cookies to provide information you requested and to reduce you having to key in repeated fields.

Name

Expiration

Description

attb-loc

3 months

Stores your location information so that we can pre-populate search fields to find jobs near you.

attb-latest-visit

attb-prev-visit

1 year

1 year

These cookies are used by ATTB to record when a user last visited the website so that we can highlight new content.

Analytic cookies allow the Company to see how the Internet Site is being used. This information forms the basis of future development work, and so enables the Company to continually improve its Internet Site to best suit its users.

Name	Expiration	Description
_ga _gid _gat_gtag_* _ga_JH3TWMTYRK __gads	Typically ranges from session-based (24 hours) to longer-lasting cookies (up to 2 years).	Google Analytics Cookies: Used for tracking and analytics, these cookies collect information about website usage to help understand user behavior. Visitor tracking, session management, and ad performance analysis.
_gcl_au NID DV UULE, EUULE	Typically lasts from a few days to months.	Google Ads / AdSense Cookies: Cookies used for advertisement personalization, conversion tracking, and remarketing by Google Ads. Track ad clicks and impressions, personalize ad content, and measure conversions.
_uetsid _uetvid	Typically lasts from a few days to months.	Microsoft Advertising (Bing Ads): Microsoft's tracking cookies for advertising and user analytics. Track user sessions and unique visitors for remarketing campaigns.
SID SSID SAPISID, APISID SIDCC SOCS AEC	Typically lasts from a few days to months.	Google Account/Authentication Cookies: These cookies are set by Google services (e.g., Gmail, YouTube) to manage user sessions, preferences, and account security. Authentication, session security, and maintaining user preferences.
__secure*	Typically lasts from a few days to months.	Secure Cookies (Potentially Third-Party): Cookies prefixed with __secure* are often used for enhanced security in user sessions or tracking. These are typically first- or third-party cookies, depending on their origin.
MSPTC MUID SRCHD SRCHHPGUSR SRCHUID SRCHUSR USRLOC WLS _EDGE_S _EDGE_V _SS _U ANON	Typically lasts from a few days to months.	These cookies form part of an analytics service that connects data from Bing with actions performed on the website. These cookies allow Bing to serve relevant advertisements to visitors across the Microsoft Bing network
_clck _clsk CLID ANONCHK MR MUID SM	Typically lasts from a few days to months.	Microsoft Clarity: is a cutting-edge behavioral analytics tool that helps us understand user interaction with your website. By using Clarity, we can enhance the user experience.

Would you like to receive notifications about IT & Computers jobs in London?

You have blocked notifications

Oops! You have blocked notifications. Click here for more info

You have blocked notifications, please check your browser settings.

You're currently subscribed to job notifications

Subscribe to notifications

You will no longer receive notifications

CMC Markets Careers

London / Global

Senior Data Engineer

Job Description

Senior Data Engineer – Market Data

We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications.

Key Responsibilities

Build scalable ETL/ELT pipelines for batch and streaming market data.

Develop production-grade Python and SQL solutions.

Ingest, normalise and validate market data, including trades, ticks, Level 1 & 2 quotes, order books, reference data and corporate actions.

Implement automated data quality, reconciliation and monitoring frameworks.

Optimise data storage using Parquet, Arrow and modern data lake technologies.

Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets.

Essential Skills

Strong Python and SQL.

Experience building scalable, production data pipelines.

Expertise with Parquet and modern data storage formats.

Deep understanding of high-frequency market data, including tick data, order books and market data normalisation.

Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events.

Experience with distributed processing (Spark, Polars, Dask, Ray or similar).

Experience with Kafka or similar streaming technologies.

Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar.

Docker, Linux, Git and CI/CD experience.

Highly Desirable

Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar.

Order book reconstruction

Tick-to-bar aggregation

Airflow, Dagster, Prefect or MLflow

Experience supporting quantitative research or trading systems

Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs)

What We're Looking For

The successful candidate will have a strong background in market data engineering with proven experience building reliable, scalable data...

Apply Now

Similar Opportunities

hireful. Careers

London / Global
Senior Data Engineer
- Remote
Harnham - Data & Analytics Recruitment Careers

London / Global
Senior Data Engineer
Tenth Revolution Group Careers

London / Global
Senior Data Engineer
develop

Greater London / Global
Senior Data and AI Engineer
Tata Consultancy Services

London / Global
Senior Data Engineer
ICIS

London / Global
Senior Data Engineer

View all jobs