Data Feed
What Is a Data Feed?
A data feed is a continuous stream of updated data that is delivered to a computer system. In financial markets, it refers to the real-time or delayed transmission of market information such as price quotes, volume, and trade details from exchanges to traders and algorithms.
A data feed is the technological pipeline through which the financial markets speak to the world. Imagine trying to trade a stock without knowing its current price—it would be impossible. The data feed solves this by constantly pushing updates from the exchange's matching engine directly to your trading screen, charting software, or algorithmic trading engine. In the early days of the market, this information was transmitted via ticker tape machines that printed prices on paper strips. Today, it is a high-speed digital stream—often utilizing efficient protocols like FIX (Financial Information eXchange) or binary multicast—that delivers millions of messages per second. A single "tick" in the feed represents a specific event: a trade occurring, a new buy order being placed, a cancellation, or an update to the best available price. Data feeds are categorized by their depth and utility. Level 1 (Top of Book) feeds show the National Best Bid and Offer (NBBO)—the highest price someone is willing to pay and the lowest price someone is willing to sell for. This is essential for basic investing. Level 2 (Market Depth) feeds show the full order book, displaying a list of limit orders waiting to be executed at various price levels. This visibility is vital for day traders to gauge liquidity and identify potential support or resistance levels.
Key Takeaways
- A data feed provides the lifeblood of market information to traders.
- It includes bid/ask quotes, last trade prices, volume, and order book depth.
- Feeds can be real-time (for active trading) or delayed (for analysis/free services).
- Latency (speed) is critical for high-frequency trading (HFT).
- Feeds come from exchanges (e.g., NYSE, NASDAQ) or consolidators (e.g., Bloomberg, Reuters).
- Traders pay subscription fees for high-quality, low-latency feeds.
How Data Feeds Work
The journey of a data feed from the trading pit to your screen involves several high-tech steps: 1. Generation: It starts at the exchange (like the NYSE, CME, or Nasdaq). When a buyer and seller match, or when a new order enters the book, the exchange's matching engine generates a digital record of the event. 2. Processing: The exchange's internal systems timestamp this event with nanosecond precision and format it into a standardized message. 3. Distribution: The message is broadcast via high-speed networks. This can happen over fiber optic cables or even microwave towers for ultra-low latency. The data is sent to data vendors and direct-access clients. 4. Consolidation: Major data vendors (like Bloomberg, Refinitiv, or your brokerage) receive feeds from dozens of exchanges. They aggregate this data, normalize the formats (so a quote from NYSE looks the same as a quote from Nasdaq), and push it out via an API. 5. Consumption: Finally, your trading platform receives the message, decodes it, and updates the number on your screen or plots the new point on your chart. This entire process happens in a fraction of a second.
SIP vs. Direct Feeds
In the U.S. equities market, there is a crucial distinction between the two main types of data feeds: the SIP and Direct Feeds. The SIP (Securities Information Processor) is the public consolidated tape. It aggregates the best bid and offer from all the different exchanges (NYSE, Nasdaq, BATS, etc.) to calculate the National Best Bid and Offer (NBBO). It is the "official" price of a stock. However, because it has to gather data from multiple locations, process it, and then send it out, it is slightly slower. Direct Feeds are proprietary data streams sold directly by individual exchanges to traders. They bypass the consolidation process. A trader with a direct feed from Nasdaq sees a Nasdaq quote microseconds faster than a trader relying on the SIP. This speed advantage allows High-Frequency Traders (HFT) to practice "latency arbitrage"—seeing a price change on one exchange and trading against a slower price on another before the SIP updates. For HFT firms, direct feeds are mandatory; for retail investors, the SIP is more than fast enough.
Latency and Co-Location
For the most demanding traders, the speed of light is too slow. To minimize the time it takes for a data feed to travel from the exchange to their trading server (latency), High-Frequency Trading (HFT) firms practice "co-location." They rent server space directly inside the exchange's data center, placing their computers just feet away from the exchange's matching engine. This eliminates the need for data to travel over miles of fiber optic cable, shaving off precious microseconds. By receiving the data feed slightly faster than the rest of the market (which receives it via the consolidated SIP feed in New Jersey), co-located traders can exploit tiny price discrepancies before anyone else even sees them.
Important Considerations
When selecting a data feed, traders must balance cost, speed, and reliability. Latency: This is the time delay between the event and the reception of data. Low latency is expensive. Unless you are running an automated scalping algorithm, paying thousands for microwave transmission is unnecessary. However, using a delayed feed (often 15 minutes) is dangerous for active trading, as the price you see is not the price you will get. Packet Loss: Data feeds are transmitted over the internet (TCP/IP) or dedicated lines (UDP). In volatile markets, the volume of data can be massive. If the network is congested, "packets" of data can be dropped, causing gaps in your chart or missing quotes. High-quality feeds have redundancy to prevent this. Normalization: Different exchanges use different symbols and formats. A good data feed provider "normalizes" this so you don't have to worry about the technical differences between a CME futures tick and a Nasdaq stock tick.
Real-World Example: HFT Arbitrage
An HFT firm trades SPY (S&P 500 ETF) on NYSE and ES (S&P 500 Futures) on CME. These two instruments are highly correlated.
FAQs
No. You cannot trade blind. Even if you use a "free" trading app, there is a data feed running in the background powering the prices you see. The quality, speed, and reliability of that feed, however, may be inferior to professional paid feeds.
A tick is the minimum price movement of a trading instrument. In the context of data feeds, a "tick data" stream records every single transaction, no matter how small. "OHLC data" (Open, High, Low, Close) aggregates these ticks into time bars (e.g., 1-minute candles) to reduce bandwidth and noise.
Exchanges invest heavily in the infrastructure (servers, networks, data centers) to generate and distribute this data reliably and quickly. They license this intellectual property to vendors and brokers, who pass the cost to you. Exchanges classify users as "professional" or "non-professional," with professionals paying significantly higher rates.
In the US stock market, the Consolidated Tape Association (CTA) oversees the SIP (Securities Information Processor). This is the single, unified feed that aggregates the best bid and offer from all registered exchanges to create the NBBO. It ensures transparency so investors know they are getting the best available price.
Historical data (past prices) is stored by data vendors. You can download it for backtesting strategies. While real-time data is for execution, historical data is for research. Some feeds provide both, allowing you to "replay" the market.
The Bottom Line
The data feed is the nervous system of the financial markets. It connects the beating heart of the exchange matching engine to the brains of traders and algorithms worldwide. Whether you are a long-term investor checking a closing price or a high-frequency algorithm parsing microseconds, the accuracy, speed, and depth of your data feed determine your view of market reality. In modern finance, data is not just information; it is the raw material of profit, and the quality of your feed can be the difference between a winning trade and a missed opportunity.
More in Market Data & Tools
At a Glance
Key Takeaways
- A data feed provides the lifeblood of market information to traders.
- It includes bid/ask quotes, last trade prices, volume, and order book depth.
- Feeds can be real-time (for active trading) or delayed (for analysis/free services).
- Latency (speed) is critical for high-frequency trading (HFT).