Missing candles in OHLCV data: how to detect gaps and backfill them safely
Detect missing candles in OHLCV bar data with a UTC grid and a trading calendar, then backfill safely without forward-filling volume or range.
Tag · pandas
pandas
15 posts on pandas from the SiftingIO market data blog, spanning real-time and historical coverage across stocks, forex, crypto, commodities, and on-chain venues.
Posts tagged pandas
Cursor pagination for market data APIs: pull years of 1-minute OHLCV bars without gaps
How cursor pagination works on the SiftingIO bars endpoint: 1,000 bars per page, about 99 requests per ticker-year of 1-minute data, and a gap-checked Python loop.
Economic calendar API: pull macro events as JSON and join each release to its price bar
Pull US economic calendar events (CPI, NFP, FOMC) as JSON and join each release to the one-minute OHLCV bar that was open when it hit, using the real field names.
When does the weekly candle open and close? Weekly bar boundaries by asset class
Weekly candle open and close times for forex, crypto, and US stocks, and how to rebuild either week convention from timestamped SiftingIO bars in pandas.
Insider trading data API: pull Form 4 buys, sells, and grants for US stocks
Pull Form 4 insider transactions for US stocks from a REST API, decode transaction codes P, S, M, and F, and separate open-market buys from routine noise.
Intraday stock data for student research: how Quantitative Trading at Brown uses the SiftingIO API
How Quantitative Trading at Brown uses intraday US equities OHLCV bars from the SiftingIO API for student research on returns, volatility, and trading volume.
TA-Lib installation error? Get RSI and MACD readings from an API instead
TA-Lib won't install? Skip the C compile and numpy version matrix: pull RSI, MACD, and moving average readings from two REST endpoints with plain requests.
1-minute OHLCV data: how to resample minute bars into 5m, 15m, and 1h
1-minute OHLCV bars are the base timeframe. The exact rules for resampling minute bars into 5m, 15m, and 1h bars, with the alignment and gap traps to avoid.
Why two backtests of the same strategy disagree: the historical price data faults to check first
Five ways historical price data silently corrupts a backtest: adjustment method, venue-dependent highs and lows, gap policy, session cuts, and restated bars.
Insider trading data API: pull SEC Form 4 transactions for a stock watchlist
Pull SEC Form 4 insider transactions for a stock watchlist with Python: decode transaction codes, paginate the API, and build a screening table with pandas.
Aligning economic calendar events with your backtest's bar timeline
How to pull scheduled US economic events from one endpoint and align them with OHLCV bars so a backtest knows when CPI, NFP, and FOMC actually hit.
yfinance rate limited: migrating Python price pulls to a keyed market data API
yfinance rate limited or throwing Too Many Requests? A call-for-call map to move daily history, intraday bars, and latest-price pulls to a keyed API in Python.
How to Get Real-Time Forex Prices in Python
Get real-time forex prices in Python: a requests call for a snapshot, a websockets feed for live updates, the official siftingio SDK with sync and async clients, and buffering ticks into a pandas DataFrame.
Tracking institutional position changes across 13F filings
How to diff 13F-HR holdings between reporting cycles using SiftingIO, find new positions, exits, and meaningful size changes.
Aligning economic calendar events with your backtest's bar timeline
How to pull scheduled US economic events from one endpoint and align them with OHLCV bars so a backtest knows when CPI, NFP, and FOMC actually hit.