Files
Jhonathan Abreu 539011274c
Python Virtual Environments / build (push) Has been cancelled
Benchmarks / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
Research Regression Tests / build (push) Has been cancelled
Support extended market hours for futures (#6522)
* Support extended market hours in AddFuture()

* Support extended market hours in AddFutureContract()

* Add C# regression algorithm

* Add Python regression algorithm

* Add regression algorithm for future contracts

* Add regression algorithm checking market hour ranges

* Fixed future regression algorithms to use extended market hours

* Fixed future regression algorithms to use extended market hours

* Fixed future regression algorithms to use extended market hours

* Fixed AddFutureOptionContractFromFutureChainRegressionAlgorithm to use extended market hours

* Update future market hours to include extended in market hours database

* Fixed AddFutureOptionContractDataStreamingRegressionAlgorithm to use extended market hours

* Fixed AddFutureOptionContractFromFutureChainRegressionAlgorithm to use extended market hours

* Fixed AddFutureContractWithContinuousRegressionAlgorithm to use extended market hours

* Fixed BasicTemplateContinuousFutureAlgorithm to use extended market hours

* Fixed BasicTemplateFuturesAlgorithm to use extended market hours

* Fix BasicTemplateFuturesDailyAlgorithm to use extended market hours

* Fixed BasicTemplateFuturesFrameworkAlgorithm to use extended market hours

* Fixed BasicTemplateFuturesHistoryAlgorithm to use extended market hours

* Fixed ContinuousBackMonthRawFutureRegressionAlgorithm to use extended market hours

* Fixed ContinuousFutureBackMonthRegressionAlgorithm to use extended market hours

* Fixed ContinuousFutureHistoryRegressionAlgorithm to use extended market hours

* Fixed ContinuousFutureLimitIfTouchedOrderRegressionAlgorithm to use extended market hours

* Fixed ContinuousFutureRegressionAlgorithm to use extended market hours

* Fixed DelistedFutureLiquidateRegressionAlgorithm to use extended market hours

* Fixed AutomaticIndicatorWarmupDataTypeRegressionAlgorithm to use extended market hours

* Fixed ConsolidateRegressionAlgorithm to use extended market hours

* Fixed DelistingFutureOptionRegressionAlgorithm to use extended market hours

* Fixed EqualWeightingPortfolioConstructionModelFutureRegressionAlgorithm to use extended market hours

* Fixed FutureContractsExtendedMarketHoursRegressionAlgorithm to use extended market hours

* Fixed FutureMarketOpenAndCloseRegressionAlgorithm to use extended market hours

* Fixed FutureMarketOpenConsolidatorRegressionAlgorithm to use extended market hours

* Fixed FutureOptionBuySellCallIntradayRegressionAlgorithm to use extended market hours

* Fixed FutureOptionCallITMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionCallITMGreeksExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionCallOTMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionDailyRegressionAlgorithm to use extended market hours

* Fixed FutureOptionHourlyRegressionAlgorithm to use extended market hours

* Fixed FutureOptionMultipleContractsInDifferentContractMonthsWithSameUnderlyingFutureRegressionAlgorithm to use extended market hours

* Fixed FutureOptionPutITMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionPutOTMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionShortCallITMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionShortCallOTMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionShortPutITMExpiryRegressionAlgorithm to use extended market hours

* Fixed FutureOptionShortPutOTMExpiryRegressionAlgorithm to use extended market hours

* Fixed FuturesAndFuturesOptionsExpiryTimeAndLiquidationRegressionAlgorithm to use extended market hours

* Fixed FuturesExpiredContractRegression to use extended market hours

* Fixed FutureSharingTickerRegressionAlgorithm to use extended market hours

* Fixed HistoryWithDifferentContinuousContractDepthOffsetsRegressionAlgorithm to use extended market hours

* Fixed HistoryWithDifferentDataMappingModeRegressionAlgorithm to use extended market hours

* Fixed HistoryWithDifferentDataNormalizationModeRegressionAlgorithm to use extended market hours

* Fixed LimitOrdersAreFilledAfterHoursForFuturesRegressionAlgorithm to use extended market hours

* Fixed OpenInterestFuturesRegressionAlgorithm to use extended market hours

* Fixed RegisterIndicatorRegressionAlgorithm to use extended market hours

* Fixed SetHoldingsFutureRegressionAlgorithm to use extended market hours

* Fixed WarmupFutureRegressionAlgorithm to use extended market hours

* Fixed AddFutureOptionSingleOptionChainSelectedInUniverseFilterRegressionAlgorithm to use extended market hours

* Fixed AlgorithmHistoryTests to use extended market hours for futures

* Fixed AlgorithmTradingTests to use extended market hours for futures

* Fixed BrokerageSetupHandlerTests to use extended market hours for futures

* Fixed TimeRulesTests to use extended market hours for futures

* Fixed FutureOptionMarginBuyingPowerModelTests to use extended market hours for futures

* Fixed FutureMarginBuyingPowerModelTests to use extended market hours for futures

* Fixed FileSystemDataFeedTests to use extended market hours for futures

* Fixed QuantBookHistoryTests to use extended market hours for futures

* Split BasicTemplateContinuousFutureAlgorithm to have an extended market version

* Fixed FutureMarketOpenAndCloseRegressionAlgorithm to use extended market hours

* Split BasicTemplateFuturesAlgorithm to have an extended market version

* Split BasicTemplateFuturesAlgorithm to have an extended market version

* Split BasicTemplateFuturesFrameworkAlgorithm to have an extended market version

* Split BasicTemplateFuturesHistoryAlgorithm to have an extended market version

* Revert AddFutureContractWithContinuousRegressionAlgorithm

* Revert AddFutureOptionContractDataStreamingRegressionAlgorithm and added data

* Revert AddFutureOptionContractFromFutureChainRegressionAlgorithm

* Revert AddFutureOptionSingleOptionChainSelectedInUniverseFilterRegressionAlgorithm

* Revert ConsolidateRegressionAlgorithm

* Revert Algorithm.CSharp/ContinuousBackMonthRawFutureRegressionAlgorithm.cs

* Revert ContinuousFutureBackMonthRegressionAlgorithm

* Revert ContinuousFutureHistoryRegressionAlgorithm

* Revert ContinuousFutureLimitIfTouchedOrderRegressionAlgorithm

* Revert ContinuousFutureRegressionAlgorithm

* Revert Algorithm.CSharp/DelistedFutureLiquidateRegressionAlgorithm.cs

* Revert EqualWeightingPortfolioConstructionModelFutureRegressionAlgorithm

* Split FutureMarketOpenAndCloseRegressionAlgorithm to have an extended market version

* Split FutureMarketOpenConsolidatorRegressionAlgorithm to have an extended market version

* Revert FutureOptionBuySellCallIntradayRegressionAlgorithm

* Revert FutureOptionCallITMExpiryRegressionAlgorithm

* Revert FutureOptionDailyRegressionAlgorithm

* Revert FutureOptionPutITMExpiryRegressionAlgorithm

* Revert FutureSharingTickerRegressionAlgorithm

* Revert FuturesAndFuturesOptionsExpiryTimeAndLiquidationRegressionAlgorithm

* Revert FuturesExpiredContractRegression

* Revert HistoryWithDifferentContinuousContractDepthOffsetsRegressionAlgorithm

* Revert HistoryWithDifferentDataMappingModeRegressionAlgorithm

* Revert HistoryWithDifferentDataNormalizationModeRegressionAlgorithm

* Revert OpenInterestFuturesRegressionAlgorithm

* Revert RegisterIndicatorRegressionAlgorithm

* Revert SetHoldingsFutureRegressionAlgorithm

* Revert WarmupFutureRegressionAlgorithm

* Revert AutomaticIndicatorWarmupDataTypeRegressionAlgorithm

* Some cleanup

* Address changes request

* Address changes request

* Add more Class III Milk data to fix DelistingFutureOptionDailyRegressionAlgorithm
2022-08-18 10:56:44 -03:00
..
2021-09-28 14:21:07 -03:00
2020-04-28 16:29:54 -03:00

alt tag

LEAN Data Formats / Futures

QuantConnect hosts futures data provided by AlgoSeek. The data contains quotes, trades, and open interest data. You can explore futures data on our website at https://www.quantconnect.com/data/tree/future

The data are stored as compressed ZIP files, each capable of containing a single, or multiple CSV files, depending on the resolution requested.

Futures data can be used with the following Resolutions:

  • Tick
  • Second
  • Minute

The markets we currently support are:

  • CBOT
  • CME
  • NYMEX
  • COMEX
  • CBOE
  • ICE

tickType in this documentation can refer to one of the following:

  • trade
  • quote
  • openinterest

Minute and Second File Format

Second/Minute files are located in the future / market / resolution / symbol folder. The zip file contains multiple csv entries, varying by the symbol's expiration date.

The zip files have the filename format: YYYYMMDD_tickType.zip. The CSV file contained within has the filename: YYYYMMDD_symbol_resolution_tickType_symbolExpirationDate.csv

Second/Minute trade schema and example data is as follows:

Time Open High Low Close Volume
63271000 85.22 85.24 85.21 85.24 126
  • Time - Milliseconds since midnight
  • Open - Opening price
  • High - High price
  • Low - Low price
  • Close - Closing price
  • Volume - Total contracts traded

Second/Minute quote schema and example data is as follows:

Time Bid Open Bid High Bid Low Bid Close Last Bid Size Ask Open Ask High Ask Low Ask Close Last Ask Size
10920000 1666.5 1666.5 1666.25 1666.25 47 1666.75 1666.75 1666.5 1666.5 37
  • Time - Milliseconds since midnight
  • Bid Open - Opening price for the best bid
  • Bid High - Highest recorded bid price
  • Bid Low - Lowest recorded bid price
  • Bid Close - Closing price for the best bid
  • Last Bid Size - Size of best bid at close
  • Ask Open - Opening price for the best ask
  • Ask High - Highest recorded ask price
  • Ask Low - Lowest recorded ask price
  • Ask Close - Closing price for the best ask
  • Last Ask Size - Size of best ask at close

Second/Minute open interest schema and example data is as follows:

Time Open Interest
42660000 2693575
  • Time - Milliseconds since midnight
  • Open Interest - outstanding contracts

Hour and Daily File Format

Hour/Daily files are located in the future / market / resolution folder. The zip file contains only a single entry.

The zip files have the filename format: symbol_tickType.zip. The CSV file contained within has the filename format: symbol_tickType_symbolExpirationDate.csv

Hour/Daily trades schema and example data is as follows:

Time Open High Low Close Volume
20160601 00:00 43.20 43.50 43.10 43.45 513
  • Time - Formatted as YYYYMMDD HH:mm
  • Open - Opening price
  • High - High price
  • Low - Low price
  • Close - Closing price
  • Volume - Total contracts traded

Hour/Daily quote schema and example data is as follows:

Time Bid Open Bid High Bid Low Bid Close Last Bid Size Ask Open Ask High Ask Low Ask Close Last Ask Size
20170719 00:00 583.20 583.40 583.10 583.40 2932 583.21 583.50 583.11 583.44 392

Hour/Daily open interest schema and example data is as follows:

Time Open Interest
20190203 00:00 3902
  • Time - Formatted as YYYYMMDD HH:mm
  • Open Interest - outstanding contracts

Tick File Format

Tick data is stored in the future / market / tick / symbol folder. The zip file contains multiple csv entries, varying by the symbol's expiration date.

The zip files have the filename format: YYYYMMDD_tickType.zip. The CSV files contained within have the filename format: YYYYMMDD_symbol_tick_tickType_symbolExpirationDate.csv

Tick trades schema and example data is as follows:

Time Last Price Quantity Exchange Sale Condition Suspicious
939243 402.01 203 usa null 0
  • Time - Milliseconds since midnight
  • Last Price - Last traded price
  • Quantity - Amount traded
  • Exchange - Where transaction took place
  • Sale Condition - always null, not used
  • Suspicious - Not used, will always be "0"