Colton Sellers
ab6027723f
Build & Test Lean / build (push) Has been cancelled
* Use lean data key as param for request * key -> filePath rename and some cleanup * Refactor * Add Organizations Endpoints * Add some organization api wrapper objects * Address namespace issue * Reorganize Api Test into seperate files using one ApiTestBase * Add Organization tests * Use capitalized "API" test namespace to reduce amount of file changes * Add License to test base * Update /data endpoint functions and response objects * Update ApiDataProvider Logic * Handle deserialization of organization products * Simplify converter * Only throw for equity requests when not subscribed to map/factor files * Add missing header * Make arguement exception * Api adjustments * Add Zip factor and map file providers - Common project will now reference Compression project and not the other way round. - Adding Zip FactorFile and MapFile providers * Refactor FactorFileProvider to use DataProvider to fetch files * Use resulting MinimumDate in construction of FactorFile * Nit FactorFile comments and arrangement * Refactor MapFileProviders to use DataProvider for fetching files * Refactor ZipFileProvider * Clean up * Refactor Backtesting Future/Option chain providers to use dataprovider * Fixes for data/ endpoints and test adjustments * Response objects adjustments/cleanups * ApiDateProvider fixes and testing * Add LocalZipFactorFileTests * Update ApiDataProvider download test to verify stream is not null * Implement posting of agreement summary and signed time * Mark all Api related tests as explicit and document details on running * Clarify default token on ApiTestBase * Adjust summary * Update Api responses for QCC, except org products which are sold in USD * Implement cache expiration for zip MapFile and FactorFiles. Adding unit tests * Fix multiple markets for ZipFactorFile provider * Use Symbol as cache key * Api.cs review * Dispose of factorFileStream after reading * Use zip.EntryFileNames * Address a few reviews * Few more fixes * Address Api Review * Add Job Org id to config * Minor tweaks * Compare with invariant culture * Fixes Option Universe selection * ZipEntryNameSubscriptionDataSourceReader will use IDataProvider * Fix research * Fix null reference exception * Make duplicate log debug Co-authored-by: Martin-Molinero <martin@quantconnect.com>
Lean Data ToolBox
Lean Home | Documentation | Download Lean
Introduction
Lean Engine is an open-source algorithmic trading engine built for easy strategy research, backtesting and live trading. We integrate with common data providers and brokerages so you can quickly deploy algorithmic trading strategies.
The ToolBox project is a command line program which wraps over 15 tools.
Usage
Each tool requires a different set of parameters, the only required argument is '--app=', which defines the target tool and is case insensitive.
Help information is available using the '--help' parameter.
Example: --app=YahooDownloader --tickers=SPY,AAPL --resolution=Daily --from-date=yyyyMMdd-HH:mm:ss --to-date=yyyyMMdd-HH:mm:ss
Available downloaders
- '--app='
- GDAXDownloader or GDAXDL
- CryptoiqDownloader or CDL
- DukascopyDownloader or DDL
- FxcmDownloader or FDL
- FxcmVolumeDownload or FVDL
- IBDownloader or IBDL
- KrakenDownloader or KDL
- OandaDownloader or ODL
- QuandlBitfinexDownloader or QBDL
- YahooDownloader or YDL
- IEXDownloader or IEXDL
- BitfinexDownloader or BFXDL
- BinanceDownloader or MBXDL
- PolygonDownloader or PDL
- '--from-date=yyyyMMdd-HH:mm:ss' required
- '--tickers=SPY,AAPL,etc' required, except for QuandlBitfinexDownloader (QBDL)
- '--resolution=Tick/Second/Minute/Hour/Daily/All' required, except for QuandlBitfinexDownloader (QBDL), CryptoiqDownloader (CDL). Case sensitive. Not all downloaders support all resolutions, send empty for more information.
- '--to-date=yyyyMMdd-HH:mm:ss' optional. If not provided 'DateTime.UtcNow' will be used
Available Converters
- '--app='
- AlgoSeekFuturesConverter or ASFC
- '--date=yyyyMMdd' reference date.
- AlgoSeekOptionsConverter or ASOC
- '--date=yyyyMMdd' reference date.
- CoinApiDataConverter or CADC
- '--source-dir=' path to the raw CoinAPI data.
- IVolatilityEquityConverter or IVEC
- '--source-dir=' source archived IVolatility data.
- '--source-meta-dir=' source archived IVolatility meta data.
- '--destination-dir=' directory where Lean Data is located "Lean/Data".
- '--resolution=Minute/Hour/Daily' resolution of your IVolatility data. Case insensitive.
- KaikoDataConverter or KDC
- '--market=' the exchange the data represents.
- '--tick-type=Quote/Trade' the tick type being processed. Case insensitive.
- '--source-dir=' path to the raw Kaiko data.
- NseMarketDataConverter or NMDC
- '--source-dir=' source directory of unzipped NSE data.
- '--destination-dir=' directory where Lean Data is located "Lean/Data".
- QuantQuoteConverter or QQC
- '--source-dir=' directory where your QuantQuote order is extracted.
- '--destination-dir=' directory where Lean Data is located "Lean/Data".
- '--resolution=' resolution of the QuantQuote data.
- AlgoSeekFuturesConverter or ASFC
Other tools
- '--app='
- CoarseUniverseGenerator or CUG