Roman Yavnikov
d1337eae2c
* feat: add CanonicalDataDownloaderDecorator for chain support Introduced CanonicalDataDownloaderDecorator to enable automatic resolution and parallel downloading of all contracts for canonical symbols (options and futures chains). Updated Program.cs and DownloaderDataProvider to use this decorator, ensuring seamless data retrieval for both canonical and non-canonical symbols. Refactored initialization logic to handle chain providers within the decorator and removed redundant code from Program.cs. * feat: improve canonical symbol error handling in data downloader * refactor: data downloader selection in DownloaderDataProvider * refactor: CanonicalDataDownloaderDecorator construction * feat: limit parallelism and improve contract data error handling * refactor: canonical data downloader and provider usage * remove: CanonicalNotSupportedException and refactor handling * refactor: data downloader selection with selector class Introduce DataDownloaderSelector to choose the correct IDataDownloader implementation based on data type, using CanonicalDataDownloaderDecorator only when needed. Update Program.cs and DownloaderDataProvider to use the selector, remove redundant initialization logic, and ensure proper resource disposal. This improves flexibility, correctness, and resource management for data downloads, especially for custom and canonical data types. * fix: wrong selector condition * refactor: change default log handler; add parallelism config to downloader - Set ConsoleLogHandler as the default log handler in code and config - Make contract download parallelism configurable via downloader-thread-count (default 4) - Track and log number of processed contracts in CanonicalDataDownloaderDecorator - Add error logging for missing universe data - Improve logging clarity and code readability * feat: prevent duplicate contract downloads in canonical chains Introduce ContractDownloadParameters to uniquely identify contract/tick type/resolution combinations and cache them in CanonicalDataDownloaderDecorator, avoiding redundant downloads when contracts are shared across canonical symbol chains. Add date range optimization for contract downloads and unit tests for the new class. * Revert "feat: prevent duplicate contract downloads in canonical chains" This reverts commit 44386c4c788904531c473c60c2a173e2354561ec. * feat: clamp contract date ranges, deduplicate downloads Added AdjustDateRangeForContract to CanonicalDataDownloaderDecorator to clamp start/end dates based on contract expiry and security type. Introduced _contractsCache to prevent duplicate downloads across canonical chains and _processedContracts for logging. Updated contract retrieval logic for deduplication. Added NUnit tests to verify date range adjustments for futures and options. * refactor: canonical contract date range adjustment logic * test:feat: add test for non-option/future contract date adjustment * feat: make look-back periods for canonical symbols configurable * refactor: remove Lazy from CanonicalDataDownloaderDecorator Revert "refactor: remove Lazy from CanonicalDataDownloaderDecorator" This reverts commit 909c1299406688a19352273f8d0b5b3ea99c0fb9. refactor: Inject IMapFileProvider into downloader selectors Revert "refactor: Inject IMapFileProvider into downloader selectors" This reverts commit 0add95269809680e425bfa6080e465bf16377e56. Reapply "refactor: remove Lazy from CanonicalDataDownloaderDecorator" This reverts commit 9e3c4bed078868a3c8dfedcab0e52d6dced1daad. * refactor: data downloader dependency injection * refactor: provider initialization in data downloader classes * refactor: DataDownloaderSelector dependencies, add tests - Require explicit IDataProvider in DataDownloaderSelector constructor, removing default and fallback logic - Change default log handler to ConsoleLogHandler in Program.cs - Pass DownloaderDataProvider as IDataProvider to DataDownloaderSelector - Add DataDownloaderSelector unit tests to verify correct downloader selection and decorator usage * feat: ensure factorFileProvider is initialized when defaulted * fix: missed dataProvider in DataDownloaderSelector ctor * refactor: improve IFactorFileProvider resolution in DataDownloaderSelector
21 lines
613 B
JSON
21 lines
613 B
JSON
{
|
|
"map-file-provider": "LocalDiskMapFileProvider",
|
|
"data-provider": "DefaultDataProvider",
|
|
"log-handler": "ConsoleLogHandler",
|
|
"factor-file-provider": "LocalDiskFactorFileProvider",
|
|
|
|
// The root directory of the data folder for this application
|
|
"data-folder": "../../../Data/",
|
|
|
|
// To get your api access token go to quantconnect.com/account
|
|
"job-user-id": "0",
|
|
"api-access-token": "",
|
|
"job-organization-id": "",
|
|
|
|
// Data downloader provider
|
|
"data-downloader": "",
|
|
|
|
// Specifies the name of the brokerage service used for data downloading (optional).
|
|
"data-downloader-brokerage": ""
|
|
}
|