11060 Commits

Author SHA1 Message Date
Stefano Raggi 1a02fbaae5 Add autorestart for Binance data connections (#5827)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12551 12552 12553
2021-08-05 10:54:50 -03:00
Alexandre Catarino ed835faf35 Change Binance Benchmark to BTCUSDC (#5823)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
`BTCUSD` is not supported by Binance (see Symbol Properties Dabase)
12549
2021-08-04 21:45:03 -03:00
Gerardo Salazar 5ea70e2a89 Adds support for CoinAPI Binance processing (#5819)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12538 12539 12540 12541 12545 12548
2021-08-03 21:17:23 -03:00
Martin-Molinero 2603694263 C# research will pre load all QC dlls (#5820)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12537
2021-08-03 21:14:59 -03:00
Stefano Raggi 4a3a7a44f5 Update Lean Foundation docker files to IBGateway v985 (#5815)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Update Lean Foundation docker files to IBGateway v985

* Add apt-get update for ARM foundation

* Update default value of IB gateway

Co-authored-by: Martin-Molinero <martin@quantconnect.com>
12534
2021-08-03 19:13:38 -03:00
Martin-Molinero 76c930a035 Update readme.md
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12525
2021-08-03 11:47:27 -03:00
Martin-Molinero 12f70aab46 Add DataSource place holder (#5817) 2021-08-03 11:30:12 -03:00
Gerardo Salazar 650ce2e2b5 Removes References To Built-in Custom Data Implementations (#5793)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* WIP removal of custom data references & tests updates

* Regression algos updated and python algorithms moved to DataSource repos

* Fixes failing unit tests

* Add "LiveDataTypes" field to LiveNodePacket

* Adds Initialize() to IDataChannelProvider

  * Adds new extension method to convert
    HistoryRequest -> SubscriptionDataConfig

* Address review: Add protobuf definitions for Iconic data types

* Address review: re-adds DynamicSecurityDataAlgorithm as regression algo

  * Small adjustments to variable naming and documentation

* Move test files to respective DataSource repos
12520 12524 12518
2021-08-02 19:24:45 -03:00
Martin-Molinero ef4fea7592 Fix engine initialization (#5814)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12502 12508 12509
2021-07-30 17:33:03 -07:00
Martin-Molinero 3cf9cc7d41 Update RestSharp to 106.12.0t (#5810)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12495 12496 12497
2021-07-30 17:45:59 -03:00
Colton Sellers a9b634b096 Pandas Dataframe indexing w/ list (#5813)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Wrap df.__getitem__ to map all keys before indexing

* Add reproducing test case
12492 12494
2021-07-30 16:34:03 -03:00
Stefano Raggi 1793add749 Add support for IBGateway v985 (#5812)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Add support for IBGateway v985

- Effective in TWS version 985 and later, for US stocks the bid, ask, and last size quotes are shown in shares (not in lots).

* Add missing error log in IB symbol mapper

* Trigger build
12490
2021-07-30 13:55:26 -03:00
Martin-Molinero 41636c94c3 Common engine initialization (#5809)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
- Create Lean common engine initialization class, which will be called
  by research and Lean launcher
- Fix backtest deserialization bug due to failing to handle decimal
  value
12477 12488 12489
2021-07-29 21:14:17 -03:00
Stefano Raggi 2624b8c6f5 Update IBAutomater to v2.0.43 (#5807)
* Update IBAutomater to v2.0.42

* Update IBAutomater to v2.0.43
2021-07-29 20:53:38 -03:00
Colton Sellers d8a86f182f Pandas Remapper Refactor (#5808)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Refactor pandas mapper to support newer versions

* Clean up remapper

* Finalize deprecated tests and adjust those that should apply to new pandas

* Move mapper to its own file

* Add supporting Py tests and setup instructions

* Add license
12474
2021-07-29 20:10:00 -03:00
Martin-Molinero 0da9d626dc Remove security from all universes holdings it (#5798)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- Calling RemoveSecurity() will remove the security from all the
  universes holdings it, there was a race condition here where it would
  just take the first universe and remove it from it.
  Adding regression test adding and removing an option contract and it's underlying
12451
2021-07-28 18:03:09 -03:00
Jovad Uribe 9888081cc0 Relative Daily Volume Indicator (#5747)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Relative Volume Indicator

* Requested changes and renamed indicator

* Made changes, included Resolution

* Added requested changes

* Update

* Update RelativeDailyVolumeTests.cs

* Update RelativeDailyVolume.cs

* Fixed Test Case File

* Update RelativeDailyVolume.cs

* Fixed IsReady flag
12448
2021-07-28 18:02:34 -03:00
Martin-Molinero 611326b140 WebSocketClient improvements (#5799)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- Take lock to refresh client to avoid null reference
  exception
- Reduce gate rate
- Use extension methods to await tasks
- Avoid copying the data multiple times
12447
2021-07-28 15:17:08 -03:00
Stefano Raggi 907a9f086c Update BinanceBrokerage to handle more than 512 symbols (#5773)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Update BinanceBrokerage to handle more than 512 symbols

* Address review

- fetch symbol weights only if required
- remove code duplication

* Add rate limiting for new connections

* Update WebSocketMessage to include the websocket instance

* Handle resubscriptions on reconnect

* Address review

* Address review

* Remove unnecessary locking

* WebSocketClientWrapper updates

- remove allocation of receive buffer on each message
- add missing lock in Close method
- log message data when message type is Close
- fix race condition after unexpected websocket close

* Set WebSocketClientWrapper task to LongRunning

* Add missing check in GetHistory

* Fix exceptions with Binance downloader

- closes #5794
12444
2021-07-28 11:10:40 -03:00
Stefano Raggi 0c4e577885 BitfinexBrokerage updates (#5787)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Update BinanceBrokerage to handle more than 512 symbols

* Address review

- fetch symbol weights only if required
- remove code duplication

* Add rate limiting for new connections

* Update WebSocketMessage to include the websocket instance

* Handle resubscriptions on reconnect

* Address review

* Address review

* Remove unnecessary locking

* WebSocketClientWrapper updates

- remove allocation of receive buffer on each message
- add missing lock in Close method
- log message data when message type is Close
- fix race condition after unexpected websocket close

* Set WebSocketClientWrapper task to LongRunning

* Add missing check in GetHistory

* Fix exceptions with Binance downloader

- closes #5794

* Update Bitfinex symbols in symbol properties database

* Update BitfinexBrokerage to use BrokerageMultiWebSocketSubscriptionManager

* Address review

* Remove unnecessary locking

* Remove old channels on resubscription
12443
2021-07-28 11:10:12 -03:00
Marco Grassi e823dfdfb7 fix a typo, and remove all unnecessary semicolumns in Python (#5795)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12432 12435 12436 12431 12434
2021-07-27 16:05:13 -03:00
Martin-Molinero 4469d18eb6 Set timezone for DateRules (#5796)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- If algorithm timeZone is changed Update DateRules timezone. Adding
  unit test
12430
2021-07-27 15:34:11 -03:00
Ishant Jain 808ba17bff Indian Market Holidays & Early Open/Late Close Modified (#5792)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
12407 12421 12422 12427 12428 12429
2021-07-26 11:14:22 -03:00
Ronit Jain 00f68b951f Zerodha - GetHistory DateTime Parse Correction (#5788)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* logging and kite connection retry

(cherry picked from commit 9845a2d79e86c338093cadcae7f41b29d897c78c)

* changed thread.sleep time for kite connection retries

* websresponse retry on error - coding style change

* datetome parse to convert time in utc

* indentation code-style fix

* zerodhaDownloader support for dataTimeZone

* removed code redundancy for single conversion without hardcoded TZ

* removed hardcode dataTimeZone and code refactor

* returns exchange TZ to lean and data TZ to local disk from downloader

* Kite historical candle timestamp TZ conversion

* added unit test for kite historical candle

* access modifier correection
12399
2021-07-23 18:34:48 -03:00
Stefano Raggi c07b643273 Filter Bitfinex currencies in Derivatives wallet (#5786)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
12377 12384 12391 12392 12393 12394 12396
2021-07-21 14:39:01 -03:00
Gerardo Salazar 95f199eae5 Bug fix: don't throw on unsupported exchanges in CoinApi converter (#5784)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
12370
2021-07-20 19:09:29 -03:00
Martin-Molinero 2cb239a330 Fix price left over split cash adjustment (#5780)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
- After a split if there are left over shares we model them getting sold
  using the new price. Adding unit and regression test
12358
2021-07-19 13:18:10 -03:00
Martin-Molinero cb326788b3 Filter out small orders based on Setting (#5776)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Filter out small orders based on Setting

- BuyingPowerModel will filter out small orders based on algorithm
  setting, a % of PTV, instead of hard coded 1 share value. Addin unit
  and regression tests
- Updating regression algorithms to use new setting, reduce order trades

* Update regression algorithms
12357
2021-07-19 13:17:51 -03:00
Ronit Jain e2e2b5f102 zerodhaDownloader support for new market convention - Market.India (#5775)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* zerodhaDownloader support for India Market

(cherry picked from commit c36272ef9c4c7eddfff77413d900faab3a2a8654)

* indenation styling fix

* zerodha donwloader

* Market.India support from zerodhaSymbolMapper

* code styling changes
12355
2021-07-19 11:43:17 -03:00
Martin-Molinero f75e81bd7d Add null check for API data folder (#5774)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- Api.Initialize will not throw for null data folder. Adding unit test
12351
2021-07-16 18:27:42 -03:00
Ronit Jain 522fe14951 Zerodha ProductType customization for Fetching Positions&holdings and also while placing orders (#5766)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
* re adding KiteProductType

* check kiteProductType per order and get all Product Type Account Holdings

* use WithLockedStream and remove lock unlock stream

* filter holding if config productType set otherwise fetch all

* improvements in styling and properties

* unionbank has less margin requirements, second always works
12346
2021-07-16 11:43:14 -03:00
Martin-Molinero 9cf4075957 Send invalid orderEvent for non shortable order (#5772)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- TransactionHandler will see invalid OrderEvent for an order which
  tries to short an non shortable asset. Adding unit test, updating
  regression algorithm.
- Fix Api data price path normalization, found while testing with
shortable provider. Adding unit tests
12344
2021-07-15 21:10:46 -03:00
Martin-Molinero 1ed390c5f7 Minor tweaks (#5771)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- Improve readme file, add nuget link, update Lean home page
- Increase 10min look back to 60 for setting currency conversion
- Replace error message for trace when minute resolution history request
  is empty
12343
2021-07-15 13:03:46 -03:00
Jasper van Merle f5224f8be9 Logging improvements (#5767)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12339
2021-07-14 20:53:09 -03:00
Colton Sellers 8d11bbf0ba Update to PythonNet 2.0.5 (#5764)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12326 12335 12338 12337
2021-07-14 11:01:57 -03:00
Martin-Molinero 1dcdfe79b0 Add data paths to PriceEntry (#5761)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12307 12308 12309 12312 12316 12317 12323 12313 12310 12325
2021-07-13 14:56:20 -03:00
Stefano Raggi e453635458 Update Binance symbols in symbol properties database (#5759)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
* Update Binance symbols in symbol properties database

* Fix failing unit tests
12293
2021-07-12 13:28:28 -03:00
Martin-Molinero d84ad9ebfc Reduce research image size (#5758)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- Reduce research image size
- Increate BrokerageConcurrentMessageHandler unit test timeout
12289 12292 12288
2021-07-12 09:58:11 -03:00
Martin-Molinero f9adc6b136 Rename data permissions (#5753)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12276 12278 12283
2021-07-09 22:59:14 -03:00
Jovad Uribe e5f62fa4dd Feature Augen Price Spike Indicator (#5713)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
* Added Augen Price Spike Files

* AugenPriceSpike Update

Adjusted indicator calculations and added test data from Trading View

* Requested Changes

* Minor changes
12266
2021-07-09 20:07:15 -03:00
Colton Sellers 3430b46e6a BuyingPowerModel GetMaximumOrder Adjustments (#5756)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Add reproducing unit test

* Apply fix to force adjustment if needed

* Adjust fee to correctly replicate original issue

* Adjust solution

* Update unit test to reflect the way this function is used

* nit - rename test

* Cleanup error message to improve reproducibility

* nit - Drop unneeded var

* Add in adjustment test cases as well, fixed
12265
2021-07-09 19:37:48 -03:00
Colton Sellers 00ac4f33af Implement Python overload of Notify.Web for PyObject Headers (#5749)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
* Implement Python overload of Notify.Web for PyObject Headers

* Address review + add unit tests
12259
2021-07-08 21:07:19 -03:00
Colton Sellers 0d752abae6 Feature Telegram Notification (#5535)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Lay telegram notification groundwork

* nit comments

* Implement in JSON converter, and add roundtrip test

* Update comment docs

* Implement configurable token in NotificationTelegram

* Rename to ID, due to @ handles not usable

* Address review + nits

* Nit comment fix
12252 12257 12255 12258
2021-07-07 21:06:45 -03:00
Martin-Molinero 2a77a8d3c0 Update readme.md
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
12250
2021-07-07 19:50:23 -03:00
Martin-Molinero 49d6cb0021 QuantBook fundamental history request (#5743)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
- Allow requiesting the entire FineFundamental object for a QuantBook
  history request. Adding unit test
12235 12240 12243 12244 12245 12246 12248
2021-07-07 12:02:01 -03:00
Stefano Raggi 9a81414a94 IB Brokerage updates (#5744)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
* IB Brokerage updates

- Update IBAutomater to v2.0.40
- Add config setting to enable export of IBGateway logs (default=false)
- Downgrade IB log level from Information to Warning

* Update IBAutomater to v2.0.41

* Trigger build
12232 12233 12234
2021-07-07 11:26:09 -03:00
Martin-Molinero 3f85c9ab82 Update readme.md
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12228 12230 12229
2021-07-06 23:06:03 -03:00
Martin-Molinero f062b54450 Update readme.md
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
12221
2021-07-06 19:59:58 -03:00
Colton Sellers 64b95b2e8e MaximumOrderQuantity Error Log Expansion (#5741)
Regression Tests / build (push) Has been cancelled
Build & Test Lean / build (push) Has been cancelled
* Add more details to the log to improve insight into bugs

* Keep string formatting invariant
12217 12219 12220 12218
2021-07-06 19:26:49 -03:00
Martin-Molinero 7bcaaf8f23 Reduce dockerfoundation size (#5740)
Build & Test Lean / build (push) Has been cancelled
Regression Tests / build (push) Has been cancelled
- Clean files and conda after each docker build step
- Merge steps to reduce size
- Clear apt lists
12215
2021-07-06 17:42:19 -03:00