Commit Graph

123 Commits

Author SHA1 Message Date
Gerardo Salazar d5e148b05c Adds Psychsignal data converter and custom data implementation 2019-07-09 17:45:31 -07:00
Jared 4a9f9448c5 Merge pull request #3264 from aytacasan/master
IQFeed Downloader Program
2019-07-03 16:53:04 -07:00
Stefano Raggi 062b27e0b0 Bitfinex DataQueueHandler June 2019 Update
- Moved IConnectionHandler and DefaultConnectionHandler from ToolBox project to Brokerages project
- Added connectionId to IConnectionHandler.Initialize to support multiple connections
- Added new BitfinexSubscriptionManager to BitfinexBrokerage to handle max 30 channels per websocket
2019-07-02 15:17:06 +02:00
AlexCatarino 7b81f1a64d Implements Estimize Equity Endpoints Alternative Data
- Release: Financial releases for the specified company
- Estimate: Financial estimates for the specified company
- Consensus: Consensus of the specified release

For each equity endpoint, we create a `BaseData`, a Downloader and add unit tests.
2019-06-21 13:14:47 +01:00
Jared 0675d5be90 Merge pull request #3329 from StefanoRaggi/coinapi-dqh-keepalive-fix
CoinApiDataQueueHandler connection handling updates
2019-06-20 13:35:18 -07:00
Stefano Raggi ed3d65dce1 Add extra logging for reconnect 2019-06-20 13:36:25 +02:00
AlexCatarino 6ce48315a6 Implements Trading Economics Data Downloader
Implements an interface for all Trading Economics Data
- Adds Trading Economics Calendar Downloader and program to be used in the Toolbox.
- Adds Trading Economics Indicators Downloader and program to be used in the Toolbox.
- Adds Trading Economics Earnings Downloader and program to be used in the Toolbox.
2019-06-20 10:34:01 +01:00
Jared bf29323df3 Merge pull request #3318 from QuantConnect/fxcm-update-jun-2019-2
Update FxcmBrokerage for TLS 1.2 support (resubmit)
2019-06-19 11:13:42 -07:00
Stefano Raggi ec66c8e415 Update FxcmBrokerage for TLS 1.2 support
These changes are required to connect and receive data properly since the TLS 1.2 server upgrade on 6/16/2019. This also required upgrading the IKVM libraries for C#/Java interop.
2019-06-18 18:35:11 +02:00
Stefano Raggi 74cdc4a767 Revert "Update FxcmBrokerage for TLS 1.2 support" 2019-06-18 18:03:12 +02:00
Stefano Raggi ca60e1c03b Update FxcmBrokerage for TLS 1.2 support
These changes are required to connect and receive data properly since the TLS 1.2 server upgrade on 6/16/2019. This also required upgrading the IKVM libraries for C#/Java interop.
2019-06-18 15:40:49 +02:00
Gerardo Salazar 2ad1f19f85 Implements Sec Custom Data, ToolBox Application, and Sample Algorithm 2019-06-17 16:45:53 -07:00
Gerardo Salazar 340cc3a330 Upgrade dependency DotNetZip to version 1.13.3 to fix security issue 2019-06-11 11:03:37 -07:00
Stefano Raggi fa2bc58564 Add IDataQueueHandler implementation for CoinAPI 2019-06-03 15:24:12 +02:00
Aytaç Aşan d6c5bc5635 IQFeed Downloader
IQFeed data downloader program that download history data for all resolutions
2019-05-31 11:36:35 -04:00
Stefano Raggi 5d6bf2ad66 Address reviews 2019-05-30 15:34:02 +02:00
Juan José D'Ambrosio 516149b793 Implement CoinApiBitfinexSymbolMapper 2019-05-29 21:49:00 +00:00
Juan José D'Ambrosio 50b3326bf7 CoinAPI refactoring includes new parameters in ToolBox 2019-05-23 23:23:52 +00:00
Stefano Raggi cede89ed31 Add CoinApiDataConverter ToolBox application 2019-05-16 16:51:37 +02:00
Jared cd80c70775 Merge pull request #2868 from gsalaz98/feature-2859-rdg-delistings-mappings-splits-dividends-generator
RandomDataGenerator Mapping, Delisting, Splits, and Dividends Generator
2019-05-14 15:46:24 -07:00
Jack Simonson daa97b08f4 Deleted GoogleDownloader to address issue #3158. Google no longer supports Google Finance API. (#3159)
* Deleted GoogleDownloader. Google no longer supports Google Finance API.

* Delete remaining references to google downloader so that solution builds
2019-05-01 15:23:26 -07:00
AlexCatarino c3de660551 Updates pythonnet to 1.0.5.20 2019-04-23 23:15:14 +01:00
Gerardo Salazar 43d26a456a Removed FinancialCalendar
Fixed bug where data would only be generated in quarters instead of
a random month
2019-04-02 21:25:10 -07:00
Gerardo Salazar 55f8376c53 Create mapping, IPO, delisting, splits, and dividends random generation
Created random-seed argument for rdg in order to let the user get deterministic output

Update documentation in 'FactorFileRow.cs' to accurately reflect factor
file structure

Update CSV generation for FactorFile so that it uses FactorFileRow's CSV
generator

Add FinancialCalendar to make it easier to implement logic regarding
financial quarters

Add mapping events to RandomDataGenerator

Update MapFileRow ToCsv method to correctly emit the ticker as lowercase

Fix bug in FactorFile where we would get the same initial data point twice
when we converted it to CSV

Create new method to convert a MapFile to CSV

Create new method to write MapFile to disk as CSV

Add unit test to test for successful CSV generation in MapFile

Add new files to project

Add FinancialCalendar unit tests

Create new class to handle generation of dividends, splits, and maps
2019-04-02 21:25:10 -07:00
AlexCatarino da6519b9f4 Updates pythonnet to 1.0.5.19
Updates PythonNet to 1.0.5.19
 - Related  https://github.com/QuantConnect/pythonnet/pull/28/
2019-04-02 17:17:40 +01:00
AlexCatarino 6d2460d8ed Updates pythonnet to 1.0.5.18
- Updates PythonNet to 1.0.5.18
  - Cherry picks the memory leak fix from upstream/pythonnet
2019-03-28 00:47:38 +00:00
AlexCatarino d91cad3123 Updates pythonnet to 1.0.5.17
- Updates PythonNet to 1.0.5.17
  -  Improve performance by adding new `interop` `type` cache holding a `bool`, true if its an `exception`. And adding a `setter` and `getter` cache for the `propertyobject`. Closes #2925.
  - Decimal parsing allows numeric string in exponential notation. Closes #2918 #2919.

Closes #2929
2019-02-22 17:46:59 +00:00
Martin Molinero d53a922cf0 PythonNet installation does not require copy pasting
- Requires a new PythonNet 1.0.5.15 package where the different `.dll` are in a
specific folder: `\win` `\linux` and `\osx`
- Removed not present `decimal.py` from `Algorithm.Python` project. It
was moved into `Common`.
- Replace `xbuild` for `msbuild` required for using the `System.Runtime.InteropServices`.
Also note the `xbuild` on travis prints:
> >>>> xbuild tool is deprecated and will be removed in future updates, use msbuild instead <<<<
2019-01-22 19:48:11 -03:00
AlexCatarino ef59fa7ba2 Updates pythonnet package.
In the new package:
- C# decimal conversion will use C# double and python float due to the big performance impact of converting C# decimal to python decimal;
2019-01-18 23:18:35 +00:00
Michael Handschuh 743e067c60 #2824: Add RandomDataGeneratorProgram
Invoke from toolbox cli using --app=rdg or --app=randomdatagenerator

Produces random data over the requested time frame in the desired resolution,
security type and density.

Here's a few sample command line invocations:

--app=rdg --start=20190101 --end=20200101 --symbol-count=1 --resolution=Daily --data-density=Dense --include-coarse=false
--app=rdg --start=20190101 --end=20200101 --symbol-count=10 --security-type=Future --resolution=Hour --data-density=VerySparse
--app=rdg --start=20190101 --end=20200101 --symbol-count=5 --security-type=Option --resolution=Minute --data-density=Sparse
2019-01-15 14:33:45 -05:00
Michael Handschuh 22ba5d431f #2824: Add RandomValueGenerator
The random value generator aims to abstract away the generation of the
 key bits of data from the toolbox project. This provides a baseline
 implementation for anyone who wishes to customize their data randomizaton.
 Simply subclass and override the desired methods. A full test suite is
 included to ensure the data generated meets specifications.
2019-01-15 14:33:10 -05:00
Juan José D'Ambrosio 73bbf33a3e Implement single day Kaiko data conversion 2019-01-09 19:18:25 -03:00
AlexCatarino 823bb01438 Updates pythonnet
Includes memory leak fix (https://github.com/QuantConnect/pythonnet/commit/c6db86653e7fa4fa89e1f8404d72e346b67ed857 and https://github.com/QuantConnect/pythonnet/commit/bec9563d2958acc5adf3e8972b23609fe3914402)

- Fix python version to 3.6.6 (avoid updating to 3.7)
- Fix numpy version to 1.14.5 (tensorflow requirement)

- Adds py-earth python package (closes #2399).
2018-12-07 09:36:48 +00:00
Adalyat Nazirov 7240a4e115 Implement IDataDownloader 2018-08-27 21:59:19 +03:00
wildart cfa5535a87 added implementation of IEX data downloader
Closes #2178.
2018-07-23 20:40:59 -04:00
AlexCatarino 8e3b7153b2 Rebase with pythonnet/master and fix datetime UTC bug
Updates pythonnet with pythonnet/master and fix datetime issue ([65ac279](https://github.com/QuantConnect/pythonnet/commit/65ac279a03dbded39fe3e28bb79c233f0c970f6f)).
2018-07-16 11:52:54 +01:00
mblouin02 629fd7b552 Fix IEXDataQueueHandler data feed
When selecting IEXDataQueueHandler as a data source for live trading,
it would not connect. The following fixed the issue:

- Updated Socket IO NuGet package (and its dependencies) to latest;

- In GzipStreamProvider, removed obsolete "using" statement refering
to deprecated Socket IO API (using statement was not used anyways);

- Increased the reconnection delay value to its recommended
value (1000ms), this was necessary for the feed to connect;

- Minor change in IEXDataQueueHandler to parse Json message.
"(JObject)message" would compile, but threw a runtime error, as this
formulation could not implicitly convert string to JObject. Used
the cleaner "JObject.Parse()" method instead.
2018-07-09 08:07:20 -04:00
Juan José D'Ambrosio 615fa53cc6 Decompressing AlgoSeek's OPRA files with SharpZipLib
Using thread safe implementation
Minor fixes.


Change ICSharpCode.SharpZipLib reference 

New reference match the `ICSharpCode.SharpZipLib`in `QuantConnect.Compression`.
2018-07-02 12:29:18 -03:00
Martin Molinero c31fa715d7 Renaming old Program.cs of each tool 2018-06-29 21:08:13 -03:00
Martin Molinero 0db14515fe Make toolbox a single application wrapping all the tools 2018-06-28 16:15:51 -03:00
Stefano Raggi 2ff5650b4a Add price and split factors to CoarseFundamental class 2018-06-01 12:19:06 +02:00
Juan José D'Ambrosio ba183461dd Delete Visualizer.cs make use of the PandasConvereter form python
Remove needed of the --data argument
2018-04-30 10:55:34 -03:00
Juan José D'Ambrosio 87e8532598 Remove config.json
Path to data folder and to assembly folder delcared as CLI arguments.
2018-04-30 07:19:21 -03:00
Juan José D'Ambrosio 7d149f07fc csproj fixed 2018-04-30 05:44:33 -03:00
Juan José D'Ambrosio 4ace8cb255 Lean Visualizer C# toolbox project and Python Wrapper working 2018-04-27 11:49:52 -03:00
benjaminthedonkey 18af37c802 IB data downloader 2018-04-05 20:55:02 -04:00
Feras Salim 8717df87da Added: Initial support for Ivolatility equity data import
Fix filename typo in the .csproj file
2018-02-27 22:39:48 -05:00
Feras Salim d6e3890db9 Added: Initial support for Ivolatility equity data import
ToolBox support for converting Ivolatility equity data to
Lean TradeBar format for min,hour,day resolutions.
Also adds Gzip stream reader to list of supported zip formats.
2018-02-02 15:41:17 -05:00
Andrew 706235c5d6 Added more Crypto markets
Made Kaiko data converter more robust to imporperly formatted data
2017-12-13 11:54:15 -05:00
Jared b7ddee7968 Merge branch 'master' into kraken-downloader 2017-12-04 12:06:35 -05:00