Commit Graph

9 Commits

Author SHA1 Message Date
Gerardo Salazar 920010b242 Add rategate to all requests so that we don't run over rate limits
Improve logging across all TradingEconomics Downloaders

Add retries to HTTP requests due to occassional failure

Added skipping of duplicates, skipping of
fields with no actual value, temp file writing, temp file moving

Write to proper output directory

Update data directory structure

Update GetSource in BaseData implementation for TradingEconomics

Parallelize data processing and writing to disk
2019-07-16 12:02:47 -07:00
AlexCatarino 1495345b88 Removes Alternative Data Files
Use `.keep` file as a place holder to keep folder structure.
2019-07-11 00:12:01 +01:00
AlexCatarino bb5cec3a49 Address Review and Fix Unit Tests 2019-06-21 13:14:47 +01:00
Jared e7b8ba4dee Merge pull request #3268 from AlexCatarino/feature-3200-tradingeconomics
Implements Trading Economics Data
2019-06-20 13:33:51 -07:00
AlexCatarino 66a0c7377d Addresses Reviews
- Changes the destination folder
- Remove Symbol converter
- Refactors Get method to return `Task<string>`
  - Since `HttpRequester` returns `Task<string>`, it makes more sense to pass this result than returning a `IEnumerable<string>`.
2019-06-20 10:35:56 +01:00
Gerardo Salazar 7ed94c0a35 Update SECDataConverter to not write null values
Update SECReport* to ignore null values
2019-06-19 14:44:48 -07:00
Gerardo Salazar a04d8dc0ab Fix potential null value in field FormerCompanies
Update data to reflect changes

Add missing AAPL data point we originally intended to include
2019-06-19 11:09:47 -07:00
Gerardo Salazar a0506ae290 Update bundled data and include new TWX and AOL SEC data 2019-06-19 09:30:33 -07:00
Gerardo Salazar 5a304a4cb5 Change path of alternative data folder
Delete converter because an existing utility already existed

Moved code from factory to converter class as statics

Add rankandfile as a CIK to ticker mapping source
2019-06-17 16:45:54 -07:00