Commit Graph

24 Commits

Author SHA1 Message Date
Gerardo Salazar 8056ee814e Make SEC data converter map file resolver configurable via config.json 2019-07-22 14:59:20 -07:00
Gerardo Salazar 3a2d976d0a Overwrite existing index files in download session 2019-07-22 12:07:29 -07:00
Gerardo Salazar 3b5bdd4ab0 Use daily index files to determine what files to download 2019-07-22 10:44:03 -07:00
Gerardo Salazar 615793597f Add exemption for USHolidays in missing SEC archive check 2019-07-08 09:31:19 -07:00
Gerardo Salazar cce9988b63 Update comments to accurately reflect upon the written code
Change SECDataConverter CLI argument `--start` to `--date`
2019-07-05 16:58:29 -07:00
Gerardo Salazar 052c08a6a8 Use map files to write SEC data to mapped symbol 2019-07-05 16:53:20 -07:00
Gerardo Salazar 263de28494 Fix bug where we wrote empty tickers to SEC data folder
Updated expected missing data log message to increase clarity

Code polish
2019-07-05 16:53:20 -07:00
Gerardo Salazar 5879cb557b Add whitelist of missing dates to SECDataConverter 2019-07-05 16:53:20 -07:00
Juan José D'Ambrosio 3ba960cd28 Fix destination folder in temporary output 2019-07-05 16:53:20 -07:00
Gerardo Salazar 3cb4bf79b9 Fix issue where MapFileResolver null check would always be true 2019-07-05 16:53:20 -07:00
Gerardo Salazar bb62484116 Add support for "FLAWED" tag 2019-07-05 16:53:20 -07:00
Gerardo Salazar 8c94f592b9 Fix map file error caused by null entry in SEC's ticker.txt 2019-07-05 16:53:20 -07:00
Juan José D'Ambrosio ac1ada5c09 Add progress logs 2019-07-05 16:53:20 -07:00
Juan José D'Ambrosio 4f7439d2bd Use map files for filtering the tickers 2019-07-05 16:53:20 -07:00
Gerardo Salazar 7b6f13f934 Address review: Make gunzip happen in memory instead of using disk 2019-07-05 16:53:20 -07:00
Gerardo Salazar 435a60a321 Move file CIK ticker parsing logic to Process method 2019-07-05 16:53:20 -07:00
Gerardo Salazar 91f08cf2b3 Address review 2019-07-05 16:53:20 -07:00
Juan José D'Ambrosio b29b8797ad Make SECConverter to process a single day 2019-07-05 16:53:19 -07:00
Gerardo Salazar 677904108e Fix outdated SEC downloader documentation 2019-07-05 16:53:19 -07:00
Gerardo Salazar 5cdfb568ab Improve SEC logging experience. Only serious errors will be outputted now.
Split SECDataDownloader and SECDataConverter to two ToolBox applications
2019-07-05 16:53:19 -07:00
Gerardo Salazar 7ed94c0a35 Update SECDataConverter to not write null values
Update SECReport* to ignore null values
2019-06-19 14:44:48 -07:00
Gerardo Salazar 5a304a4cb5 Change path of alternative data folder
Delete converter because an existing utility already existed

Moved code from factory to converter class as statics

Add rankandfile as a CIK to ticker mapping source
2019-06-17 16:45:54 -07:00
Gerardo Salazar 3c04d922c2 Address reviews 2019-06-17 16:45:53 -07:00
Gerardo Salazar 2ad1f19f85 Implements Sec Custom Data, ToolBox Application, and Sample Algorithm 2019-06-17 16:45:53 -07:00