Software to get FOREX data in CSV format - Software ...

Releasing a Decade of Forex Tick Data I Crawled and Converted

Releasing a Decade of Forex Tick Data I Crawled and Converted

Intro:

In my exploration of the world of big data and I became curious about tick data. Unfortunately, market data is almost always behind a paywall or de-sampled to the point of uselessness. After discovering the Dukascopy API, I knew I wanted to make this data available for all in a more accessible format. Over the course of a few months, I downloaded, cleaned, parsed, and compressed over a decade of Forex tick data on 37 currency pairs and commodities. Today I am happy to finally release the final result of my work to the DataHoarder community!

Download Links:

Warning: I have rented a seedbox for the next 3 months from seedbox.io but I have been having some issues. If you have any issues with the torrent please leave a comment. Also, PLEASE SEED when you are done. This is quite a large data set and I can only push so much data on my own.
Torrent File: https://drive.google.com/file/d/18ymZWeFLJK7FggK_iiWZ-TxgWIVdJVvv/view?usp=sharingCompanion Blog Post: https://www.driftinginrecursion.com/post/dukascopy_opensource_data/

Stats Overview:

Totals Quantities
Total Files 463
Total Line Count 8,495,770,706
Total Data Points 33,983,082,824
Total Decompressed Size 501 GB
Total Compressed Size 61 GB

About the Data:

The data was collected from https://www.dukascopy.com/ via a public API that allows for the download of tick data on the hour level. These files come in the form of a .bi5 file. The data starts as early as 2004 all the way to 2019.
These files were decompressed, then merged into yearly CSV’s named in the following convention. “AUDCHF_tick_UTC+0_00_2011.csv” or ‘Pair_Resolution_Timezone_Year.csv’
These CSV’s are split into 3 categories “Majors”, “Crosses”, “Commodities”.
Majors, Crosses, and Commodities have had their timestamps modified so that they are in the official UTC ISO standard. This was originally done for a Postgresql database that quickly became obsolesced. Any files that have been modified are appended with a “-Parse”. These timestamps have been modified in the following format.
Millisecond timestamps to UTC +00:00 time [2017.01.01 22:37:08.014] -- [2017-01-01T22:37:08.014+00:00]
https://preview.redd.it/x6g277skfiu51.png?width=1399&format=png&auto=webp&s=35cd6735c1826424580919ac3377612377a3107c

User Resources:

For those looking to use this data in a live context or update it frequently, I have included a number of tools for both Windows and Linux that will be useful.

Windows

The ~/dukascopy/resources/windows folder contains a third party tool written in java that can download and convert Dukascopy’s .bi5 files. I have also included the latest zstd binaries from Zstandard Github page.

Linux

Linux is my daily driver in 99% of cases, so I have developed all my scraping tools using Linux only tools. In the ~/dukascopy/resources/linux folder you will find a number of shell script and pyhton3 files that I used to collect this data. There are quite a few files in this directory but I will cover the core ones below.

download-day.py:

This file is used to download a single symbol for a single day and then convert and merge all 24 .bi5 files into a single CSV.

download-year.py

This file is used to download a single symbol for a full year and then convert and merge all .bi5 files into a single CSV.

dukascopy.py

This file contains all the core logic for downloading and converting data from dukascopy.

utc-timestamp-convert.py

This tad slow but works well enough. It requires the pandas project and parses timestamps into the UTC ISO standard. This is useful for those looking to maintain the format of new files with the those in this repo, or those looking to use this in a SQL database.
submitted by jtimperio to DataHoarder [link] [comments]

Need good forex data

Hello forex community! I am looking for a place where I can download good high quality forex data by the tick in a .csv format for all the majors from Jan 01 2000 or earlier to Dec 31 2019. I am ok with paying some money but not too much money for such data.
Does any one have any recommendations? Thank you all kindly in advance!
submitted by BogdanovCoding to Forex [link] [comments]

Big Data Set for Crypto Backtesting

I have a huge data set from the past couple of months with the price of cryptocurrencies off of CoinMarketCap as well as Forex prices off of XRates. The CoinMarketCap data is every five minutes and the XRates data is every minute. I collected data between August and November. The data is in csv format. I want to share all this data. Is there a good place I can share it? Thanks for the help!
submitted by Dotherightthing253 to algotrading [link] [comments]

Who are the best data providers for forex sentiment data? Paid or free

I'm looking for data sources that provide sentiment data for forex mainly in a csv,xml or API format. I need the raw data, not just pre-made interactive charts.
Here are some of the current sources I've found - FCMX - $1000/month for unlimited access. $1000 for 6 months of historic data. https://www.fxsentimentmarket.com/ - Data looks pretty cheap which is nice but makes me weary of the quality.
Thanks!
submitted by bbennett36 to Forex [link] [comments]

Crypto Tax Tool Update

Hi Guys,
It has been a couple of weeks since an update. Short version is I wasn't happy with it and wanted to rebuild and then I managed to get sick (and still am)!
Right now 20 people have been given access, but I decided to post a few screenshots here as well to get more feedback. If you are in the waiting list I am adding 5 a day-ish so it won't be too long.
The Main Portfolio view is ultimately what you want for tax time. However, to have complete numbers you need to link your sell trades to the buy trades first. You do this in the Balance pages for each coin.
Right now you can either manually link sell trades to buy trades or you can adopt a FIFO method which over-rides everything. LIFO and other methods will be added come tax time.
I would also like to give a bit more detail how we get AUD values - we hit a (paid) API that provides granular information on pricing. When I say granular I mean spot prices to the second. Let's say we are trying to find the AUD price of XRP - the app will attempt to find an AUD price from BTCmarkets first, if data isn't available then it will find a USD price and if that data isn't available (typical for smaller coins) then it finds the BTC price and then converts BTC to USD/AUD. Any USD values are converted to AUD using the daily XE USD-AUD Forex rate. We basically want to attempt to get the most accurate data possible.
With that said, we have received some suggestions to use free data as well - even though it is hourly pricing - and offer the more accurate data as an added service. I would love to hear more opinions on that.
I will be making this information clearer at a later stage - right now it gets automatically converted and the end-user doesn't see too much except the final AUD price and (if applicable) USD price.
This tax tool will be a paid service
Those who are testing the service and providing feedback will be able to continue to use it for free in perpetuity, but this is being built as a paid tool and will be priced similarly to bitcoin.tax
With that said though there are two things worth noting:
Immediate goals right now are to setup some simple onboarding videos, add IR & Bitfinex imports, be able to export the data in CSV and PDF formats and a feature request/voting platform to guide development and keep it focused on community wants.
submitted by somethingrather to BitcoinAUS [link] [comments]

NYC PHP Devlopers - how much are you making?

Hey guys, what's up? So a little bit of background - I am currently a Jr Full Stack PHP Dev (html,css,js,mysql,php) in NYC (financial district). I earned a degree in Finance in 2012 and worked as a helpdesk tech (ughhhhh - job market never recovered for Financial Analysts at investment banks) until 2013 while teaching myself webdev. I started at 30k as a tech (thanks college degree, you were really useful) and got a raise to 42k earlier this year after doing dev work for 1 year. I am nearing the 2 years of experience mark, and I feel I am being underpaid for working in NYC. I am currently the lead (95% of the work, aside from managing the scripts that sync an ERP accounting system with some SQL Server DB's) on a project where the goal was to make a front end billing portal for Sage 300 so that the vendors of a client can submit their invoices electronically instead of mailing papecalling/etc. I pretty much built this from the ground up, along with other projects for BMW (they are one of our clients) - a few internal web apps for key management people such as converting US accounting CSV's into a German format and logging any missing entries.
This is in addition to creating virtual machines, creating and managing SQL Server tables, spinning up IIS and LAMP servers, and various other (minor) tasks - occasional helpdesk and structured wiring in the field.
As for personal projects - I've written an image scraper that scrapes all new submissions of imgur albums in a certain subreddit and uploads them into folders on AmazonS3, and my other major personal project is an automated forex trading algorithm that pulls minute-by-minute data from a live forex feed, drops it into sql, and then makes trades based on that data. Also a bunch of wordpress sites but I don't really consider those as PHP experience, although some employers do (swolesnacks.com as an example - me and my roommates stagnant startup).
If any of you can chime in that can give me an idea as to how much I should be making (without knowing any frameworks - although I do know some OOP PHP) or how much you are making in a similar position in NYC, I would be very grateful.
The experience here has been great but I am living paycheck to paycheck after taxes get taken out and I think it is time for a change. My last raise was $12k in January and I only got it begrudgingly after my boss found out I was job hunting, not before when I asked for it. I like working here - I can walk in whenever between 9 and 10, wear gym shorts and flip flops, play some DOTA2 for an hour before I leave - but I like being able to pay my bills more than the non-monetary perks offered here.
Also, if anyone has any openings in NYC or Brooklyn for a Jr Dev, please let me know! I am open to learning Rails, Python, or Java if need be.
submitted by xgrave01 to PHP [link] [comments]

What's the fastest and easiest way to turn my data into timeseries data?

Hi, complete beginner here. I have a question on how to prepare my data for ML.
I'm trying to turn forex tick data (from 10000 plus separate CSV files) formated like below:
Datetime Price
20180823 13:35:44.617 110.979
20180823 13:35:45.818 110.9
20180823 13:35:45.833 110.98
20180823 13:35:45.908 110.989
...into timeseries data.
My question is, what is the easiest way to do this by a complete beginner?
EDIT: I forgot to mention that I need the time series data to have uniform time intervals, with each file being a unique record in the dataset.
submitted by Ifffrt to learnmachinelearning [link] [comments]

Big Data Set for Backtesting

I have a huge data set from the past couple of months with the price of cryptocurrencies off of CoinMarketCap as well as Forex prices off of XRates. The CoinMarketCap data is every five minutes and the XRates data is every minute. I collected data between August and November. The data is in csv format. I want to share all this data. Is there a good place I can share it?
submitted by Dotherightthing253 to Bitcoin [link] [comments]

How do you backtest your trading strategy?

I am new to forex and my backtesting stratergy is very simple, I need historic daily high, low, open and close data for at least one currency pair in Excel/CSV format, that I can manipulate using matalb.
My issue, where the hell can you find historic daily high low open and close data in CSV format
submitted by ljlis to Forex [link] [comments]

Subreddit Stats: cs7646_fall2017 top posts from 2017-08-23 to 2017-12-10 22:43 PDT

Period: 108.98 days
Submissions Comments
Total 999 10425
Rate (per day) 9.17 95.73
Unique Redditors 361 695
Combined Score 4162 17424

Top Submitters' Top Submissions

  1. 296 points, 24 submissions: tuckerbalch
    1. Project 2 Megathread (optimize_something) (33 points, 475 comments)
    2. project 3 megathread (assess_learners) (27 points, 1130 comments)
    3. For online students: Participation check #2 (23 points, 47 comments)
    4. ML / Data Scientist internship and full time job opportunities (20 points, 36 comments)
    5. Advance information on Project 3 (19 points, 22 comments)
    6. participation check #3 (19 points, 29 comments)
    7. manual_strategy project megathread (17 points, 825 comments)
    8. project 4 megathread (defeat_learners) (15 points, 209 comments)
    9. project 5 megathread (marketsim) (15 points, 484 comments)
    10. QLearning Robot project megathread (12 points, 691 comments)
  2. 278 points, 17 submissions: davebyrd
    1. A little more on Pandas indexing/slicing ([] vs ix vs iloc vs loc) and numpy shapes (37 points, 10 comments)
    2. Project 1 Megathread (assess_portfolio) (34 points, 466 comments)
    3. marketsim grades are up (25 points, 28 comments)
    4. Midterm stats (24 points, 32 comments)
    5. Welcome to CS 7646 MLT! (23 points, 132 comments)
    6. How to interact with TAs, discuss grades, performance, request exceptions... (18 points, 31 comments)
    7. assess_portfolio grades have been released (18 points, 34 comments)
    8. Midterm grades posted to T-Square (15 points, 30 comments)
    9. Removed posts (15 points, 2 comments)
    10. assess_portfolio IMPORTANT README: about sample frequency (13 points, 26 comments)
  3. 118 points, 17 submissions: yokh_cs7646
    1. Exam 2 Information (39 points, 40 comments)
    2. Reformat Assignment Pages? (14 points, 2 comments)
    3. What did the real-life Michael Burry have to say? (13 points, 2 comments)
    4. PSA: Read the Rubric carefully and ahead-of-time (8 points, 15 comments)
    5. How do I know that I'm correct and not just lucky? (7 points, 31 comments)
    6. ML Papers and News (7 points, 5 comments)
    7. What are "question pools"? (6 points, 4 comments)
    8. Explanation of "Regression" (5 points, 5 comments)
    9. GT Github taking FOREVER to push to..? (4 points, 14 comments)
    10. Dead links on the course wiki (3 points, 2 comments)
  4. 67 points, 13 submissions: harshsikka123
    1. To all those struggling, some words of courage! (20 points, 18 comments)
    2. Just got locked out of my apartment, am submitting from a stairwell (19 points, 12 comments)
    3. Thoroughly enjoying the lectures, some of the best I've seen! (13 points, 13 comments)
    4. Just for reference, how long did Assignment 1 take you all to implement? (3 points, 31 comments)
    5. Grade_Learners Taking about 7 seconds on Buffet vs 5 on Local, is this acceptable if all tests are passing? (2 points, 2 comments)
    6. Is anyone running into the Runtime Error, Invalid DISPLAY variable when trying to save the figures as pdfs to the Buffet servers? (2 points, 9 comments)
    7. Still not seeing an ML4T onboarding test on ProctorTrack (2 points, 10 comments)
    8. Any news on when Optimize_Something grades will be released? (1 point, 1 comment)
    9. Baglearner RMSE and leaf size? (1 point, 2 comments)
    10. My results are oh so slightly off, any thoughts? (1 point, 11 comments)
  5. 63 points, 10 submissions: htrajan
    1. Sample test case: missing data (22 points, 36 comments)
    2. Optimize_something test cases (13 points, 22 comments)
    3. Met Burt Malkiel today (6 points, 1 comment)
    4. Heads up: Dataframe.std != np.std (5 points, 5 comments)
    5. optimize_something: graph (5 points, 29 comments)
    6. Schedule still reflecting shortened summer timeframe? (4 points, 3 comments)
    7. Quick clarification about InsaneLearner (3 points, 8 comments)
    8. Test cases using rfr? (3 points, 5 comments)
    9. Input format of rfr (2 points, 1 comment)
    10. [Shameless recruiting post] Wealthfront is hiring! (0 points, 9 comments)
  6. 62 points, 7 submissions: swamijay
    1. defeat_learner test case (34 points, 38 comments)
    2. Project 3 test cases (15 points, 27 comments)
    3. Defeat_Learner - related questions (6 points, 9 comments)
    4. Options risk/reward (2 points, 0 comments)
    5. manual strategy - you must remain in the position for 21 trading days. (2 points, 9 comments)
    6. standardizing values (2 points, 0 comments)
    7. technical indicators - period for moving averages, or anything that looks past n days (1 point, 3 comments)
  7. 61 points, 9 submissions: gatech-raleighite
    1. Protip: Better reddit search (22 points, 9 comments)
    2. Helpful numpy array cheat sheet (16 points, 10 comments)
    3. In your experience Professor, Mr. Byrd, which strategy is "best" for trading ? (12 points, 10 comments)
    4. Industrial strength or mature versions of the assignments ? (4 points, 2 comments)
    5. What is the correct (faster) way of doing this bit of pandas code (updating multiple slice values) (2 points, 10 comments)
    6. What is the correct (pythonesque?) way to select 60% of rows ? (2 points, 11 comments)
    7. How to get adjusted close price for funds not publicly traded (TSP) ? (1 point, 2 comments)
    8. Is there a way to only test one or 2 of the learners using grade_learners.py ? (1 point, 10 comments)
    9. OMS CS Digital Career Seminar Series - Scott Leitstein recording available online? (1 point, 4 comments)
  8. 60 points, 2 submissions: reyallan
    1. [Project Questions] Unit Tests for assess_portfolio assignment (58 points, 52 comments)
    2. Financial data, technical indicators and live trading (2 points, 8 comments)
  9. 59 points, 12 submissions: dyllll
    1. Please upvote helpful posts and other advice. (26 points, 1 comment)
    2. Books to further study in trading with machine learning? (14 points, 9 comments)
    3. Is Q-Learning the best reinforcement learning method for stock trading? (4 points, 4 comments)
    4. Any way to download the lessons? (3 points, 4 comments)
    5. Can a TA please contact me? (2 points, 7 comments)
    6. Is the vectorization code from the youtube video available to us? (2 points, 2 comments)
    7. Position of webcam (2 points, 15 comments)
    8. Question about assignment one (2 points, 5 comments)
    9. Are udacity quizzes recorded? (1 point, 2 comments)
    10. Does normalization of indicators matter in a Q-Learner? (1 point, 7 comments)
  10. 56 points, 2 submissions: jan-laszlo
    1. Proper git workflow (43 points, 19 comments)
    2. Adding you SSH key for password-less access to remote hosts (13 points, 7 comments)
  11. 53 points, 1 submission: agifft3_omscs
    1. [Project Questions] Unit Tests for optimize_something assignment (53 points, 94 comments)
  12. 50 points, 16 submissions: BNielson
    1. Regression Trees (7 points, 9 comments)
    2. Two Interpretations of RFR are leading to two different possible Sharpe Ratios -- Need Instructor clarification ASAP (5 points, 3 comments)
    3. PYTHONPATH=../:. python grade_analysis.py (4 points, 7 comments)
    4. Running on Windows and PyCharm (4 points, 4 comments)
    5. Studying for the midterm: python questions (4 points, 0 comments)
    6. Assess Learners Grader (3 points, 2 comments)
    7. Manual Strategy Grade (3 points, 2 comments)
    8. Rewards in Q Learning (3 points, 3 comments)
    9. SSH/Putty on Windows (3 points, 4 comments)
    10. Slight contradiction on ProctorTrack Exam (3 points, 4 comments)
  13. 49 points, 7 submissions: j0shj0nes
    1. QLearning Robot - Finalized and Released Soon? (18 points, 4 comments)
    2. Flash Boys, HFT, frontrunning... (10 points, 3 comments)
    3. Deprecations / errata (7 points, 5 comments)
    4. Udacity lectures via GT account, versus personal account (6 points, 2 comments)
    5. Python: console-driven development (5 points, 5 comments)
    6. Buffet pandas / numpy versions (2 points, 2 comments)
    7. Quant research on earnings calls (1 point, 0 comments)
  14. 45 points, 11 submissions: Zapurza
    1. Suggestion for Strategy learner mega thread. (14 points, 1 comment)
    2. Which lectures to watch for upcoming project q learning robot? (7 points, 5 comments)
    3. In schedule file, there is no link against 'voting ensemble strategy'? Scheduled for Nov 13-20 week (6 points, 3 comments)
    4. How to add questions to the question bank? I can see there is 2% credit for that. (4 points, 5 comments)
    5. Scratch paper use (3 points, 6 comments)
    6. The big short movie link on you tube says the video is not available in your country. (3 points, 9 comments)
    7. Distance between training data date and future forecast date (2 points, 2 comments)
    8. News affecting stock market and machine learning algorithms (2 points, 4 comments)
    9. pandas import in pydev (2 points, 0 comments)
    10. Assess learner server error (1 point, 2 comments)
  15. 43 points, 23 submissions: chvbs2000
    1. Is the Strategy Learner finalized? (10 points, 3 comments)
    2. Test extra 15 test cases for marketsim (3 points, 12 comments)
    3. Confusion between the term computing "back-in time" and "going forward" (2 points, 1 comment)
    4. How to define "each transaction"? (2 points, 4 comments)
    5. How to filling the assignment into Jupyter Notebook? (2 points, 4 comments)
    6. IOError: File ../data/SPY.csv does not exist (2 points, 4 comments)
    7. Issue in Access to machines at Georgia Tech via MacOS terminal (2 points, 5 comments)
    8. Reading data from Jupyter Notebook (2 points, 3 comments)
    9. benchmark vs manual strategy vs best possible strategy (2 points, 2 comments)
    10. global name 'pd' is not defined (2 points, 4 comments)
  16. 43 points, 15 submissions: shuang379
    1. How to test my code on buffet machine? (10 points, 15 comments)
    2. Can we get the ppt for "Decision Trees"? (8 points, 2 comments)
    3. python question pool question (5 points, 6 comments)
    4. set up problems (3 points, 4 comments)
    5. Do I need another camera for scanning? (2 points, 9 comments)
    6. Is chapter 9 covered by the midterm? (2 points, 2 comments)
    7. Why grade_analysis.py could run even if I rm analysis.py? (2 points, 5 comments)
    8. python question pool No.48 (2 points, 6 comments)
    9. where could we find old versions of the rest projects? (2 points, 2 comments)
    10. where to put ml4t-libraries to install those libraries? (2 points, 1 comment)
  17. 42 points, 14 submissions: larrva
    1. is there a mistake in How-to-learn-a-decision-tree.pdf (7 points, 7 comments)
    2. maximum recursion depth problem (6 points, 10 comments)
    3. [Urgent]Unable to use proctortrack in China (4 points, 21 comments)
    4. manual_strategynumber of indicators to use (3 points, 10 comments)
    5. Assignment 2: Got 63 points. (3 points, 3 comments)
    6. Software installation workshop (3 points, 7 comments)
    7. question regarding functools32 version (3 points, 3 comments)
    8. workshop on Aug 31 (3 points, 8 comments)
    9. Mount remote server to local machine (2 points, 2 comments)
    10. any suggestion on objective function (2 points, 3 comments)
  18. 41 points, 8 submissions: Ran__Ran
    1. Any resource will be available for final exam? (19 points, 6 comments)
    2. Need clarification on size of X, Y in defeat_learners (7 points, 10 comments)
    3. Get the same date format as in example chart (4 points, 3 comments)
    4. Cannot log in GitHub Desktop using GT account? (3 points, 3 comments)
    5. Do we have notes or ppt for Time Series Data? (3 points, 5 comments)
    6. Can we know the commission & market impact for short example? (2 points, 7 comments)
    7. Course schedule export issue (2 points, 15 comments)
    8. Buying/seeking beta v.s. buying/seeking alpha (1 point, 6 comments)
  19. 38 points, 4 submissions: ProudRamblinWreck
    1. Exam 2 Study topics (21 points, 5 comments)
    2. Reddit participation as part of grade? (13 points, 32 comments)
    3. Will birds chirping in the background flag me on Proctortrack? (3 points, 5 comments)
    4. Midterm Study Guide question pools (1 point, 2 comments)
  20. 37 points, 6 submissions: gatechben
    1. Submission page for strategy learner? (14 points, 10 comments)
    2. PSA: The grading script for strategy_learner changed on the 26th (10 points, 9 comments)
    3. Where is util.py supposed to be located? (8 points, 8 comments)
    4. PSA:. The default dates in the assignment 1 template are not the same as the examples on the assignment page. (2 points, 1 comment)
    5. Schedule: Discussion of upcoming trading projects? (2 points, 3 comments)
    6. [defeat_learners] More than one column for X? (1 point, 1 comment)
  21. 37 points, 3 submissions: jgeiger
    1. Please send/announce when changes are made to the project code (23 points, 7 comments)
    2. The Big Short on Netflix for OMSCS students (week of 10/16) (11 points, 6 comments)
    3. Typo(?) for Assess_portfolio wiki page (3 points, 2 comments)
  22. 35 points, 10 submissions: ltian35
    1. selecting row using .ix (8 points, 9 comments)
    2. Will the following 2 topics be included in the final exam(online student)? (7 points, 4 comments)
    3. udacity quiz (7 points, 4 comments)
    4. pdf of lecture (3 points, 4 comments)
    5. print friendly version of the course schedule (3 points, 9 comments)
    6. about learner regression vs classificaiton (2 points, 2 comments)
    7. is there a simple way to verify the correctness of our decision tree (2 points, 4 comments)
    8. about Building an ML-based forex strategy (1 point, 2 comments)
    9. about technical analysis (1 point, 6 comments)
    10. final exam online time period (1 point, 2 comments)
  23. 33 points, 2 submissions: bhrolenok
    1. Assess learners template and grading script is now available in the public repository (24 points, 0 comments)
    2. Tutorial for software setup on Windows (9 points, 35 comments)
  24. 31 points, 4 submissions: johannes_92
    1. Deadline extension? (26 points, 40 comments)
    2. Pandas date indexing issues (2 points, 5 comments)
    3. Why do we subtract 1 from SMA calculation? (2 points, 3 comments)
    4. Unexpected number of calls to query, sum=20 (should be 20), max=20 (should be 1), min=20 (should be 1) -bash: syntax error near unexpected token `(' (1 point, 3 comments)
  25. 30 points, 5 submissions: log_base_pi
    1. The Massive Hedge Fund Betting on AI [Article] (9 points, 1 comment)
    2. Useful Python tips and tricks (8 points, 10 comments)
    3. Video of overview of remaining projects with Tucker Balch (7 points, 1 comment)
    4. Will any material from the lecture by Goldman Sachs be covered on the exam? (5 points, 1 comment)
    5. What will the 2nd half of the course be like? (1 point, 8 comments)
  26. 30 points, 4 submissions: acschwabe
    1. Assignment and Exam Calendar (ICS File) (17 points, 6 comments)
    2. Please OMG give us any options for extra credit (8 points, 12 comments)
    3. Strategy learner question (3 points, 1 comment)
    4. Proctortrack: Do we need to schedule our test time? (2 points, 10 comments)
  27. 29 points, 9 submissions: _ant0n_
    1. Next assignment? (9 points, 6 comments)
    2. Proctortrack Onboarding test? (6 points, 11 comments)
    3. Manual strategy: Allowable positions (3 points, 7 comments)
    4. Anyone watched Black Scholes documentary? (2 points, 16 comments)
    5. Buffet machines hardware (2 points, 6 comments)
    6. Defeat learners: clarification (2 points, 4 comments)
    7. Is 'optimize_something' on the way to class GitHub repo? (2 points, 6 comments)
    8. assess_portfolio(... gen_plot=True) (2 points, 8 comments)
    9. remote job != remote + international? (1 point, 15 comments)
  28. 26 points, 10 submissions: umersaalis
    1. comments.txt (7 points, 6 comments)
    2. Assignment 2: report.pdf (6 points, 30 comments)
    3. Assignment 2: report.pdf sharing & plagiarism (3 points, 12 comments)
    4. Max Recursion Limit (3 points, 10 comments)
    5. Parametric vs Non-Parametric Model (3 points, 13 comments)
    6. Bag Learner Training (1 point, 2 comments)
    7. Decision Tree Issue: (1 point, 2 comments)
    8. Error in Running DTLearner and RTLearner (1 point, 12 comments)
    9. My Results for the four learners. Please check if you guys are getting values somewhat near to these. Exact match may not be there due to randomization. (1 point, 4 comments)
    10. Can we add the assignments and solutions to our public github profile? (0 points, 7 comments)
  29. 26 points, 6 submissions: abiele
    1. Recommended Reading? (13 points, 1 comment)
    2. Number of Indicators Used by Actual Trading Systems (7 points, 6 comments)
    3. Software Install Instructions From TA's Video Not Working (2 points, 2 comments)
    4. Suggest that TA/Instructor Contact Info Should be Added to the Syllabus (2 points, 2 comments)
    5. ML4T Software Setup (1 point, 3 comments)
    6. Where can I find the grading folder? (1 point, 4 comments)
  30. 26 points, 6 submissions: tomatonight
    1. Do we have all the information needed to finish the last project Strategy learner? (15 points, 3 comments)
    2. Does anyone interested in cryptocurrency trading/investing/others? (3 points, 6 comments)
    3. length of portfolio daily return (3 points, 2 comments)
    4. Did Michael Burry, Jamie&Charlie enter the short position too early? (2 points, 4 comments)
    5. where to check participation score (2 points, 1 comment)
    6. Where to collect the midterm exam? (forgot to take it last week) (1 point, 3 comments)
  31. 26 points, 3 submissions: hilo260
    1. Is there a template for optimize_something on GitHub? (14 points, 3 comments)
    2. Marketism project? (8 points, 6 comments)
    3. "Do not change the API" (4 points, 7 comments)
  32. 26 points, 3 submissions: niufen
    1. Windows Server Setup Guide (23 points, 16 comments)
    2. Strategy Learner Adding UserID as Comment (2 points, 2 comments)
    3. Connect to server via Python Error (1 point, 6 comments)
  33. 26 points, 3 submissions: whoyoung99
    1. How much time you spend on Assess Learner? (13 points, 47 comments)
    2. Git clone repository without fork (8 points, 2 comments)
    3. Just for fun (5 points, 1 comment)
  34. 25 points, 8 submissions: SharjeelHanif
    1. When can we discuss defeat learners methods? (10 points, 1 comment)
    2. Are the buffet servers really down? (3 points, 2 comments)
    3. Are the midterm results in proctortrack gone? (3 points, 3 comments)
    4. Will these finance topics be covered on the final? (3 points, 9 comments)
    5. Anyone get set up with Proctortrack? (2 points, 10 comments)
    6. Incentives Quiz Discussion (2-01, Lesson 11.8) (2 points, 3 comments)
    7. Anyone from Houston, TX (1 point, 1 comment)
    8. How can I trace my error back to a line of code? (assess learners) (1 point, 3 comments)
  35. 25 points, 5 submissions: jlamberts3
    1. Conda vs VirtualEnv (7 points, 8 comments)
    2. Cool Portfolio Backtesting Tool (6 points, 6 comments)
    3. Warren Buffett wins $1M bet made a decade ago that the S&P 500 stock index would outperform hedge funds (6 points, 12 comments)
    4. Windows Ubuntu Subsystem Putty Alternative (4 points, 0 comments)
    5. Algorithmic Trading Of Digital Assets (2 points, 0 comments)
  36. 25 points, 4 submissions: suman_paul
    1. Grade statistics (9 points, 3 comments)
    2. Machine Learning book by Mitchell (6 points, 11 comments)
    3. Thank You (6 points, 6 comments)
    4. Assignment1 ready to be cloned? (4 points, 4 comments)
  37. 25 points, 3 submissions: Spareo
    1. Submit Assignments Function (OS X/Linux) (15 points, 6 comments)
    2. Quantsoftware Site down? (8 points, 38 comments)
    3. ML4T_2017Spring folder on Buffet server?? (2 points, 5 comments)
  38. 24 points, 14 submissions: nelsongcg
    1. Is it realistic for us to try to build our own trading bot and profit? (6 points, 21 comments)
    2. Is the risk free rate zero for any country? (3 points, 7 comments)
    3. Models and black swans - discussion (3 points, 0 comments)
    4. Normal distribution assumption for options pricing (2 points, 3 comments)
    5. Technical analysis for cryptocurrency market? (2 points, 4 comments)
    6. A counter argument to models by Nassim Taleb (1 point, 0 comments)
    7. Are we demandas to use the sample for part 1? (1 point, 1 comment)
    8. Benchmark for "trusting" your trading algorithm (1 point, 5 comments)
    9. Don't these two statements on the project description contradict each other? (1 point, 2 comments)
    10. Forgot my TA (1 point, 6 comments)
  39. 24 points, 11 submissions: nurobezede
    1. Best way to obtain survivor bias free stock data (8 points, 1 comment)
    2. Please confirm Midterm is from October 13-16 online with proctortrack. (5 points, 2 comments)
    3. Are these DTlearner Corr values good? (2 points, 6 comments)
    4. Testing gen_data.py (2 points, 3 comments)
    5. BagLearner of Baglearners says 'Object is not callable' (1 point, 8 comments)
    6. DTlearner training RMSE none zero but almost there (1 point, 2 comments)
    7. How to submit analysis using git and confirm it? (1 point, 2 comments)
    8. Passing kwargs to learners in a BagLearner (1 point, 5 comments)
    9. Sampling for bagging tree (1 point, 8 comments)
    10. code failing the 18th test with grade_learners.py (1 point, 6 comments)
  40. 24 points, 4 submissions: AeroZach
    1. questions about how to build a machine learning system that's going to work well in a real market (12 points, 6 comments)
    2. Survivor Bias Free Data (7 points, 5 comments)
    3. Genetic Algorithms for Feature selection (3 points, 5 comments)
    4. How far back can you train? (2 points, 2 comments)
  41. 23 points, 9 submissions: vsrinath6
    1. Participation check #3 - Haven't seen it yet (5 points, 5 comments)
    2. What are the tasks for this week? (5 points, 12 comments)
    3. No projects until after the mid-term? (4 points, 5 comments)
    4. Format / Syllabus for the exams (2 points, 3 comments)
    5. Has there been a Participation check #4? (2 points, 8 comments)
    6. Project 3 not visible on T-Square (2 points, 3 comments)
    7. Assess learners - do we need to check is method implemented for BagLearner? (1 point, 4 comments)
    8. Correct number of days reported in the dataframe (should be the number of trading days between the start date and end date, inclusive). (1 point, 0 comments)
    9. RuntimeError: Invalid DISPLAY variable (1 point, 2 comments)
  42. 23 points, 8 submissions: nick_algorithm
    1. Help with getting Average Daily Return Right (6 points, 7 comments)
    2. Hint for args argument in scipy minimize (5 points, 2 comments)
    3. How do you make money off of highly volatile (high SDDR) stocks? (4 points, 5 comments)
    4. Can We Use Code Obtained from Class To Make Money without Fear of Being Sued (3 points, 6 comments)
    5. Is the Std for Bollinger Bands calculated over the same timespan of the Moving Average? (2 points, 2 comments)
    6. Can't run grade_learners.py but I'm not doing anything different from the last assignment (?) (1 point, 5 comments)
    7. How to determine value at terminal node of tree? (1 point, 1 comment)
    8. Is there a way to get Reddit announcements piped to email (or have a subsequent T-Square announcement published simultaneously) (1 point, 2 comments)
  43. 23 points, 1 submission: gong6
    1. Is manual strategy ready? (23 points, 6 comments)
  44. 21 points, 6 submissions: amchang87
    1. Reason for public reddit? (6 points, 4 comments)
    2. Manual Strategy - 21 day holding Period (4 points, 12 comments)
    3. Sharpe Ratio (4 points, 6 comments)
    4. Manual Strategy - No Position? (3 points, 3 comments)
    5. ML / Manual Trader Performance (2 points, 0 comments)
    6. T-Square Submission Missing? (2 points, 3 comments)
  45. 21 points, 6 submissions: fall2017_ml4t_cs_god
    1. PSA: When typing in code, please use 'formatting help' to see how to make the code read cleaner. (8 points, 2 comments)
    2. Why do Bollinger Bands use 2 standard deviations? (5 points, 20 comments)
    3. How do I log into the [email protected]? (3 points, 1 comment)
    4. Is midterm 2 cumulative? (2 points, 3 comments)
    5. Where can we learn about options? (2 points, 2 comments)
    6. How do you calculate the analysis statistics for bps and manual strategy? (1 point, 1 comment)
  46. 21 points, 5 submissions: Jmitchell83
    1. Manual Strategy Grades (12 points, 9 comments)
    2. two-factor (3 points, 6 comments)
    3. Free to use volume? (2 points, 1 comment)
    4. Is MC1-Project-1 different than assess_portfolio? (2 points, 2 comments)
    5. Online Participation Checks (2 points, 4 comments)
  47. 21 points, 5 submissions: Sergei_B
    1. Do we need to worry about missing data for Asset Portfolio? (14 points, 13 comments)
    2. How do you get data from yahoo in panda? the sample old code is below: (2 points, 3 comments)
    3. How to fix import pandas as pd ImportError: No module named pandas? (2 points, 4 comments)
    4. Python Practice exam Question 48 (2 points, 2 comments)
    5. Mac: "virtualenv : command not found" (1 point, 2 comments)
  48. 21 points, 3 submissions: mharrow3
    1. First time reddit user .. (17 points, 37 comments)
    2. Course errors/types (2 points, 2 comments)
    3. Install course software on macOS using Vagrant .. (2 points, 0 comments)
  49. 20 points, 9 submissions: iceguyvn
    1. Manual strategy implementation for future projects (4 points, 15 comments)
    2. Help with correlation calculation (3 points, 15 comments)
    3. Help! maximum recursion depth exceeded (3 points, 10 comments)
    4. Help: how to index by date? (2 points, 4 comments)
    5. How to attach a 1D array to a 2D array? (2 points, 2 comments)
    6. How to set a single cell in a 2D DataFrame? (2 points, 4 comments)
    7. Next assignment after marketsim? (2 points, 4 comments)
    8. Pythonic way to detect the first row? (1 point, 6 comments)
    9. Questions regarding seed (1 point, 1 comment)
  50. 20 points, 3 submissions: JetsonDavis
    1. Push back assignment 3? (10 points, 14 comments)
    2. Final project (9 points, 3 comments)
    3. Numpy versions (1 point, 2 comments)
  51. 20 points, 2 submissions: pharmerino
    1. assess_portfolio test cases (16 points, 88 comments)
    2. ML4T Assignments (4 points, 6 comments)

Top Commenters

  1. tuckerbalch (2296 points, 1185 comments)
  2. davebyrd (1033 points, 466 comments)
  3. yokh_cs7646 (320 points, 177 comments)
  4. rgraziano3 (266 points, 147 comments)
  5. j0shj0nes (264 points, 148 comments)
  6. i__want__piazza (236 points, 127 comments)
  7. swamijay (227 points, 116 comments)
  8. _ant0n_ (205 points, 149 comments)
  9. ml4tstudent (204 points, 117 comments)
  10. gatechben (179 points, 107 comments)
  11. BNielson (176 points, 108 comments)
  12. jameschanx (176 points, 94 comments)
  13. Artmageddon (167 points, 83 comments)
  14. htrajan (162 points, 81 comments)
  15. boyko11 (154 points, 99 comments)
  16. alyssa_p_hacker (146 points, 80 comments)
  17. log_base_pi (141 points, 80 comments)
  18. Ran__Ran (139 points, 99 comments)
  19. johnsmarion (136 points, 86 comments)
  20. jgorman30_gatech (135 points, 102 comments)
  21. dyllll (125 points, 91 comments)
  22. MikeLachmayr (123 points, 95 comments)
  23. awhoof (113 points, 72 comments)
  24. SharjeelHanif (106 points, 59 comments)
  25. larrva (101 points, 69 comments)
  26. augustinius (100 points, 52 comments)
  27. oimesbcs (99 points, 67 comments)
  28. vansh21k (98 points, 62 comments)
  29. W1redgh0st (97 points, 70 comments)
  30. ybai67 (96 points, 41 comments)
  31. JuanCarlosKuriPinto (95 points, 54 comments)
  32. acschwabe (93 points, 58 comments)
  33. pharmerino (92 points, 47 comments)
  34. jgeiger (91 points, 28 comments)
  35. Zapurza (88 points, 70 comments)
  36. jyoms (87 points, 55 comments)
  37. omscs_zenan (87 points, 44 comments)
  38. nurobezede (85 points, 64 comments)
  39. BelaZhu (83 points, 50 comments)
  40. jason_gt (82 points, 36 comments)
  41. shuang379 (81 points, 64 comments)
  42. ggatech (81 points, 51 comments)
  43. nitinkodial_gatech (78 points, 59 comments)
  44. harshsikka123 (77 points, 55 comments)
  45. bkeenan7 (76 points, 49 comments)
  46. moxyll (76 points, 32 comments)
  47. nelsongcg (75 points, 53 comments)
  48. nickzelei (75 points, 41 comments)
  49. hunter2omscs (74 points, 29 comments)
  50. pointblank41 (73 points, 36 comments)
  51. zheweisun (66 points, 48 comments)
  52. bs_123 (66 points, 36 comments)
  53. storytimeuva (66 points, 36 comments)
  54. sva6 (66 points, 31 comments)
  55. bhrolenok (66 points, 27 comments)
  56. lingkaizuo (63 points, 46 comments)
  57. Marvel_this (62 points, 36 comments)
  58. agifft3_omscs (62 points, 35 comments)
  59. ssung40 (61 points, 47 comments)
  60. amchang87 (61 points, 32 comments)
  61. joshuak_gatech (61 points, 30 comments)
  62. fall2017_ml4t_cs_god (60 points, 50 comments)
  63. ccrouch8 (60 points, 45 comments)
  64. nick_algorithm (60 points, 29 comments)
  65. JetsonDavis (59 points, 35 comments)
  66. yjacket103 (58 points, 36 comments)
  67. hilo260 (58 points, 29 comments)
  68. coolwhip1234 (58 points, 15 comments)
  69. chvbs2000 (57 points, 49 comments)
  70. suman_paul (57 points, 29 comments)
  71. masterm (57 points, 23 comments)
  72. RolfKwakkelaar (55 points, 32 comments)
  73. rpb3 (55 points, 23 comments)
  74. venkatesh8 (54 points, 30 comments)
  75. omscs_avik (53 points, 37 comments)
  76. bman8810 (52 points, 31 comments)
  77. snladak (51 points, 31 comments)
  78. dfihn3 (50 points, 43 comments)
  79. mlcrypto (50 points, 32 comments)
  80. omscs-student (49 points, 26 comments)
  81. NellVega (48 points, 32 comments)
  82. booglespace (48 points, 23 comments)
  83. ccortner3 (48 points, 23 comments)
  84. caa5042 (47 points, 34 comments)
  85. gcalma3 (47 points, 25 comments)
  86. krushnatmore (44 points, 32 comments)
  87. sn_48 (43 points, 22 comments)
  88. thenewprofessional (43 points, 16 comments)
  89. urider (42 points, 33 comments)
  90. gatech-raleighite (42 points, 30 comments)
  91. chrisong2017 (41 points, 26 comments)
  92. ProudRamblinWreck (41 points, 24 comments)
  93. kramey8 (41 points, 24 comments)
  94. coderafk (40 points, 28 comments)
  95. niufen (40 points, 23 comments)
  96. tholladay3 (40 points, 23 comments)
  97. SaberCrunch (40 points, 22 comments)
  98. gnr11 (40 points, 21 comments)
  99. nadav3 (40 points, 18 comments)
  100. gt7431a (40 points, 16 comments)

Top Submissions

  1. [Project Questions] Unit Tests for assess_portfolio assignment by reyallan (58 points, 52 comments)
  2. [Project Questions] Unit Tests for optimize_something assignment by agifft3_omscs (53 points, 94 comments)
  3. Proper git workflow by jan-laszlo (43 points, 19 comments)
  4. Exam 2 Information by yokh_cs7646 (39 points, 40 comments)
  5. A little more on Pandas indexing/slicing ([] vs ix vs iloc vs loc) and numpy shapes by davebyrd (37 points, 10 comments)
  6. Project 1 Megathread (assess_portfolio) by davebyrd (34 points, 466 comments)
  7. defeat_learner test case by swamijay (34 points, 38 comments)
  8. Project 2 Megathread (optimize_something) by tuckerbalch (33 points, 475 comments)
  9. project 3 megathread (assess_learners) by tuckerbalch (27 points, 1130 comments)
  10. Deadline extension? by johannes_92 (26 points, 40 comments)

Top Comments

  1. 34 points: jgeiger's comment in QLearning Robot project megathread
  2. 31 points: coolwhip1234's comment in QLearning Robot project megathread
  3. 30 points: tuckerbalch's comment in Why Professor is usually late for class?
  4. 23 points: davebyrd's comment in Deadline extension?
  5. 20 points: jason_gt's comment in What would be a good quiz question regarding The Big Short?
  6. 19 points: yokh_cs7646's comment in For online students: Participation check #2
  7. 17 points: i__want__piazza's comment in project 3 megathread (assess_learners)
  8. 17 points: nathakhanh2's comment in Project 2 Megathread (optimize_something)
  9. 17 points: pharmerino's comment in Midterm study Megathread
  10. 17 points: tuckerbalch's comment in Midterm grades posted to T-Square
Generated with BBoe's Subreddit Stats (Donate)
submitted by subreddit_stats to subreddit_stats [link] [comments]

Download historical Forex data for FREE in 3 Simple Steps Motive Wave Importing Data GMT Import Forex Data Import Data, Analyze, Export and Plot in Python - YouTube MetaTrader 4 Data Downloader Stream free for forex and stock tick data with Metatrader 4 MQL to CSV text file for MATLAB plots How to download indicator’s data in csv and excel format How to import CSV files into MetaTrader4 and perform ... import ascii (text) data in csv format to stockalyze How to import MT4 history data from csv files, forex guidance

Please, don’t hesitate to send us a message in case you find any trouble with the forex data files available in this website. Regarding your question, we output the historical data in 6 diferent file formats. Here the details: 1. Generic ASCII in M1 Bars (1 Minute Bars): As example, in DAT_ASCII_EURUSD_M1_201202.csv: Forex Tester allows you to import an unlimited number of currency pairs and years of history data in almost any possible text format (ASCII *.csv, *.txt). We strongly recommend importing 1-minute data for accurate testing (it is possible to import higher timeframes but testing results may not be as good). Steps to access free forex historical data and forex data for forex (currency) pairs: Step 1: Choose the forex currency pair(s) to query by checking individual close-high-low or check all . Step 2: Enter the start and close range dates for the forex data. Reenter the START and/or STOP DATE in the boxes if necessary. The format must be "mm/dd ... Load the necessary data in Forex Strategy Builder (CSV) format. 100 000 bars is a good start. Copy and paste the downloaded forex data files in the new Data Source directory. Now the new data will be available in the Editor. Load Historical Forex Data in Excel. Loading CSV (Comma Separated Values) files in Excel is straightforward. Download the necessary forex symbol files in Excel (CSV ... Forex Historical Data App is absolutely free for all the traders who want to download Forex data CSV and use it to backtest trading strategies and Robots. Forex Historical Data App is FREE! The Forex Historical Data app is developed to solve one of the biggest problems that the beginner algo traders meet – the brokers do not provide a lot of bars. With this App, you will have Daily Data ... Copy and paste the Forex History Dump CSV script for MetaTrader 4.zip files into the MQL4 Scripts folder of the Metatrader 4 trading platform. Restart your MetaTrader 4 application (assuming it’s currently open) … or Launch your MetaTrader 4 application. You can access this folder from the top menu as follows: File > Open Data Folder > MQL4 ... The data must be like $1 = PHP 51.83 as an example. The data can be exported into a CSV file; The exported file must contain all the data of today's Forex; Must be user friendly and preferably free; I tried to use TickStory but it's a tad tedious to use because I have to download the data that I want, before exporting them to Excel. I also ...

[index] [15871] [28372] [4393] [28211] [760] [11771] [18599] [2866] [19671] [24095]

Download historical Forex data for FREE in 3 Simple Steps

In this video I show you how to delete previous MetaTrader 4 currency pair data and upload your own data to perform consistent back tests. Steps 1. Open MT4 ... The Data Downloader is a MetaTrader 4 Tool that allow the user to export the forex data in CSV format. Available on MQL5 Market: https://mql5.com/3eq6p. Describes how to import csv data into MT4. Import external ascii (text) data in csv format to stockalyze. Use this data for charting, backtesting, scanning, etc. Allows interaction between MetaTrader 4 and Matlab via CSV Files. Exporting forex and stock tick data from MetaTrader 4 into your live trading application. Resources to get you started. http ... A common task in data science is to analyze data from an external source that may be in a text or comma separated value (CSV) format. By importing the data i... Demonstrates how to easily acquire free historical data for your trading platform - in 3 simple steps! Note that this video has closed captions that can be translated into your local language ... http://elliottwavestockmarket.com/ In response to a members query this is how to import data in .csv format into Motive Wave to do an Elliott Wave analysis. How to import MT4 history data from csv files, data source : www.histdata.com Do you need good robot ? Please contact : https://t.me/DNX_system 100% FREE, NO... How to download several indicator’s data in one excel format file or csv format from WHO/Europe DW using an API request. European Health Information Gateway:...

https://binaryoptiontrade.cocortattmesinbu.tk