Build Log #01 - Mining Market Data
Finn is finally out of my development machine and onto a real server...and apparently making it possible to run simulations while a train is disappearing into a tunnel 🕵🏼♂️
So here we are, finally...the launch of hello-finn.com
Well, I call it a "launch", but it's more of a "get this crap on to the server so that I can see it even if it's not my development machine", and the biggest part of that which is mining the market data.
Why mining? And what does that mean? Well, given that Finn needs a lot of candlestick-type data, we can't just API-quiz the providers every time we want to run a backtest, or check that our trading bot would work. There's just too much - on a 15min chart over the course of 4 years of backtesting we would need to quiz a provider for about 140,000 candles - and that's for each asset.
So, what did I do - a smaller API call repeatedly gathering candlestick data, separating them into assets and timeframes, and caching them permanently for my scripts to read and run things off of. It's kinda cool, I can also run simulations now when I'm going through a tunnel on a train and the internet dies...
...just like Ethan Hunt in some secret mission.
Anyways, the hello-finn.com site is officially up and running, and there are mining operations happening in the background to collect asset info. It's only on Bitcoin at the moment, chill out. More to come.