From 30th April, 2015 Packt Publishing has thrown open the virtual doors of its new Free Learning Library and offering its customers a daily chance to grab a fresh free eBook from its website. The publisher is encouraging people to learn new skills and try out new technologies and so every day it will be offering a different eBook from its huge list of titles free for anyone to download. The Free Learning Library will be open all year-round but each title will only be up for 24 hours, so make sure you keep checking back to get your hands on the latest book! Packt has well over 2000 titles published and the range of topics that could potentially feature is huge. From AngularJS to Zabbix, there’s going to be something to appeal to everyone – this is a great opportunity to try out a different technology or a new technique. All you’ll have to do is simply click on the day’s free eBook and it will instantly be added to your account. New customers are also encouraged to take advantage, with the offer being a brilliant chance to try out Packt’s great range of books and products – all that’s required is a Packt account. Find out more:http://bit.ly/1Kt6U6w #FreeLearning
OK, firstly, I’m not talking proper BigData here. This is not Hadoop, or even an analytical database. (Lets not get into whether an analytical database counts as bigdata though!). And it’s certainly not NoSQL. Disk space we’re looking at 100’s of gigabytes, not terabytes. Yet this project involves more data than the Hadoop projects I’ve done.
So tens of billions of records. Records that must be processed in a limited environment in extremely tight time windows. And yes; I’m storing all of that in MySQL!
Hey, wake up, yes, I did say billions of records in MySQL, try not to lose consciousness again… (It’s not the first time I’ve had billions of rows in MySQL either – Yet I know some of you will guffaw at the idea)
In fact, in this project we are moving away from a database cluster, to a single box. The database cluster has 64 nodes and 4TB…
View original post 495 more words