A simple method for working with BigQuery results in Python (for pandaphobes)
I love Pandas. They’re so cute and cuddly and make great pets.
On the other hand, I have to admit that I’m not the biggest fan of the Pandas Python Library… while I do use it (and it is incredibly powerful and well adopted), I have always found the syntax unintuitive and documentation thorough but taxing on my brain.
While some of the functions can seem like pure magic (I love a bit of
read_html), the syntax to achieve some basic tasks like filtering or iteration often has…
Because simple is better than complex.
The first Cloud Function I ever deployed was to achieve exactly this task. We had a number of CSV files being dropped into a Google Cloud Storage bucket every night, which needed to be available for transformation and analysis in BigQuery.
Spending some time on Google brought me to this how-to guide, which was a little different (JSON files instead of CSV), but I figured I could tweak it a bit and get it to work. After all, it’s a pretty common workflow in the world of software and data engineering: find something which…
Analyse the contents of over 25 million books in a matter of seconds
When I was at college, finding specific information involved a pretty low-tech and inefficient process. You had to scan through book titles on a standalone computer (from my recollection you could at least search by keywords) to find the correct lookup code, then walk to the correct section of the library to physically track down the book. You then had to decide which particular words you were looking for and flick through the index to find pages where specific words were mentioned. Then (whilst carefully holding your…
Because I don’t carry my Oxford English Dictionary around any more.
There are loads of things you probably don’t know about Google Chrome, but this trick is very simple and useful.
Because it might be useful for some things. Like writing posts about taking partial screenshots on a Mac.
OK that looks easy. In more details:
Because I can’t find it on my keyboard. Well, actually I can find it on my keyboard but it makes my other keys do different stuff.
I really hate having to do things with weird key combinations. Kind of like phone numbers in the olden days, for some reason I can still (pointlessly) remember long-defunct eleven digit phone numbers from forgotten friends and sequential key combinations from Excel ’95; however my brain is now full and nearly every time I need to do something with a keyboard shortcut I need to look it up. …