Alright, so I wanted to work on my last crawler that did a couple new things. Here are the goals for this one. Use lxml's etree html parser over bs4 Separate into functions / clean up code a bit Cut out duplicate entries I do not understand xpaths, but that's the

Just collecting the hotkeys, shortcuts, and commands that I use frequently (and some I use infrequently but often have to go looking for). Windows General Use Win + L: Lock computer (very useful) Win + X: Quick link window (links to a bunch of administrative tools) Win + X, U: Shutdown menu, follow

Ohai. I was thinking about how I would secure sensitive data while traveling without inconveniencing myself, of course. I figured it would be an interesting thought to share, to see if anyone wanted to comment on it. Goals: Data is secure in transit Cannot be feasibly coerced into providing access

I wanted to build a web crawler in python to dive into pages and look for images. So of course the first thing I did was google it. After looking through several pages, I stumbled across this simple article. Well, that seems easy enough let's see if we can't build

Hello! I recently moved my blog (you're reading it!) from the official Ghost hosting to DigitalOcean. I can spend a moment talking about why I made the transition: It's hella fucking cheaper and way easier now. That was quick, so I guess now is where I talk about how I

I have been thinking about this for a bit now, so I thought I would share. A year ago when I set up my blog and professional email address, tools were a bit limited. There was a lot of it was do-it-yourself, which can be rather annoying and intimidating when

Update (2018-01-29): Whitequark on twitter made a tool to scrape the Strava data.[1] Strava, a company that operates a fitness tracking application compatible with the Fitbit, has released a heatmap tool to see global usage of their heatmaps. People have found military bases[2] using the heatmap and people

At the start of college I was told to keep an engineering journal. I was told to write down problems I encountered and how I solved them in detail. The idea is that you should never have to solve the same problem twice. I will share how I structure my

Lessons Learned is a collection of issues and failures that I encounter each month. Each entry explains the problem that I encountered, the solution I reached, and what I learned from it. This list will be updated periodically. Last Updated: 2017-10-03 Issues 'Error: Invalid Serial Connection', 2017-10-01 Problem: While working

Over the past couple years I spent time with several password managers. Each password manager I tested addresses different problems. As with all technology, understanding what problems a technology addresses allows you to make informed decisions about its use. I will cover password managers at a high level before going