python

Suppose you have a set of YouTube videos and you want to easily listen to the audio. For me, this is the The Archers omnibus which I am really behind on (yeah, I know, but I’ve been listening since I was 14 and can’t quit now). There are some services that can do this for you, but I’ve found them to be kind of annoying. The one I was using only accepted audio, so I had to rip the YouTube audio myself, put it somewhere public like Dropbox public folder, and add the URL to the podcast site....

The faster you move, the slower time goes relative to an obvserver. As you approach the speed of light, those effects can become massive, and hard to wrap your head around. I have recently been reading Project Hail Mary by Andy Weir, and a long space journey where time dilation comes into play is part of the plot. It got me thinking if we could use Python to calculate the dilation effects exactly for various journeys....

When dealing with massive datasets, traditional methods of data processing can be slow and inefficient. Fortunately, Apache Spark provides a powerful framework for distributed processing that allows for much faster and more scalable data manipulation. In this blog post, we will explore how to use Apache Spark to import a massive CSV/JSON (as in many gigabytes and tens of millions of lines), do some data processing and cleaning of the text-based data, and then save the new rows into a database using Python....