Making Mac Bearable

<span title='2023-12-02 12:16:28 +0000 UTC'>December 2, 2023</span>

Sentence Mining with OpenAI's Whisper

Online, I tend to market myself as an AI / computery guy, creating and following content related to these areas. However, I have other interests and passions to tinker with – unfortunately too many to actually dedicate lots of time to all of them, with the exception of one. The One is language learning, specifically learning Chinese, which I have been generally consistent with. It has been a long road, starting in late 2018 but with large breaks and misguided routes taken along the way....

<span title='2023-07-04 07:07:39 +0100 +0100'>July 4, 2023</span>

Easy JAX training loops with Flax and Optax

In my previous blog post, I discussed JAX – a framework for high performance numerical computing and machine learning — in an atypical manner. I didn’t create a single training loop, and only showed a couple patterns that looked vaguely machine learning-like. If you haven’t read that blog post yet, you can read it here. This approach was deliberate as I felt that JAX — although designed for machine learning research — is more general-purpose than that....

<span title='2023-06-04 12:00:00 +0100 +0100'>June 4, 2023</span>

On Learning JAX – A Framework for High Performance Machine Learning

Recently, I took part in the Huggingface x Google Cloud community sprint which (despite being named a ControlNet sprint) had a very broad scope: involve diffusion models, use JAX, and use TPUs provided for free by Google Cloud. A lot of cool projects came out of it in a relatively short span of time. Our project was quite ambitious: to take my master’s dissertation work on combining step-unrolled denoising autoencoders (loosely adjacent to discrete diffusion models) with VQ-GAN, porting it all to JAX, then adding support for text-conditioned generation....

<span title='2023-05-22 08:41:00 +0100 +0100'>May 22, 2023</span>

A Brief Overview of Parallelism Strategies in Deep Learning

Royal York Crescent, Bristol. It has been nearly half a year since I started my first real job as a fully-fledged graduate. This has taken the form of being an AI Engineer at Graphcore, a Bristol-based AI accelerator startup. In quite a short amount of time, I have learned a great great deal and I am grateful for the opportunity and the patience of my colleagues – the latter of which is particularly needed when tutoring the average, fresh compsci graduate....

<span title='2023-02-26 09:00:00 +0000 UTC'>February 26, 2023</span>