Jaz's Blog
Turning Billions of Strings into Integers Every Second Without Collisions
I’ve recently started building a POC of a Redis RESP3 Wire Compatible Key/Value Database built on...
26th Sep 2025
I’ve recently started building a POC of a Redis RESP3 Wire Compatible Key/Value Database built on FoundationDB with @calabro.io and though it’s rather early, it’s already spawned a fun distributed systems problem that I thought would be interesting to share.
Previously I’ve...
Jaz's Blog
When Imperfect Systems are Good, Actually: Bluesky's Lossy Timelines
Often when designing systems, we aim for perfection in things like consistency of data,...
19th Feb 2025
Often when designing systems, we aim for perfection in things like consistency of data, availability, latency, and more.
The hardest part of system design is that it’s difficult (if not impossible) to design systems that have perfect consistency, perfect availability, incredibly...
Jaz's Blog
Jetstream: Shrinking the AT Proto Firehose by >99%
Bluesky recently saw a massive spike in activity in response to Brazil’s ban of Twitter.
As a...
24th Sep 2024
Bluesky recently saw a massive spike in activity in response to Brazil’s ban of Twitter.
As a result, the AT Proto event firehose provided by Bluesky’s Relay at bsky.network has increased in volume by a huge amount. The average event rate during this surge increased by...
Jaz's Blog
How HLS Works
Over the past few weeks, I’ve been building out server-side short video support for Bluesky.
The...
5th Jul 2024
Over the past few weeks, I’ve been building out server-side short video support for Bluesky.
The major aim of this feature is to support short (90 second max) video streaming at a quality that doesn’t cost an arm and a leg for us to provide for free.
In order to stay within these...
Jaz's Blog
Your Data Fits in Memory (GraphD Part 1)
I recently shipped a new revision of Bluesky’s global AppView at the start of February and things...
15th Apr 2024
I recently shipped a new revision of Bluesky’s global AppView at the start of February and things have been going very well. The system scales and handles millions of users without breaking a sweat, the ScyllaDB-backed Data Plane service sits at under 5% DB load in the most...
Jaz's Blog
Scaling Go to 192 Cores with Heavy I/O
For the past few months I’ve been working alongside Why, Jacob, Dan, and Divy on a new revision of...
10th Jan 2024
For the past few months I’ve been working alongside Why, Jacob, Dan, and Divy on a new revision of Bluesky’s global AppView.
The AppView is a piece of infrastructure that aggregates posts, likes, follows, etc. from all across ATProto and merges them into a consistent view of the...
Jaz's Blog
Solving Thundering Herds with Request Coalescing in Go
Caches are a wonderful way to make your most frequent operations cheaper.
If you’ve got a resource...
28th Sep 2023
Caches are a wonderful way to make your most frequent operations cheaper.
If you’ve got a resource somewhere on disk (or a network hop away) that is accessed often, changes infrequently, and fits in memory, you’ve got an excellent candidate for a cache!
Caching Celebrity...
Jaz's Blog
Speeding Up Massive PostgreSQL Joins with Common Table Expressions
I’ve been continuing to work on a growing series of services that archive, analyze, and represent...
10th Aug 2023
I’ve been continuing to work on a growing series of services that archive, analyze, and represent data from a social network.
This network creates text-based posts at a rate of around 400,000 posts per day, and I’ve been feeding the posts through different ML models to try and...
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 