Pensieve
Subscribe
Sign in
Home
Archive
Latest
Top
Discussions
The "Files are the Database": A Deep Dive into Delta Lake
How a simple transaction log turned cloud object storage into a reliable data warehouse.
Nov 27
•
Anuvrat Singh
1
An AI Was Tricked Into Hacking
The Real Flaw Is in Our Design
Nov 15
•
Anuvrat Singh
1
OpenAI's Browser - Architectural Trade-off
When OpenAI launched its new browser, most people focused on the AI features. But the more interesting story is its architecture.
Nov 4
•
Anuvrat Singh
October 2025
The Spanner Paper: Google's Quest for a Globally Consistent Database
Or, how to have your Bigtable (scale) and eat your MySQL (transactions) too.
Oct 22
•
Anuvrat Singh
Deconstructing Bigtable: A Study in Distributed System Design
After diving into the foundational papers on the Google File System (GFS) and Facebook’s Tectonic, I felt I had a decent grasp of how to build a…
Oct 16
•
Anuvrat Singh
Tectonic: Navigating Design Trade-offs at Facebook Scale
Some research papers don’t just document a system, they reveal how engineers reason about complexity.
Oct 15
•
Anuvrat Singh
Engineering Trade-offs in the Google File System
The Art of Choosing What to Give Up
Oct 10
•
Anuvrat Singh
May 2025
A Baby, a Bug, and a Pull Request to the Human Genome
A few weeks ago, I read a story that I haven’t been able to shake off.
May 29
•
Anuvrat Singh
1
1
Beyond `kubectl apply`Giving Your Kubernetes Apps Superpowers with the Operator Pattern
Kubernetes 101 — Desired State Magic
May 5
•
Anuvrat Singh
January 2025
Debugging Pip Extras: A Deep Dive into .whl Files
Background
Jan 8
•
Anuvrat Singh
July 2018
Writing Into Dynamic Partitions Using Spark
Hive has this wonderful feature of partitioning — a way of dividing a table into related parts based on the values of certain columns.
Jul 12, 2018
•
Anuvrat Singh
1
May 2017
Parse Json in Hive Using Hive JSON Serde
In an earlier post, I wrote a custom UDF to read JSON into my table.
May 25, 2017
•
Anuvrat Singh
1
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
