Hands-On Transformer Deep Dive: Part 3— Positional Encoding, RoPE & YaRNThis is Part 3 of the “Hands-on Transformer Deep Dive” series. We dive deep into position encoding, implement Sinusoidal Encoding and…Sep 15Sep 15
Hands-On Transformer Deep Dive: Part 2 — Multi-head Attention Variants with CodeWhat exactly are the multi-head attention variants MHA, MQA, GQA, and MLA? Follow along to understand and implement them all.Aug 5Aug 5
Hands-On Transformer Deep Dive: Part 1 — Masked Attention Explained & ImplementedIn this “Hands-On Transformer Deep Dive” series, we go step-by-step through the algorithms and components of modern Transformers, with…Aug 1A response icon3Aug 1A response icon3
A Fullstack Text-to-Image Generative AI App You Can Build in an AfternoonAs a fun project for a hot summer weekend, I built a minimal fullstack text-to-image Generative AI web app with the Stable Diffusion model…Jul 10, 2023Jul 10, 2023
Published incodeburstMigrate PostgreSQL on AWS from RDS to AuroraThis is a story about rescuing a not-so-old system from the legacy architecture design which no longer suits its global requirements.Dec 10, 2020Dec 10, 2020
The DNS Lookup Journey…Or one answer to the famous “what happens when you type an URL in your browser address bar and hit the Enter key” question.Apr 26, 2020Apr 26, 2020
My Docker CheatsheetAfter lots of fumbling and rummages I’ve finally compiled my own Docker cheatsheet.Jan 3, 2019Jan 3, 2019
A Simple Friendly Story of Go PointersScary stories have been told about the pointers in C/C++. The pointers in Go, however, are just simple and friendly: two usages of the…Nov 10, 2018Nov 10, 2018
Build a Create-React-App (ejected) for stagingIn my work, there are environment variables predefined by the DevOps team which must obey certain company-wide rules. The implication: no…Nov 8, 2018Nov 8, 2018
Develop in Docker: a Node backend and a React front-end talking to each otherRecently I’ve started a new project which involves both a Node backend and a React front-end. The Node backend is a simple application…May 31, 2018A response icon23May 31, 2018A response icon23