Alex Xiaoli Shen – Medium

Alex Xiaoli Shen

she/her

Hands-On Transformer Deep Dive: Part 3— Positional Encoding, RoPE & YaRN

This is Part 3 of the “Hands-on Transformer Deep Dive” series. We dive deep into position encoding, implement Sinusoidal Encoding and…

Sep 15

Hands-On Transformer Deep Dive: Part 3— Positional Encoding, RoPE & YaRN

Sep 15

Hands-On Transformer Deep Dive: Part 2 — Multi-head Attention Variants with Code

What exactly are the multi-head attention variants MHA, MQA, GQA, and MLA? Follow along to understand and implement them all.

Aug 5

Hands-On Transformer Deep Dive: Part 2 — Multi-head Attention Variants with Code

Aug 5

Hands-On Transformer Deep Dive: Part 1 — Masked Attention Explained & Implemented

In this “Hands-On Transformer Deep Dive” series, we go step-by-step through the algorithms and components of modern Transformers, with…

Aug 1

Hands-On Transformer Deep Dive: Part 1 — Masked Attention Explained & Implemented

Aug 1

A Fullstack Text-to-Image Generative AI App You Can Build in an Afternoon

As a fun project for a hot summer weekend, I built a minimal fullstack text-to-image Generative AI web app with the Stable Diffusion model…

Jul 10, 2023

A Fullstack Text-to-Image Generative AI App You Can Build in an Afternoon

Jul 10, 2023

Published in

Migrate PostgreSQL on AWS from RDS to Aurora

This is a story about rescuing a not-so-old system from the legacy architecture design which no longer suits its global requirements.

Dec 10, 2020

Migrate PostgreSQL on AWS from RDS to Aurora

Dec 10, 2020

The DNS Lookup Journey

…Or one answer to the famous “what happens when you type an URL in your browser address bar and hit the Enter key” question.

Apr 26, 2020

The DNS Lookup Journey

Apr 26, 2020

My Docker Cheatsheet

After lots of fumbling and rummages I’ve finally compiled my own Docker cheatsheet.

Jan 3, 2019

Jan 3, 2019

A Simple Friendly Story of Go Pointers

Scary stories have been told about the pointers in C/C++. The pointers in Go, however, are just simple and friendly: two usages of the…

Nov 10, 2018

A Simple Friendly Story of Go Pointers

Nov 10, 2018

Build a Create-React-App (ejected) for staging

In my work, there are environment variables predefined by the DevOps team which must obey certain company-wide rules. The implication: no…

Nov 8, 2018

Build a Create-React-App (ejected) for staging

Nov 8, 2018

Develop in Docker: a Node backend and a React front-end talking to each other

Recently I’ve started a new project which involves both a Node backend and a React front-end. The Node backend is a simple application…

May 31, 2018

Develop in Docker: a Node backend and a React front-end talking to each other

May 31, 2018

Alex Xiaoli Shen

Alex Xiaoli Shen

she/her

Leading AI and Cloud innovation at Microsoft. Ex-AWS Solutions Architect (ML focused) . 14 years in tech and counting. Opinions and posts are my own.

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech