Musings from My Corner of the World

I write about the things that spark my curiosity. Some posts will be polished, while others serve as a journal for me.
Hopefully you’ll find something here to inspire you too.

Running Llama 3 in the Browser!

NLP

LLM

WebLLM

MLC-LLM

WebGPU

TVM

Chat with Llama and other LLMs that run locally in your browser using WebLLM.

My Notes on Information Theory

ML

Information Theory

A brief overview of Information Theory concepts that I compiled for my own reference.

Custom Loss Functions for LightGBM and CatBoost

ML

LightGBM

CatBoost

GBT

Guide on how to implement custom loss functions and evaluation metrics for LightGBM and CatBoost

Implementing Multi-Layer LSTM and AdamW from Scratch using NumPy

ML

NLP

Optimization

Analysis

This tutorial walks through the implementation of a multi-layer LSTM model from scratch in pure NumPy, and trains it on the Shakespeare dataset. It also covers the implementation of the AdamW optimizer and the necessary data modules.

Reuse