Pinned Loading

1. lm-research-pilot lm-research-pilot Public

   A CPU-friendly experimental pipeline for analyzing how linguistic structure forms during early transformer training.

   Python

2. pytorch-rope-embeddings pytorch-rope-embeddings Public

   A lightweight, pure PyTorch implementation of Rotary Positional Embedding (RoPE) and its variants (e.g., Llama 4's iRoPE scaling), designed for easy integration into custom transformer attention la…

   Python

3. TInyTransformer TInyTransformer Public

   Transformer Implementations from scratch

   Jupyter Notebook

4. lasso lasso Public

   Studing the Llama 4 code

   Python 1

5. rope-visualizer rope-visualizer Public

   An interactive D3.js visualization exploring Rotary Positional Embeddings (RoPE) through a clockwork metaphor. Designed to provide visual intuition for modern LLM architecture.

   JavaScript

6. OllamaRAG OllamaRAG Public

   Retrieval Augmented Generation using Ollama LLM

   Python