DEV-TOOLSApril 24, 20261 min read5 views

Show HN: How LLMs Work – Interactive visual guide based on Karpathy's lecture

A comprehensive guide explaining the technical journey of building Large Language Models, from raw internet data to conversational assistants, inspired by Andrej Karpathy's insights.

A Visual Deep Dive How LLMs Actually Work Live LLM Response Human: What is behind this text box? A complete walkthrough of how large language models like ChatGPT are built — from raw internet text to a conversational assistant. Based on Andrej Karpathy's technical deep dive. Training Tokens 15T Parameters 405B Text Data 44 TB Token Vocabulary 100K Scroll to explore

Source: Hacker News

More in this category

dev-tools

Regressive JPEGs

By exploiting the progressive scan structure of JPEG files, it is possible to create 'Regressive JPEGs' that overwrite previously rendered data to display animations without using GIFs or video formats.

dev-tools

I started a “dirt notebook”

The author shares their experience of overcoming the perfectionism of note-taking by starting a 'dirt notebook'—a messy, unstructured space for raw thoughts and ideas.

dev-tools

Stenchill: 3D Printable Solder Paste Stencil Generator

Stenchill is a web-based tool that converts Gerber files into 3D-printable STL files for PCB solder paste stencils, making prototyping faster and cheaper.

dev-tools

TP-Link Kasa cameras leaked home GPS via unauthenticated UDP for 6 years

A security analysis of the TP-Link Kasa Spot EC71 camera revealed critical vulnerabilities, including unauthenticated GPS exposure, fleet-wide RSA keys, and insecure MD5 credential storage, which have now been patched in firmware version 2.4.1.

dev-tools

Open Book Touch: open-source e-reader

After six years of development, the Open Book Touch has launched as a fully open-source, pocket-sized e-reader featuring a 4.26-inch touchscreen and dual-tone frontlight. It supports EPUB files and empowers users with complete hardware and software customizability.

dev-tools

The Zilog Z80 has turned 50

The Zilog Z80 processor, launched in 1976, has officially reached its 50th anniversary. This article explores its historical significance, technical evolution from the Intel 8008/8080, and its lasting legacy in computing history.