ToolsBlog

WebGPU + WebLLM: Running LLMs in the Browser

Try it free:CSV AIParquet AI

Table of Contents

  • What is WebGPU?
  • LLMs in the browser
  • How we can run them in the browser
  • Whisper Turbo

WebGPU

What is WebGPU? #

WebGPU is a web standard that enables native GPU execution on browsers, allowing for faster graphics and computations. WebGPU is the successor to WebGL, which was designed for graphics rendering, but WebGPU has first-class support for GPGPU computations

WebLLM is a new project that runs large language models fully inside the browser, reducing costs and enhancing personalization and privacy.

Running large language models in the browser is made possible by WebLLM and WebGPU. WebLLM is a project that runs large language models fully inside the browser, while WebGPU enables native GPU execution on browsers, allowing for faster computations

LLMs in the browser #

With WebLLM we can compile open source large language models to work with WebGPU and run entirely in the browser:

Here are some links to some of models compiled for WebGPU and Web Assembly:

  • SQLCoder 7B
  • Glaive Coder 7B

Here is a great guide on how to compile different models to WebGPU.

How we can run them in the browser #

Once we have a model compiled for Web GPU, we can use WebLLM to run it for inference. Here is a really cool demo where you can run the demo at wasmai.vercal.app.

web gpu wasmai example

We are going to continue compiling new models as they come out and hopefully add them to the free tools for you to try 😊!

Whisper Turbo #

whisper turbo

Whisper Turbo is another big project that brings Whisper to the browser. It can transcribe audio at about 20x realtime speed. Super cool, that you can have a performant model, working totally locally with no internet connection!

You can see their GitHub repo as well!

Try the tools from this post

Free and private: your files stay in your browser.

  • CSV AIGet insights from your CSV files using natural language.
  • Parquet AIQuery your Parquet files using natural language.

Related posts

OpenAI Dev Day Updates

Explore the different types of SQL joins and learn how they can improve your data analysis capabilities.

2023-11-06

Building a More Intuitive AI for Your Database

A deeper dive into the development and potential of our AI-powered database assistant, ChatDB

2023-06-16

CSV AI: Querying CSV files with AI and natural language

We are proud to introduce a new, free tool where you can query your CSV with AI.

2024-05-01

ChatDB

Free, browser-side data tools. No uploads, no accounts.

Data tools

Reader

  • Online CSV Viewer
  • Parquet Viewer & Reader
  • Excel Viewer and Editor
  • SQLite Viewer
  • Gzip CSV Reader
  • CSV Size Analyzer
  • Parquet Schema Reader
  • Parquet Metadata Reader
  • Data Profiler
  • Image Measure
  • Shapefile Viewer
  • GeoJSON Viewer

Editor

  • CSV Viewer and Editor
  • Excel Viewer and Editor
  • Online Excel Editor
  • CSV Splitter
  • Markdown Editor
  • Image Cropper
  • SVG Editor
  • Screenshot Background Creator
  • Document Scanner
  • Audio Clipper
  • Video Trim & Crop Tool

Converter

  • CSV to Gzip Converter
  • CSV to Parquet Converter
  • Excel to CSV Converter
  • Parquet to CSV Converter
  • JSON to Parquet Converter
  • Parquet to JSON Converter
  • CSV Decompressor
  • CSV to JSON Converter
  • CSV to Markdown Table
  • Image Converter
  • KML to GeoJSON Converter
  • GPX to GeoJSON Converter
  • GeoJSON to KML Converter
  • Shapefile to GeoJSON Converter

Formatter

  • CSV Encoder
  • SQL Formatter
  • JSON Formatter
  • XML Formatter
  • YAML Formatter
  • Dataset README Generator
  • URL Encoder & Decoder
  • Regex Tester

Compressor

  • CSV Compressor
  • CSV to Gzip Converter
  • CSV Decompressor
  • Image Compressor

AI

  • Parquet AI
  • CSV AI
  • Color Palette Generator
  • Extract Image Colors

GIS

  • Lat/Lng Point Finder
  • KML to GeoJSON Converter
  • GPX to GeoJSON Converter
  • GeoJSON to KML Converter
  • Shapefile to GeoJSON Converter
  • Shapefile Viewer
  • GeoJSON Viewer

Image tools

Convert To

  • Convert to JPEG
  • Convert to PNG
  • Convert to WEBP
  • Convert to GIF
  • Convert to BMP
  • Convert to TIFF
  • Convert to ICO
  • Convert to AVIF
  • Convert to FF
  • Convert to HDR
  • Convert to EXR
  • Convert to QOI
  • Convert to TGA
  • Convert to PNM

Edit

  • Image Cropper
  • SVG Editor
  • Screenshot Background Creator
  • Document Scanner

Compress

  • Compress JPG
  • Compress JPEG
  • Compress PNG
  • Compress WEBP
  • Compress GIF

Company

  • All tools
  • Blog
  • Privacy Policy
  • Terms of Service

© 2026 ChatDB. All rights reserved.

v2.4.1