Fastest
FastVLM-0.5B
Best entry point for WebGPU, browser demos and constrained edge devices.
Browser · Mobile · Edge
View modelFASTVLM · APPLE VISION MODELS · ON-DEVICE VLM · TOOLS
On-Device Vision AI Playground
Run FastVLM and explore Apple’s latest vision models directly on your device. Image Q&A, depth maps, zero-shot classification and image-to-3D—no server, no upload.
- Runs in browser
- WebGPU acceleration
- FastVLM-0.5B
FastVLM-0.5B
See what FastVLM sees
prompt › Describe what is happening in front of the camera.
FastVLM FastVLM processes the visual stream locally in the browser and generates a live description.
FastViTHDTransformers.jsWebGPUMLXCore ML
Models
Apple vision models, organised by what they do
FastVLM is the flagship, but Apple’s research teams also publish depth, image–text, 3D and generative models. Each card says whether you can run it here, locally, or only read about it.
FastVLM
Browser toolVision-language model with the FastViTHD encoder; 0.5B runs in your browser.
OpenDepth Pro
Browser toolMetric depth and focal length from one image; powers the depth map generator.
OpenMobileCLIP2
Browser toolLow-latency image–text encoders; zero-shot classification and similarity tools.
OpenAIMv2
Run guideOpen vision encoders (0.3B–2.7B) with PyTorch, JAX and MLX backends.
OpenSHARP
Run guideOne photo to 3D Gaussians and real-time nearby views in under a second.
OpenLuce
ReferenceRelightable PBR Gaussians and textured meshes from a single object image.
OpenTools
Start from the task, not the paper
Every tool downloads an open model once and runs on your GPU. The model behind each tool is named on the card.
In-browser
Depth Map Generator
Convert one image into a depth map and download it as PNG.
Depth Pro · Depth Anything V2
In-browserZero-Shot Image Classifier
Type your own labels and rank them against an image. No training.
MobileCLIP-S0
In-browserImage–Text Similarity
Score how well sentences describe an image with CLIP embeddings.
MobileCLIP-S0
Local guideImage to 3D
Turn one photo into 3D Gaussians for nearby views, or a relightable asset.
SHARP · Luce
In-browserBenchmark Your Device
Measure model load, first token and tokens per second on your GPU, then share the result.
FastVLM-0.5B
Compare on-device AI
FastVLM against the other small VLMs
Source-qualified comparisons with SmolVLM2, LFM2.5-VL and Gemma, plus a table of every small vision-language model that runs on phones, laptops or in the browser.
Start here
A real FastVLM WebGPU playground
Open the embedded FastVLM demo, grant camera access when you are ready, and run the 0.5B model through Transformers.js and WebGPU. The original demo stays available on its own focused page.
apple/FastVLM-0.5BWebGPU
Choose a model
Three FastVLM sizes, one efficient vision encoder
Start with 0.5B for browser and edge experiments, move to 1.5B for a stronger balance, or use 7B when benchmark quality matters most.
Balanced
FastVLM-1.5B
A practical middle ground for local development and Apple Silicon.
Mac · Workstation
View model Best quality
FastVLM-7B
The strongest official variant across the published evaluation table.
Desktop · Native
View modelFastVLM explained
High-resolution vision without the usual token cost
FastVLM is an open vision-language model from Apple researchers. Its FastViTHD hybrid vision encoder reduces visual tokens and encoding latency, improving the accuracy–latency trade-off for high-resolution images and on-device use.
Apple-reported comparison In Apple’s reported comparison at the highest resolution, FastVLM-0.5B achieved up to 85× faster time-to-first-token than LLaVA-OneVision-0.5B while using a 3.4× smaller vision encoder.
Image
FastViTHD
Visual tokens
LLM
Response
Official results
FastVLM benchmark snapshot
Published evaluation scores from Apple’s Hugging Face model cards. Higher is better; benchmark protocols differ, so compare within each row.
| Benchmark | 0.5B | 1.5B | 7B |
|---|---|---|---|
| AI2D | 68.0 | 77.4 | 83.6 |
| ScienceQA | 85.2 | 94.4 | 96.7 |
| MMMU | 33.9 | 37.8 | 45.4 |
| ChartQA | 76.0 | 80.1 | 85.0 |
| TextVQA | 64.5 | 70.4 | 74.9 |
| DocVQA | 82.5 | 88.3 | 93.2 |
Source: Apple FastVLM model card Hugging Face
Deploy your way
Run FastVLM where your application lives
Browser
Use the 0.5B WebGPU demo without installing a local runtime.
Open playgroundPython
Load official Hugging Face checkpoints for local inference.
Python guideMac
Use Apple Silicon resources including MLX-compatible checkpoints.
Mac guideiPhone
Explore Apple’s official iOS/macOS demo and Core ML resources.
iPhone guidePopular guides
From first run to local deployment
Make the trade-off explicit
Compare FastVLM before you deploy
See how model sizes trade accuracy for footprint, and read a source-qualified comparison with LLaVA-OneVision.
FAQ
FastVLM questions, answered
Can FastVLM really run in a browser?
Yes. The linked FastVLM-0.5B demo uses Transformers.js and WebGPU to run inference directly in a compatible browser. Initial model download and compilation can take time.
Which FastVLM model should I start with?
Use 0.5B for the browser and constrained devices, 1.5B for a balanced local setup, and 7B when published benchmark quality is the priority.
Is FastVLM.net the official Apple website?
No. FastVLM.net is an independent developer resource. Apple’s research page, GitHub repository and Hugging Face organization are the official sources linked throughout this site.
Does every FastVLM setup run fully on-device?
No. FastVLM supports on-device deployment, but privacy and data flow depend on the runtime and application you choose. The WebGPU playground is designed for in-browser inference.
Primary sources