Start free. Scale when you need to.
Run LayerScale free on a single GPU, with the same API, sessions and Flash Queries as Pro. Upgrade to Pro when you need unlimited sessions, one model across several GPUs and production monitoring.
Free
LayerScale
$0
Free license key. Use forever.
- ✓ OpenAI and Anthropic API compatibility
- ✓ Tool calling (both formats)
- ✓ SSE streaming responses
- ✓ 1 live session
- ✓ Push live data into a session
- ✓ Flash Queries
- ✓ WebSocket support
- ✓ Runs on one GPU
- ✓ Context length up to 32K tokens
License key required
LayerScale Pro
Contact us
30-day free trial available.
- ✓ Everything in LayerScale
- ✓ Unlimited concurrent sessions
- ✓ Unlimited context length
- ✓ Multi-GPU tensor parallelism
- ✓ Prometheus metrics endpoint
- ✓ Continuous-batching scheduler
- ✓ Production support
Feature comparison
| Feature | LayerScale | Pro |
|---|---|---|
| Inference | ||
| OpenAI API (/v1/chat/completions) | ✓ | ✓ |
| Anthropic API (/v1/messages) | ✓ | ✓ |
| Tool calling | ✓ | ✓ |
| SSE streaming | ✓ | ✓ |
| GPU acceleration (CUDA, ROCm) | 1 GPU | Multi-GPU |
| Tensor parallelism | – | ✓ |
| Sessions | ||
| Live sessions | 1 | Unlimited |
| Push live data into a session | ✓ | ✓ |
| Flash Queries | ✓ | ✓ |
| WebSocket connections | ✓ | ✓ |
| Infrastructure | ||
| Context length | 32,768 | Unlimited |
| Prometheus metrics | – | ✓ |
| Continuous-batching scheduler | – | ✓ |
| Support | ||
| Documentation | ✓ | ✓ |
| Priority support | – | ✓ |
| License key required | Yes (free key) | Yes |