Get your license key

Serve a model on one GPU with 1 live session, 32K context and the full API. Multi-GPU tensor parallelism is part of LayerScale Pro.