Get your license key
Full inference capabilities with 1 session, 32K context, and GPU acceleration on a single GPU. Multi-GPU tensor parallelism is part of LayerScale Pro.
Full inference capabilities with 1 session, 32K context, and GPU acceleration on a single GPU. Multi-GPU tensor parallelism is part of LayerScale Pro.