Enterprise AI
SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints
Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator.
AMLB
AWS Machine Learning Blog
Source
AWS Machine Learning Blog
Read the full story at AWS Machine Learning Blog →
Share
Filed under:Enterprise AI
Comments
Keep comments relevant and respectful. No links, advertising, self-promotion, or spam.