Microsoft's Singularity aims to reduce the cost of artificial intelligence

Microsoft is working to reduce the cost of artificial intelligence (AI) and wasted effort when computing at a global scale.

"Singularity is a fully managed, globally distributed infrastructure service for AI workloads at Microsoft, with support for diverse hardware accelerators. 

Singularity is designed from the ground up to scale across a global fleet of hundreds of thousands of GPU and other AI accelerators," explain Microsoft Azure and Research teams in their paper.

In layman's terms, Microsoft's Singularity lets hundreds of thousands of GPUs and AI accelerators to work together. Singularity is a global infrastructure service designed to reduce wasted efforts. 

Singularity can also adapt to prioritize different workloads. While opportunistically using spare capacity, Singularity simultaneously provides isolation by respecting job-level SLAs, says Microsoft.

 "For example, Singularity adapts to increasing load on an inference job, freeing up capacity by elastically scaling down or preempting training jobs."

In contrast to some other systems that require restarting from scratch following failure, Singularity can jump back in where a job was cut off.

Microsoft has invested heavily in AI over the years, including a $1 billion investment in OpenAI in 2019. 

Check out
More Stories!

Click Here