SoftBank Enhances AI Platform by Installing 4,000 Nvidia Hopper GPUs

Reported by Srikapardhi October 31st, 2024 at 01:41 pm

Aiming for 25.7 Exaflops by FY2025, SoftBank Enhances Infrastructure for Large Language Model Development in Japan.

Highlights

Total GPU count aims to reach around 10,000 by FY2025.
SB Intuitions focuses on developing Japanese-specific LLMs with 390 billion parameters.
AI platform certified by Japan's METI under the Economic Security Promotion Act.

SoftBank announced it had finished installing approximately 4,000 Nvidia Hopper GPUs in its Japan top-level AI computing platform now under expansion. The platform is one of the largest computing platforms in Japan for large language models (LLMs) learning. SoftBank began operating its 0.7 exaflops AI computing platform equipped with approximately 2,000 Nvidia Ampere GPUs in September 2023. With this installation of approximately 4,000 Nvidia Hopper GPUs, the AI platform's total computing performance has been boosted to approximately exaflops with approximately 6,000 GPUs installed.

Also Read: Expect Artificial Super Intelligence by 2035, Says SoftBank CEO

Plans for Future Enhancements

SoftBank said the company plans to further enhance its AI computing platform's performance by deploying an Nvidia DGX SuperPOD and DGX B200 systems, aiming for a total compute capacity of 25.7 exaflops by FY2025 by increasing the total number of GPUs installed to approximately 10,000.

Focus on Homegrown LLMs

This AI computing platform will initially be utilised by SB Intuitions Corp (SB Intuitions), SoftBank's subsidiary dedicated to developing homegrown large language models (LLMs) specialised for the Japanese language.

SB Intuitions is aiming to build LLMs with approximately 390 billion parameters that support multiple modalities within FY2024. With this AI computing platform enhancement, development of LLMs will be further accelerated, the company said.

Government Certification

SoftBank also mentioned that its AI platform has received certification from Japan's Ministry of Economy, Trade and Industry (METI) under the Economic Security Promotion Act, ensuring supply assurance. The company plans to offer its AI computing resources as a service to various generative AI developers and research institutions across Japan, contributing to the establishment of development infrastructure and strengthen the service provision framework in the country.

Also Read: SoftBank and Ericsson Partner to Explore AI-Integrated RAN Solutions

Service Expansion

"In addition to utilising the AI computing platform among its own group companies, SoftBank plans to provide the infrastructure as a service to companies and research institutions based in Japan," SoftBank said Thursday.

Reported By

Srikapardhi Telecom Analyst

Passionately following the Indian #Telecom Industry for over a decade from Business, Consumer and a Technical perspective. My primary focus area is Consumer & Digital Experience.