SoftBank Enhances AI Platform by Installing 4,000 Nvidia Hopper GPUs

Aiming for 25.7 Exaflops by FY2025, SoftBank Enhances Infrastructure for Large Language Model Development in Japan.

Highlights

  • Total GPU count aims to reach around 10,000 by FY2025.
  • SB Intuitions focuses on developing Japanese-specific LLMs with 390 billion parameters.
  • AI platform certified by Japan's METI under the Economic Security Promotion Act.

Follow Us

SoftBank Enhances AI Platform by Installing 4,000 Nvidia Hopper GPUs
SoftBank announced it had finished installing approximately 4,000 Nvidia Hopper GPUs in its Japan top-level AI computing platform now under expansion. The platform is one of the largest computing platforms in Japan for large language models (LLMs) learning. SoftBank began operating its 0.7 exaflops AI computing platform equipped with approximately 2,000 Nvidia Ampere GPUs in September 2023. With this installation of approximately 4,000 Nvidia Hopper GPUs, the AI platform's total computing performance has been boosted to approximately exaflops with approximately 6,000 GPUs installed.

Also Read: Expect Artificial Super Intelligence by 2035, Says SoftBank CEO




Plans for Future Enhancements

SoftBank said the company plans to further enhance its AI computing platform's performance by deploying an Nvidia DGX SuperPOD and DGX B200 systems, aiming for a total compute capacity of 25.7 exaflops by FY2025 by increasing the total number of GPUs installed to approximately 10,000.

Focus on Homegrown LLMs

This AI computing platform will initially be utilised by SB Intuitions Corp (SB Intuitions), SoftBank's subsidiary dedicated to developing homegrown large language models (LLMs) specialised for the Japanese language.

SB Intuitions is aiming to build LLMs with approximately 390 billion parameters that support multiple modalities within FY2024. With this AI computing platform enhancement, development of LLMs will be further accelerated, the company said.

Government Certification

SoftBank also mentioned that its AI platform has received certification from Japan's Ministry of Economy, Trade and Industry (METI) under the Economic Security Promotion Act, ensuring supply assurance. The company plans to offer its AI computing resources as a service to various generative AI developers and research institutions across Japan, contributing to the establishment of development infrastructure and strengthen the service provision framework in the country.

Also Read: SoftBank and Ericsson Partner to Explore AI-Integrated RAN Solutions

Service Expansion

"In addition to utilising the AI computing platform among its own group companies, SoftBank plans to provide the infrastructure as a service to companies and research institutions based in Japan," SoftBank said Thursday.

Reported By

Telecom Analyst

Passionately following the Indian #Telecom Industry for over a decade from Business, Consumer and a Technical perspective. My primary focus area is Consumer & Digital Experience.

Recent Comments

Shivraj Roy :

Samsung 5G equipment is used by Airtel i guess?And Ericson for Jio?

Nokia Completes 5G Equipment Deliveries for Vodafone Idea, Gears Up…

Faraz :

That is true.. But atleast BSNL 2G and 4G are still an affordable option compared to Vi. There are 20…

Can Vodafone Idea Turn Tables with 5G

Faraz :

When will you fix this zero comments problem ?? Admins @Tanay @Kripa @Srikapardhi Even though there are 10 comments, I…

Can Vodafone Idea Turn Tables with 5G

shivraj roy :

Bro by ur logic BSNL should stop adding 4G towers ,because 4G is available since affordably sep 2016 which was…

Can Vodafone Idea Turn Tables with 5G

Rachit :

Ask yourself, what Vi 5G will offer that Jio and Airtel hasn't in last 2 years besides core Vi fans…

Can Vodafone Idea Turn Tables with 5G

Load More
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments