SoftBank Enhances AI Platform by Installing 4,000 Nvidia Hopper GPUs

Aiming for 25.7 Exaflops by FY2025, SoftBank Enhances Infrastructure for Large Language Model Development in Japan.

Highlights

  • Total GPU count aims to reach around 10,000 by FY2025.
  • SB Intuitions focuses on developing Japanese-specific LLMs with 390 billion parameters.
  • AI platform certified by Japan's METI under the Economic Security Promotion Act.

Follow Us

SoftBank Enhances AI Platform by Installing 4,000 Nvidia Hopper GPUs
SoftBank announced it had finished installing approximately 4,000 Nvidia Hopper GPUs in its Japan top-level AI computing platform now under expansion. The platform is one of the largest computing platforms in Japan for large language models (LLMs) learning. SoftBank began operating its 0.7 exaflops AI computing platform equipped with approximately 2,000 Nvidia Ampere GPUs in September 2023. With this installation of approximately 4,000 Nvidia Hopper GPUs, the AI platform's total computing performance has been boosted to approximately exaflops with approximately 6,000 GPUs installed.

Also Read: Expect Artificial Super Intelligence by 2035, Says SoftBank CEO




Plans for Future Enhancements

SoftBank said the company plans to further enhance its AI computing platform's performance by deploying an Nvidia DGX SuperPOD and DGX B200 systems, aiming for a total compute capacity of 25.7 exaflops by FY2025 by increasing the total number of GPUs installed to approximately 10,000.

Focus on Homegrown LLMs

This AI computing platform will initially be utilised by SB Intuitions Corp (SB Intuitions), SoftBank's subsidiary dedicated to developing homegrown large language models (LLMs) specialised for the Japanese language.

SB Intuitions is aiming to build LLMs with approximately 390 billion parameters that support multiple modalities within FY2024. With this AI computing platform enhancement, development of LLMs will be further accelerated, the company said.

Government Certification

SoftBank also mentioned that its AI platform has received certification from Japan's Ministry of Economy, Trade and Industry (METI) under the Economic Security Promotion Act, ensuring supply assurance. The company plans to offer its AI computing resources as a service to various generative AI developers and research institutions across Japan, contributing to the establishment of development infrastructure and strengthen the service provision framework in the country.

Also Read: SoftBank and Ericsson Partner to Explore AI-Integrated RAN Solutions

Service Expansion

"In addition to utilising the AI computing platform among its own group companies, SoftBank plans to provide the infrastructure as a service to companies and research institutions based in Japan," SoftBank said Thursday.

Reported By

Telecom Analyst

Passionately following the Indian #Telecom Industry for over a decade from Business, Consumer and a Technical perspective. My primary focus area is Consumer & Digital Experience.

Recent Comments

Rohit Kumar :

Loot to rahe ho ho Bhai lekin etna to rehem kar do customer pe ki koi bechara aadmi monthly bhi…

Breaking: Airtel Launches Rs 1849 Yearly Voice and SMS-Only Plan,…

TheAndroidFreak :

What's the yearly annual voice calling pack of BSNL? It's going to be good battle once BSNL deploys 700Mhz LTE…

Jio, Airtel and Vi Every Voice and SMS Packs Listed

TheAndroidFreak :

BSNL will move it's network to IP network soon. BSNL VoLTE is great as per Aniruddha dhar.

Jio, Airtel and Vi Every Voice and SMS Packs Listed

TheAndroidFreak :

Mittal ki fat gayi.....ek hi din mein lakkon mein port request aa gayi kya?

Breaking: Airtel Launches Rs 1849 Yearly Voice and SMS-Only Plan,…

rahul_yadav :

BSNL need 5G in the long run to effectively balance the load between 4G and 5G users. This upgrade will…

BSNL 4G Sites Count Update: 65000 Sites Now on Air…

Load More
Subscribe
Notify of
guest

0 Comments
Inline Feedbacks
View all comments