Al's Impact on Data Center Networks
Bisinfotech|October 2024
The rapid growth of AI is impacting large data centers as high volumes of traffic and intensive processing requirements are pushing the limits of hyperscale data centers.
Al's Impact on Data Center Networks

To successfully support AI’s rapid growth, data center architectures and the high-speed networks they rely on, must be re-evaluated. AI application model complexity and size dictate the level of compute, memory and network type needed to connect AI accelerators (like GPUs) used for training and inferencing. At the same time, AI workloads are driving an unprecedented demand for low latency and high bandwidth connectivity between servers, storage, and accelerators.

The scale required for support doesn’t come from simply adding racks to a data center. Handling large AI training and inference workloads requires a separate, scalable, routable backend network infrastructure to connect distributed GPU nodes. AI apps have less impact on the frontend Ethernet networks that use general purpose servers to provide AI data ingestion for the training process.

The requirements for new backend network differ considerably from traditional data center frontend access networks. In addition to higher traffic and increased network bandwidth per accelerator, the backend network needs to support thousands of synchronized parallel jobs, as well as data and compute-intensive workloads. The network must be scalable, and provide low latency and high bandwidth connectivity between servers, storage, and the GPUs essential for AI training and inferencing.

Data center networks must transform to support new AI workloads

هذه القصة مأخوذة من طبعة October 2024 من Bisinfotech.

ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.

هذه القصة مأخوذة من طبعة October 2024 من Bisinfotech.

ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.

المزيد من القصص من BISINFOTECH مشاهدة الكل
Securing India's Future: AI And Evolving Threats In Cybersecurity
Bisinfotech

Securing India's Future: AI And Evolving Threats In Cybersecurity

ManageEngine is a leading provider of comprehensive IT management solutions, offering tools for network, security, and identity management to help organizations optimize and secure their IT infrastructure.

time-read
5 mins  |
November 2024
ThoughtSol Launches New Initiatives to Cut Emissions
Bisinfotech

ThoughtSol Launches New Initiatives to Cut Emissions

ThoughtSol Infotech Pvt. Ltd is stepping up its commitment to sustainability by undertaking a comprehensive assessment of its carbon footprint.

time-read
1 min  |
November 2024
India's First Green Hydrogen Steel Facility Project Awarded
Bisinfotech

India's First Green Hydrogen Steel Facility Project Awarded

Gensol Engineering Limited has partnered with Matrix Gas & Renewables to develop India’s first and largest Green Steel production facility.

time-read
1 min  |
November 2024
Strengthening India's Cyber Resilience with Sattrix
Bisinfotech

Strengthening India's Cyber Resilience with Sattrix

Sattrix India is a distinguished leader in the realm of IT and cybersecurity serving many Big players across eCommerce, BFSI, Electronics and PSU sector.

time-read
4 mins  |
November 2024
Pioneering India's Semiconductor Revolution with Merck Electronics
Bisinfotech

Pioneering India's Semiconductor Revolution with Merck Electronics

Merck's electronics business is committed to advancing digital living and at the heart of these strides are Semiconductors.

time-read
5 mins  |
November 2024
How Mowito is Enhancing Flexibility and Efficiency in Warehouses and Factories
Bisinfotech

How Mowito is Enhancing Flexibility and Efficiency in Warehouses and Factories

Mowito is unique in offering software that enables robotic arms to pick fresh produce and handle a range of items, including pharmaceuticals, FMCG, CPG, cosmetics, and electronics.

time-read
3 mins  |
November 2024
Pioneering Battery Recycling and Strengthening India's Lithium-lon Value Chain
Bisinfotech

Pioneering Battery Recycling and Strengthening India's Lithium-lon Value Chain

Recyclekaro has made a substantial investment of 100 crore in establishing a Nickel Metal plant facility within the country. This strategic move is geared towards reinforcing India's standing within the worldwide lithium-ion value chain. During an interaction with Vidushi, Prassann Daphal, CEO, Recyclekaro discussed Recyclekaro's initiatives in battery recycling, their investment in a Nickel Metal plant, and efforts to support India's lithium-ion value chain and circular economy.

time-read
3 mins  |
November 2024
VIAVI Solutions Leads the Charge in 5G, Open RAN, and Al-Driven Network Innovations
Bisinfotech

VIAVI Solutions Leads the Charge in 5G, Open RAN, and Al-Driven Network Innovations

VIAVI Solutions is a global provider of network test, monitoring and assurance solutions for communication networks, cloud, hyperscale and enterprise data centers to mission-critical avionics, industrial, automotive, transportation, military, railway and aerospace.

time-read
6 mins  |
November 2024
Advancements in Electronics and Semiconductor Manufacturing in Uttar Pradesh
Bisinfotech

Advancements in Electronics and Semiconductor Manufacturing in Uttar Pradesh

Uttar Pradesh (UP) has become the center of electronics and semiconductor manufacturing in India.

time-read
3 mins  |
November 2024
Advancing Security at The Intelligent Edge
Bisinfotech

Advancing Security at The Intelligent Edge

As embedded systems become more intelligent and more capable of gathering vast amounts of data to deliver real-time, insightful decisions their impact on peoples’ health, productivity, and safety becomes profound.

time-read
2 mins  |
November 2024