To successfully support AI’s rapid growth, data center architectures and the high-speed networks they rely on, must be re-evaluated. AI application model complexity and size dictate the level of compute, memory and network type needed to connect AI accelerators (like GPUs) used for training and inferencing. At the same time, AI workloads are driving an unprecedented demand for low latency and high bandwidth connectivity between servers, storage, and accelerators.
The scale required for support doesn’t come from simply adding racks to a data center. Handling large AI training and inference workloads requires a separate, scalable, routable backend network infrastructure to connect distributed GPU nodes. AI apps have less impact on the frontend Ethernet networks that use general purpose servers to provide AI data ingestion for the training process.
The requirements for new backend network differ considerably from traditional data center frontend access networks. In addition to higher traffic and increased network bandwidth per accelerator, the backend network needs to support thousands of synchronized parallel jobs, as well as data and compute-intensive workloads. The network must be scalable, and provide low latency and high bandwidth connectivity between servers, storage, and the GPUs essential for AI training and inferencing.
Data center networks must transform to support new AI workloads
هذه القصة مأخوذة من طبعة October 2024 من Bisinfotech.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك ? تسجيل الدخول
هذه القصة مأخوذة من طبعة October 2024 من Bisinfotech.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك? تسجيل الدخول
Securing India's Future: AI And Evolving Threats In Cybersecurity
ManageEngine is a leading provider of comprehensive IT management solutions, offering tools for network, security, and identity management to help organizations optimize and secure their IT infrastructure.
ThoughtSol Launches New Initiatives to Cut Emissions
ThoughtSol Infotech Pvt. Ltd is stepping up its commitment to sustainability by undertaking a comprehensive assessment of its carbon footprint.
India's First Green Hydrogen Steel Facility Project Awarded
Gensol Engineering Limited has partnered with Matrix Gas & Renewables to develop India’s first and largest Green Steel production facility.
Strengthening India's Cyber Resilience with Sattrix
Sattrix India is a distinguished leader in the realm of IT and cybersecurity serving many Big players across eCommerce, BFSI, Electronics and PSU sector.
Pioneering India's Semiconductor Revolution with Merck Electronics
Merck's electronics business is committed to advancing digital living and at the heart of these strides are Semiconductors.
How Mowito is Enhancing Flexibility and Efficiency in Warehouses and Factories
Mowito is unique in offering software that enables robotic arms to pick fresh produce and handle a range of items, including pharmaceuticals, FMCG, CPG, cosmetics, and electronics.
Pioneering Battery Recycling and Strengthening India's Lithium-lon Value Chain
Recyclekaro has made a substantial investment of 100 crore in establishing a Nickel Metal plant facility within the country. This strategic move is geared towards reinforcing India's standing within the worldwide lithium-ion value chain. During an interaction with Vidushi, Prassann Daphal, CEO, Recyclekaro discussed Recyclekaro's initiatives in battery recycling, their investment in a Nickel Metal plant, and efforts to support India's lithium-ion value chain and circular economy.
VIAVI Solutions Leads the Charge in 5G, Open RAN, and Al-Driven Network Innovations
VIAVI Solutions is a global provider of network test, monitoring and assurance solutions for communication networks, cloud, hyperscale and enterprise data centers to mission-critical avionics, industrial, automotive, transportation, military, railway and aerospace.
Advancements in Electronics and Semiconductor Manufacturing in Uttar Pradesh
Uttar Pradesh (UP) has become the center of electronics and semiconductor manufacturing in India.
Advancing Security at The Intelligent Edge
As embedded systems become more intelligent and more capable of gathering vast amounts of data to deliver real-time, insightful decisions their impact on peoples’ health, productivity, and safety becomes profound.