Supermicro and NVIDIA partner in AI at the Edge

NVIDIA is currently one of the leading global chipmakers, pushing to become one of the largest companies worldwide, with its shares continuing to increase at the time of writing this article
With systems powered by NVIDIA AI, Supermicro launches new AI systems for edge computing to offer faster data centre power to more remote locations

NVIDIA is playing a crucial role in enabling Supermicro to expand its AI solutions portfolio, allowing customers to drive advanced AI capabilities to edge computing environments.

The company is utilising NVIDIA GPUs to provide greater processing power for AI workloads at the edge, in addition to the NVIDIA AI Platform offering software tools and libraries optimised for running AI workloads.

Using Supermicro application-optimised servers with NVIDIA GPUs will make it easier to fine-tune pre-trained models and for AI inference solutions to be deployed at the edge where the data is generated, improving response times and decision-making.

Utilising AI to drive real data centre business value

Last year (2023) saw huge progress in innovation that is entwined with AI, the Internet of Things (IoT) and other new technologies that businesses implemented into their digital strategies. As a result, this year (2024) enterprises will be starting to actualise these ideas and thinking about how they can further optimise their operations.

As a result, companies like Supermicro are seeking to expand their remote edge computing services, as they require high-performance AI and training solutions to advance workloads and increase productivity. It is expanding its AI portfolio enabling customers to leverage the power and capability of AI in edge locations like public spaces, retail stores or industrial infrastructure.

The company’s edge AI solutions are capable of supporting pre-trained models for the edge environment of its customers.

“The Supermicro Hyper-E server, based on the dual 5th Gen Intel Xeon processors, can support up to three NVIDIA H100 Tensor Core GPUs, delivering unparalleled performance for Edge AI,” says Charles Liang, President and CEO of Supermicro. “With up to 8TB of memory in these servers, we are bringing data centre AI processing power to edge locations. Supermicro continues to provide the industry with optimised solutions as enterprises build a competitive advantage by processing AI data at their edge locations.”

Enhancing customer experience 

Within the context of edge data centres, data can be processed and analysed more quickly and effectively. This can be crucial for applications that require low latency or high bandwidth.

By processing data closer to the user, edge data centres can reduce the time it takes for data to travel to and from the central data centre, significantly improving the responsiveness of the application.

With server advancements like this, users no longer need to send data back to the cloud for processing, only to retrieve the information back to the edge. Customers can now use pre-trained large language models (LLMs) optimised for performance and available with NVIDIA AI Enterprise at their edge locations where the data is needed for real-time decision-making close to the data origination.

Supermicro has been keen to advance its AI solutions, having recently launched a full stack storage solution for AI and machine learning data pipelines. The end goal is to enable businesses across a wide range of industries to train AI models faster.

“Businesses across industries, including healthcare, retail, manufacturing and auto, are increasingly looking to leverage AI at the edge,” says Kevin Connors, Vice President of Partner Alliances at NVIDIA. “The new Supermicro NVIDIA-Certified Systems, powered by the NVIDIA AI platform, are built to deliver the highest-performing accelerated computing infrastructure, as well as NVIDIA AI Enterprise software to help run edge AI workloads.”

In addition to NVIDIA hardware and software, Supermicro also holds an extensive portfolio of Intel and AMD based storage servers to advance customer AI.


Make sure you check out the latest edition of Data Centre Magazine and also sign up to our global conference series - Tech & AI LIVE 2024


Data Centre Magazine is a BizClik brand


Featured Articles

Hitachi Vantara Explores Building Green Data Centres

Hitachi Vantara’s Lynn Collier, Director of Global Solutions, discusses why data centre decarbonisation is essential & how AI can be a key tool

AI and Data Centres: Ensuring the Next Era is Sustainable

Matt Pullen, EVP Managing Director Europe at CyrusOne, explains how increased AI workloads will impact data centres - highlighting a need to be sustainable

Rittal: Data Centres Sustainability & Energy Efficiency

Industrial machinery manufacturer Rittal produces energy efficient cooling solutions for data centres, which can reduce the environmental impact of AI

In a Data Centre first, Iceotope Shares Liquid Cooling Lab

Technology & AI

Digital Realty Acquires US$200m Slough Data Centre

Data Centres

CyrusOne: US$7bn Warehouse Credit Facility for AI Expansion

Technology & AI