The chip’s AI capabilities, which can be activated after deployment, are designed to enhance certain computing tasks that software alone cannot sufficiently optimize.
Broadcom Inc. has announced the integration of a groundbreaking on-chip neural-network inference engine, NetGNT (Networking General-purpose Neural-network Traffic-analyzer), in its new Trident 5-X12 chip, which is software-programmable and field-upgradable. This AI (artificial intelligence) integration allows data center operators to train models to detect specific types of undesirable traffic and then input a version of this model into the chip to assist in traffic routing.
NetGNT enhances the chip’s capabilities by working alongside the standard packet-processing pipeline. Unlike the traditional one-packet/one-path approach, NetGNT employs machine learning to analyze traffic patterns spanning the entire chip. This ability allows NetGNT to identify and manage complex traffic patterns like ‘incast’ in AI/ML workloads.
In such cases multiple packet flows converge on a single port, potentially causing congestion. Operating in hardware at full line rate, NetGNT manages these issues without affecting throughput or latency.
Trident 5-X12 consumes 25% lower power per 400G port compared to the Trident 4-X9. It has enhanced telemetry capabilities for deeper real-time network insights, beneficial for training NetGNT. It supports 800G ports with Broadcom’s 100G-PAM4 SerDes, facilitating up to 4m DAC and linear optics connections.
It is fully programmable with the Network Programming Language (NPL) for in-field feature upgrades. NPL compatibility with the Trident 4 family is widely used for customized switch applications. It is also compatible with next-generation CPU & GPU servers using 400G NICs.
The addition of AI to a portion of the chip’s silicon not only improves overall efficiency but also enhances the chip’s ability to handle tasks like network security. The Trident 5-X12 boasts typical upgrades such as reduced power consumption and increased network bandwidth. Broadcom is currently shipping the Trident 5-X12 devices to selected customers.
