Plugable Ships “Build Your Own” Thunderbolt 5 Local AI Enclosure

Plugable Ships “Build Your Own” Thunderbolt 5 Local AI Enclosure

Summary

Plugable's innovative TBT5-AI enclosure empowers users to connect workstation-class power directly to their PCs by utilizing a user-supplied GPU, effectively eliminating the need for costly cloud subscription fees. This advancement enhances desktop computing capabilities significantly.

Read Original Article

Key Insights

What is a Thunderbolt 5 AI enclosure and how does it work?
The Plugable TBT5-AI is an external PCI Express enclosure that connects to a Windows 11 computer via Thunderbolt 5 to add a high-performance GPU for running artificial intelligence models locally. It leverages Thunderbolt 5's 80Gbps bandwidth to deliver workstation-class AI computing power directly to your PC. The enclosure includes an 850W internal power supply (providing up to 600W to the GPU) and can be bundled with GPUs from Nvidia, AMD, or Intel depending on customer preference. This setup enables users to host and operate local AI infrastructure on their own computers rather than relying on cloud-based services.
Sources: [1]
What are the privacy and cost advantages of using a local AI enclosure instead of cloud-based AI services?
The TBT5-AI enclosure operates with a "Privacy First" approach where data never leaves the enclosure, meaning your AI computations and sensitive information remain on your local device rather than being transmitted to external cloud servers. This eliminates the need for costly cloud subscription fees associated with AI services, as you can run AI models like Phi, OpenAI GPT-OSS, and Mistral directly on your own hardware. The enclosure uses ONNX Runtime GenAI to optimize GPU performance without the overhead of complex compilation chains, making local AI processing both more private and more economical for users who need regular access to AI capabilities.
Sources: [1]
An unhandled error has occurred. Reload 🗙