TechForLive

TH Tom's Hardware · · AI

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second
Image: Tom's Hardware

A Reddit homelabber’s Optane PMem 200 server now runs Moonshot AI’s Kimi K3 at 3.11 tokens/s with two RTX 3090s and a RAM drive.

Tom's Hardware

TechForLive shows the headline, the short excerpt and the picture the newsroom shares in its public feed. The reporting belongs to Tom's Hardware.