#sambanova

SambaNova adds prompt caching for MiniMax M3 on SambaCloud

SambaNova has launched prompt caching for MiniMax M3 on SambaCloud, reducing input costs by 90% to $0.06 per million cached tokens and improving time to first token by 35% to 88% without code changes.

SambaNova says SN50 pairs RDU decode with existing GPUs for premium inference

SambaNova said SN50 is built for premium inference by pairing RDU decode with existing GPUs for prefill. It cited ROI in 6 months at a 70% billable utilization planning assumption.