AI News

Chips & Infrastructure news

10 stories on Chips & Infrastructure.

ReportedChips & Infrastructure ·

Fireworks says it serves over 40T tokens per day for customers' customized open models

Fireworks told its first company conference it serves more than 40 trillion tokens daily to customers' customized models, a slice it says grew over 2x since summer.

Why it matters: Hosted inference for customized open models is growing quickly, so companies weighing open versus closed model APIs now have a larger, more established set of hosting options.

1 source
ReportedChips & Infrastructure ·

AI server demand squeezes printed circuit board supply for PC makers

Factories are prioritizing complex, higher-priced boards for AI servers, and one Taiwanese maker says laminate prices are at least 12 times their July level.

Why it matters: Board shortages can delay or raise the price of PCs, cameras and medical equipment even when chips are available, so hardware buyers should plan for longer lead times.

1 source