AI News

Nace AI news

2 stories about Nace AI.

OfficialResearch ·

Artificial Analysis launches Decision Index v2 with calibration-weighted scoring

Artificial Analysis has released version 2 of its Decision Index, with 45% of the score now built on private datasets and a headline metric that rewards calibrated confidence.

Why it matters: Teams choosing decision models can see that cost per task and calibration can change rankings, and that per-question billing can make one model several times more expensive than another with similar list prices.

1 source
ReportedModels · · Updated

Nace AI's open Drex models return answer probabilities without generating text

Nace AI's open Drex decision models return option probabilities without generating text, and a paper reports the 27B Max model scores 67.52 on Decision Index 0.4.1.

Why it matters: Teams running classification or routing decisions can get calibrated option probabilities in one forward pass, which may cut latency and cost compared with generating answers.

2 sources