Free Engineering Workbench calculator — live below, no login
GPU utilisation (MFU) Calculator
Work out model FLOPs utilisation for training from throughput and hardware peak.
GenAI & agentic AIAI-first companies
How it's worked out
- MFU = 6 × parameters × tokens per second ÷ peak FLOPS
- Dense transformer, forward and backward pass, attention FLOPs ignored
NoteUse the dense peak for your precision; sparse peaks overstate the hardware.
Source: Chowdhery et al., PaLM (2022), model FLOPs utilisation
Need help acting on this number?
VVnT SeQuor's GenAI & Agentic AI Development practice helps teams turn this metric into a plan.