GPU & Training Calculators
10 free gpu & training calculators in AI & ML. The first 2 have a full write-up: the method, a worked example and questions specific to that calculator.
- Tokens/sec CalculatorCalculate LLM throughput in tokens generated or processed per second.
- VRAM Usage CalculatorEstimate the VRAM consumed by model weights, activations, and optimizer states.
- FLOPs CalculatorCalculate the floating point operations required for a model's forward pass.
- GPU Memory CalculatorEstimate the GPU memory required to train or run a given model architecture.
- GPU Utilization CalculatorCalculate GPU utilization percentage from actual versus theoretical compute throughput.
- Inference Time CalculatorEstimate model inference latency per request based on hardware throughput.
- Samples/sec CalculatorCalculate training throughput in samples processed per second.
- Tensor Size CalculatorCalculate the memory footprint of a tensor from its shape and data type.
- TFLOPs CalculatorCalculate the teraFLOPs throughput required or delivered for a training workload.
- Training Time CalculatorEstimate total model training time from dataset size, batch size, and hardware speed.