LLM Engineering Calculators
10 free llm engineering calculators in AI & ML. The first 2 have a full write-up: the method, a worked example and questions specific to that calculator.
- KV Cache Memory CalculatorCalculate the memory required for the key-value cache during LLM inference.
- RAG Storage CalculatorEstimate total storage requirements for a retrieval-augmented generation pipeline.
- ANN Index Size CalculatorEstimate the memory size of an approximate nearest neighbor search index.
- Chunk Overlap CalculatorCalculate effective chunk stride and overlap ratio for document splitting in RAG.
- Chunk Size CalculatorCalculate the number of chunks produced when splitting a document for RAG retrieval.
- Context Memory CalculatorCalculate the memory footprint required to hold a given LLM context length.
- Embedding Cost CalculatorCalculate the API cost of generating embeddings for a given amount of text.
- Embedding Dimension CalculatorEstimate an appropriate embedding dimension size for a given vocabulary or dataset.
- Retrieval Recall CalculatorCalculate recall@k for a retrieval system used in RAG pipelines.
- Vector Storage CalculatorCalculate the storage size required for a set of vector embeddings.