Job Queue Size Calculator
Calculate required job queue depth to absorb burst traffic without dropping jobs.
About Job Queue Size Calculator
The M/M/1 queuing model (Markovian/memoryless arrivals, Markovian service times, 1 server) gives closed-form formulas for a single-queue-single-server system's steady-state behavior from just two inputs: arrival rate (λ) and service rate (μ = 1/average service time). Utilization ρ = λ/μ must stay below 1 for the queue to reach a stable steady state at all — as ρ approaches 1, both average queue length (ρ²/(1-ρ)) and average wait time grow sharply and non-linearly, the same underlying mathematics behind why systems that look 'mostly fine' at 70-80% utilization can degrade dramatically with only a modest additional load increase.
Formulas
M/M/1 average jobs in system
L = ρ / (1 − ρ), where ρ = λ / μ = λ × avg_service_time
- "\\lambda"
- arrival rate
- T_s
- average service time
- "\\rho"
- utilization
M/M/1 average wait time in queue
Wq = ρ² / (λ × (1 − ρ))
- "\\rho"
- utilization
- "\\lambda"
- arrival rate
Worked example
With the default values below, Job Queue Size Calculator returns Avg Jobs in System (L) of 4. Change any input above and every figure here is recalculated in your browser.
Inputs used
- Arrival Rate λ (jobs/sec)minimum 0
- 8
- Average Service Time per Job (seconds)minimum 0.001
- 0.1
Results
- Avg Jobs in System (L)
- 4
- Status
- High utilization — queue length and wait time grow sharply; small increases in arrival rate cause disproportionate queue growth.
- Utilization (ρ)
- 80.00%
- Avg Jobs Waiting (excl. one in service)
- 3.200
- Avg Wait Time in Queue (s)
- 0.4000
- Avg Total Time in System (s)
- 0.5000
Step by step
- 1Values used
- 2M/M/1 average jobs in system
- 3M/M/1 average wait time in queue
- 4Avg Jobs in System (L)= 4
- 5Status= High utilization — queue length and wait time grow sharply; small increases in arrival rate cause disproportionate queue growth.
- 6Utilization (ρ)= 80.00
- 7Avg Jobs Waiting (excl. one in service)= 3.200
- 8Avg Wait Time in Queue (s)= 0.4000
- 9Avg Total Time in System (s)= 0.5000
Assumptions and limits
- The result is derived only from the 2 inputs listed above. Anything not among them is not part of the calculation.
- In particular, this calculator does not take inflation, tax, fees or charges or compounding frequency into account.
- Figures are rounded for display to 4 decimal places, so totals built from several rounded parts can differ slightly from the unrounded arithmetic.
How these calculators are built and tested is described on the Methodology page. If a figure looks wrong, please report it.
Frequently Asked Questions
What does it mean if utilization (ρ) is ≥ 1?
It means jobs are arriving at or faster than the single server can process them on average, so the queue grows without bound over time rather than reaching a stable steady state — no finite average queue length exists. In practice this shows up as an ever-growing backlog until something is changed (add capacity, shed load, or reduce arrival rate).
Why does queue length grow so much faster than utilization near ρ=1?
Because average jobs in system scales as ρ/(1-ρ), which has a vertical asymptote at ρ=1 — going from 80% to 90% utilization more than doubles the queue length (from 4 to 9), and going from 90% to 95% nearly doubles it again (9 to 19), illustrating why 'a little more load' near saturation causes disproportionate backlog growth.
How realistic is the M/M/1 assumption for a real job queue?
It's a simplification — real arrival processes and service times are rarely perfectly memoryless/exponential, and most real systems have multiple workers (M/M/c) rather than exactly one. Still, M/M/1 captures the qualitative shape of queue behavior (sharp growth as utilization approaches 1) well enough to be a useful first-order estimate before reaching for more complex queuing models.