Interactive: Throughput vs Latency Tradeoff

Interactive: Throughput vs Latency Tradeoff

animation
amqp
protocols
messaging
Try Change disk I/O latency to 20 ms.
Observe Compare Persistent (Disk) and Transient (Memory) Max capacity at 20 ms disk I/O latency.
Explain Explain why 10 ms disk latency limits throughput to 100 msg/sec per connection.

Technical boundaries. This serial-latency model calculates maximum throughput as 1000 divided by latency. Achievable throughput is limited to the target or maximum capacity.

NoteInteractive: Throughput vs Latency Tradeoff

Key Insight: Disk I/O is the limiting factor for persistent messages. A 10 ms disk latency limits throughput to 100 msg/sec per connection. In this serial-latency model, transient messages with an assumed 0.5 ms memory latency reach 2,000 msg/sec—a 20x difference from the assumed 10 ms persistent path. For high-throughput workloads (>10K msg/sec), either use transient messages or employ broker clustering with message sharding.

Back to the chapter