Apache Kafka Broker Disk Storage, Replication & Partition Throughput Calculator

Compute Kafka cluster disk TB (with Replication Factor), network MB/s, and optimal partition count.

Total Replicated Cluster Disk Storage
38.02 TB
Uncompressed Producer Ingress Rate 48.828 MB/s
Replicated Disk Write Throughput 65.918 MB/s
Recommended Topic Partitions 15 partitions
Inputs
⚡ Scenarios:
msg/sec
Average producer message ingestion rate (messages/sec).
KB
Average uncompressed payload size per message in KB.
days
Topic log retention period in days.
replicas
Broker replication factor (typically 3 for production durability).
ratio
LZ4 / Zstandard compression ratio (0.45 = 55% size reduction; 1.0 = uncompressed).
Results & Graph
Total Replicated Cluster Disk Storage
38.02 TB
Uncompressed Producer Ingress Rate
48.828 MB/s
Replicated Disk Write Throughput
65.918 MB/s
Recommended Topic Partitions
15 partitions

Total Replicated Cluster Disk Storage

Graph 1 • Kafka Storage & Partitions • Domain Architecture & Live Telemetry Maps Events Per Second, Average Message Size Kb, Retention Period Days through Kafka Storage & Partitions Formula.
Total Replicated Cluster Disk : 38.02 TB Kafka Storage & Partitions • Invariants & Metrics Total Replicated Cluster Dis 38.02 TB Uncompressed Producer Ingres 48.828 MB/s Replicated Disk Write Throug 65.918 MB/s Recommended Topic Partitions 15 partitions
Graph 2 • Total Replicated Cluster Disk Storage Across Events Per Second Sweep (40% → 160%) Evaluates Ingress_MB_s = (EventsPerSec × AvgMessageKB) / 1024; ClusterStorage_TB across 7 operating points (current input highlighted).
0 TB 33.46 TB 66.92 TB 15.21 10.0k 22.81 15.0k 30.42 20.0k 38.02 25.0k 45.62 30.0k 53.23 35.0k 60.83 40.0k
Graph 3 • Joint Sensitivity: Events Per Second × Average Message Size Kb Compares Total Replicated Cluster Disk Storage when Average Message Size Kb is shifted +25% (solid) vs. −25% (dashed).
0 TB 33.98 TB 67.96 TB --- Average Message Size Kb @ 75% 33.27 -30% 40.40 -15% 47.52 +0% 54.65 +15% 61.78 +30%
Summary: 25,000 msg/s (48.8 MB/s uncompressed ingress) retained for 7 days at RF=3 and 0.45× compression requires 38.02 TB of broker disk across ~15 partitions.
Summary: 25,000 msg/s (48.8 MB/s uncompressed ingress) retained for 7 days at RF=3 and 0.45× compression requires 38.02 TB of broker disk across ~15 partitions.
⚡ Send result to: Unit Converter →Scientific →Date Difference →
Interactive chart & math engine powered by CalculatorGraph

Formula & Mathematical Methodology: Kafka Storage & Partitions Formula

IngressMBs = (EventsPerSec × AvgMessageKB) / 1024
ClusterStorageTB = IngressMBs × 86400 × RetentionDays × ReplicationFactor × CompressionRatio / 10⁶
Ingress_MB_s = (EventsPerSec × AvgMessageKB) / 1024; ClusterStorage_TB = Ingress_MB_s × 86400 × RetentionDays × ReplicationFactor × CompressionRatio / 10⁶
  • eventsPerSecond: Average producer message ingestion rate (messages/sec).
  • averageMessageSizeKb: Average uncompressed payload size per message in KB.
  • retentionPeriodDays: Topic log retention period in days.
  • replicationFactor: Broker replication factor (typically 3 for production durability).
  • compressionRatioFactor: LZ4 / Zstandard compression ratio (0.45 = 55% size reduction; 1.0 = uncompressed).

Rounding: Internal floating-point calculations run in 64-bit IEEE-754 double precision; display values round to 2–4 decimal places.

Worked Example: Kafka Storage & Partitions Worked Example

Compute Kafka cluster disk TB (with Replication Factor), network MB/s, and optimal partition count.

  1. Enter the input measurement, system configuration, or astronomical parameter.
  2. Apply the standard conversion or analytical equation: Ingress_MB_s = (EventsPerSec × AvgMessageKB) / 1024; ClusterStorage_TB = Ingress_MB_s × 86400 × RetentionDays × ReplicationFactor × CompressionRatio / 10⁶.
  3. Inspect the primary metric, secondary equivalents, and 3 real-time SVG graphs.
Result: Computes Kafka Storage & Partitions via Ingress_MB_s = (EventsPerSec × AvgMessageKB) / 1024; ClusterStorage_TB = Ingress_MB_s × 86400 × RetentionDays × ReplicationFactor × CompressionRatio / 10⁶.

Frequently Asked Questions

How does the Apache Kafka Broker Disk Storage, Replication & Partition Throughput Calculator perform the calculation?

It evaluates Ingress_MB_s = (EventsPerSec × AvgMessageKB) / 1024; ClusterStorage_TB = Ingress_MB_s × 86400 × RetentionDays × ReplicationFactor × CompressionRatio / 10⁶ directly in your browser and renders three custom SVG charts in real time.

Can I solve backwards for an input parameter using Goal Seek?

Yes. Click "🎯 Goal Seek" in the results toolbar to solve backwards for any numeric input field.

Does this tool work offline?

Yes. All calculations run 100% locally in your browser with full offline PWA support.

Developer Tools · AI, Cloud & Distributed Systems

Apache Kafka Broker Disk Storage, Replication & Partition Throughput Calculator: inputs, method, and how to read the result

Compute Kafka cluster disk TB (with Replication Factor), network MB/s, and optimal partition count.

Choose inputs for the case you are checking

The defaults are illustrative. Replace them with values for your case and keep the units shown beside each field.

  • Events Per Second: Average producer message ingestion rate (messages/sec).
  • Average Message Size Kb: Average uncompressed payload size per message in KB.
  • Retention Period Days: Topic log retention period in days.
  • Replication Factor: Broker replication factor (typically 3 for production durability).

What the calculation includes

With the default values shown, Total Replicated Cluster Disk Storage is 38.02 TB. The calculation follows Kafka Storage & Partitions Formula; the formula and variable definitions above show how the inputs combine.

One-input check: With the other defaults held constant, changing Events Per Second from 25,000 msg/sec to 27,500 msg/sec changes Total Replicated Cluster Disk Storage from 38.02 TB to 41.822 TB. This is a comparison inside the calculator's stated model, not a prediction.

Where to use caution

  • Uses official NIST Special Publication 811, IEEE/RFC systems engineering, APA psychometric, and USNO astronomical formulas.
  • Empirical metallurgy and calendar conversions represent standard reference-condition approximations.

Scope: Global NIST, IEEE, APA & Astronomical Standard Check the assumptions and limitations against your situation before relying on the estimate.

More in Developer Tools: Unit Conversion Calculator, Scientific Calculator, Date Difference & Business Days Calculator.