Skip to main content

Recalculate Blob Store Storage Task Performance Testing

In Sonatype Nexus Repository 3.69.0, we introduced the Repair - Recalculate blob store storage task that calculates the total space occupied by blobs in a blob store. We are providing the performance testing information below to help you appropriately plan and allocate resources for using this task.

Environment Configuration

The performance testing environment for testing the Repair - Recalculate blob store storage task included the following:

  • m5d.2xlarge EC2 Instance

  • An S3 bucket used to store assets

  • A Gatling script used to populate assets

  • Blob store containing 6 million blobs

Collected Data

Sonatype collected the following findings when running the Repair - Recalculate blob store storage task for 7 hours:

  • Task processes ~11 blobs per second

  • After 7 hours, the task had counted ~280,000 blobs

  • Processing speed was consistent throughout entire test duration

Conclusions and Performance Projections

The Repair - Recalculate blob store size task runs at a constant processing rate. Based on test results, the estimated processing times are:

  • 5 million blobs: approximately 126 hours (5.2 days)

  • 20 million blobs: approximately 505 hours (21 days)

Given the lengthy processing time for running this task, it may not be appropriate for very large blob stores.

Note

You cannot stop the task once it starts.

The blob count and used size update continuously while the task runs. Values may appear inaccurate until the task completes.