Briefing

How many models do you keep on your SSD?

ai-dev
by /u/Perfect-Flounder7856 ·

Check SSD capacity before downloading more models.

What to do now

Check SSD capacity before downloading more models.

Summary

The user has a 4TB primary SSD and a 2TB secondary storage. They prefer to keep all LLM models on the fast primary slot. Currently they are downloading many models and plan to trim the excess to free space. They are considering upgrading to a larger primary SSD, such as two 4TB drives, to accommodate more models. The goal is to balance storage capacity with performance by keeping models on the fastest storage. They anticipate needing to manage model size as their collection grows. The discussion highlights the importance of SSD capacity for local LLM deployment.

Key changes

  • Primary SSD 4TB
  • Secondary storage 2TB
  • Models stored on fast slot
  • Plan to trim models

Affects

internal

Customer impact

Analyzing matches…

Ask about this story

Impact on an agency? Which customers? Compare historically Risks of waiting