The request pertains to an on-premises storage solution where the organization is facing frequent storage limits due to its current infrastructure. The goal is to implement a system that can automatically identify and archive less frequently accessed files from multiple SAN devices onto cloud storage, akin to AWS S3 lifecycle policies which move cold data to colder tiers over time. This approach aims to keep on-premises storage hot while leveraging cost-effective cloud storage for archival purposes. Such a solution requires software capable of monitoring file activity across the SANs and triggering automated archiving processes without disrupting read/write operations. Open-source solutions are preferred, but commercial options that support Terraform configuration are also acceptable.
- On-premises SAN devices
- Cloud Storage Services
- Identify open-source software like Storj or Minio that support lifecycle management policies for archiving files to cloud storage.
- Evaluate commercial solutions such as Dell EMC Data Domain and configure them using Terraform scripts if necessary.
- Deploy the chosen solution by setting up monitoring of file access patterns on SAN devices.
- Configure automated workflows to transfer cold data to the cloud, ensuring read/write operations are transparent for end-users.
This issue directly impacts homelab setups with multiple storage arrays and limited budget for expansion. The need for efficient storage management tools can be crucial in maintaining performance without significant hardware upgrades.