Page 1 of 1
Anyone using Amazon S3 for cluster repository?
Posted: Fri Feb 19, 2016 2:49 pm
by vAJ
Trying to come up with options for repository for our geo-clustered NLS.
Once thought was to use S3FS and mount the same bucket to all cluster nodes for backup of data that we need to archive and move out of online index storage.
Thoughts?
Re: Anyone using Amazon S3 for cluster repository?
Posted: Fri Feb 19, 2016 3:07 pm
by hsmith
How much storage is available on that server? How much data worth of logs are you receiving per day? Cost would be my consideration here.
Re: Anyone using Amazon S3 for cluster repository?
Posted: Fri Feb 19, 2016 3:13 pm
by vAJ
I have a few hundred gigs of SAN storage attached to the cluster node VMs. But I have conversations going on now where we might need to retain logs for years (compliance).
Once ramped up in production, we could be looking at 50GB/day.
Re: Anyone using Amazon S3 for cluster repository?
Posted: Mon Feb 22, 2016 10:57 am
by hsmith
That's a lot of logs. If you have the budget for the cloud storage, I'm sure it will work fine.
Re: Anyone using Amazon S3 for cluster repository?
Posted: Mon Feb 22, 2016 11:04 am
by vAJ
Hopefully I get to talk about it all in September
Re: Anyone using Amazon S3 for cluster repository?
Posted: Mon Feb 22, 2016 11:08 am
by hsmith
Better you than me
