[OmniOS-discuss] Big Data

[Ian Kaufman]

You might want to read this thread (especially the comments).

http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-January/015599.html



On Sat, Jun 16, 2018 at 10:46 AM Michael Talbott <mtalbott at lji.org> wrote:

> We've been using OmniOS happily for years now for our storage server
> needs. But we're rapidly increasing our data footprint and growing so much
> (multiple PBs per year) that ideally I'd like to move to a cluster based
> object store based system ontop of OmniOS. I successfully use BeeGFS inside
> lxzones in OmniOS which seems to work nicely for our HPC scratch volume,
> but, it doesn't sound like it scales to hundreds of millions of files very
> well.
>
> I am hoping that someone has some ideas for me. Ideally I'd like something
> that's cluster capable and has erasure coding like Ceph and have cluster
> aware snapshots (not local zfs snaps) and an s3 compatibility/access layer.
>
> Any thoughts on the topic are greatly appreciated.
>
> Thanks,
>
> Michael
> Sent from my iPhone
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>


-- 
Ian Kaufman
Research Systems Administrator
UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://omniosce.org/ml-archive/attachments/20180619/f5ca12cc/attachment.html>