We have been using CouchDB for that, saving images as an “Attachment”. But after a year the multi-dozen GB CouchDB Database files turned out to be a headache. For example CouchDB replication still has issues if you use it with very large document sizes. So we just rewrote our software to use CouchDB for image … Read more
I found this nugget at the link following. It worked perfect for me and only took 5 seconds. As of VirtualBox 4 they added support for expansion. VBoxManage modifyhd filename.vdi –resize 46080 That will resize a virtual disk image to 45GB. https://superuser.com/questions/172651/increasing-disk-space-on-virtualbox
Storage performance can get a bit complex, but the underlying statement is true. 10k or 15k have similar performance, for the most part. If you put them side by side doing the type of work that disks are worst at (random small-block IO), you will measure a difference, but the reality is that with most … Read more
If you trust such things, here is what Wikipedia claims (from http://en.wikipedia.org/wiki/Human_genome#Information_content): The 2.9 billion base pairs of the haploid human genome correspond to a maximum of about 725 megabytes of data, since every base pair can be coded by 2 bits. Since individual genomes vary by less than 1% from each other, they can … Read more
My two cents: If you are concerned about the edge case failures that may occur with SATA hardware (specifically, lousy SATA controllers), spend the money on real SAS disks. These cards do what they say on the tin: They translate SAS (SCSI) commands to SATA commands, and even implement a few themselves (like power- and … Read more
Your figures sound like they’re on the right track in general, a dual disk, dual processor box like a HP DL380 pulls about 350-450w on average so add in 43 x 15-20w for the disk and you’re not far off a Kw per chassis. This gives you two problems, you’re going to need 4 x … Read more
Different layers of abstraction. If you’ve got a large storage array, you probably don’t want one server to use the whole thing, so you divide it into logical units (LUN is actually Logical Unit Number, but hey, it helps me remember). So you’ve got your storage sliced into usable chunks, and now you present it … Read more
IOPS measures the number of read and write operations per second, while throughput measures the number of bits read or written per second. Although they measure different things, they generally follow each other as IO operations have about the same size. If you have large files, you simply need more IO operations to read the … Read more
The reason most people buy everything from one vendor is simple – support. I buy HP, we can call them up at any time and know that they’ll deal with any problem we have as they supplied it all. Buy bits from here, bits from there and you’re giving each vendor a perfectly justifiable ‘get … Read more
Swift is OpenStack’s object storage engine, and as of the Bexar release in Feb 2011, it claims an experimental S3-compatible middleware. As OpenStack is getting a lot of attention (Canonical are shifting Ubuntu to it over Eucalyptus this October, for example) it might be worth a look.