Best strategy for saving huge amount of small files

[SeanLeyne]

How are you connecting to the DSS (Via iSCSI volumne, NAS Share, NFS?)?

If via iSCSI, what file system have you used (FAT, NTFS, EXT3)?

[phil]

it is a NAS (I guess samba) share... my application runs on windows and uses \\storage\spool as a "target"

[netsyphon]

There is something about blocksize and filesystem that may help you out more than anything else.

i think open-e uses XFS

[Robotbeat]

Yeah, I think it's XFS, which has variable block size (can be good for small files). Does Open-E have any tuning parameters that can help optimize for many small files? We have a customer who's looking to use the open-e box as a storage pool to store lots (millions) of small (~16KB) files.

[Robotbeat]

BTW, he's interesting in using it as a NAS, not as an iSCSI box (although we'd probably just get him the DSS version).