slow indexing

[WrigleyF]

What's a good way to solve a slow indexing issue, especially one that's being caused by too many files in your directory?

[suwunk]

a) Make plans to sub-divide them into sub-folders (e.g., lets say you have 100M files. It's better to store them in 1000 folders so that you only have 100,000 files per folder than to store them into 1 big folder. This will create 1000 folder indices instead of a single big one that's more likely to hit the max # of fragments limit or

b) Make plans to run contig.exe on a regular basis to keep your big folder's index defragmented.

Details:
filesystems - How many files in a directory is too many? - Stack Overflow
windows - NTFS performance and large volumes of files and directories - Stack Overflow

[greenmatter]

also on a side note use gzip