With a custom binary file format for archives that is structured similiar to Valve's VPK files I have a
Game.index.gcf which holds information about all files and where exactly they are stored. I can split up and say, that the
/Assets/Scripts folders should be stored in
Game.000.gcf while the bigger
/Assets/Music folder could be split up into
Game.002.gcf. This should boost performance but only if done right. Moreover with updates I could say, just update this particular split archive and not the entire archive (when storing everything in one really huge a file).
As of yet, I don't know how to write such an adaptive algorithm which automatically decides the best way to split all archives and files. What aspects should I keep in mind and what should I be aware of when creating these? Do you have any suggestions?