(I've split this question into two. For 2D, see: http://gamedev.stackexchange.com/questions/3431/)
Are there any recommendable middleware available for 3D collision detection?
I believe I've heard Bullet has a pretty good 3D collision detection that can be used without the physics engine. I'd like to hear if people have any experiences on Bullet or other libraries for 3D collision detection specifically.