Even with a SSD it can take a min or so, the load is very cpu intensive and is based on raw non multi core performance. Memory bandwidth also is a big factor.

How much ram are you using in game I think the game by itself is like 2-3GB when you run low on ram you system will massively bottle neck.