I also have issues with freezing which is nullified by allocating more ram. in F3 I can see the amount of ram jump up close to 100% as the game loads and drops again. With less ram it hits the 100% mark and freezing occurs before dropping back down as the game processes. This was one of the reasons why I offset some processing to a server.
EDIT and yes it is worldgen. Regular game play is fine.