My head cannon is that the reason more people didn't flee Sunnydale en masse is that the next big city over was Angel Grove, and the populace of Sunnydale was just like "yes, there are vampires and occasionally demons, but there's never been a 150 foot tall Sphinx or Pumpkin Monster wandering through downtown, so..."