You'd go all the way to Hershey just for the factory? You realize it's a 30 second tour ?
There is also a 4D show at the factory, and you could also make your own choolcte, and a train ride tour. There's also lots more to do in the area. Potato chip factory, pretzel factory, choo choo barn, cherry crest (a must for kids), Amish town...