Yep. Change the mounts and bearings. Unless you live somewhere with glass smooth roads you are also due to replace the following items if not done yet:

front struts
rear shocks
lower control arms (bushings)
ball joints
sway bar (bushings)
sway bar links

I would advise against starting to replace many parts at once. You don't know if the previous owner has already replaced some of them. That noise is a little strange, I think you can try locating it more precisely using a 1/2" hose, one end at your ear, the other near any parts - careful near r...