The bearings have a seat that they sit against, going out its the same diameter, when you fit the new bearings you need to make sure the new bearing is hard up against its seat.
However you choose to apply pressure to the bearing to remove and refit, it needs to be on the outer race as that's where the friction is.