Joe_S,
I'll admit my way is probably not the best way, but I've done many of them this way, and even made a few up from scratch. I just get a piece of rod (mandrel) that's near the size of the hole, and cut a slit in it to take a piece of emery cloth. Chuck your die up in the lathe, and wrap a piece of emery cloth around your mandrel that will be a slightly tight fit and put in your tail stock. Be sure you wrap it the right way.

Be sure and start the mandrel in from the top side, as that's tapered and running the mandrel in tends to widen that slightly if you try it from the other end. With the lathe on run the mandrel back and forth slowly, going all the way thru, and as evenly as possible.
Since you only want to take out .002" be sure and check the inner diam. frequently. It won't take long and you don't want to over do it.
Be sure to measure the diam. of the hole before you start and only take out the amount necessary. You might find, after trying it out, that you might have to take out a little more.
This is about the easiest way, short of a regular hone, to do this and the results have always worked out ok for me with a very nice smooth finish. Sometimes even better than when it was new.
I wouldn't recommend taking out more than .003" or so. If you do things seem to get out of round after that.
PETE