Check the hammer with a file to see if it's hard or soft. Do this on the back of the hammer where it won't show. You can tell by the feel if it's hard or soft. It it's soft you won't need to anneal it. Then do like Larry says. Use a flat faced punch 3/16" or so. If you're careful on the outside...