... Also have hairline cracks in the frizen now. Do you think I might have been better quenching in oil instead of water?
Hopefully the cracks are just surface cracks and don't penetrate very far.
IMO, water quenching cools the material much faster than oil quenching.
Although the water turns to steam rapidly, the water races back onto the steel as soon as the steam bubble moves away from the metal. The cold water then returns to chill the metal again. Water absorbs heat much faster (and gives it off much faster) than oil does. That's the reason most cars use water instead of oil in their radiators to cool their engines.
Oil on the other hand forms a layer which although it may temperarly make smoke tends to cling to the metal and protects it from additional cold oil coming in contact with the metal too rapidly.
One of the problems with adding a case hardening to a frizzen is it is impossible to know what material the frizzen is made from.
Siler for instance uses a thru hardening material which must be oil quenched. Water quenching will crack it.
Before applying Casenit or other carburizing materials, it is wise to just heat the part up until it is bright red/yellow and quench it in oil. If this hardens it to a "file hard" condition, it is a oil hardening steel and must not be water quenched. It also will need to be tempered so it isn't so hard that it breaks when it is used.
Frizzens made from low carbon steel will work best with water quenching and because the material below the case stays ductile, it won't crack. Low carbon steel will not harden below the "case" depth.
If your small cracks are in the thicker area of the frizzen, it is probably ok. If the cracks are in the thin areas like where the screw passes thru the frizzen, they will get worse, leading to possible failure.
If the frizzen cracks are on the sides, right at the "L" where the face meets the underside and if they go thru this thin area, you can keep them from getting worse by grinding them away. You must remove enough material so that you get rid of the full depth of the crack.
Although this sounds like your weakening the area (which you are), by removing all of the crack, you will have stopped a future failure.
Cracks are known as "stress risers". The bottom of the crack is so very small that any stress applied to the part will concentrate at this location. The stress at this point can exceed 300,000 PSI which is well above the tensile strength of any steel. This will cause the crack to grow deeper until the part fails.
The idea of removing material to get rid of the cracks can also be used at the thin area where the frizzen screw is located.
Whether your frizzen is oil hardening steel, or low carbon steel, it would be a good idea to temper it before using it.
This can be done by polishing the surface to a bright appearance and then SLOWLY heating it until it turns a light yellow. You can water quench it from this temperature without harm.
I'm keeping my fingers crossed for you.