Your #4 in 32-20 is a dangerous idea. Much too weak an action, even the non-takedown threaded actions. 
Regards, 
Ron

As you had nothing helpful to say about my problem, why did you post?

Does it extract a dummy shell OK?  Or is this a function that doesn't work with a shell that's been fired?  There is not much leverage on that little extractor on the #4.

If the latter, it is definitely a signal that you are overstressing your action.  Standard .32-20 loads will expand the base noticeably in the average chamber.  A little flexing on those stingy little screws that hold the #4 block and hammer, and flexing back when the bullet exits and the pressure drops, will wedge the shell into the chamber and make extraction hard in the absence of any camming action.  This was the first warning in Winchester 94s in .30-30 that the pressure was over what the action was supposed to handle, and of course Single Action revolvers also have hard extraction as a red line.

The three blade spring on my #4 keeps the block against the breech, or down, keeps the trigger in the sear notch and provides the snap in the extractor once the block impinges on the little tail of the extractor.  If one of these blades is broken, the function it controls will fail.  With mine, it was the blade that controlled the breech block.  But even without the spring, the extractor should pull out as you pull the breech block open.  The pin that holds in the firing pin should hit the tail of the extractor when you open the block.

There is somebody who advertises those springs in Single Shot Exchange.  I don't have any copies of the publication here though, so I don't know who he is.

If the extractor doesn't move at all, my guess is that the lower part of it is bent or the pivot pin is bent. It pivots on a small cross pin and the lower part of the breech block makes contact with lower part the extractor to pivot it back.

At least, that's how it looks on mine.

Frank

BR, you got it, the retaining pin would not work for the new firing pin, so I did not install it, using another method to locate and retain the firing pin. With the pin pressed in, the extractor works fine.
Thank you.
Now, for all those net nannies who are forecasting my imminent doom for having rechambered it to .32-20, I did so because I had brass, mold and dies on hand
I talked to 2 retired gunsmiths with many years experience in RBs, they told me it would be ok to go to .32-20, just keep the loads to less than 12000 cup, which was the maximum pressure of the .32 lrf.
I have access to several manuals and quickload, finding loads under 12000cup is not a problem.
A bunch of olympic class conclusion jumping has gone on.
I am 73, I have been casting and loading since 1955, I cast and load more than 25 cartridges,from .223 to .50-70 and .500 S&W mag. I have developed 3 wildcats, made reamers  and die sets for them, adapted the barrels to an action and shot them.
I hope to design and build an original design action, one that is easily made and will be safe with 50000-60000 cup loads.
The warnings were ok, the attitude of the first 2 was rude 
Politeness never hurts.
I am still thinking on what I want.

I have this conversation with lots of customers wanting to hot rod an old gun. One guy wanted to go with a 50 BMG on an old 10 gauge action. When a person dies the gun gets passed down to a family member or sold at auction and then it becomes a problem.