Randy,
About three years ago I got sucked into Mann's writings and labored through his book, to fully understand what he discussed and experimented with I struggled comprehending, until I did some of his experiments. I followed some of his path's but with a little more recent equipment, (note that I said recent, not modern as that is relevant).
There is another piece of work published that discounts a lot of Mann's findings, it's called Rifle Accuracy Facts by Harold Vaughn. I haven't made it through all of this book but there is a part of it that with present equipment and processes sheds light on potential culprits for the unexplained flyers you are inquiring about. Bullet imbalance.
In my spare time

I'm chasing some of this concept. Mr. Vaughn was concerning himself with the unbalanced condition of jacketed bullets which I agree does exist but is there really enough to create an effect for any but the most regimented shooter? But in the world of cast bullets? We study a cast bullet and with our two primary methods determine that it's good or bad - visual and weight, do we really know? I have almost completed a static bullet balance fixture (caliber specific) and have a thought bouncing around my little pea brain for making a dynamic balancer (again caliber specific).
I tired of the lube sizer and have found that pan lubing and shooting as cast improved? or at least wasn't detrimental to my accuracy - so I eliminated one step in my reloading process. If one of these methods I have going that can check balance of my bullets works - will I make that one of my steps in the future? Can't say... I made a fixture once that when the bullet was sized, the base of the bullet was faced so it was square to the sized sides, wasted effort? Probably. Improvement to accuracy and consistency? maybe. I still had an occasional flyer I couldn't explain, average of 1 in 10?
To answer an earlier question you asked, "has anyone recovered fired bullet?" My work has been done with 45 and 38 caliber bullets with my "normal" loads both black and smokeless. I don't know how well the oiled sawdust worked for others in these calibers but in my experiments my box was never big enough to capture them - another item I need to spend more time with. The clay bank on the other side did stop things but generally with considerable distortion and base obliqueness was hard to measure.
Hopefully, someone else can chime in with their findings?
Regards,
Greg