Well, the official TD/TF Midget Shop Manual assumes everyone already knows how to do this, hence no need to waste print and paper on the subject. What little it does say matches what you did - install the inner bearing, seal and spacer into the hub first, then install it on to the spindle. Torquing the spindle nut to specs will fully seat the inner bearing. It is indeed a tight fit - using some light lube like WD40 on the spindle surface will help. It also would have been nice for the Abingdon boys to specifiy what torque value to use, but you're supposed to know that "snug up smartly" is all you need to know ...
Dave DuBois' web site recommends 40-70 ft/lbs.
My only suggestion with the grabbing brakes is to run thru the brake shoe adjustment procedure for all 4 brake assemblies one more time (pages M.5-6 in the manual). No need to pull the drums off.