can i leave starter on,pulling motor

its been 20 years since ive pulled one,does the starter have to come off?tti so its kinda a *****.radiator, fan,alt.ps pump,all off.im ready to pull it but was wondering about the starter