Unless your replacing the fropnt drum with one that didnt come with the hub, there isnt any reason to remove the drum from the hub. To remove the drum just to do the brakes you remove the center bearing dust cap, pin, cage and unscew the nut.
This sounds obvious to most but I could...