That would be normal in your situation where the drums are so worn. Your shoes are finally almost broke in, to these drums.
But that is in fact abnormal wear; those drums should be changed or; should be machined if still allowable, AND custom shoes made for the large ID drums.