well, one answer would be that the site itself is quite busy in the evenings -- which wouldn't be reflected in the tracerts --
At the same time -- the servers are way overkill for what we need so there should be no problem there. In addition, as I have said before - I am seeing none of this. I'll get a little sluggish at times if I use IE -- but, its IE so that's expected.