That may work, but it is a bad idea, as it is horrendously bad for your lungs. Silicosis will kill you.
I use a hepa filtered vacuum on my machine and I still wear a respirator while blasting using aluminum oxide media. In fact I have another hepa filter i run in the shop just to be constantly improving air quality.
Be good to your body, it is the only one you get!!!