Thinking of switching from M1 single plane to LD340 but LD340 would need to be milled to fit. Is it worth it?

In all honesty, I'd go straight for the M1. Especially with the plans for steeper gears in the future. When you swap in the GV overdrive, go straight for the 4.56 gears.