Sometimes the best way to solve problem with some component is to get rid of it. Prusa's filament buffer is not perfect at all, and it's biggest problem is unnecessary additional friction which causes lots of failures in MMU's idler gears. In my case this bypass became the real relief.
Just try it and feel the difference. Anyways, the idea is not destructive, so you can get back to the buffer at any time.
Use bolts from the Prusa's buffer to fix PTFE tubes in the bypass, be careful not to overtighten them.
Don't worry about messy look of the filaments without the buffer - they do not interlace during printing.
0.3 mm draft profile in PrusaSlicer