At worst the CPU won’t work when the boards are made which means you will have to redo the boards. I expect the routing still wants to be as direct as possible.
It looks from the photo that it indeed doesn’t need to be that close. I understand that the cristal and bypass capacitors should be as close as possible from the microcontroler, but are you shure it must be that close?