I lost friends, forever, when I left. However you exit, expect the loss of some and be willing to accept it - you and your wife have a life to live.
You have a convoluted assocciation with The Way - numerous ties. Your exit will be quite differenct than I and my wife.
Follow your heart and your logical thoughts BlueCord, memories will haunt you, expect it but grasp hold on the freedom and the awakened life you have chosen - DON'T LOOK BACK.
You are not turning your back on God - always keep that in your head.
If anyone tells you otherwise, and they will, just let it go, let it go.