Lydia,
Right now your plans include travel from;
- Animal Kingdom Lodge to Wilderness Lodge
- Wilderness Lodge to Miniature Golf
- Miniature Golf to Magic Kingdom
- Magic Kingdom to Epcot
- Epcot to Animal Kingdom Lodge
The alternative would be;
- Animal Kingdom to Wilderness Lodge
- Wilderness Lodge to Magic Kingdom
- Magic Kingdom to Miniature Golf
- Miniature Golf to Epcot
- Epcot to Animal Kingdom Lodge
Technically it might seem that you would save travel time by moving from the Wilderness Lodge after breakfast to the Magic Kingdom. But for two reasons I will say to stick to your original plan.
First, you want to go golf after the big breakfast. You should do what you WANT, not what you think is the best travel strategy. It is vacation, after all, not work!
Second, you will find that the transportation to Epcot from the Magic Kingdom around dinner time will be both enjoyable (who doesn't love riding the monorail?) and efficient. So I am not sure that when you roll the whole day up that you really save that much time with the change.
Trust your instincts and go golfing!
Have a magical vacation!