Hi Kacie!
For lower crowds, you should opt for the last week of October. Halloween isn't much of a factor since it's mid-week and it is not a school holiday. Your November dates, however, run in to the very crowded Thanksgiving holiday week.
October usually has beautiful weather. The humidity of the summer has declined and daily temps average around 75. November has daily temps around 66. The daily highs can be up to 85 in October and near 75 in November.
Walt Disney World can be very romantic. We honeymooned there and have spent many anniversaries in WDW too. There are some wonderful meals to enjoy including dining atop the Contemporary Resort at California Grill. Time it for the fireworks for extra romance! Snuggle together in a "car" at the Sci-Fi Dine-In Theater. Or order room service!
A stroll through Epcot's World Showcase is also fun, especially if you sample different beverages (and chocolate) from around the world.
Take in the Magic Kingdom's fireworks from the Polynesian Beach while sipping on a Lapu Lapu out of a coconut!
There are carriage rides, fireworks cruises, and spa treatments! The
recreation at WDW goes way beyond the theme parks!
I also recommend visiting the lounges at WDW, including Mizner's at the Grand Floridian where you can relax and listen to music.
Don't underestimate the romance of riding Dumbo, Peter Pan, and Pirates of the Caribbean together. Haunted Mansion is a great place to hold on to your sweetie!