Yes, absolutely.
You can take your baby with you on any ride for which there is no height requirement.
If you look at this page of travel tips for people with small children found
HERE,
you will see a button on the right hand side of the page that says
"Height Requirements." Clicking on this link will bring you to handy
pdf that you can download. The pdf lists the attractions in all four
theme parks and both water parks that have height requirements. If an
attraction is not listed on this document it means that there is no
height requirement and any age child can enjoy the ride.
The height requirements are also listed on all the maps at the parks and on signage in front of the various attractions.
I brought my twins to WDW when they were just under one year old. They loved Dumbo, Small World, Winnie the Pooh, Peter Pan, character meals, the parades, and so much more. I'm sure you'll find plenty to do with your little one too.