Josh Duhamel's Mother's Day Plans for Fergie Will Be 'Low-Key': 'We're Just Going to Be a Family'

"We'll probably order in from someplace fancy, but that's about as extravagant as we'll get," Duhamel told PEOPLE