When David Letterman steps down as host of The Late Show later this month, he’ll be passing the torch to Stephen Colbert, who’ll be debuting as Late Show host in September.

And while he has been a huge supporter of CBS’s decision to place Colbert behind the desk, in an interview with The New York Times the late-night funnyman admits the network could have used the opportunity to shake things up by giving the job to a person of colour or a woman in an arena that has traditionally been dominated by white male talk-show hosts.

RELATED: DAVID LETTERMAN’S MOST MEMORABLE “LATE SHOW’ GUESTS

“I always thought Jon Stewart would have been a good choice,”; reveals Dave to NYT. “”And then Stephen [Colbert]. And then I thought, well, maybe this will be a good opportunity to put a black person on, and it would be a good opportunity to put a woman on. Because there are certainly a lot of very funny women that have television shows everywhere. So that would have made sense to me as well.”;

Dave’s final Late Show broadcast will air on Wednesday, May 20.