Hilary Duff was only 24 when she gave birth to her son, and in a sit-down on today’s edition of “The Talk” she says that she felt disparaged for having a child at a relatively young age.

Commenting on Jennifer Aniston’s recent remarks about how society judges as woman “useless” if she doesn’t have children, Duff tells the hosts that society also judged her for starting a family in her early 20s.

RELATED: Hilary Duff Splits With Beau Jason Walsh: ‘They Weren’t On The Same Page,’ Says Source

“I think it’s really interesting because I see her point and she is such a beautiful role model and a smart woman to have the courage to say these things in Hollywood,” said Duff, who shares four-year old son Luca with ex Mike Comrie. “But I feel like I was judged for having a baby too soon and getting married too soon, and now I’m pigeonholed for being a ‘mom.’”

As Duff correctly points out, the real problem is the scrutiny placed on women — which, sadly, often comes from other women. “But then lots of women in the industry that don’t have a child yet are judged for not having a child and it’s crazy that women, we are the most in-demand and the most desirable, but the most judged and the hardest on one another,” she adds. “You know, [there’s] so much scrutiny. Nobody cares about men’s personal lives as much as women’s.”

“The Talk” airs weekdays at 2 p.m. ET/PT on Global; you can also watch full episodes online.