AITA for refusing to take in my homeless brother after he mocked me for years for being childfree?

I (35F) never wanted kids. It’s a personal choice I’ve always stood by, but my older brother (40M) spent years making me feel like I was less of a person because of it. Every time we saw each other, he had some comment about how I’d “die alone,” how my life had “no meaning,” or how women who don’t have kids are “selfish.”

Meanwhile, he married young, had four kids, and constantly rubbed it in my face. He bragged about how fulfilling fatherhood was and even told me once that my life was "a waste" because I wasn’t contributing to the next generation. Our parents always sided with him, saying he was just “proud” of his family and I was “too sensitive.”

Well, karma came knocking. His wife left him, he lost his job, and suddenly, he was homeless with four kids. And guess who he came running to?

He showed up at my house, looking pitiful, asking if he and the kids could stay “just for a while.” I was floored. I asked, “Why me? Why not one of your other family members who actually believes in your ‘family-first’ nonsense?” He said I was the only one who had a stable place and could “afford” to help.

I told him no. I reminded him of every nasty thing he said to me. I asked him why, if my life was so empty and meaningless, he wanted me to be responsible for his entire family. He got mad and said I was punishing his children for our issues.

Our parents started calling me heartless, saying “family helps family” and that I had more than enough room. I told them they were welcome to take him in. Apparently, that was different.

Now my whole family is calling me cruel, and my brother says he "misjudged" me all these years, that he sees now how selfish I am. But I think he just never expected the roles to reverse.

AITA?