The lack of rich people doesn’t imply freedom - people who are forced to hunt, gather, fish or farm for subsistence only with no reward beyond that are enslaved to the need to produce food and find shelter, but that differs from a society where there’s sufficient food and shelter, it’s just hoarded by those who have too much

Additionally the presence of rich people doesn’t imply a lack of freedom - you could have a “safety net” system where everyone is guaranteed housing and enough grains and beans/similar to survive, and if they want more they can work for it (some of the taxes from this go towards compensating farmers and builders), giving people the freedom to not have to worry about survival, while also allowing for people to earn lots of money and buy nice things if they want and/or can