Firstly, let me explain that I don't mean this in a way that society keeps us unequal and it needs to be fixed. I mean this in a way that we are not all equal and that's the way it's supposed to be. We are individuals for a reason, because we are not the same as everybody else. This is what gives us uniqueness.
Some people are faster, some people are smarter, some are braver, richer, poorer, more competent, better in certain fields, and worse in others. This doesn't mean person A is better overall as a human being than person B just because they're more talented at some random skill.
However, it does mean they aren't the same and thus not equal in their ability. When there's a competition, everyone doesn't come in first place because someone is the winner of the competition. This can be applied to real life applications, and situations as well. To think we're all equal is a very dangerous thing.
The delusion of thinking equality exists, creates conformity, and we all become part of a group think. No one does anything different. No one has uniqueness. No one has individual identity. I'm not going to go into extreme detail how this ruins society just look around you.
Society isn't worse off when we understand that equality is a falsehood. It is worse off when we give the false pretense that equality is a real thing. The person that trains to be the fastest runner cannot be categorized in the same group as someone who is lazy and doesn't even like to go on walks, who is slow.
It is by that person's effort, determination, their dedication and devotion to their training, their exercise, practice, or growth that they are superior, not equal to that person who is lazy and slothful. (The runner example can be used for any example that it is applicable to. There doesn't have to be physicality involved.
We are all human but we are not all equal. Sometimes people are better. Sometimes people are worse. And that's perfectly fine.
This is only unpopular because you're missing the entire point of equality, and your conclusions are banal tautology. Of course people are different, but our differences alone do not account for the differences in success or failure, the differences in freedom and oppression, in joy and suffering.
Your starements are offensive because you imply that people are largely responsible for their own respective lots in life, and you suggest we are worse off as a society when we try to treat people equally. It is the foundational argument for fascism and kleptocracy. It's bad for society and bad for humanity, and you should feel bad for thinking it is an opinion at all. Your ignorance is not equal to an opinion.
This is called the Just-world fallacy.