But I’m that case if Linux gets 1 new user and windows gets 10 then proportionally Linux usage would decrease despite the absolute number increasing.
I would argue the absolute number is meaningless because without context that number has no value. If I tell you there are 3.4 million Linux desktop users does that number actually tell you anything? Not really. You don’t even know if it’s a lot or not because you have no frame of reference. 4% already has that frame built in and gives you an indication how Linux stacks up to other desktop OSs.
You’re not the only user. Other people may benefit even if you personally don’t. Getting software you don’t want is a compromise for getting an easy out the box installation that comes with what you want already pre-installed.
If you want a more personalized approach there’s always forking a distro and customizing it so that it suits your needs (which is how Nobara came into being).