The organisers, the sponsors and the participants decide together on the rules and the number of games.
Organisers and sponsors realised a lot of Candidates Tournaments and later-on replaced this by other systems.
You should read about all championships since 1886 -- and the attempts to hold it, to get answers to your questions. This is written in many books already and in my opinion far to much to answer in this forum.
By the way : this is not a negative regression, just a normal progress of history and development...
Why aren't WC Matches at least 24 games? Are the players actually against this? And why aren't there matches in the Candidates anymore? Are the players against this too?
Can anyone enlighten me as to why the system has regressed over time?