The only thing I can see is that they could choose who would play Fischer by prearranging draws, but if he was prepared he could play any of them. Before Fischer's time, they said Keres threw games to Botvinnik. So, maybe his allegation stems from that.
As far as memorization, that's part of the game. He might have been right, but we have yet to memorize all permutations.
Then after that, it's retaining what you remember. Memorizing is the planning stage which is ironic because that is what feeds prearrangement. We have seen countless examples of players not retaining what they used to in earlier years.
You have to make a decision, do you want to play chess or variants of chess where calculation is the key, or do you want to focus on pattern recognition?
Fischer said chess at the highest level is a lot of memorization and pre arrangement. What is the meaning of pre arrangement