If I look at your latest games only your game against RandomFactoid is an unrated game, which is the only game where your rating was not adjusted. You probably changed the setting for just one game, assuming it would change the setting for all games.
Rated vs unrated

Duck fest, I could still see both of our ratings when I played factoid, aren't they supposed to be hidden? Or am I totally missing the point?

Does unrated just mean that we will be paired with random people instead of people who are rated similarly?

??
Not sure if I understand you completely. Just to avoid misunderstandings. Rated is the normal setting, which means that after each game the ELO rating for both players is adjusted accordingly. That's not always desirable. For example, I might ask a higher rated player to play a certain line against me so I can practice, or maybe I want to test a new line without dropping my rating. Then unrated is the better setting because in an unrated game the outcome will not impact my rating. It has no effect on the visibility of rating. Your rating will always be visible, in game and on your profile.
The players' ratings will always be displayed regardless of the type of game played. I'm not clear on whether this can be changed to hide the ratings or not.
However, for a rated game, the conclusion of a game most likely results in the gain of one player's rating and the loss of the other player's rating, with the notable exception of a draw in games of very closely rated players. In unrated games, on the other hand, ratings do not change at all at the end of a completed game.
I tried turning off the ratings for a few games but it's still rating me and my opponents, how can we play unrated games?