You only get points back when they use an engine. What you are describing falls under fair play/poor sportsmanship. When enough reports are made they are put in a poor players pool where they play others like themselves, and you will no longer play against them. ( They will probably receive a warning the first/couple of times they do this). Stop reading what they say and pay closer attention to your game. When it ends report them. You can also turn off chat if you wish in your settings.
Sometimes I am playing normally and winning the game and I don't know what trick they do that they end the game blaming me as if I am giving up and I want to win and they say as if I abandon the game and it is not because of the time because I respond quickly I do not think a lot, it's a trap that many people make by making you lose a game that I'm winning very easily, and I report them and they don't give me back the points , anyway