In an OTB game, no.
Also in OTB tournament games, you don't win if your opponent makes an illegal move. The position is reset to before the first illegal move was made. So if it were set up incorrectly, the game would start over.
(Although interestingly In USCF, if the game passes move 10 without either player noticing, then they have to keep playing from there)
Can I claim a win? Because he'd be playing an illegal move.
By wrong way I mean, swapping the positions of the king and the queen or the bishop and the knight etc.