How to refute a bunch of black e4 openings

Same for Latvian gambit, it sorta worries me if it does pop-up as it is played a little too. And I have no idea how to play against it.

most of what you listed isnt refutable period. Only the latvian is
the replies you mentioned (fantasy variation, advanced french, alapin variation agaisnt sicilian) are all fine, although not the most challenging lines agaisnt those defenses.
as for the latvian gambit, go to the lichess database under master games, turn on engine and follow the most played lines, you will find something good there.

If you want to be mean, you could play the Exchange Variation.

Most Players hate playing against the Exchange variation's.

As a Latvian Gambit player, I'm going to give you an idea to face those who play this opening against you.

Personally, I'm not bothered by any particular variation because I have them all well studied, but I can share a line that many Latvian Gambit players are unfamiliar with.

Every time I've played it with the white pieces, my opponent has gotten confused.

In this variation, many players end up losing their rook. It's important to study how to safely bring the queen out from h8 in order to win the game. Still, most of the time, the black player doesn't make the most accurate moves to try to capture that queen either.

Alr thanks!

I use the Alapin and the Sicilian, but the Panov attack against the Caro-Kann, and the exchange variation with 4c4 against the French. I know my line against the French is not the best objectively, but it leads to a wide open game, which usually annoys French players. I have also tried the Tarrasch variation, which also usually leads to open positions and is sounder. I play the Danish gambit against 1... e5, which I know is not good if black knows the best ways to decline it or give back the pawns. If I think I player will handle the Danish well, I play the kings gambit. I like somewhat aggressive openings and wide open positions. It seems sort of contradictory to use the Alapin and the advanced against the French. The advanced is closed and positional. The Alapin leads to an open game. It is not as aggressive as 2Nf3, but can sometimes lead to sharp double edged Sicilian positions. Obviously, these are all good defenses and not refutable. Caro-Kann players usually want to get to the endgame, so the Fantasy variation may work because it is trappy. There are also some traps in Panov attack, particularly if black plays Bf5 or worse for black Bg4.