I'm guessing you're white, right?
OK, imo move 10. Instead of moving your queen to a position where it threatens nothing, and as you found out, just allowed black to push it around and develop, why not castle first? Until then you had not anything particulary wrong.
The middle game is where you start to think how am I going to attack the king. In other words, what are my opponents weakest squares? The bishop on the c file can't do much by move 9/10 as its staring straight at a protected pawn. If black attacked it with the knight or pawn, then the d square would be much better. You could then look to attack the king that way putting the queen on the b1 square for example, and perhaps move a knight round to look at attacking the h7 pawn, which makes a nice target. You just need to think of a plan of removing the knight, such as pushing the e pawn, trade a knight or sac a pawn for example.
Blacks Bc6 was an odd choice, and many more from there but not surprising given their rating.
You would learn far more playing players in 1400-1600 range, even weak players can get a decent position for 6 or 7 moves, its knowing what to do after that is the hard part.
can someone help me figure out how to plan during the middlegame??? i feel like my opening is solid but i dont know what to do afterwards...