Go back to your room and finish your homework, Stephen!

When he said that though, wasn't he speaking of Loki?

Yes he was

To be fair, everything Thanos did up until this point was through his henchmen.
So I mean, I guess I don't blame him but then again how do you know about threats from other realms but not those from your own?