I've definitely noticed in rewatching the show that for budget reasons or whatever, they've always conspicuously chosen to show him just here or there, outisde of the occasional "fuck yeah giant wolf" scene, just so you don't forget he exists.
And then they had him charge with Jorah who he never met, and then never saw him again.