Humans are social animals. Regardless of what you think, you absolutely need to socialize. I notice you're hedging your argument, and that's disingenuous given the circumstances: how much you need to socialize is entirely dependent on your personality, so I'm not suggesting that you need to socialize more or less. I'm saying that you can't sacrifice the bare minimum social interaction for you to make a little extra money, at least in the long term.
I'm sure part of it is this myth that socializing means going out every Saturday night and clubbing or taking weekends here or there with the guys (or girls) to do things. That's not really what socialization is. In overly-simple terms, it means interacting interpersonally in ways that could simply be calling a friend up and spending an hour or so just talking. For a lot of people, that could be an utterly meaningless conversation about nothing in particular: the value comes in with the simple act of interacting. There are a couple of important things that happen when you interact - it allows you to calibrate your ability to read secondary cues (like body language and vocal inflection), and it also gives you an important reference point to judge your own actions and reaction. From a sociological perspective, humans aren't born with a complete skill set; interaction with fellow humans allows us to compensate for the elements we lack while offering an "safety net" of connections.
There is a reason why work weeks are supposed to be limited to 40 hours. Anything more than that ultimately leads to you missing out on valuable interactions that can have ramification on your life both inside and out of work.