I think it's pretty much just because he doesn't really want the job.
He was going to accept anyway though out of duty since everyone felt he was the next best qualified choice available, with Tsunade still out of commission with unknown prospects of recovery and Danzo dead.