Yeah, you could see him point to the first base umpire. At this point, I don't think anyone thinks it was a swing, but that's with the benefit of a slow motion replay dead on. When they showed it from the camera that's on the first base side, you can see how it might have looked like an a half-swing based on the way Wilmer pulls the grip and twirls the knob, making it look like his hands broke into the swing.