I'm pretty sure most of what you described is a west coast thing. My mother grew up in California and she called gym P.E.. Here, in the Northeast, I only ever hear gym. All of my classes were always in one big school building. I think California is one of the few places with outdoor trekking to classes, maybe because of the pleasant weather. In most other places it would be too humid or too cold to have that.