It turns out the local horse riding concession is run from that parking lot, and everyone was arriving before 7am so they could ride when it was cooler. Unfortunately none of that was told to us when we booked the camp sites right next to it. The parking lot just said "Horse trailer parking", and that was it. We assumed that meant if someone renting a campsite brought a horse trailer that's where they should park it.