Throat coat tea - there are a few brands, try one of the ones with licorice and mallow.
If you don't have a fever, and it's resolving, stick with plenty of liquids and ibuprofen for pain (since it's an anti inflammatory, it will help the swelling a bit as well).
If you start running a temp, if it gets worse, if you develop spots on your tonsils, or if it doesn't resolve in a few days, call the doc.
Also, if you think it's allergies or allergy-related, you might want to try your antihistamine of choice