One of the best parts of SUNY New Paltz is the town. The Village of New Paltz is located about two blocks away from campus. It's a pretty incredible place; there are cool music venues, tons of restaurants, and the people are progressive and laid-back.
The natural scenery is also great. The Wallkill River runs through the town, and one can hike along the Wallkill Valley Rail Trail. Plus, the beautiful Shawangunk Mountains are fully visible from both town and campus.