Most students don't think of UVA as a drug school. The most-used drug among students is alcohol by far. Generally, if you don't know about drugs or aren't interested in knowing about them, you'll never see the scene around Charlottesville. Some students feel as though marijuana and cocaine are a problem, but for the most part no one sees heavy drug use. Some sororities and fraternities are known for certain drugs, but again, if you don't know about it, you don't see it.
While there definitely are drugs at UVA, the actual scene is a relatively small problem. Essentially, there is a niche for every type of substance, but you'll really have to go looking for any hard drugs. This is something you may run into after a few years in the area, but at first, you're not likely to notice it. In terms of peer pressure, a lot of people don't tend to feel it; while many parties have alcohol, there's little pressure to drink and harder drugs have much less of a presence at student functions. In the end, this school has one of the safer drug scenes around.