Although about half of the campus belongs to a Greek organization, Greek life is not as overwhelming as you'd expect. If you don't want to join a frat or sorority, don't worry about being chastised for it. Often the only way to tell who's in a sorority is by the Greek paraphernalia they wear since sorority girls don't live in sorority houses. It's a little easier to tell which guys are in frats since they do live together, but again, no one really sees it as a big deal. The different houses intermingle all the time. The frat parties do dominate the party scene, but if it's not your thing, you can usually find something else to do. A lot of first-years get sucked into the frat scene because there seems to be so little else to do. However, you will find that sometimes just chilling in the dorms is better than going out.
If you are interested in Greek life, Albion is a good place to get involved in it. Going Greek doesn't mean that it's going to take over your life. Most Greek organizations are concerned with their chapter's academic standing, and they all take pride in it. Rushing an organization is not troublesome, either, as the College has a strict "no hazing" policy that every chapter must follow. There are definite stereotypes that go along with each fraternity and sorority, though, so be careful in choosing the one that's right for you.