It's worth checking to see if there's a branch of Comhaltas Ceoltóirí Éireann in your area. You don't have to be a musician to join. One of their aims is to promote the Irish language (most branches have an Irish language officer). You may find they know of a convo/study group, or perhaps you could run an ad in their newsletter. Check it out here:
http://comhaltas.ie/You may have to go farther afield than your immediate area to find other speakers/learners. For example, in the Monterey Bay Area, there are only a few of us with Irish, and there's a huge gap in ability...three of us are reasonably fluent, whereas most of the others are beginners (and there are only a couple of them who are truly interested in learning beyond the absolute basics). We tried to get a convo group going here, but with other obligations, the other fluent people often couldn't make it, and the beginners were nervous and intimidated. I tried to encourage the more gung ho beginners to get together to study outside of class once a week, but they had the same issue...with their numbers being so few, it was hard to find a time and a place where all could get together on a regular basis.
About 30 - 50 miles away, however (how far depends on who is hosting, as the area is fairly spread out), in the San Francisco Bay Area, there's a thriving Irish-speaking community, with lots of opportunities to get together with people on one's level. If I'm willing to drive a little, I can attend a convo group once a month, special events for Seachtain na Gaeilge, and an annual Diereadh Seachtaine Gaeltachta. You wouldn't want to drive that every day, but once every couple of weeks isn't bad, especially if we carpool. Depending on where you live, you may have to do something similar.
Redwolf