Do I Have To Go To Church?

I am stuggling with Sunday mornings. I enjoy some of the other services and activities at our local fellowship, but sitting in a pew on a Sunday morning singing hymns just freaks me out. It feels too much like I am back in church, rather than exploring a new spiritual path and getting better aquainted with interesting people and ideas.

I want to engage with the community at the fellowship, but do I have to go Sunday morning service to really do that? Can I participate on a non-Sunday morning basis?

Have any other former-something UU's dealt with this issue? What has worked for you?