Can I use Vosotros with Latin Americans?

I speak Spanish as a second language, and work in customer service in a community with a large number of Latin Americans. I try to speak Castillian Spanish, pronoucing "Z" with a lisp, etc. I like to use vosotros with my customers, rather than Ustedes, as I think it really sounds better (Sois and estais instead of Son and estan, etc). One of my co-workers, who is from Central America says that it sounds strange to him and could be considered rude. In Spain, it is used frequently and not just in informal situations or with children. People on TV and on the news say it all the time. Like I said, I think it sounds more sophisticated than ustedes. Am I wrong to use it with Latin Americans? Would it be considered offensive? Like I said, I like the way it sounds, and plus, it is standard in Castillian.