I am in the process of getting my pistol permit in Orange County, NY (3 months and waiting). I have a lot of friends that have their permits and everyone tells me different things. On the news today was the first I ever heard of not being able to openly carry as all my friends do without ever being bothered, along with undercover officers around my workplace (where we go to delis, parks, everywhere and not once have they ever been approached in my presence). In my handgun safety class the NRA instructor says you absolutely can openly carry but does not recommend as it leads to constant questions. My friends also claim as silly as it sounds the restrictions are only for the county the permit was issued. Another crazy thing they claim is that you give up your right to refuse a warrantless search of your home or property once you obtain your permit.
I had a NYS Pistol License to Carry Concealed in both upstate and NYC at the same time (those days are gone) but now live in NJ so...
I highly recommend getting the following book which will answer all your questions if you want to "play by the rules" or at least know them. It's the "bible" on the subject.
Firearms and Weapons Laws: Gun Control in New York
~ Lee O. Thomas (Author), Jeffrey Chamberlain (Author)