Open carry is illegal in NYS. It is covered under NYS Penal Law article 265 which deals with criminal possesion of weapons.
Concealed carry is allowed with proper licensing/permits. Upstate may be more likely to issue such a permit. Downstate counties, NYC, long island do not issue CCW permits without extenuating cirmcustances, such as if you were Robert Deniro and wished to have one.