A taste of the far east in America's most exclusive town