Birds have an excellent sense of smell, and they can detect the scent of humans on and around their nests. However, they do not necessarily associate this scent with danger. If a bird does abandon its nest, it is likely due to a combination of factors, not just because it was touched by a human. These factors may include predation, lack of food, or disturbance of the nest site.
If you happen to find a bird's nest, it's best to observe it from a distance and avoid touching it. This will help to minimize any potential stress or disruption to the birds. If you're concerned about the nest or its occupants, you can contact a local wildlife rehabilitator for assistance.