This article in the New York Times talks about some research into the "5 second rule". I guess the results show that bacteria gets transferred, even with only a 5 second exposure.
When I was a kid, there wasn't a 5 second rule. It was either the 30 second rule or "God made dirt, dirt don't hurt". Maybe if they said a chant like that, the results would have been different.