No, prob. It took me a while to realize that!!
Despite all the mistakes the Ramseys made in this case, they made sure they had their gloves on. They used them for the garrote the note and everything else that needed to be done. It was an obvious move and an easy one to do.
You could also make an argument that the note didn't really need to be moved anywhere. It was probably on a kitchen table and was touched by Patsy alone. You can easily do a quick flip through the pages without touching it all that much.
The intruder does not have that luxury, he has to transport these three pages and the pad back and forth. How and why he did this without folding them in two is bizarre to me.