My cat is eating all the baby stuff?

My family recently adopted a baby. My cat who has never eaten anything besides his food, has taken an intherest in the bottles and the pacifiers. it has gotten to the point where if we leave it out he takes it. what is causing this and how do I stop it? My dad is almost at the point of giving the cat to a shelter. HELP!