My son is 14 months old and can't live without his pacifier. How do I wean him from it?

I recently found a stash that he had under his pillow. I keep hiding them and he finds them. He throws a fit when he doesn't have one and I'm getting frustrated especially when at 3 in the morning he throws it out of his crib and screams until I wake up and give it back. Help!