If it's a P4-based Celeron, you will notice the performance hit. Those bastards are the shoddy offspring of a gimped architecture.
I had a celeron D, 3GHz it was pretty shitty. But I don't even need the "power" gaffaw of this Pentium 4, computer does nothing but browse internets and download.