It isn't your quuen that is laying extra eggs in the cells.  YOU HAVE A LAYING
WORKER.
What you have to do now is take your hive at least 30 feet away and shake all
the bees out of the hive.  After you have done that return the hive to its
original location.  The laying worker has never been out of the hive and will
not be able to find her way back.  The foraging bees will return.  Either you
can wait three days and introduce a new caged queen (make sure you don't have
queen cells of eggs) or destroy all the eggs with a toothpick and add a new
queen right away.
 
Norm