Let them "their" thing.  After all, you have only had the swarm 4 weeks, over
half of all the bees you caught are now dead.  The new bees, laid by the
queen in your hive
are still nurse bees and have not even gone out to forage yet.  Let nature
take its natural course until they build their own colony integrity.  After 1
or 2 more
brood cycles (3-6 weeks), move anything you want around.

I hope I have helped.

George Imirie