The Factory’s from-scratch bakers will pull up stakes and head into the former My Little…