Learning from the Outside In