EMO: Pretraining mixture of experts for emergent modularity - Tech Sentiments