AI Interview Series #4: Transformers vs Mixture of Experts (MoE) - Tech Sentiments