“In AI, LLM science part is actually quite easy,” he said, explaining that the fundamental science behind these models—based on Transformer ... attention, Mixture of Experts (MoE), and ...