SuperGLUE: The AI race

The SuperGLUE (Super General Language Understanding Evaluation) benchmark is utilized in the evaluation of natural language processing (NLP) systems. It comprises eight challenging tasks that test complex linguistic and cognitive abilities. This review focuses on five language models that achieved the best performances in executing the tasks of this benchmark up to the year 2023: Vega v2, ST-MOE-32B, METRO, ERNIE 3.0, and PaLM-540B. These models are examined in terms of their architectures, pre-training methods, and performance in the SuperGLUE tasks, providing a comprehensive comparison of their capabilities, technicalities, and innovations. The analysis highlights the ongoing evolution in the NLP field, reflecting significant advancements in the understanding and processing of human language by AI systems. This study offers insight into the current state of NLP technology and its implications, both in terms of technological development and practical applications.