The Epistemology of Metrics: How Quantification Shapes What Organisations Believe Is “Real” — A Cross-Cultural Analysis of Engineering and Academia
Discuss this preprint
Start a discussion What are Sciety discussions?Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Metrics increasingly define competence and legitimacy in engineering and academia, from chartership and licensure to rankings and citation indices. Although treated as objective, these measures vary across national, disciplinary, and institutional contexts, shaping what organisations recognise as credible knowledge and success. This paper develops a conceptual framework that positions metrics as epistemic infrastructure—systems that structure attention, identity, and organisational behaviour. Through a comparative analysis of engineering credentialing systems across the UK, Australia, the United States, and Malaysia, it identifies three distortions of quantification—compression, incentive, and legitimacy—that explain how metrics tend to reshape perceptions and actions. The Global Metric–Identity Feedback Loop is introduced to show how these distortions become self-reinforcing over time. The analysis argues that metrics act as epistemic filters, privileging certain forms of expertise while obscuring others, often favouring Western credentialing traditions. By treating metrics as situated practices rather than universal standards, the framework provides diagnostic and comparative tools for analysing evaluation systems and identifying more inclusive approaches to professional and academic assessment.