The AIR Framework for Research Transparency: A Critical Analysis of Stage-Specific AI Disclosure in the Context of Accessibility and Research Integrity--Article Type: Review

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

As generative AI tools integrate rapidly into research workflows, the absence of shared disclosure vocabulary creates a transparency crisis: researchers wish to use AI responsibly but lack consistent language for describing how these tools contribute to their work. The AIR (AI in Research) framework addresses this gap through a two-dimensional matrix mapping AI involvement across seven research stages and five engagement bands, from no use to substantial use. This critical review examines AIR’s theoretical foundations, empirical viability, and ethical limitations, with particular attention to accessibility and neurodiversity. Drawing on virtue epistemology, I argue that transparency must be understood as a constitutive epistemic virtue rather than a procedural requirement, and assess how AIR operationalizes this commitment. An inter-rater reliability pilot study (n=15 raters, nine scenarios, Cohen’s κ=0.72) demonstrates that trained evaluators can apply AIR with substantial agreement while revealing systematic boundary ambiguities. Critical analysis identifies five major limitations: false precision in ambiguous practices, inadequate treatment of accessibility-related AI use, stigmatization of legitimate high-band practices, vulnerability to adversarial compliance, and insufficient edge case guidance. I propose evidence-informed refinements including boundary case designations, a protected A1-Access sub-band for disability accommodations, separation of verification burden from appropriateness judgment, spot-check validation studies, and community-maintained edge case repositories. These refinements aim to preserve AIR’s descriptive precision while protecting vulnerable researchers and mitigating exclusion risks. The analysis concludes that AIR, with refinements, represents valuable transparency infrastructure, but that implementation requires sustained dialogue among researchers, integrity officers, editors, accessibility advocates, and policymakers to ensure research integrity and inclusion remain interdependent rather than competing aspirations.

Article activity feed