Autonomous Artificial Intelligence, Scientific Research, and Human Values

During the initial stage of AI’s incorporation into scientific research, AI systems have functioned predominantly as tools under direct human supervision and control. However, AI incorporation into scientific research is now entering a stage in which Agential AI systems perform research tasks with partial autonomy while remaining under human supervision and control. In the not-too-distant future, a third stage may arise when autonomous AI systems conduct their own research and generate knowledge without human supervision or control. While the second and third stages of AI-augmented research may offer substantial benefits for science and society, they can also create disproportionate risks. This paper examines ethical issues, problems, and concerns raised by the participation of partially and fully autonomous AI systems in research and offers proposals for ensuring that incorporation of AI into scientific research supports human values.