A large-scale investigation into how university students across disciplines adopt, use, and perceive Large Language Models in their academic and non-academic lives.
Lead PI:
Team Members:
Research Period:
Prof. Ben Leong Wing Lup
Dr. Gladia Hotan, Dr. Liu Liu, Marcus Yeo, Lucius Khor, Olivia
2024 – Ongoing
About This Project
The SoL NUS Trial is a longitudinal, cross-faculty study that investigates how university students adopt, adapt to, and are shaped by Large Language Models over the course of their studies. Conducted across the NUS School of Computing, Faculty of Arts and Social Sciences (FASS), and NUS College, the study is distinctive in combining two streams of evidence: periodic surveys that track students’ self-reported usage patterns, attitudes, perceived risks, and epistemic habits over time, and direct analysis of conversation logs captured through ScholAIstic, AICET’s purpose-built platform. This dual-stream design allows the project to go beyond what students say they do and examine what they actually do, surfacing the gap between reported and real behaviour that survey-only studies routinely miss. By analysing the content, structure, and trajectory of student-AI conversations at scale, the project asks deeper questions: How do students frame their requests to AI? Do they engage critically or deferentially? And do their patterns of engagement shift as they gain more experience with these tools? Spanning multiple disciplines, the SoL NUS Trial is one of the few studies positioned to track how LLM adoption unfolds not as a snapshot, but as a process.
ScholAlstic platform
