[NSF-IUSE] SciLAF: Scientific-based Learning Assessment Framework for Student Knowledge Tracking

Amount: $250,000
Duration: 08/2015 – 04/2018
PI: Gabriel Terejanu
Co-PIs: Juan Caicedo, Charles Pierce

Abstract

This project is addressing the fundamental challenge of assessing individual student’s knowledge in cornerstone engineering classes with high student-to-faculty ratios. The goal is to: develop a computational assessment framework that easily integrates into an instructor’s routine efforts to track student knowledge, suggest remedial interventions, and guide future examinations. The rationale is that individual student knowledge is a hypothesis/model that needs to be tested using the scientific method. Similarly, assessment instruments are just experiments to discover how well a student masters specific concepts. This fits naturally with probabilistic methodologies such as the Bayesian inference that formalize the scientific method.

The main approach taken is to track the progress of individual students by developing student knowledge models based on Bayesian networks. This proposal addresses an open fundamental problem in constructing and using knowledge models to assess learning, namely how to relate curricular structure to knowledge models and how to inform the models using assessment data. The proposed methodology emphasizes the role of concept inventories to inform the construction of Bayesian networks models and to extract information from these models to suggest informative questions for future examinations. To facilitate ease of use and broader adoption by faculty, the software artifacts will be made available under open source licenses and the functionality of the framework will be integrated within a widely used learning management system through the development of a prototype plugin. The education and outreach aspects of this proposal include training participants in effective educational strategies and mentoring of future faculty.

Papers

  • S. Madarshahian, C. Chen, J. Caicedo, C. Pierce, and G. Terejanu, “Using Multiple Choice Responses to Assess Uncertainty in Student Understanding of Vector Concepts,” in ASEE Annual Conference and Exposition, Columbus OH, 2017.
    [BibTeX]
    @CONFERENCE{MadarshahianP_ASEE_2017,
    author = {Seyedramin Madarshahian and Chao Chen and Juan Caicedo and Charles Pierce and Gabriel Terejanu},
    title = {{Using Multiple Choice Responses to Assess Uncertainty in Student Understanding of Vector Concepts}},
    booktitle = {{ASEE Annual Conference and Exposition, Columbus OH}},
    year = {2017},
    month= {June},
    }

  • G. Terejanu, J. Caicedo, and C. Pierce, “SciLAF: Scientific-based Learning Assessment Framework for Student Knowledge Tracking,” in Envisioning the Future of Undergraduate STEM Education: Research and Practice, Washington DC, 2016.
    [BibTeX]
    @CONFERENCE{TerejanuP_EnFUSE_2016,
    author = {Gabriel Terejanu and Juan Caicedo and Charles Pierce},
    title = {{SciLAF: Scientific-based Learning Assessment Framework for Student Knowledge Tracking}},
    booktitle = {{Envisioning the Future of Undergraduate STEM Education: Research and Practice, Washington DC}},
    year = {2016},
    month= {April},
    }

  • C. Chen, S. Madarshahian, J. Caicedo, C. Pierce, and G. Terejanu, “Bayesian network models for student knowledge tracking in large classes,” in ASEE Annual Conference and Exposition, New Orleans LA, 2016.
    [BibTeX]
    @CONFERENCE{TerejanuP_ASEE_2016,
    author = {Chao Chen and Seyedramin Madarshahian and Juan Caicedo and Charles Pierce and Gabriel Terejanu},
    title = {{Bayesian network models for student knowledge tracking in large classes}},
    booktitle = {{ASEE Annual Conference and Exposition, New Orleans LA}},
    year = {2016},
    month= {June},
    }

Team Members

Gabriel Terejanu : Associate Professor
Gabriel Terejanu
Associate Professor
Computer Science
UNCC
Juan Caicedo : Professor
Juan Caicedo
Professor
Civil & Environmental
Engineering
UofSC
Charles Pierce : Associate Professor
Charles Pierce
Associate Professor
Civil & Environmental
Engineering
UofSC

Chao Chen : PhD 2018
Chao Chen
PhD 2018
Computer Science
and Engineering
UofSC
Seyedramin<br>Madarshahian : PhD Student
Seyedramin
Madarshahian

PhD Student
Civil & Environmental
Engineering
UofSC