Services
Corporate and academic services
Corporate Service
- Enterprise Test Security Leadership Team [2022–2023]: Oversaw development and implementation of enterprise-wide test security initiatives.
- AI and Data Analytics Initiative for Test Security [2021–2023]: Led the definition of research agenda and budget to develop AI- and data-driven solutions for test security.
- Research Upskilling Initiative [2021–2022]: Led the design and implementation of training programs in AI, data science, and digital learning.
- Remote Proctoring Strategy Committee [2020–2021]: Helped to plan the remote proctoring strategy and implementation.
- R&D Technology Steering Committee [2019–present]: Provided technical oversight and strategic guidance for R&D computing infrastructure and cloud strategy.
- Research Advisory Council, PSDS Division (Co-Chair) [2019–2020]: Co-led research agenda setting, proposal review, and portfolio oversight.
- AI Strategy Committee [2019–2020]: Contributed to the development and prioritization of enterprise AI strategy.
- Computational Psychometrics Initiative [2016–2017]: Led agenda setting and execution of research initiatives defining computational psychometrics.
- Software and Data Infrastructure Sub-Initiative [2014–2016]: Led research agenda development and implementation for software and data infrastructure.
Professional Service
-
Associate Editor
Frontiers in Psychology: Quantitative Psychology and Measurement -
Editorial Board
Journal of Educational Measurement -
Reviewer (active)
Psychometrika; Journal of Educational Measurement; Educational and Psychological Measurement;
Journal of Educational and Behavioral Statistics; International Journal of Testing;
Learning and Instruction; Computers & Education; PLOS One;
Journal of Learning Analytics; Computers in Human Behavior;
Journal of Educational Data Mining; Educational Assessment;
IEEE Transactions on Learning Technologies; Quality Assurance in Education;
ETS Research Report -
Conference Program/Organizing Committee
- International Conference on Educational Data Mining (EDM): 2017–now
- International Conference on Artificial Intelligence in Education (AIED): 2024 - now
- Workshop on Innovative Use of NLP for Building Educational Applications (BEA): 2017–now
- International Conference on Computer Supported Education: 2023 - now
- EdTech and Computational Psychometrics Summit (ECPS): 2024
- NeurIPS workshop: 2024
- AAAI Conference on Artificial Intelligence: 2021–2024
- Association for Computational Linguistics (ACL / NAACL / AACL / IJCNLP): 2018–2023
- International Conference on Learning Sciences (ICLS): 2018
- IEEE International Conference on Systems, Man, and Cybernetics: 2015
-
Workshop/Symposium Chair/Panel
- Coordiated session “Computer-Supported Collaborative Social Emotional Learning and Assessment in Classroom”, 2025 NCME 2025, Denver, CO.
- Organized panel discussion “One year after GPT-4: how AI changed Assessments”, 2024 NCME, Philadelphia, PA.
- Coordinated session “Support Test Security of Remote Testing with Process Data Analytics and AI”, 2023 NCME, Chicago, IL
- Training workshop “Addressing the Data Challenges of Next-generation Assessments: Data Science Upskilling for Psychometricians”, 2023 NCME, Chicago, IL
- Coordinated session “Assessing Collaborative Problem Solving at Scale: Individual Contribution to Teamwork”, 2023 NCME, Chicago, IL
- Panel discussion “From Science Fiction to 2023’s GPT-4: Implications for Assessment”, 2023 NCME, Chicago, IL
- Symposium “AI and data analytics approaches to address test security issues from remotely proctored tests”, 2022 Conference on Test Security, Princeton, NJ, Nov. 2022
- Training workshop “Machine Learning, Natural Language Processing, and their Application in Educational Assessment, 2022 MARC conference, Nov. (2022).
- Pre-conference Workshop “Addressing the psychometrics challenges from digital learning and assessment: how computational psychometrics helps”, Edtech & Computational Psychometrics Summit, June (2022)
- Training workshop “Addressing the data challenges from next-generation assessments: data science upskilling for psychometricians”, NCME, Virtual (2022)
- Coordinated session “Using Response Process Data to Support At-home Administrations of High-stakes Assessments”, NCME, Virtual ( 2022)
- Training workshop “Addressing the data challenges from next-generation assessments: data science upskilling for psychometricians”, NCME, Virtual (2021)
- Coordinated session “Leveraging Response Process Data to Support Testing Programs: Strategies and Real-world Examples”, NCME, Virtual (2021)
- Coordinated session, “Assessing collaborative problem solving at scale: the status quo and the next”, NCME, Virtual (2020)
- Workshop “EPCAL: studying synchronous collaboration at scale”, 13th International Conference on Computer Supported Collaborative Learning, Lyon, France (2019)
- Workshop “Evidence-centered design and computational psychometric solution for process data”, annual meeting of the National Council on Measurement in Education, New York, NY, USA (2018)
- Workshop “EPCAL: computer-supported collaboration at scale”, 12th International Conference on Computer Supported Collaborative Learning, Philadelphia, PA, USA (2017)
- Workshop “Evidence-centered design and computational psychometric solution for process data”, annual meeting of the National Council on Measurement in Education, San Antonio, TX, USA (2017)