Authors: Dane A. Morey & Michael F. Rayo
CSEL is exploring a new approach to testing and evaluation (T&E) of human-machine systems called joint activity testing (JAT). This methodology focuses on evaluating the performance of the joint human-machine system (i.e., joint activity) as challenge to the system increases. This methodology was designed to facilitate extrapolating insights outside the limits of discrete testing sets in order to better anticipate how complex human-machine systems will respond to scenarios that were not explicitly tested. CSEL has now begun to operationalize JAT in multiple healthcare and intelligence analysis domains spanning multiple projects and continues to further develop the methodology through these experiences.
Want to learn more about JAT?
You can view the related article here: Mile Two.
Dane Morey presented a lecture on CSEL’s continuing JAT research at the 64th Annual Meeting of the Human Factors and Ergonomics Society entitled “Predicting Graceful Extensibility of Human-Machine Systems: A New Analysis Method for Evaluating Extensibility Plots to Anticipate Distributed System Performance.”
Example JAT graph adapted from Morey et al. (2020)
Morey, D. A., Marquisee, J. M., Gifford, R. C., Fitzgerald, M. C., & Rayo, M. F. (2020). Predicting Graceful Extensibility of Human-Machine Systems: A New Analysis Method for Evaluating Extensibility Plots to Anticipate Distributed System Performance. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 64, No. 1, pp. 313-318). Sage CA: Los Angeles, CA: SAGE Publications.
You can view the article on joint activity testing methodology overview [Here].
Read the proceedings paper [Here].