William L. Bewley

3928 Via Verde Drive

Thousand Oaks, CA 91360

(805) 523-7844

Educational History

Ph.D.1969, University of Wisconsin
Experimental Psychology, Computer Science minor

M.A.1966, University of Wisconsin
Experimental Psychology, Computer Science minor

B.A.1964, StanfordUniversity
Experimental Psychology

Employment History

2015, Fall - PresentAdjunct Faculty, USC Rossier School of Education

Responsible for a section of Education 627, Educational Performance Problems: The Role of Learning, a course in the Ed.D. program dealing with issues of learning, training, and motivation and how they affect organizational performance.

2000 - PresentAssistant Director for Technology, UCLA CRESST

CRESST is the NationalCenter for Research on Evaluation, Standards, and Student Testing, a research center headquartered in the UCLAGraduateSchool of Education & Information Studies. Dr. Bewley is responsible for strategic planning, financial and administrative planning and management, project management, and technology development, focusing on projects applying CRESST assessment and evaluation methodology and technology to applications including instructional simulations, distance learning, assessment authoring systems, performance assessments, and instructional management decision support systems.His current work is concerned with cognitive readiness, assessment methodology, technology evaluation, and research on applications of advanced technology to instruction and human performance assessment, focusing on complex skills. His work has been recognized by the American Society for Training and Development, receiving Excellence in Practice awards in 2009, 2010, and 2011 for work on technology-based training and assessment systems for the Navy Surface Warfare Officers School.

2005, SpringAdjunct Faculty, USC Rossier School of Education

Responsible for Education 525, Challenges in Urban Education: Learning, a course in the Ed.D. program dealing with gap analysis for detecting, diagnosing, and treating performance problems. Served on dissertation committees for Ed.D. students, 2005-2006.

1999 - 2000Vice President, Skoozle.com, Menlo Park, CA

Managed the functional design of Web-based services for teachers. Developed business partnerships and managed customer relationships.

1988 to 1999Vice President, ISX Corporation, Westlake Village, CA

Responsible for an education and training business providing advanced technology applications and curriculum integration support for teachers. Responsible for strategic planning and leveraging technology assets to develop new commercial companies, including a spin-off company based on ISX educational technology.

1986 to 1988Program Manager, Teknowledge, Inc., Palo Alto, CA

Responsible forartificial intelligencesoftware applications including a decision-support system for instructional designers,

1978 to 1986Programand Product Manager, Xerox Corporation, Palo Alto, CA

Responsible for development of embedded help and training systems, user interface testing, and management of workstation software functional definition and support for the Xerox 8010 Star, the first commercial system to incorporate a bitmapped display, a window-based graphical user interface, icons, a mouse, Ethernetnetworking, file servers, print servers and e-mail.

1976 to 1978Education Consultant, Control Data Corp., Minneapolis, MN

Designed and developed courseware for the PLATO system, including CREATE, a product providing guidelines and training for courseware designers and developers..

1975 to 1976Educational Technologist, MECC, Minneapolis, MN

Designed and developed courseware and technology for use on a statewide educational timesharing system managed by the Minnesota Educational Computing Consortium. Conducted National Institutes of Education funded research on the impact of computing on education in Minnesota. Consulted on educational technology to school districts in and outside Minnesota.

1974 to 1975Educational Technologist, Northwest Regional Educational

Laboratory, Portland, OR

Designed and developed courseware and educational technology including a published instructional system providing guidelines and training for courseware designers and developers. Consulted on educational technology to school districts.

1969 to 1974Assistant Professor, LawrenceUniversity, Appleton, WI

Taught courses in cognitive psychology, computer simulation and artificial intelligence, and experimental design. Conducted research on human learning and memory. At DartmouthCollege, developed and published instructional simulations and lab manuals for cognitive psychology courses. Served as Department Chair.

1968 to1969Human Factors Engineer, The Boeing Co., Seattle, WA

Developed systems for information representation and decision support for operators of early warning systems.

Publications and presentations

Bewley, W. L., Lee, J. J., Jones, B., & Cai, H. (2014). Assessing cognitive readiness in a simulation-based training environment. In H. F. O’Neil, R. S. Perez, & E. L. Baker (Eds.),Teaching and measuring cognitive readiness (pp. 253-278). New York: Springer.

Bewley, W. L., & O'Neil, H. F. (2013). Evaluation of medical simulations. Military Medicine, 178(Suppl. 1), 64-75.

Bewley, William L. (2013, January.) Selecting Methods for Evaluating Medical Simulations. Paper presented at the Hawaii International Conference on Education, Honolulu, HI.

Bewley, William L. (2012, January.) Evaluation of Medical Simulations. Paper presented at the Hawaii International Conference on Education, Honolulu, HI.

Bewley, William L. (2011, January.) What Do We Know About Automated Assessment of Performance in Serious Games? Paper presented at the Hawaii International Conference on Education, Honolulu, HI.

Bewley, William L. (2010.) Methods to evaluate technology. In Eva Baker, Penelope Peterson, & Barry McGaw (Eds.), The international encyclopedia of education, 3rd edition. Oxford: Elsevier.

Bewley, William L. (2010, January.) Discussant: Learning and Motivational Issues in Serious Games. Paper presented at the Hawaii International Conference on Education, Honolulu, HI.

Bewley, William L., Chung, Gregory K. W. K., Delacruz, Girlie, C., & Baker, Eva L. (2009). Assessment models and tools for virtual environment training. In Dylan Schmorrow, Joseph Cohn, & Denise Nicholson (Eds.), The PSI handbook of virtual environments for training and education: Developments for the military and beyond, Volume 1(pp. 300-313). Westport, CT: Greenwood Publishing.

Bewley, William L, & O’Neil, H. F. (2009, April.) Assessing cognitive readiness. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.

Bewley, William L, & O’Neil, H. F., & Lang, J. (2009, January.) What is cognitive readiness? Paper presented at the Hawaii International Conference on Education, Honolulu, HI.

Chung, G. K. W. K., Iseli, M. R., Buschang, R.E., Delacruz, G. C., & Bewley, W. L. (2009, June). Developing domain ontologies to support assessment and instruction: Initial work on pre-algebra. Poster presentation at the Fourth Annual IES Research Conference, June 7-9, 2009 Institute of Education Sciences, U. S. Department of Education, Washington, DC.

Lee, J. J., Bewley, W. L., Jones, B. Min, H. &., Kang, T. (2009, December). Assessing performance in a simulated combat information center. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Munro, A., Pizzini, Q., & Bewley, W. L. (2009, December). Learning anti-submarine warfare with a game-like tactical planner. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Lee, J. J., Delacruz, G. C., Elmore, J., & Bewley, William L. (2008, March.) Video-based assessment of a coach's ability to fault check performance. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Munro, A., & Bewley, William L. (2008, March.) Teaching advanced learners with interactive visualizations. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Chung, G. K. W. K., O’Neil, H. F., Bewley, W. L., & Baker, E. L. (2008). Computer-based assessments in support of distance learning. In Hartig, J., Klieme, E., & Leutner, D. (Eds.), Assessment of competencies in educational contexts. Göttingen, Germany: Hogrefe & Huber.

Chung, G. K. W. K., Baker, E. L., Delacruz, G. C., Bewley, W. L., Elmore, J. J., & Seely, B. (2008). A computational approach to authoring problem-solving assessments. In Baker, E., Dickieson, J., Wulfeck, W., & O’Neil, H. F. (Eds.), Assessment of problem solving using simulations. New York: Lawrence Erlbaum Associates.

Delacruz, G. C., Lee, J. J., Elmore, J., & Bewley, William L. (2008, March.) Examining the validity of a video-based assessment: Distributed representations, scaffolding, and the expertise reversal effect. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Bewley, William L. (2007, April.) Using technology for measures of complex knowledge and skill. Invited paper presented at the SIG TACTL session "Assessment and Technology: Identifying the Current Trends and Issues," at the annual meeting of the American Educational Research Association, Chicago, IL.

Bewley, William L, Lee, J. J., Munro, A., & Chung, G.K.W.K. (2007, April.) The use of formative assessments to guide instruction in a military training system. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.

Bewley, William L., Chung, Gregory K. W. K., Delacruz, Girlie C., & Munro, Allen. (2006, April.) Simulation-based assessment of air defense planning. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.

Chung, G. K. W. K., Delacruz, G. C., de Vries, L. F., Bewley, W. L., & Baker, E. (2006). New directions in rifle marksmanship research. Military Psychology, 18(2): pp. 161-179.

Clark, R.L., Bewley, William L., & O’Neil, H. F.. (2006). Heuristics for selecting distance or classroom settings for courses. In H. F. O'Neil Jr. & R. S. Perez (Eds.), Web-based Learning: Theory, Research, and Practice. Mahwah, NJ: Erlbaum.

Bewley, William L. (2005, April.) An after-action review in a computer-based collaborative problem-solving task. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.

Chung, G. K. W. K., O’Neil, H. F., Jr., Delacruz, G. C., & Bewley, W. L. (2005). The role of affect on novices’ rifle marksmanship performance. Educational Assessment, 10, 257–275.

O’Neil, H. F., Baker, E. L., & Bewley, W. (2005). Background and purpose. In H. F. O’Neil (Ed.), What works in distance learning. Guidelines (pp. 1-6). Greenwich, CT: Information Age Publishing.

Sylvester, R., O’Neil, H. F., & Bewley, William L. (2005, April.) A tool for applying research-based guidelines to courseware evaluation. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.

Bewley, W. L., Chung, G. K. W. K., Kim, J-O. Lee, J. J. &., Saadat, F. (2004, December). A distance-learning testbed. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Chung, Gregory K.W.K., Delacruz, Girlie C., & Bewley, William L. (2004.) Performance assessment models and tools for complex tasks. The ITEA Journal, 25(1): pp. 47-52.

Bewley, William L, & Chung, G.K.W.K. (2004, April.) Approaches to evaluating distance learning. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.

Bewley, William L, Chung, G. K. W. K , & Vendlinski, T.. (2004, January.) Computer-based assessment of problem solving: Two examples. Paper presented at the Hawaii International Conference on Education, Honolulu, HI.

Vendlinski, T. P. J. F., Munro, A., Pizzini, Q. A., Bewley, W. L., Chung, G. K. W. K., Stuart, G., & Delacruz, G. C. (2004, December). Learning complex cognitive skills with an interactive job aid. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Chung, G. K. W. K., Delacruz, G. C., Dionne, G. B., & Bewley, W. L. (2003, December). Linking assessment and instruction using ontologies. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Delacruz, G. C., Chung, G. K. W. K., & Bewley, W. L. (2003, December). Identifying learning phases using the Human Performance Knowledge Mapping Tool (HPKMT) and microgenetic analysis. Proceedings of the Interservice/Industry Training, Simulation and Education Conference, Orlando, FL.

Niemi, D., Chung, G. K. W. K., & Bewley, W. L. (2003, April). Assessment design using ontologies: Linking assessment, content, and cognitive demands. Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.

Chung, Gregory K.W.K., de Vries, Linda F., Cheak, Alicia M., Stevens, Ronald H., & Bewley, William L. (2002.) Cognitive process validation of an online problem solving assessment. Computers in human behavior. 18 (6): pp. 669-684.

Bewley, William L., & Baker, Eva L. (2001). E. L. Thorndike 1874-1949. In J. A. Palmer (Ed.) & L. Bresler & D. E. Cooper (Advisory Eds.), Fifty major thinkers on education: From Confucius to Dewey (pp. 233-238). London: Routledge.

Bewley, William L. The Presidential Technology Initiative, Final Report: Integrating Technology in Department of Defense Educational Activity K-12 Classrooms. ISX Corporation Technical Report, 1998.

Bewley, William L. The DARPA Computer Aided Education and Training Initiative, Final Report: Technology in the K-12 Classroom and in Support of Defense Acquisition University Course Management. ISX Corporation Technical Report, 1996.

Edwards, G.R., Burnard, R.H., Bewley, W.L., and Bullock, B.L., "The Ground Vehicle Manager's Associate", Tech Report AIAA-94-1249-CP, 1994, pp. 520-526.

Bewley, William L. The DARPA POGO Program, Final Report: A Quickstart to Technology Insertion in the K-12 Classroom. ISX Corporation Technical Report, 1993.

Bewley, William L. An Intelligent Decision Support System for a NASA Airborne Observatory, Final Report. ISX Corporation Technical Report, 1992.

Bewley, William L. An Intelligent Decision Support System for NASA Computational Fluid Dynamics Codes, Final Report. ISX Corporation Technical Report, 1991.

Bewley, William L. Intelligent Decision Support for NASA Space Station Assembly Sequence Planning, Final Report. ISX Corporation Technical Report, 1990.

Bewley, William L. The Manager’s Associate: Intelligent Decision Support for Remote Operators of NASA Microrobots on a Planetary Surface, Final Report. ISX Corporation Technical Report, 1989.

Bewley, William L. Intelligent Computational Resource Management for NASA Computing Resources, Final Report. ISX Corporation Technical Report, 1988.

Bewley, William L. The Artificially Intelligent Model: Decision Support for USAF Space Transportation Planners, Final Report. ISX Corporation Technical Report, 1987.

Bewley, William L., Roberts, Teresa, Schroit, David, and Verplank, William. Human Factors Testing in the Design of Xerox’s 8010 “Star” Office Workstation. Proceedings of CHI’83, NY: Association for Computing Machinery, 1983, 72-77.

Bewley, William L., and Reko, Molly. The PLATO Author Language: Part of the CREATE Curriculum. Minneapolis: Control Data Education Company, 1978.

Bewley, William L. Developing Instructional Simulations. Northwest Regional Educational Laboratory Technical Report, 1974.

Bewley, William L. Cognitive Psychology: A Computer-Oriented Laboratory Manual, Teacher Manual. Hanover, NH: Dartmouth College, 1974.

Bewley, William L. Cognitive Psychology: A Computer-Oriented Laboratory Manual, Student Manual. Hanover, NH: Dartmouth College, 1974.

Bewley, William L. The functional stimulus in serial learning. In R. F. Thompson and J. F. Voss (Eds.), Topics in Learning and Performance. NY: Academic Press, 1972.

Bewley, William L.; Nelson, Douglas L.; Brogden, W. J.Effect of Cue Alteration for Ordinal Position on Acquisition and Serial Position Curve Form. Journal of Experimental Psychology. 1969. 79 (3, Pt. 1): p. 445-451

Bewley, William L.; Nelson, Douglas L.; Brogden, W. J.Single, Alternate, and Successive Practice in the Acquisition of Two and Three Serial Lists. Journal of Experimental Psychology. 1968. 76 (3, PT. 1): p. 376-386

1