Dr. Anthony Ciavarelli holds a doctorate in Educational Psychology /Instructional Technology, and a Master’s Degree in Experimental Psychology/Human Factors. He has over fifty years’ experience across a broad range of technical disciplines, including human factors engineering, training requirements analysis and system design, simulation training, and performance evaluation. His expertise includes, instructional systems methodology, education and training effectiveness evaluation. As professor Applied Psychology Dr. Ciavarelli taught classes in Scientific Methods, Statistics, Human Factors Engineering and Training Simulation.
Proceedings of the Human Factors Society Annual Meeting, 1980
The content of this paper summarizes four years of research designed to develop valid and reliabl... more The content of this paper summarizes four years of research designed to develop valid and reliable performance criteria for the Navy's Tactical Aircrew Combat Training System (TACTS). Performance measurement methods for assessing missile envelope recognition and air combat engagements have been developed and applied in an operational setting. TACTS measures used in performance assessment were selected on the basis of their operational importance and their demonstrated statistical relationship to successful completion of such air combat tasks as missile launch success and engagement outcomes. A measurement framework has evolved and may be appropriately applied to estimate overall air combat effectiveness, and to provide diagnostic performance analysis of critical air combat tasks. The resulting measurement framework has been applied operationally to evaluate U.S. Navy competitive air combat exercises and to provide diagnostic performance feedback to aircrews undergoing TACTS trai...
This paper addresses human performance risk mitigation strategies for incorporation into a Safety... more This paper addresses human performance risk mitigation strategies for incorporation into a Safety and Environmental Management System (SEMS). A framework is provided that identifies human factors considerations and evaluation criteria needed for successful integration of Human Factors into a company's SEMS. A methodology is presented for assessing safety culture and the effectiveness of SEMS implementation. Results from employee surveys, taken across various high-risk industries, will be presented. The survey findings illustrate the common difficulties encountered in establishing and maintaining a strong safety culture and the challenges in achieving an effective SEMS. Successful integration of Human Factors in SEMS for the Oil and Gas Industry can reduce the risks of accidents and manmade disasters, such as the Macondo Well blowout. Integrating Human Factors into an SEMS might also improve operational efficiency and effectiveness, because Human Factors considers all levels of p...
Proceedings of the Human Factors Society Annual Meeting, 1988
This paper describes methods for developing automated performance measurement systems used with t... more This paper describes methods for developing automated performance measurement systems used with training ranges and simulators. A prototype automated measurement system designed to assess aircrew performance during strike warfare training is presented as an application of this methodology. Methods are also presented for displaying information which is useful in assessing student progress and for diagnosing training results.
: This paper summarizes the background, methodology and findings of initial efforts to improve ou... more : This paper summarizes the background, methodology and findings of initial efforts to improve our approach to training and assessing high-performance skills. High performance skills are those that require accurate and precise perceptual - motor coordination to achieve desired levels of expertise. We review and integrate key areas of knowledge related to skill acquisition and expertise, address strategies for teaching and assessing complex skills, and examine the use of technologies that enable precise recording of trainee performance. Instructional strategies are discussed to accelerate complex skill development, based upon learning principles and enhanced performance feedback. Developments in simulation training technologies, with performance monitoring capabilities, provide a means for studying and improving high performance skills. The US Army's Engagement Skills Trainer (EST) was designed to teach basic and advanced marksmanship skills, and can be used to monitor performanc...
HFES 51st Annual MeetingResearch conducted at the Navy Postgraduate School, over the past 10 year... more HFES 51st Annual MeetingResearch conducted at the Navy Postgraduate School, over the past 10 years, has focused on key organizational factors that may influence the likelihood of an accident or organizational failure. The concept of “high-reliability-organizations”, originated by Dr. Karlene Roberts and her colleagues at UC Berkeley, California, and was used as a point of departure for understanding how different organizations manage the risk of accidents and other organizational failures. High-reliability organizations are those that are very successful at reducing the risks of operational hazards that typically underlie accidents and organizational disasters, such as the Challenger and Columbia Shuttle accidents. Included in the concept of high-reliability organizations are factors related to the safety culture of the organization. The author and his colleagues at the Naval Postgraduate School and UC Berkeley have developed and validated a web-based safety climate assessment and f...
Public reporting burden for this collection of information is estimated to average 1 hour per res... more Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instruction, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to
Public reporting burden for this collection of information is estimated to average 1 hour per res... more Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instruction, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including
: The Aviation Command Safety Assessment (ACSA) is a questionnaire survey methodology developed t... more : The Aviation Command Safety Assessment (ACSA) is a questionnaire survey methodology developed to evaluate a Naval Aviation Command's safety climate, culture, and safety program effectiveness. This survey was a manual process first administered in the fall of 1996. The primary goal of this thesis is to design, develop, and test an Internet-based, prototype model for administering this survey using new technologies that allow automated survey submission and analysis. The result of this thesis is a web site ?http://spitfire.avsafety.nps.navy.mil that adheres to a three-tier client/server architecture. The back-end SQL server database used to store survey information is accessed via front-end Java applets or Hypertext Markup Language (HTML) forms. Middleware components that complete the connection between client and server include Weblogic's Fastforward JDBCTM driver and Java servlets. The ACSA web site utilitizes many Internet technologies: Active Server Pages (ASP), HTML, Ja...
This paper summarizes the background, methodology and findings of initial efforts to improve our ... more This paper summarizes the background, methodology and findings of initial efforts to improve our approach to training and assessing high-performance skills. High performance skills are those that require accurate and precise perceptual – motor coordination to achieve desired levels of expertise. We review and integrate key areas of knowledge related to skill acquisition and expertise, address strategies for teaching and assessing complex skills, and examine the use of technologies that enable precise recording of trainee performance. Instructional strategies are discussed that are designed to accelerate complex skill development, based upon learning principles and enhanced performance feedback. Our emphasis is on teaching the “warrior ” skills needed for military serviceman now engaged in very different and challenging war-fighting tasks. Developments in simulation training technologies, with performance monitoring capabilities, provide a means for studying and improving high perfor...
Human Factors, Anthony Ciavarelli, Ed.D., School of Aviation Safety, Naval Postgraduate School, M... more Human Factors, Anthony Ciavarelli, Ed.D., School of Aviation Safety, Naval Postgraduate School, Monterey, California, June 1997
Advanced simulators and other training systems have been designed to replicate as realistically a... more Advanced simulators and other training systems have been designed to replicate as realistically as possible various operational systems and environments. The rationale for this particular design goal is to attain sufficient fidelity for maximum training transfer to the real world. Yet, effective training may not only depend on attaining adequate fidelity, but also upon how a given training system is used to achieve specific learning outcomes. This paper identifies some of the salient problems with training system design and use, and discusses possible solutions for improving their training value based on incorporating instructional support capabilities and using prescriptive instructional methods.
Accident debris: ValuJet The National Transportation Safety Board (NTSB) found that a fire in the... more Accident debris: ValuJet The National Transportation Safety Board (NTSB) found that a fire in the cargo hold of the aircraft, started when several uncapped chemical oxygen generators ignited then burned into flight control equipment and caused the pilot to lose control of the aircraft. The chain of errors leading to the ValuJet Airlines crash in May 1996 is one of several examples of an Organizational Accident or an accident that is deeply rooted in a company’s lack of leadership commitment and support for safety.
A great deal has been written in the educational literature about the use of distance education, ... more A great deal has been written in the educational literature about the use of distance education, given the rapid expansion of the World Wide Web on the Internet. Web-based courses are now available or under development at many academic institutions and through corporate universities. Educators are concerned, however, about ensuring the quality of online courses, and many question whether online courses can maintain the same high standards of excellence as traditional classroom instruction. One way to ensure quality control over online instruction is to establish an ongoing instructional quality assessment process. This chapter discusses background information and several considerations for assessing the quality of online instruction. (Contains 47 references.) (GCP) Reproductions supplied by EDRS are the best that can be made from the ori inal document. Assessing the Quality of Online Instruction: Integrating Instructional Quality and Web Usability Assessments
Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2007
Research conducted at the Navy Postgraduate School, over the past 10 years, has focused on key or... more Research conducted at the Navy Postgraduate School, over the past 10 years, has focused on key organizational factors that may influence the likelihood of an accident or organizational failure. The concept of “high-reliability-organizations”, originated by Dr. Karlene Roberts and her colleagues at UC Berkeley, California, and was used as a point of departure for understanding how different organizations manage the risk of accidents and other organizational failures. High-reliability organizations are those that are very successful at reducing the risks of operational hazards that typically underlie accidents and organizational disasters, such as the Challenger and Columbia Shuttle accidents. Included in the concept of high-reliability organizations are factors related to the safety culture of the organization. The author and his colleagues at the Naval Postgraduate School and UC Berkeley have developed and validated a web-based safety climate assessment and feedback system now in use in Naval Aviation and in other aviation, aerospace, and medical applications. This paper reviews recent findings in the application of safety climate and culture assessments conducted in naval aviation and US hospitals.
Proceedings of the Human Factors Society Annual Meeting, 1980
The content of this paper summarizes four years of research designed to develop valid and reliabl... more The content of this paper summarizes four years of research designed to develop valid and reliable performance criteria for the Navy's Tactical Aircrew Combat Training System (TACTS). Performance measurement methods for assessing missile envelope recognition and air combat engagements have been developed and applied in an operational setting. TACTS measures used in performance assessment were selected on the basis of their operational importance and their demonstrated statistical relationship to successful completion of such air combat tasks as missile launch success and engagement outcomes. A measurement framework has evolved and may be appropriately applied to estimate overall air combat effectiveness, and to provide diagnostic performance analysis of critical air combat tasks. The resulting measurement framework has been applied operationally to evaluate U.S. Navy competitive air combat exercises and to provide diagnostic performance feedback to aircrews undergoing TACTS trai...
This paper addresses human performance risk mitigation strategies for incorporation into a Safety... more This paper addresses human performance risk mitigation strategies for incorporation into a Safety and Environmental Management System (SEMS). A framework is provided that identifies human factors considerations and evaluation criteria needed for successful integration of Human Factors into a company's SEMS. A methodology is presented for assessing safety culture and the effectiveness of SEMS implementation. Results from employee surveys, taken across various high-risk industries, will be presented. The survey findings illustrate the common difficulties encountered in establishing and maintaining a strong safety culture and the challenges in achieving an effective SEMS. Successful integration of Human Factors in SEMS for the Oil and Gas Industry can reduce the risks of accidents and manmade disasters, such as the Macondo Well blowout. Integrating Human Factors into an SEMS might also improve operational efficiency and effectiveness, because Human Factors considers all levels of p...
Proceedings of the Human Factors Society Annual Meeting, 1988
This paper describes methods for developing automated performance measurement systems used with t... more This paper describes methods for developing automated performance measurement systems used with training ranges and simulators. A prototype automated measurement system designed to assess aircrew performance during strike warfare training is presented as an application of this methodology. Methods are also presented for displaying information which is useful in assessing student progress and for diagnosing training results.
: This paper summarizes the background, methodology and findings of initial efforts to improve ou... more : This paper summarizes the background, methodology and findings of initial efforts to improve our approach to training and assessing high-performance skills. High performance skills are those that require accurate and precise perceptual - motor coordination to achieve desired levels of expertise. We review and integrate key areas of knowledge related to skill acquisition and expertise, address strategies for teaching and assessing complex skills, and examine the use of technologies that enable precise recording of trainee performance. Instructional strategies are discussed to accelerate complex skill development, based upon learning principles and enhanced performance feedback. Developments in simulation training technologies, with performance monitoring capabilities, provide a means for studying and improving high performance skills. The US Army's Engagement Skills Trainer (EST) was designed to teach basic and advanced marksmanship skills, and can be used to monitor performanc...
HFES 51st Annual MeetingResearch conducted at the Navy Postgraduate School, over the past 10 year... more HFES 51st Annual MeetingResearch conducted at the Navy Postgraduate School, over the past 10 years, has focused on key organizational factors that may influence the likelihood of an accident or organizational failure. The concept of “high-reliability-organizations”, originated by Dr. Karlene Roberts and her colleagues at UC Berkeley, California, and was used as a point of departure for understanding how different organizations manage the risk of accidents and other organizational failures. High-reliability organizations are those that are very successful at reducing the risks of operational hazards that typically underlie accidents and organizational disasters, such as the Challenger and Columbia Shuttle accidents. Included in the concept of high-reliability organizations are factors related to the safety culture of the organization. The author and his colleagues at the Naval Postgraduate School and UC Berkeley have developed and validated a web-based safety climate assessment and f...
Public reporting burden for this collection of information is estimated to average 1 hour per res... more Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instruction, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to
Public reporting burden for this collection of information is estimated to average 1 hour per res... more Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instruction, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including
: The Aviation Command Safety Assessment (ACSA) is a questionnaire survey methodology developed t... more : The Aviation Command Safety Assessment (ACSA) is a questionnaire survey methodology developed to evaluate a Naval Aviation Command's safety climate, culture, and safety program effectiveness. This survey was a manual process first administered in the fall of 1996. The primary goal of this thesis is to design, develop, and test an Internet-based, prototype model for administering this survey using new technologies that allow automated survey submission and analysis. The result of this thesis is a web site ?http://spitfire.avsafety.nps.navy.mil that adheres to a three-tier client/server architecture. The back-end SQL server database used to store survey information is accessed via front-end Java applets or Hypertext Markup Language (HTML) forms. Middleware components that complete the connection between client and server include Weblogic's Fastforward JDBCTM driver and Java servlets. The ACSA web site utilitizes many Internet technologies: Active Server Pages (ASP), HTML, Ja...
This paper summarizes the background, methodology and findings of initial efforts to improve our ... more This paper summarizes the background, methodology and findings of initial efforts to improve our approach to training and assessing high-performance skills. High performance skills are those that require accurate and precise perceptual – motor coordination to achieve desired levels of expertise. We review and integrate key areas of knowledge related to skill acquisition and expertise, address strategies for teaching and assessing complex skills, and examine the use of technologies that enable precise recording of trainee performance. Instructional strategies are discussed that are designed to accelerate complex skill development, based upon learning principles and enhanced performance feedback. Our emphasis is on teaching the “warrior ” skills needed for military serviceman now engaged in very different and challenging war-fighting tasks. Developments in simulation training technologies, with performance monitoring capabilities, provide a means for studying and improving high perfor...
Human Factors, Anthony Ciavarelli, Ed.D., School of Aviation Safety, Naval Postgraduate School, M... more Human Factors, Anthony Ciavarelli, Ed.D., School of Aviation Safety, Naval Postgraduate School, Monterey, California, June 1997
Advanced simulators and other training systems have been designed to replicate as realistically a... more Advanced simulators and other training systems have been designed to replicate as realistically as possible various operational systems and environments. The rationale for this particular design goal is to attain sufficient fidelity for maximum training transfer to the real world. Yet, effective training may not only depend on attaining adequate fidelity, but also upon how a given training system is used to achieve specific learning outcomes. This paper identifies some of the salient problems with training system design and use, and discusses possible solutions for improving their training value based on incorporating instructional support capabilities and using prescriptive instructional methods.
Accident debris: ValuJet The National Transportation Safety Board (NTSB) found that a fire in the... more Accident debris: ValuJet The National Transportation Safety Board (NTSB) found that a fire in the cargo hold of the aircraft, started when several uncapped chemical oxygen generators ignited then burned into flight control equipment and caused the pilot to lose control of the aircraft. The chain of errors leading to the ValuJet Airlines crash in May 1996 is one of several examples of an Organizational Accident or an accident that is deeply rooted in a company’s lack of leadership commitment and support for safety.
A great deal has been written in the educational literature about the use of distance education, ... more A great deal has been written in the educational literature about the use of distance education, given the rapid expansion of the World Wide Web on the Internet. Web-based courses are now available or under development at many academic institutions and through corporate universities. Educators are concerned, however, about ensuring the quality of online courses, and many question whether online courses can maintain the same high standards of excellence as traditional classroom instruction. One way to ensure quality control over online instruction is to establish an ongoing instructional quality assessment process. This chapter discusses background information and several considerations for assessing the quality of online instruction. (Contains 47 references.) (GCP) Reproductions supplied by EDRS are the best that can be made from the ori inal document. Assessing the Quality of Online Instruction: Integrating Instructional Quality and Web Usability Assessments
Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2007
Research conducted at the Navy Postgraduate School, over the past 10 years, has focused on key or... more Research conducted at the Navy Postgraduate School, over the past 10 years, has focused on key organizational factors that may influence the likelihood of an accident or organizational failure. The concept of “high-reliability-organizations”, originated by Dr. Karlene Roberts and her colleagues at UC Berkeley, California, and was used as a point of departure for understanding how different organizations manage the risk of accidents and other organizational failures. High-reliability organizations are those that are very successful at reducing the risks of operational hazards that typically underlie accidents and organizational disasters, such as the Challenger and Columbia Shuttle accidents. Included in the concept of high-reliability organizations are factors related to the safety culture of the organization. The author and his colleagues at the Naval Postgraduate School and UC Berkeley have developed and validated a web-based safety climate assessment and feedback system now in use in Naval Aviation and in other aviation, aerospace, and medical applications. This paper reviews recent findings in the application of safety climate and culture assessments conducted in naval aviation and US hospitals.
Uploads
Papers by anthony ciavarelli