faa handbook of system safety (2000) - ipev.cta.br§ões/ssv 2011 s1... · faa handbook of system...

18
28/08/11 1 IPEV SSV Simpósio Segurança de Voo Prof. Katherine Andrea Lemos, Ph.D. (ITA) © Lemos and Lemos Consul9ng 2011 All Rights Reserved 1 4° Simpósio de Segurança de Voo (SSV) Agosto 2011 Katherine Andrea Lemos, Ph.D. Instituto Técnico de Aeronáuticas São José dos Campos, Brasil 2 FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D. SSV 2011

Upload: phamkiet

Post on 30-Aug-2018

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

1  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

1  

4° Simpósio de Segurança de Voo (SSV) Agosto 2011

Katherine Andrea Lemos, Ph.D. Instituto Técnico de Aeronáuticas

São José dos Campos, Brasil

2  

FAA Handbook of System Safety (2000)

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 2: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

2  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

3  

Guiding Principles § Minimize human error

§  Increase error tolerance

§ Avoid excess complexity

§ Evaluate new technology or operational changes for effect on human performance

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

4  

1. Design for Minimum Risk

2.  Incorporate Safety Devices (Protect)

3. Provide Warning Devices (Notify)

4. Develop Procedures and Training

(FAA  Handbook  of  System  Safety,  2000)  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 3: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

3  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

5  

1. Design for Minimum Risk

2.  Incorporate Safety Devices (Protect)

3. Provide Warning Devices (Notify)

4. Develop Procedures and Training

(FAA  Handbook  of  System  Safety,  2000)  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

6  

§  Status of configuration or parameters v Patterns of color or switch position v Absence of indication is difficult to notice (absence of green)

§  Consistent flight deck v Philosophy “Dark, Quiet” v Control knobs – direction of movement v Flow of checklist matches panel design

§  Prevent Ability for Operator to Committ Error v E.g., Flight Envelope Limiting

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 4: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

4  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

7  

§  August 19, 2005 §  NWA 74, B747-200 § Gear-up landing at Agana, GUAM (GUM) §  Panel Design

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

8  

§ Multiple Indications of Status of all 5 Gear §  Front Panel: Presence of gear warning

illuminated & absence of confirmation §  Landing Gear Aural Tone §  FE Panel: Absence of nose gear down

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 5: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

5  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

9  

§  Crew Conducted Checklist 3 Times: v “Four Green – Good to go.” v “All down and locked.”

Crew saw this… FOM Updated

Training Fix for Design Limitation

Should have seen this…

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

10  

The  Bureau  of  Air  Safety  Inves9ga9on    suggests  that  operators  of  Australian  registered  B747-­‐200  and  B747-­‐300  series  aircraJ  consider  placing  a  fine  border  line  around  the  five  landing  gear  annunciators  located  on  the  flight  engineer  panel  to  beNer  define  the  annunciators  as  a  group.  

Page 6: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

6  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

11  

1. Design for minimum risk

2.  Incorporate Safety Devices (Protect)

3. Provide Warning Devices (Notify)

4. Develop Procedures and Training

(FAA  Handbook  of  System  Safety,  2000)  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

12  

§  Protect the Operator from Poor / Inadvertent Actions §  Extra step required §  Physical barrier

v E.g., Flight Control Protection §  Confirmation required

v Increase cognizance v Purposeful action

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

Page 7: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

7  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

13  

§  Incident: United Air Lines v March 31, 1986 v San Francisco, CA v B767-200

§  Incident: Delta Air Lines v June 30, 1987 v Los Angeles to Cincinnati v B767-200

Inadvertent  shutoff/deac9va9on  of  engines  during  climb    Engine  re-­‐start  at  low  al9tude  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

14  

§  Issue: Inadvertent Activation of Controls v Electronic Engine Control (EEC) Caution v Inadvertently activated Engine Start Controls v Located Side by Side on Pedestal v How? Controls push-button vs. toggle/lever

§ Manufacturer Response: v Larger “Fence” around engine start buttons v Re-design – Moved EEC to overhead panel

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 8: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

8  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

15  

1. Design for Minimum Risk

2.  Incorporate Safety Devices (Protect)

3. Provide Warning Devices (Notify)

4. Develop Procedures and Training

(FAA  Handbook  of  System  Safety,  2000)  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

16  

§  February12, 2009 §  Colgan Air, Inc. Flight 3407 §  DHC-8-400 (Bombardier) §  Buffalo, NY §  50 Fatalities §  Low Airspeed and Stall

on Approach §  Unable to Recover

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 9: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

9  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

17  

18  

Low Speed Awareness Tape §  Indicates proximity to stall speed

(not to exceed low airspeed)

§  Amber/Yellow: Caution Range v Margin above Stick-Shaker

§  Red: Warning Range v V-Shaker and below v Top of range is small margin above

stall speed EMB  170/190  PFD  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 10: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

10  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

19  

Q400  –  No  Cau9onary  Range   B747-­‐400  –  Cau9onary  Range  

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

20  

NTSB Conclusions:

§  “The Q400 airspeed indicator lacked low-speed awareness features, such as an amber band above the low-speed cue …that would have facilitated the flight crew’s detection of the developing low-speed situation.”

§  “An aural warning in advance of the stick shaker would have provided a redundant cue of the visual indication of the rising low-speed cue and might have elicited a timely response from the pilots before the onset of the stick shaker.”

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 11: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

11  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

21  

1. Design for Minimum Risk

2.  Incorporate Safety Devices (Protect)

3. Provide Warning Devices (Notify)

4. Develop Procedures and Training

(FAA  Handbook  of  System  Safety,  2000)  

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

22  

O Que Nós Podemos Fazer?

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 12: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

12  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

23  

§  Flight Deck Automation Problems or Concerns v Automation-Centered (39.7%)

§ Human-centered design § Automation failures § Automation authority and levels

v Pilot/Crew and Organization-Centered (57.7%) § Role Change and Crew Coordination § Training and Use § Confidence in use (over/under) § Situation and automation awareness § Manual skill § Workload and focus of attention

-­‐  Funk  &  Lyall,  1996  

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

24  

Pattern of Automation Accidents and Incidents

§  Pilots do not understand what the automation is doing (Automation “Mode” Confusion)

OR §  Pilots do not receive adequate feedback from

automation -  Dr. Charlie Billings, NASA “Human-Centered Aircraft Automation: A Concept and Guidelines”

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 13: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

13  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

25  

“Glass cockpit displays can present more information in the space required for conventional instrument panels, but the increase in information places greater demands on pilot attention and creates a risk of overloading pilots with more information than they can effectively monitor and process.

The complexity of the integrated computerized systems that drive glass cockpit displays may also limit pilots’ understanding of the functionality of the underlying systems.”

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

26  

CAST REPORT (2008) §  Fundamental Problems:

v  What is automation doing? v  How to manipulate to eliminate error?

§  Two Root Causes: v  Training and System Knowledge v  Incompatibility between:

§  Automation System §  Flight Regime -­‐  CAST,  2008  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 14: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

14  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

27  

Pilot vs. Autopilot § China Air Lines A300-600 Flt 140

v April 26, 1994 v Nagoya, Japan v 264 fatalities (of 271)

§  Interflug A310 v February 11, 1991 v Moscow, Russia v Aircraft recovered (Incident)

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

28  

§  CAST Recommendations: Guidance and Training

v  Philosophy and Approach to Use of Automation v  Maintaining Awareness: §  Verification §  Monitoring §  Communication

§  Most Important Take-Away v  “Fly the Airplane” v  Revert to a more “direct level of automation”

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 15: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

15  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

29  

“Pilots must be thoroughly knowledgeable and proficient

in the selection and use of all levels of automation and

manual flight.”

“The appropriate use of autoflight systems offers enhanced

levels of safety, efficiency, and situation awareness,

allowing for optimal time and task management.”

Autoflight  Philosophy  Statement  ATA  Industry  Automa9on  Task  Force    

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

30  

Autoflight  Philosophy  Statement  ATA  Industry  Automa9on  Task  Force    

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 16: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

16  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

31  

§ Definitions of Attention and Vigilance: v Attention: The process whereby a person concentrates on

some features of the environment to the (relative) exclusion of others

v Attention: The faculty or power of mental concentration

v Vigilance: The process of paying close and continuous attention vigilance is especially susceptible to fatigue

§ Watchfulness, Wakefulness, Alertness

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

32  

§ Three attention situations/modes:

v Selective attention: Pick one of a variety of stimuli / targets (to the relative exclusion of others).

v Divided attention: Attending to multiple targets or carrying out more than one thing at a time.

v Vigilance: Attend for a long time at a rare target at unpredictable intervals.

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 17: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

17  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

33  

Arousal/Stress and Vigilance: §  Arousal influences attention and performance.

v Yerkes-Dodson Law: Poor performance for low and high arousal v Depends on complexity of task

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

34  

§  Potential Solution: “Adaptive Automation” v Redefine assignment of tasks: “integrated approach” v Goal: Maximize benefits of both human and automation v Increases human engagement (Parasuraman)

(Figure:  Endsley  &  Kiris)  

Periodic manual control

@

Pre-set intervals

Or “Neuroergonomics”

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011

Page 18: FAA Handbook of System Safety (2000) - ipev.cta.br§ões/SSV 2011 S1... · FAA Handbook of System Safety (2000) Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D

28/08/11  

18  

IPEV  SSV  Simpósio  Segurança  de  Voo  Prof.  Katherine  Andrea  Lemos,  Ph.D.  (ITA)  

©  Lemos  and  Lemos  Consul9ng  2011  All  Rights  Reserved  

35  

§  The airworthiness “fit” in the context of operational approval – like a propeller blade

Equipment  /  System  Standards  

Design  Criteria  

Air  Traffic  

Opera9onal  Procedures    and  Standards  

Human Factors in Aviation System Engineering Prof. Katherine Andrea Lemos, Ph.D.

Agosto 2011

36  

Crew  

Physical    Environment  

Organiza9onal  Environment    “Corporate  Culture”  

Regulatory  Environment  

Human Factors: Beyond the Slogan Prof. Katherine Andrea Lemos, Ph.D.

SSV 2011