EXPERIMENT 2 FLIGHT SCENARIO (High Workload)
Prebrief:
[Experimenter reads.]
You are flying a night flight from New York, NY (JFK) to Reno, NV (RNO). Your ETA is 2200 local time (0500Z). Your equipment is a NASA-owned B-757 with EVS (Enhanced Vision System) and SVS (Synthetic Vision System) displays on-board. These systems are used to support a HUD (head-up display) for the pilot flying. You will fly the ILS Runway 16R approach to RNO, beginning abeam the IAF (PYRAM) and ending with either a landing or missed approach. Your first officer is an experienced pilot, but new to your company and not yet proficient with company specific procedures and crew coordination standards. Prior to beginning the approach, you will have an opportunity to brief him on the approach and your expectations for crew coordination.
Provide pilot with instrument approach plate and weather conditions for study.
Approach plates:
[Read to pilot while (s)he reviews plates.]
You will start out at 8500 ft abeam PYRAM on localizer on a heading of 164. This will be your IAF (Initial Approach Fix). You will fly the ILS RWY 16R approach as depicted on the approach plate. There is a PAPI system on the left side of RWY 16R (and it can only be used within 2nm of the runway threshold). The decision height for the field is 5515ft MSL (1100 AGL). You can assume at the start of the scenario that your vehicle is on course for PYRAM. Your autopilot, flight director, and autothrottles are inoperative, and you will be hand-flying the approach. All navaids and FMC are already set for the approach.
Weather:
[Second experimenter to give printed copy of weather strip to pilot.
Both strips reflect crosswind conditions.]
[Trial High-Workload (HW)1 and HW3]
TAF KRNO XX0400Z XX0410Z 10017KT 4SM HZ OVC011 TEMPO0410 1/2SM FG OVC001 (where XX = Date of session)
Wind 100 at 17 kts
Visibility 4 SM (statute miles) in haze
Ceiling 1100 and overcast
Temporary conditions
0.5 SM in fog
Ceiling 100 and overcast.
[Trial HW2]
TAF KRNO XX0400Z XX0410Z 23017KT 4SM HZ OVC011 TEMPO0410 1/2SM FG OVC001 (where XX = Date of session)
Wind 230 at 17 kts
Visibility 4 SM (statute miles) in haze
Ceiling 1100 and overcast
Temporary conditions
0.5 SM in fog
Ceiling 100 and overcast.
Because of the cloud layer, the landing lights in the clouds are too bright for use. In the simulator cockpit, it causes the conditions to appear like IMC day-time. In addition, the lights are too bright in the clouds for certain HUD configurations. You should not turn on your wing or nose lights until breakout. You will need to brief your FO on this.
In Simulator:
- [Experimenter introduces FO and asks pilot to brief planned approach and crew coordination expectations.]
[Experimenter to verify simulator settings are correct:
Contrast control = 44
Brightness control = 90 (max)
Iconic symbol brightness = 0.55
Grid brightness = 0.65 (1000m spacing with 3 pixels lines)
SVS/EVS mixer – foreground = 200
SVS/EVS mixer – background = -250]
1.1. Actions:
Pilot is expected to require FO to...
Communicate with ATC.
Operate FCP, flaps and gear.
Confirm aircraft control settings as requested (e.g., flaps 15 selected, flaps 15 set).
Complete landing checklists.
Make callouts as instructed (e.g., 1000 to go, 500 to go).
Pilot is expected to inform FO that...
(S)he will advise of runway in sight (e.g., strobes, “rabbits”)
(S)he will announce decision at decision height.
(S)he will announce runway in sight and decision at EVS decision height.
Pilot is expected to inform FO or terms and process to be used for go-around.
They should describe how the go-around will be conducted.
(e.g., Pilot will set power.
Pilot will call for flaps 15.
FO should ensure altimeter is armed.
FO should advise ATC of go-around.)
- Segment 1 (Abeam PYRAM to I-RNO 13.2 DME)
2.1.Status:
[Experimenter reads.]
Your 757 is beginning the ILS RWY 16 approach at PYRAM. Altitude is 8500 ft. with poor visibility (IMC). Course is 164 degrees. [HW2] HDG is 167. [HW1 and HW3] HDG is 160. Speed is 210 knots with Flaps 0.
[Second experimenter to inform programmer of leg ID and advise pilot of display configuration.]
Your HUD configurations includes...[SVS / EVS / PRIM / IMC / TUNNEL].
[Experimenter reads.]
FO would you please ensure the brightness on the HDD PFD and ND are turned all the way down.
2.2.Clearances:
[Experimenter role-playing ATC to provide ATIS broadcast.]
[Trial HW1 and HW3]
“Reno/Tahoe international information.
Delta. 0500 Zulu weather.
Ceiling 1100, overcast. Visibility 4 miles, haze.
Temperature 15, dew point 12.
Wind 100 at 17 knots.
Temporary conditions are:
0.5 SM in fog
Ceiling 100, overcast.
Altimeter 3007.
ILS Runway 16R in use. Landing 16R, Departures 16L.
Advisory…
[Trial HW1]
Unlit tower 150 feet AGL 2 nautical miles south of airport.
[Trial HW3]
Taxiway Bravo closed between taxiways Alfa and Lima.
Advise on initial contact you have Delta.”
[Trial HW2]
“Reno/Tahoe international information.
Delta. 0500 Zulu weather.
Ceiling 1100, overcast. Visibility 4 miles, haze.
Temperature 27, dew point 12.
Wind 230 at 17 knots.
Temporary conditions are:
0.5 SM in fog
Ceiling 100, overcast.
Altimeter 3007.
ILS Runway 16R in use. Landing 16R, Departures 16L.
Advisory…
Men and equipment between runways.
Advise on initial contact you have Delta.”
[Experimenter reads to pilot.]
Would you please confirm when you are ready to begin this trial by saying “operate”.
[FO should use tool to index video when any significant path deviations occur – 1 dot off localizer or glideslope.]
[Experimenter should terminate trial in the event of localizer or glideslope off scale.]
[ATC to provide clearance.]
“NASA-113. Reno Approach: Abeam PYRAM, maintain 8500 ft until established, cleared ILS 16R approach. Maintain 210 for slower traffic. Altimeter setting is 3003.”
[FO responds.]
“Reno Approach, NASA-113, maintain 8500 until established, cleared ILS 16 right, maintain 210. Altimeter 3003, we have Delta.”
[ATC to provide clearance at 19.0 DME]
“NASA 113. Reno Approach. Slow to approach speed.”
2.3.Actions:
Pilot is expected to slow aircraft, call for FCP speed setting (138 kts), call for extending flaps (e.g., 15 degrees) and landing gear.
[FO should use tool to index video when these actions occur.]
Pilot is expected to complete before landing checklist during this segment.
[FO should use tool to index video when these actions occur.]
2.4. Pause:
[Experimenter announces “halt” and “reset”.]
This is end leg at I-RNO 13.2 DME
[Experimenter administers questionnaires, including subjective rating of perceived display clutter and NASA-TLX.]
Please turn on your map light using the control on the panel to your left.
We now ask that you complete this cognitive workload rating form. Please review the workload demand component definitions and make your ratings based on the last leg of the flight.
We now ask that you complete this display clutter rating form. Please review the definitions of the underlying properties of clutter and make your ratings based on the last leg of the flight.
- Segment 2 (I-RNO 13.2 DME to DICEY [I-RNO 5.9 DME])
3.1.Status:
[Experimenter reads.]
You are now at I-RNO, 13.2 DME and 8500 ft. MSL, approaching glideslope intercept. Your course is 164. [HW2] Your heading is 169. [HW1 and HW3] Your heading is 158. Airspeed is 138 kts and configuration has been reset for the next segment. Speed brake is armed.
[Second experimenter to inform pilot of display configuration.]
Your HUD configurations includes...[SVS / EVS / PRIM / IMC / TUNNEL].
[Experimenter reads to pilot.]
Would you please confirm “operate”.
3.2.Actions:
Pilot is expected to maintain localizer course and 8500 MSL until glideslope intercept. At glideslope intercept, pilot is expected to initiate descent to maintain glideslope.
[FO should use tool to index video when these actions occur.]
3.3.Clearance:
At 9.0 DME:
[ATC to provide clearance.]
“NASA 113, Reno Approach. Approaching DICEY, contact tower.”
[FO responds.]
“Reno Approach, NASA-113, switching to tower.”
[FO tunes Reno tower (118.7)]
“Reno Tower, NASA-113, DICEY inbound on ILS 16R.”
[ATC]
[Trial HW1 and HW3]
“NASA-113, cleared to land 16R. Wind 100 at 17 kts.”
[Trial HW2]
“NASA-113, cleared to land 16R. Wind 230 at 17 kts.”
[FO responds]
“NASA-113, cleared to land.”
3.4.Actions:
If not completed on previous leg, the crew is expected to fully configure aircraft and complete before landing checklist.
[FO should use tool to index video when these actions occur.]
3.3 Pause:
[Experimenter announces “halt” and “reset”.]
This is end of segment at DICEY (I-RNO 5.9 DME).
[Second experimenter informs programmer of leg ID.]
[Experimenter administers questionnaires, including subjective rating of perceived display clutter and NASA-TLX.]
Please turn on your map light using the control on the panel to your left.
We now ask that you complete this cognitive workload rating form. Please review the workload demand component definitions and make your ratings based on the last leg of the flight.
We now ask that you complete this display clutter rating form. Please review the definitions of the underlying properties of clutter and make your ratings based on the last leg of the flight.
- Segment 3 (DICEY to landing or missed approach)
4.1.Status:
Experimenter reads: You are now at DICEY, on course and on glideslope at 6400 feet. Your course is 164 degrees. [HW2] Your heading is 169. [HW1 and HW3] Your heading is 158. Your airspeed is 138 kts with landing gear and flaps extended to 30. Speed brake is armed.
[Second experimenter to inform pilot of display configuration.]
Your HUD configurations includes...[SVS / EVS / PRIM / IMC / TUNNEL].
[Experimenter reads to pilot.]
Would you please confirm “operate”.
4.2.Clearance:
No new clearance on this segment.
4.3.Actions
Pilot is expected to maintain localizer course and glideslope at approach speed. Aircraft must be in final landing configuration and before landing checklist must be complete prior to decision height.
[FO should use tool to index video when these actions occur.]
[FO is expected to provide callouts to pilot as requested, per initial briefing.]
[Experimenters to track pilot decisions for errors.]
At published decision height, if runway is not in sight with naked eye and/or with EVS, pilot is expected to initiate go-around and missed approach.
[Trial LW3 - Present weather down to field level.]
Pilot is expected to initiate go-around at minimum (5515 ft.) in non-EVS condition.
[FO should use tool to index video when these actions occur.]
[Continue trial until throttle-up and then terminate immediately.]
At published decision height, if runway is in sight, pilot is expected to continue to landing.
[Trials HW1 and HW2 – Breakout should occur at minimums.]
Pilot is expected to callout runway in sight and decision to land.
[FO should use tool to index video when these actions occur.]
At EVS decision height, if runway is not visible with naked eye, a go-around is expected.
[Trial HW3 - Present weather down to field level.]
Pilot is expected to initiate go-around at EVS minimum (100 ft.) in an EVS condition.
[Second experimenter should use tool to index video when these actions occur.]
[Continue trial until throttle-up and then terminate immediately.]
[Experimenter announces “halt” and “reset”.]
This is end of final segment.
[Experimenter administers questionnaires, including subjective rating of perceived display clutter and NASA-TLX.]
Please turn on your map light using the control on the panel to your left.
We now ask that you complete the cognitive workload rating form. Please review the workload demand component definitions and make your ratings based on the last leg of the flight.
We now ask that you complete the display clutter rating form. Please review the definitions of the underlying properties of clutter and make your ratings based on the last leg of the flight.
[Allow subject to take 5 min. break before next trial.]