Table 3 Arguments for perceived difficulty in NTS observation

1. Not everything can be observed

The availability of NTS to be observed is influenced by the -scripted- training scenario and the degree of (non)verbal expression by the participants. E.g. certain NTS cannot be observed directly as they are mental processes of the participants.

Translated: “Observation is what you see, without knowing what the intentions and thoughts of the observed [participants] are” [R6]

“Some people are more introvert … and do not think/talk out [loud] in the room. Also some have vague mimics and gestures.” [R126]

Translated: “Depending on the scenario (complexity, length, roles), some NTS are not addressed.” [R24]

Translated: “Duration of the scenarios is sometimes too short.” [R70]

2. Not everything is observed

Even when NTS are expressed, not everything is actually seen or heard by the facilitator. Many variables influence facilitators’ opportunity and capability of NTS observation, hence NTS aspects can be missed easily.

Translated: “Especially in larger teams (over 3 persons) it is difficult to capture all NTS. Most of the (non-verbal) communication happens simultaneously between team members. I therefore focus especially on the team leader.” [R4]

“Simulation situations are many times very loud and it is difficult to hear all the communication which occurs.” [R124]

Translated: “More subtle variants [of NTS] that do influence the interaction between people, can be missed.” [R40]

Translated: “It [observation of NTS] is very strenuous, at the end of a training day you sometimes miss things.” [R16]

3. Interpretation of the observed NTS is difficult

Whenever NTS are actually expressed and observed by the facilitator, interpretation and analysis is difficult and subjective to personal influences

Translated: “Observations are often subjective and influenced by your own frame of reference and experience.” [R9]

“They [certain NTS] are more difficult to observe because you cannot have a list of unique behavioural markers. There may be more ways to achieve a good goal.” [R123]

Translated: “Many NTS items are interlinked and influence each other, which makes them hard to unravel.” [R43]

Translated: “Because [the training] takes place in a simulation center, people may (re)act different compared to the authentic work-place setting.” [R23]