Validation of the Portuguese version of Amsterdam Preoperative Anxiety and Information Scale (APAIS)
Health and Quality of Life Outcomes volume 19, Article number: 95 (2021)
Preoperative anxiety is common among the oncological surgical population. Due to its psychological and physiological detrimental effects, identifying and addressing it is of uttermost importance to improve anesthetic management and patient’s outcomes. The aim of this study is to validate the Portuguese version of Amsterdam Preoperative Anxiety and Information Scale (APAIS) in the oncological population.
Following forward and backward translation of the original APAIS scale, further adaptation was obtained through cognitive interviewing. The resulting instrument was tested on the day before surgery on a sample of adult cancer surgical patients from a Portuguese oncology centre. Psychometric evaluation was derived from inter-item correlation, confirmatory factor analysis, Cronbach’s alpha, correlation with comparative scales, receiver operating characteristic curve and Youden index.
109 patients (58 males, 51 females) were included. A three-dimensional model—anxiety about anesthesia, anxiety about surgery and desire for information, showed the best fit to the data. The questionnaire revealed high internal consistency (Cronbach alpha 0.81) and good inter-item correlation. Also, Portuguese APAIS correlated well with the gold standard anxiety scale. Therefore, the psychometric properties of this scale version make it a valid and reliable instrument. The optimal cutoff to maximize both sensitivity and specificity was 12 for the APAIS global anxiety score.
Portuguese APAIS version is an accurate tool to identify preoperative anxiety among cancer patients and might impact its management, from premedication choice to provision of information and reassurance about either anesthesia or surgery.
Preoperative anxiety has been recognized as a significant issue among surgical patients [1, 2]. Excessive anxiety leads to psychological and physical adverse stress reactions. It causes a greater consumption of anesthetic [3, 4] and analgesic drugs , intra- and post-operatively. Moreover, it is a negative predictor of surgical outcomes  and has a deleterious impact on the patient’s health care experience .
Preoperative anxiety is a multifactorial disorder. Causes may include fear of anesthesia, concern about surgical outcomes, anticipation of post-operative pain and hospital environment hostility . It is also influenced by socio-demographic and psychosocial factors, which may be of great significance and challenging to evaluate [9, 10].
Regarding the oncological population, 18% of the patients report depression symptoms and 24% anxiety symptoms . In the preoperative setting, these patients have additional anxiety causes, including the life-threatening nature of their disease, the surgical impact on their body image and the effects of other non-surgical treatments . Psychological pre-rehabilitation has been suggested to have a favorable outcome in improving postoperative functional capacity and resuming normal daily activities . However, albeit the relevance of psychological factors in postsurgical outcomes, these variables are not systematically evaluated. As a result, despite being well known among clinicians, anxiety is not being sufficiently treated.
Several instruments can be used to evaluate patients’ anxiety. The State-Trait Anxiety Inventory (STAI) and the Hospital Anxiety and Depression Scale (HADS)  have been widely used in the hospital setting. They both have already been translated and validated to the Portuguese language. However, they are long and time-consuming, have not been designed for the pre-operative setting and do not assess the need for information.
The Amsterdam Preoperative Anxiety and Information Scale (APAIS) was created in order to obtain a rapid and easy evaluation of the patient’s anxiety and need for information about the surgery and anesthesia . The APAIS questionnaire has been showing remarkable results in the preoperative evaluation of subjects undergoing a variety of procedures, from minor to major surgery, as it allows the identification of patients who would benefit from therapeutic intervention and/or further information . The APAIS has been translated into several languages [17,18,19,20,21,22], but it has not been validated for the Portuguese population neither specifically for cancer patients.
The aim of this study is to translate the APAIS into Portuguese and validate this version for the oncologic population.
Design, setting and ethics
Following the institution’s Ethics Committee approval, this cross-sectional psychometric study was carried out at Instituto Português de Oncologia de Lisboa Francisco Gentil, one of the main oncology centers in Portugal. Participant selection was done using a quota sampling procedure to obtain equal proportion of males and females. Patients were recruited between July and December 2018, and written consent was obtained from all of them.
The APAIS is a simple questionnaire consisting of six items, four regarding the anxiety about the surgical procedure and the fear of anesthesia, and two regarding the need for information (Table 1). The answers are recorded in a 5-point Likert scale, thus the anxiety scale ranges from 4 to 20 points and the need for information scale ranges from 2 to 10 points. The original cutoffs from the Dutch version and its English translation are 11 for the clinical context, and 13 for investigation purposes due to its higher specificity .
Translation and adaptation
First, authorization to translate the APAIS was required from the authors of the original scale. According to the WHO guidelines for translation and adaptation of instruments , the process included a forward translation by two anesthesia trainees, an expert review by two bilingual senior anesthetists, a backward translation by an independent translator and cognitive interviewing with ten surgical adult inpatients by a senior clinical psychologist, in order to obtain an equivalent scale in Portuguese.
Sampling process, study subjects and data collection
The size of the validation sample was based on a ratio of 20 cases per item, which holds a number that is similar to those seen in other APAIS validation studies [17,18,19,20,21,22]. The sample included patients aged above 18 years old, able to read and understand the Portuguese language, undergoing elective cancer surgery, either general, gynaecological or urological procedures. Exclusion criteria were: psychiatric disorder requiring antipsychotic drugs, cognitive impairment, difficulty understanding the study, non-cancer or emergent surgery. The day before surgery, and after the pre-anesthetic visit, patients filled in the questionnaires.
Patients’ characteristics and comparative scales
Patients’ sociodemographic and clinical variables potentially associated with anxiety and desire for information were collected. These included age, gender, ASA physical status, education, work situation and marital status, previous anesthesia and/or surgery, regular use of anxiolytics, type of surgery and waiting time. The instruments used were the APAIS (anxiety scale—4 items, score 4–20; need for information scale—2 items, score 2–10), STAI-Y1 (subscale for anxiety-state—20 items, score 20–80, ) and HADS (subscale A for anxiety and subscale D for depression—7 items each, score 0–21, ) for post hoc comparisons.
Statistical analysis and psychometric evaluation
We performed a descriptive analysis of the sociodemographic and clinical variables and of the APAIS, STAI-Y1, HADS-A and HADS-D scores using mean, standard deviation (SD), and absolute and relative frequencies.
Evaluation of APAIS validity was conducted as follows. A confirmatory factor analysis (CFA) has been performed to evaluate whether the APAIS Portuguese version, once applied to oncology patients, would maintain the same factor structure reported in previous validation studies. We evaluated the one-factor model as described in the Spanish APAIS validation , the two-factor model as in the original APAIS  and the three-factor model as in the French APAIS validation . Kaiser–Meyer–Olkin measure of sampling adequacy (0.77) and Bartlett's test of sphericity (p < 0.001) confirmed data suitability for factor analysis but Mardia’s test rejected multivariate normality. Therefore, we used a maximum likelihood estimation with robust standard errors and a Satorra–Bentler scaled test statistic suitable for non-normal data. We report the fit indices derived from this robust approach chi-square test of exact fit (p > 0.05 indicates good fit), Tucker Lewis Index (good fit if TLI ≥ 0.95), comparative fit index (good fit if CFI ≥ 0.95) and the root mean square error of approximation (good fit if RMSEA < 0.08) and its 90% confidence interval (90% CI). The Scaled Chi Square Difference Test was used for model comparison (likelihood ratio test with robust estimation).
Internal consistency of the APAIS scale was assessed by Cronbach's alpha coefficient (reliability acceptable if ≥ 0.70). Nonparametric Spearman correlations were used for determining the associations and correlations between the scales, with the correlation between STAI-Y1 and APAIS global anxiety score (resulting from the sum of scores from items 1, 2, 4 and 5) being used to evaluate concurrent validity. Finally, we attempted to identify the utility of the APAIS in Portuguese cancer patients. The sensitivity, specificity, and positive and negative predictive values of the APAIS global anxiety score were assessed for different cutoff points by using a STAI-Y1 score ≥ 40 as the reference point to detect clinically significant anxiety . Accuracy was estimated by receiver operating characteristic (ROC) curve and the corresponding area under the curve (AUC). The best cutoff of APAIS was determined by analysis of accuracy at every APAIS score and by Youden index.
Process of translation and adaptation
Following translation into Portuguese by a Portuguese anesthesiologist knowledgeable of the English language, the scale was reviewed by a different bilingual health professional. Then, it was independently translated back into English with no mismatches. Further feedback was obtained from pretesting using cognitive assessment. Ten surgical patients were interviewed by a clinical psychologist with experience in psycho-oncology and instrument development. Cognitive interviewing included participant rephrasing of the original sentences, inquiries about words and expressions that might sound confusing, offensive or upsetting. According to the participants, direct translation on items 2, 3, 5 and 6 did not describe their experience and context properly. Participant suggestions were then considered: “continuamente” (continuously) was replaced by “permanentemente” (permanently) in items 2 and 5, “o mais possível” (as much as possible) was replaced by “mais” (more) in items 3 and 6. The six items of the original English version and their Portuguese equivalents are shown in Table 1.
Characteristics of study subjects
123 subjects were recruited, although fourteen of them have withdrawn from the study due to difficulties in interpretation and filling the three distinctive written questionnaires. Low literacy levels, as explained below, might have discouraged these patients from participating. Hence the response rate among the included subjects was 100% and there was no missing data, which indicates good acceptability of all questions. Characterisation of the respondent group is presented in Table 2. Men represented 53% of the sample, median age was 62 years and 95% had an ASA status score of II or higher. 43% of the patients had only attained primary school education, less than half were currently employed and the majority were married. Additionally, 83% of the study participants had been anesthetized before and 71% had undergone surgery before. Regarding waiting times, 74% of the patients had waited over a month for cancer surgery. Anxiolytics were used regularly by 11% of respondents, roughly in accordance with general population data .
Scales scoring and internal consistency of the APAIS
As shown in Table 3, the mean scores were as follows: APAIS anxiety 12.82 ± 4.68, APAIS desire for information 7.33 ± 2.29, STAI-Y1 42.10 ± 10.59. Of the 109 patients, 61% would be classified as anxious using STAI-Y1 (score ≥ 40), and 34% using HADS-A. 18% were found to be at least mildly depressed using HADS-D . Overall APAIS items showed good inter-item correlations, the weakest correlation was between item 6 and items 1 and 2 (Table 4).
Tests of dimensionality
Confirmatory factor analysis was run, evaluating three a priori hypotheses: one-factor model (as in the Spanish APAIS validation), two-factor model (as in the original APAIS) and three-factor model (as is the French APAIS validation). Overall, the model with the best fit to the data was a three-dimensional model: anxiety about anesthesia, anxiety about surgery, desire for information. Table 5 reports fit statistics for each model.
Tests of reliability
Regarding the internal consistency of scale items, all items showed item-to-total correlations > 0.5, and Cronbach’s alpha was 0.81, 95% CI 0.71–0.91 (Table 6).
Tests of convergent validity
In order to assess the extent to which the Portuguese APAIS version measures anxiety, the APAIS global anxiety score resulting from the sum of scores from items 1, 2, 4 and 5 was compared with STAI-Y1, HADS-A and HADS-D scores (Fig. 1). APAIS score correlates slightly better with the gold standard STAI-Y1 (Spearman’s rho 0.580, p < 0.001) and HADS-A as well (Spearman rho 0.539, p < 0.001), than with HADS-D results (Spearman’s rho 0.455, p < 0.001), which screens for probable depression in the hospital setting.
Tests of criterion validity
Criteria validity was tested by means of a ROC curve from APAIS global anxiety score and STAI-Y1 scores, yielding an area under the curve for anxiety as assessed by APAIS of 79.7% (95% CI 70.5–88.9%, Fig. 2). The optimal cutoff to maximize sensitivity and specificity was 11.5 (Fig. 2) and several integer cutoff points were tested (Table 7). Overall, a value of 12 is the best cutoff value for the Portuguese version of APAIS until new representative data are available.
The aim of this study is to translate and validate the APAIS for the Portuguese oncologic population. The use of a quick and easy-to-administer instrument to evaluate anxiety is of foremost importance in the perioperative setting as anxiety leads to a more challenging anesthetic management and a worse patient experience. Our study revealed an anxiety prevalence of 61%, higher than other published oncological reports.
The education level of our sample was in line with the average elder Portuguese population (52% of the people aged 65 and over only attained primary school education, PORDATA 2018). Thus, in order to obtain a better comprehension, warranting an appropriate phrasing was crucial. Following WHO guidelines, after cross-validation of the direct translation, the final questionnaire resulted from additional cognitive interviewing. Nevertheless, due to the very low literacy among the elderly, 11% of the participants withdrew from the study.
Contrary to previous validations, all questionnaires were applied after the patient’s admission on the day before surgery, instead of immediately before the surgery. We believe this provided a less stressful environment for the patients.
Results showed high-quality psychometric properties. Scale reliability revealed a Cronbach’s alpha of 0.81, consistent with the one obtained on the original scale and further validations. In contrast, confirmatory factor analysis suggested a three-dimensional model (anxiety about anesthesia, anxiety about surgery, desire for information) as the best fit, differently from the original scale. This model has already been described for the French scale validation . Differences might be explained by cultural and educational reasons, as well as the life-changing nature of the oncological disease and its surgical treatment. Thus inter-item correlation was moderate to high on both anxiety dimensions. A weaker correlation, however, was observed in the desire for information dimension. A paternalistic doctor-patient relationship, based on trustworthiness, may be a reason for the mismatch between reported anxiety and need for information.
Spearman’s correlation confirmed the capacity for the Portuguese version of the APAIS to explore anxiety states. APAIS correlated slightly better with the STAI-Y1 and HADS-A scores (Spearman’s rho 0.580 and 0.539) than with HADS-D (Spearman’s rho 0.455). Albeit the presence of weak correlations among anxiety scales, HADS-D scores were not as disparate as anticipated. As shown in the HADS-D final scores, 18% of the studied population also suffered from depression. Although clinically different, anxiety and depression are both frequent comorbidities in oncological patients, and sometimes coexist, which may justify our observations. Indeed, results from correlation testing between APAIS and HADS-D suggested that preoperative anxiety is usually present in cancer patients suffering from depression (Fig.1b), an association that should be tested in future works.
For this specific population, two cutoffs determined by the ROC curves could be used. For a higher sensitivity (0.86) a cutoff of 11 would be recommended, similar to the original version. However, taking all the results into account, a cutoff of 12 is suggested in order to gain specificity (specificity 0.79).
That said, this study presents some limitations. First, the studied population is restricted to a single hospital and it only includes cancer surgery patients. As previously mentioned, cancer patients are known to have higher baseline anxiety and depression. Furthermore, many of these patients undergo multiple diagnostic and therapeutic procedures during the course of the disease, somehow modulating their perioperative-related anxiety. Secondly, several patients were not included due to low literacy, meaning that further works should be developed in order to evaluate the applicability of a verbal assessment in this group. One factor contributing to the difficulty of answering the questionnaires was their length, particularly the ones used for comparative measures, not APAIS itself. Also, convenience sampling was applied in this study. Last, and unintentionally, no ASA IV or V patients were sampled from the population.
This study established the Portuguese version of the APAIS as a valid and reliable instrument for the evaluation of preoperative anxiety in cancer patients.
Routine preoperative anesthetic evaluation should encompass identification of not only anxious patients but also those that need further information. In this setting, and with increasing awareness of the impact of different perioperative factors—as anxiety—on overall patient’s experience, a prompt and easy evaluation tool has become of pivotal importance. Recognizing anxiety and need for information is the first step toward clinical intervention, either prescription of anxiolytic premedication or further information and reassurance.
Additionally, as data on interventions to decrease preoperative anxiety are scarce and benzodiazepines continue to be widely used despite its side effects, the application of the APAIS might also be appropriate for evaluating the role of current pharmacological and psychological interventions. Its ability to objectively identify states of anxiety makes it suitable not only for the clinical setting, but also as a tool for further works in this field.
Finally, if meant to be used more widely, the Portuguese version of the APAIS will need further validation in a broader surgical population.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Amsterdam Preoperative Anxiety and Information Scale
Hospital Anxiety and Depression Scale
State-trait anxiety inventory
Norris W, Baird WL. Pre-operative anxiety: a study of the incidence and aetiology. Br J Anaesth. 1967;39(6):503–9.
Laufenberg-Feldmann R, Kappis B. Assessing preoperative anxiety using a questionnaire and clinical rating: a prospective observational study. Eur J Anaesthesiol. 2013;30(12):758–63.
Maranets I, Kain ZN. Preoperative anxiety and intraoperative anesthetic requirements. Anesth Analg. 1999;89(6):1346–51.
Gras S, Servin F, Bedairia E, Montravers P, Desmonts JM, Longrois D, Guglielminotti J. The effect of preoperative heart rate and anxiety on the propofol dose required for loss of consciousness. Anesth Analg. 2010;110(1):89–93.
Ip HY, Abrishami A, Peng PW, Wong J, Chung F. Predictors of postoperative pain and analgesic consumption: a qualitative systematic review. Anesthesiology. 2009;111(3):657–77.
Rosenberger PH, Jokl P, Ickovics J. Psychosocial factors and surgical outcomes: an evidence-based literature review. J Am Acad Orthop Surg. 2006;14(7):397–405.
Theunissen M, Peters ML, Bruce J, Gramke HF, Marcus MA. Preoperative anxiety and catastrophizing: a systematic review and meta-analysis of the association with chronic postsurgical pain. Clin J Pain. 2012;28(9):819–41.
Wilson WE. Preoperative anxiety and anesthesia: their relation. Anesth Analg. 1969;48(4):605–11.
Yilmaz M, Sezer H, Gürler H, Bekar M. Predictors of preoperative anxiety in surgical inpatients. J Clin Nurs. 2012;21(7–8):956–64.
Caumo W, Schmidt AP, Schneider CN, Bergmann J, Iwamoto CW, Bandeira D, Ferreira MB. Risk factors for preoperative anxiety in adults. Acta Anaesthesiol Scand. 2001;45(3):298–307.
Brintzenhofe-Szoc KM, Levin TT, Li Y, Kissane DW, Zabora JR. Mixed anxiety/depression symptoms in a large cancer cohort: prevalence by cancer type. Psychosomatics. 2009;50(4):383–91.
Traeger L, Greer JA, Fernandez-Robles C, Temel JS, Pirl WF. Evidence-based treatment of anxiety in patients with cancer. J Clin Oncol. 2012;30(11):1197–205.
Carli F, Gillis C, Scheede-Bergdahl C. Promoting a culture of prehabilitation for the surgical cancer patient. Acta Oncol. 2017;56(2):128–33.
Telles-Correia D, Barbosa A. Anxiety and depression in medicine: models and measurement. Acta Med Port. 2009;22(1):89–98.
Moerman N, van Dam FS, Muller MJ, Oosting H. The Amsterdam Preoperative Anxiety and Information Scale (APAIS). Anesth Analg. 1996;82(3):445–51.
Boker A, Brownell L, Donen N. The Amsterdam preoperative anxiety and information scale provides a simple and reliable measure of preoperative anxiety. Can J Anaesth. 2002;49(8):792–8.
Nishimori M, Moerman N, Fukuhara S, van Dam FS, Muller MJ, Hanaoka K, Yamada Y. Translation and validation of the Amsterdam preoperative anxiety and information scale (APAIS) for use in Japan. Qual Life Res. 2002;11(4):361–4.
Berth H, Petrowski K, Balck F. The Amsterdam Preoperative Anxiety and Information Scale (APAIS)—the first trial of a German version. Psychosoc Med. 2007;4:Doc01.
Maurice-Szamburski A, Loundou A, Capdevila X, Bruder N, Auquier P. Validation of the French version of the Amsterdam preoperative anxiety and information scale (APAIS). Health Qual Life Outcomes. 2013;11:166.
Buonanno P, Laiola A, Palumbo C, Spinelli G, Terminiello V, Servillo G. Italian validation of the Amsterdam Preoperative Anxiety and Information Scale (APAIS). Minerva Anestesiol. 2017;83:705–11.
Mohd Fahmi Z, Lai LL, Loh PS. Validation of the Malay version of the Amsterdam Preoperative Anxiety and Information Scale (APAIS). Med J Malaysia. 2015;70(4):243–8.
Vergara-Romero M, Morales-Asencio JM, Morales-Fernández A, Canca-Sanchez JC, Rivas-Ruiz F, Reinaldo-Lapuerta JA. Validation of the Spanish version of the Amsterdam Preoperative Anxiety and Information Scale (APAIS). Health Qual Life Outcomes. 2017;15(1):120.
WHO Process of translation and adaptation of instruments. http://www.who.int/substance_abuse/research_tools/translation/en/.
Silva D. O inventário de Estado-Traço de Ansiedade (STAI). Avaliação psicológica: Instrumentos validados para a população portuguesa. 2003; Coimbra: Quarteto Editora.
Pais-Ribeiro J, Silva I, Ferreira T, Martins A, Meneses R, Baltar M. Validation study of a Portuguese version of the Hospital Anxiety and Depression Scale. Psychol Health Med. 2007;12(2):225–35.
Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA. Manual for the state-trait anxiety inventory. Palo Alto: Consulting Psychologists Press; 1983.
R Core Team. R: A language and environment for statistical computing. 2018; R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/.
Rosseel Y. lavaan: an R package for structural equation modeling. J Stat Softw. 2012;48(2):1–36.
Revelle W. psych: Procedures for Psychological, psychometric, and Personality Research. 2019; Northwestern University, Evanston, Illinois, USA; version 1.9.12. https://CRAN.R-project.org/package=psych.
Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Müller M. pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinform. 2011;12:77.
Stevenson M with contributions from Nunes T, Heuer C, Marshall J, Sanchez J, Thornton R, Reiczigel J, Robison-Cox J, Sebastiani P, Solymos P, Yoshida K, Jones G, Pirikahu S, Firestone S, Kyle R, Popp J, Jay M. epiR: Tools for the analysis of epidemiological data. 2018; version 0.9.99. https://CRAN.R-project.org/package=epiR.
OECD Health Statistics: Pharmaceutical Market. https://stats.oecd.org/Index.aspx?DataSetCode=HEALTH_PHMC.
We thank the psychologist Maria de Jesus Moura (Unidade de Psicologia, Instituto Português de Oncologia de Lisboa), who has guided the cognitive interviewing process. Also, we are grateful to Lucia Mascarenhas (teacher and translator), who has performed the backward translation of the scale.
This study was supported by Instituto Português de Oncologia de Lisboa, which provided funds for the publication of results.
Ethics approval and consent to participate
This study (protocol reference number UIC/1125) was approved by the Ethics Committee (chaired by Filomena Pereira, MD) and Research Committee (chaired by Paula Chaves, MD Ph.D.) of Instituto Português de Oncologia de Lisboa on the 26th September 2017.
Consent for publication
Written informed consent for publication of their clinical details was obtained from all the participants in this study. A copy of the consent form is available for review by the Editor of this journal.
The authors declare that they have neither financial nor nonfinancial competing interests to disclose.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Maurício, S., Rebêlo, I., Madeira, C. et al. Validation of the Portuguese version of Amsterdam Preoperative Anxiety and Information Scale (APAIS). Health Qual Life Outcomes 19, 95 (2021). https://doi.org/10.1186/s12955-021-01736-6
- Validation study
- Perioperative care