The APISS Questionnaire: A New Tool to Assess the Epidemiology of Systemic Allergic Reactions to Bee Venom in Beekeepers

Carli, Tanja; Košnik, Mitja; Zaletel Kragelj, Lijana; Burazeri, Genc; Kukec, Andreja

doi:10.2478/sjph-2023-0019

Abstract

Aim

To develop and validate a comprehensive questionnaire to be used as an instrument in cross-sectional studies among beekeepers.

Methods

A comprehensive questionnaire in Slovenian was validated by an expert panel (n=13) for content relevance and a rater panel (n=14) for clarity and comprehensibility. The content validity indices (an item-level content validity index and scale-level content validity index based on the average and universal agreement method) and item-level face validity index were calculated in accordance with the recommended number of both the review panels with their implications on the acceptable cut-off scores. Piloting was performed in a sample (n=50) of the target population (N=1.080) using telephone interviews.

Results

The item-level content validity index and scale-level content validity index based on the average method exhibited excellent content validity (0.97), while the scale-level content validity index based on the universal agreement method reached a value of 0.72. The item-level face validity index of 1.00 indicated that all items were clear and comprehensive.

Conclusions

The new instrument may be considered valid and feasible for use in nationwide population-based studies among Slovenian beekeepers and eventually in other populations.

References

Bilo MB, Pravettoni V, Bignardi D, Bonadonna P, Mauro M, Novembre E, et al. Hymenoptera venom allergy: management of children and adults in clinical practice. J Investig Allergol Clin Immunol. 2019;29(3):180–205. doi: 10.18176/jiaci.0310.
Open DOI Search in Google Scholar Back to article
Casale TB, Burks AW. Clinical practice. Hymenoptera-sting hypersensitivity. N Eng J Med. 2014;10;370(15):1432–1439. doi: 10.1056/NEJMcp1302681.
Open DOI Search in Google Scholar Back to article
Bilo MB, Tontini C, Martini M, Corsi A, Agolini S, Antonicelli L. Clinical aspects of Hymenoptera venom allergy and venom immunotherapy. Eur Ann Allergy Clin Immunol. 2019;51(6):244–258. doi: 10.23822/EurAnnACI.1764-1489.113.
Open DOI Search in Google Scholar Back to article
Blank S, Haemmerle S, Jaeger T, Russkamp D, Ring J, Schmidt-Weber CB, et al. Prevalence of Hymenoptera venom allergy and sensitization in the population-representative German KORA cohort. Allergo J Int. 2019;28(6):183–191. doi: 10.1007/s40629-018-0089-4.
Open DOI Search in Google Scholar Back to article
Becerril-Angeles M, Nuñez-Velázquez M, Grupo del Programa de Control de la Abeja Africanizada, SAGARPA. [Risk factors for allergy to honey-bee venom in Mexican beekeepers]. Rev Alerg Mex. 2013;60(3):100–104.
Search in Google Scholar Back to article
Ediger D, Terzioglu K, Ozturk RT. Venom allergy, risk factors for systemic reactions and the knowledge levels among Turkish beekeepers. Asia Pac Allergy. 2018;8(2):e15. doi: 10.5415/apallergy.2018.8.e15.
Open DOI Search in Google Scholar Back to article
Richter AG, Nightingale P, Huissoon AP, Krishna MT. Risk factors for systemic reactions to a bee venom in British beekeepers. Ann Allergy Asthma Immunol. 2011;106(2):159–163. doi: 10.1016/j.anai.2010.11.005.
Open DOI Search in Google Scholar Back to article
Carli T, Locatelli I, Košnik M, Kukec A. Epidemiology and risk factors of self-reported systemic allergic reactions to a Hymenoptera venom in beekeepers: A protocol for a systematic literature review of epidemiological observational studies in beekeepers worldwide. BMJ Open. 2022;12(7):1–5. doi: 10.1136/bmjopen-2021-058130.
Open DOI Search in Google Scholar Back to article
Münstedt K, Hellner M, Winter D, von Georgi R. Allergy to bee venom in beekeepers in Germany. J Investig Allergol Clin Immunol. 2008;18(2):100–105.
Search in Google Scholar Back to article
Prattala R, Helasoja V, Laaksonen M, Laatikainen T, Nikander P, Puska P. CINDI health monitor. Proposal for practical guidelines. Helsinki: Publications of the National Public Health Institute [Internet]. 2019 [cited 2023 Apr 27]. Available from: https://www.julkari.fi/bitstream/handle/10024/78046/2001b14.pdf;sequence=1
Search in Google Scholar Back to article
Fernandez-Gomez E, Martin-Salvador A, Luque-Vara T, Sanchez-Ojeda MA, Navarro-Prado S, Enrique-Miron C. Content validation through expert judgement of an instrument on the nutritional knowledge, beliefs, and habits of pregnant women. Nutrients. 2020;12(4):1136. doi: 10.3390/nu12041136.
Open DOI Search in Google Scholar Back to article
McGartland Rubio D, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Soc Work Res. 2003;27(2):94–104. doi: 10.1093/swr/27.2.94.
Open DOI Search in Google Scholar Back to article
Davis KA. Validity and reliability in qualitative research on second language: Acquisition and teaching. Another Researcher Comments. TESOL Q. 1992;26(3):605–608. doi: 10.2307/3587190.
Open DOI Search in Google Scholar Back to article
Yusoff MSB. ABC of content validation and content validity index calculation. Med Educ. 2019;11(2):49–54. doi: 10.21315/eimj2019.11.2.6.
Open DOI Search in Google Scholar Back to article
Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, Nikanfar A-R. Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. J Caring Sci. 2015;4(2):165–178. doi: 10.15171/jcs.2015.017.
Open DOI Search in Google Scholar Back to article
Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489–497. doi: 10.1002/nur.20147.
Open DOI Search in Google Scholar Back to article
Grant JS, Davis LL. Selection and use of content experts for instrument development. Res Nurs Health. 1997;20(3):269–274. doi: 10.1002/(sici)1098-240x(199706)20:3<;269:aid-nur9>3.0.co;2-g.
Open DOI Search in Google Scholar Back to article
Hambleton RK, Swaminathan H, Algina J, Coulson D. Criterion-referenced testing and measurement: A review of technical issues and developments. Rev Educ Res. 1978;48:1–47. doi: 10.3102/00346543048001001.
Open DOI Search in Google Scholar Back to article
Slovenian Beekeepers Association. General information [Internet]. [cited 2023 Mar 13]. Available from: https://en.czs.si/about/general-information/
Search in Google Scholar Back to article
Yusoff MSB. ABC of response process validation and face validity index calculation. Med Educ. 2019;11(3):55–61. doi: 10.21315/eimj2019.11.3.6.
Open DOI Search in Google Scholar Back to article
Sin BE, Öztuna D, Gelincik A, Gürlek F, Baysan A, Sin AZ, et al. Quality-of-life in insect venom allergy: Validation of the Turkish version of the “Vespid Allergy Quality of Life Questionnaire” (VQLQ-T). Springerplus. 2016;5:583. doi: 10.1186/s40064-016-2246-x.
Open DOI Search in Google Scholar Back to article
Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by expertes. MethodsX. 2021;8:101326. doi: 10.1016/j.mex.2021.101326.
Open DOI Search in Google Scholar Back to article
Rolstad S, Adler J, Rydén A. Respone burden and questionnaire length: Is shorter better? A review and meta-analysis. Value Health. 2011;14(8):1101–1108. doi: 10.1016/j.jval.2011.06.003.
Open DOI Search in Google Scholar Back to article
Annila IT, Karjalainen ES, Annila PA, Kuusisto PA. Bee and wasp sting reactions in current beekeepers. Ann Alergy Asthma Immunol. 1996;77(5):423–427. doi: 10.1016/S1081-1206(10)63342-X.
Open DOI Search in Google Scholar Back to article
Celikel S, Karakaya G, Yurtsever N, Sorkun K, Falyoncu AF. Bee and bee products allergy in Turkish beekeepers: determination of risk factors for systemic reactions. Allergol Immunopathol (Madr.). 2006;34(5):180–184. doi: 10.1157/13094024.
Open DOI Search in Google Scholar Back to article
Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: A survey of practice. Am J Epidemiol. 2005;163(3):197–203. doi: 10.1093/aje/kwj036.
Open DOI Search in Google Scholar Back to article
Blumenberg C, Menezes AMB, Gonçalves H, Formoso Assunçao MC, Wehrmeister FC, Barros FC, et al. The role of questionnaire length and reminders frequency on response rates to a web-based epidemiologic study: A randomised trial. Int J Soc Res Methodol. 2019;22(6):626–635. doi: 10.1080/13645579.2019.1629755.
Open DOI Search in Google Scholar Back to article
Beekeeping Academy of Slovenia. Beekeeping in Slovenia [Internet]. 2012 [Cited 2023 Mar 17]. Available from: https://sca.kis.si/en/slovenian-beekeeping/
Search in Google Scholar Back to article
Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–385.
Search in Google Scholar Back to article
Jokiniemi K, Meretoja R, Pietilä AM. Constructing content validity of clinical nurse specialist core competencies: Exploratory sequential mixed-method study. Scand J Caring Sci. 2018;32(4):1428–1436. doi: 10.1111/scs.12588.
Open DOI Search in Google Scholar Back to article
Chang L. A psychometric evaluation of 4-point and 6-point Likert-type scales in relation to reliability and validity. Appl Psychol Meas; 1994:18(3):205–215. doi: 10.1177/01466216940180030.
Open DOI Search in Google Scholar Back to article
Polit DF, Tatano Beck C, Owen SVV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–467. doi: 10.1002/nur.20199.
Open DOI Search in Google Scholar Back to article
Rodrigues IB, Adachi JD, Beattle KA, MacDermid JC. Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord. 2017;18(1):540. doi: 10.1186/s12891-017-1914-5.
Open DOI Search in Google Scholar Back to article
Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Resocial Adm Phar. 2019;15(2):214–221. doi: 10.1016/j.sapharm.2018.03.066.
Open DOI Search in Google Scholar Back to article

The APISS Questionnaire: A New Tool to Assess the Epidemiology of Systemic Allergic Reactions to Bee Venom in Beekeepers

Abstract

Aim

Methods

Results

Conclusions

Paradigm

My account