|
Selecting a methodology to study process: lessons from a systematic review
of the effectiveness, role and value of written medicines information
for patients
Grime, J.; Blenkinsopp, A.
Background
A recent systematic review carried out by researchers at Leeds and
Keele Universities was concerned not only with evaluating outcome - the
effectiveness of written medicines information for patients - but also
with process - the role and value of such information to patients and
health professionals. Process evaluation can help to explain outcome findings1.
Methodologies of the studies reviewed for role and
value.
It was anticipated that relevant studies for the role and value strand
of the systematic review would be predominantly qualitative1. The difficulty
of searching for qualitative studies has been highlighted by other systematic
reviewers2. The literature search covered both strands of the review and
was designed to be sensitive rather than specific, in order to find qualitative
studies. This strategy produced over 50,000 references. Twenty eight papers
(27 studies) were found to meet the inclusion criteria for the role and
value strand of the review. Nine of the studies were qualitative, using
mainly semi-structured interviews or focus groups. Seventeen were quantitative.
Mostly these were surveys (12), but four were laboratory based studies
which involved members of the public reviewing information about medicines.
One was a mixed methods study. In eight of the quantitative studies and
four of the qualitative some or all of the lay participants were not taking
the medicine of the written information being evaluated nor had a related
illness. These have been referred to by us as hypothetical studies.
Evaluation of the methodologies
Three different rationales for carrying out the research were identified.
Twelve studies were carried out in relation to medicine information policy
initiatives. Eight studies were set within a context of aiming to increase
patient compliance and seven within a context of patients as active participants
in their care. Questionnaires used in the surveys mostly had closed questions
in which participants selected a response category predetermined by the
researcher. Thus participants' responses were constrained to fit the a
priori ideas of the researcher. In contrast semi-structured interviews
and focus groups encourage respondent to dwell on what is important to
them. In the quantitative studies the findings were more likely to reflect
the starting position of the researcher. For example written information
being secondary to spoken information from the doctor emerged in the qualitative
studies but not in the quantitative. In hypothetical studies the context
of illness and medicine taking was absent and respondents speculated on
how they might use written information should they actually be prescribed
a medicine. There was evidence to show that what patients anticipate doing
and what they actually do are not the same.
Conclusion
Selecting an appropriate methodology in order to understand the use
and usefulness of patients' written medicines information is crucial.
Researchers' preconceived ideas influenced survey findings, and hypothetical
studies could only answer certain questions.
Acknowledgements
We thank the funders, the NHS R&D Health Technology Assessment Programme
and fellow team members Theo Raynor, Peter Knapp, Donald Nicolson, Kristian
Pollock, Gill Dorer, Simon Gilbody, David Dickinson, John Maule, and Pat
Spoor.
References
1. Calnan M., Ferlie E., Analysing process in health care; the methodological
and theoretical challenges, Policy and Politics, 2003;31:185-93
2. Dixon-Woods M., Fitzpatrick R., Roberts K., Including qualitative research
in systematic reviews: opportunities and problems, Journal of Evaluation
in Clinical Practice, 201;7:125-33
Presented at the HSRPP Conference 2006, Bath
|