Open Access Research

Validation of the M. D. Anderson Symptom Inventory multiple myeloma module

Desiree Jones1*, Elisabeth G Vichaya1, Xin Shelley Wang1, Loretta A Williams1, Nina D Shah2, Sheeba K Thomas3, Valen E Johnson45, Richard E Champlin2, Charles S Cleeland1 and Tito R Mendoza1

Author Affiliations

1 Department of Symptom Research, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Unit 1450, 77030, Houston, TX, USA

2 Department of Stem Cell Transplantation and Cellular Therapy, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Unit 423, 77030, Houston, TX, USA

3 Department of Lymphoma/Myeloma, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Unit 429, 77030, Houston, TX, USA

4 Department of Biostatistics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Unit 1411, 77030, Houston, TX, USA

5 Current address: Department of Statistics, Texas A&M University, 525K Blocker, 3143 TAMU, College Station, 77843-3143, Houston, TX, USA

For all author emails, please log on.

Journal of Hematology & Oncology 2013, 6:13  doi:10.1186/1756-8722-6-13


The electronic version of this article is the complete one and can be found online at: http://www.jhoonline.org/content/6/1/13


Received:27 November 2012
Accepted:31 January 2013
Published:5 February 2013

© 2013 Jones et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The symptom burden associated with multiple myeloma (MM) is often severe. Presently, no instrument comprehensively assesses disease-related and treatment-related symptoms in patients with MM. We sought to validate a module of the M. D. Anderson Symptom Inventory (MDASI) developed specifically for patients with MM (MDASI-MM).

Methods

The MDASI-MM was developed with clinician input, cognitive debriefing, and literature review, and administered to 132 patients undergoing induction chemotherapy or stem cell transplantation. We demonstrated the MDASI-MM’s reliability (Cronbach α values); criterion validity (item and subscale correlations between the MDASI-MM and the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ-C30) and the EORTC MM module (QLQ-MY20)), and construct validity (differences between groups by performance status). Ratings from transplant patients were examined to demonstrate the MDASI-MM’s sensitivity in detecting the acute worsening of symptoms post-transplantation.

Results

The MDASI-MM demonstrated excellent correlations with subscales of the 2 EORTC instruments, strong ability to distinguish clinically different patient groups, high sensitivity in detecting change in patients’ performance status, and high reliability. Cognitive debriefing confirmed that the MDASI-MM encompasses the breadth of symptoms relevant to patients with MM.

Conclusion

The MDASI-MM is a valid, reliable, comprehensive-yet-concise tool that is recommended as a uniform symptom assessment instrument for patients with MM.

Keywords:
Symptoms; Assessment; Validation; Multiple myeloma; MDASI

Background

Notwithstanding the use of novel agents [1] and treatment advances such as autologous hematopoietic stem cell transplantation (HSCT), multiple myeloma (MM) is often associated with significant disease-related and/or treatment-related side-effects [2-5]. Because toxicities from induction therapy and HSCT are common [2-4], the symptom burden associated with MM or its treatment (eg, bone pain, fatigue, muscle weakness, nausea, vomiting, constipation, diarrhea) can be severe. Thus, effective symptom management becomes a critical component of patient care.

Accurate symptom assessment in patients with MM requires psychometrically validated tools that are clinically efficient to administer. Instruments used previously (eg, the European Organization for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire (QLQ-C30) [6] and the EORTC Multiple Myeloma Module (QLQ-MY20)) [7] include some symptom items but primarily assess health-related quality of life (QOL). Further, the QLQ-MY20 is administered in tandem with the QLQ-C30 [7], resulting in a 50-item measure that can create substantial patient burden. Other QOL instruments (eg, the Functional Assessment of Cancer Therapy – Multiple Myeloma) and scales assessing general cancer-related symptoms (eg, the M. D. Anderson Symptom Inventory (MDASI)) [8] have been used in patients with MM [9,10]. However, they do not capture the breadth of symptoms unique to MM or its treatment.

To address this need, we developed a MDASI module specifically for patients with MM. The MDASI is a reliable, valid instrument that was designed for ease of administration and that asks patients to rate 13 symptoms (known as the “core” items) and 6 symptom-related interference items that are common across cancer types and treatments [8]. A recent systematic review of symptom-assessment instruments identified several advantages of the MDASI compared with other measures [11]. The MDASI is comprehensive yet brief, thus minimizing patient burden, and has a readily understood numeric scale that can be adapted for telephone, electronic, or other digital forms of administration. The developers of the original MDASI recognized that particular cancer types or treatments may require the addition of specific symptom items to the MDASI to ensure a comprehensive symptom assessment [12]. These MDASI “modules” include the original MDASI’s 13 core symptom and interference items augmented by additional symptom items specific to certain cancers or treatments. MDASI modules have been developed and validated for patients with a variety of cancers [12-15]. This study describes the psychometric properties and validation of a MDASI module for MM (MDASI-MM).

Methods

Participants

Data were derived from 2 studies in patients with MM treated at The University of Texas MD Anderson Cancer Center in Houston, Texas, between 2008 and 2011. The first study assessed symptoms during induction therapy, and the second, during HSCT. For the induction sample, eligible patients had received ≤2 cycles of chemotherapy and were scheduled for bortezomib or thalidomide. Patients were assessed upon enrollment (baseline) and at the end of induction to capture change in symptom profiles in response to therapy. The transplant sample was derived from patients undergoing autologous HSCT. Patients were assessed before beginning high-dose melphalan treatment (pre-HSCT) and at nadir of treatment (7 days post-HSCT). Patients with relapsed or refractory disease were not excluded from the study.

Additional inpatients [16] with MM were interviewed for cognitive debriefing of the MDASI-MM.

All patients were 18 years of age or older, spoke English, and provided written informed consent. The studies were approved by the MD Anderson Institutional Review Board.

Data collection

Module development and cognitive debriefing

Symptom data was obtained via the MDASI-MM (Additional file 1: Figure S1). The MDASI-MM was developed using methods employed for previous MDASI modules [14,15]. MM-related candidate items were derived through patient report of symptoms to clinicians via informal interviews, through clinician and researcher input, and through an exhaustive literature search that included a review of symptoms associated with both MM and its treatment. The resulting MM-specific symptom items were added to the original MDASI to form a provisional MDASI-MM, which was then used for comprehensive patient interviews (cognitive debriefing) with a sample of 20 inpatients with MM. Cognitive debriefing is a critical component of instrument development during which patients assess the relevance, comprehensibility, and clarity of items. We asked patients whether the MDASI-MM encompassed major symptoms of concern; if the items presented were relevant and if any that seemed important were missing; if the questions were easy to understand; if any items seemed redundant; whether the 0–10 numeric scale was easy to use; whether patients were comfortable answering the questions; and if they had suggestions for making the questions more comfortable to answer. The final MDASI-MM contains the MDASI’s 13 core symptom severity items and 6 interference items [8], plus 7 MM-specific items (bone aches, muscle weakness, sore mouth/throat, rash, difficulty concentrating, constipation, diarrhea). Patients rate symptoms on a 0–10 scale ranging from “not present” to “as bad as you can imagine.” Interference is rated on a 0–10 scale ranging from “did not interfere” to “interfered completely.”

Additional file 1: Figure S1. The MDASI-MM.

Format: PDF Size: 22KB Download file

This file can be viewed with: Adobe Acrobat ReaderOpen Data

Scoring

MDASI-MM ratings can be used to derive 3 subscale scores: mean core (13 MDASI core symptom items), mean severity (13 MDASI core plus 7 MM-specific items), and mean interference (6 interference items). The interference items can be subdivided into mean activity-related (interference with work, general activity, and walking ability (WAW)) and mean mood-related (interference with relations with people, enjoyment of life, and mood (REM)) dimensions [17]. Symptom severity can be classified as 0 (none), 1–4 (mild), 5–6 (moderate), or 7–10 (severe) [17,18].

Criterion measures

EORTC QLQ-C30 and QLQ-MY20

The QLQ-C30 is a reliable, valid 30-item instrument used to measure QOL in cancer patients [19]. The QLQ-MY20 is a reliable, valid 20-item measure used in combination with the QLQ-C30 to assess QOL in MM patients [7]. Both consist of functional and symptom/side-effect subscales and items. Higher functional subscale scores represent higher levels of functioning, whereas higher symptom/side-effect subscale and item scores represent more-severe symptoms/side effects.

Eastern Cooperative Oncology Group performance status

Eastern Cooperative Oncology Group performance status (ECOG PS) is used to estimate patients’ functional status and to determine appropriate treatment and prognosis [20]. ECOG PS is a reliable, valid 5-point measure ranging from fully active (0) to deceased (5) [21,22].

Statistical analyses

Analyses were conducted using Statistical Package for the Social Sciences version 17.0 (SPSS Inc., Chicago, IL). Descriptive statistics were computed for symptoms and subscales. Statistical significance was set at a 2-tailed α level of .05.

Reliability

Internal consistency reliability of the MDASI-MM was estimated by calculating Cronbach α values for the MDASI-MM core, severity, interference subscales at baseline (first MDASI-MM assessment). A Cronbach α value ≥0.70 indicates good internal consistency reliability [23].

Criterion validity

Criterion validity was examined by correlating selected MDASI-MM items and subscales with those from the QLQ-C30 and QLQ-MY20 at baseline. We hypothesized that the MDASI-MM’s activity-related and mood-related interference subscales would correlate with the physical-function and emotional-function subscales, respectively, of the QLQ-C30, and that the MDASI-MM’s symptom subscales would correlate with the symptom/side-effect subscales of the QLQ-MY20. Because the QLQ-MY20 disease-symptoms subscale contains primarily pain and bone-ache-related items [7], we examined correlations of the individual MDASI-MM “pain” and “bone aches” items with this subscale.

Construct validity

Construct validity of the MDASI-MM was assessed by evaluating its ability to distinguish between groups of patients with clinical differences in ECOG PS (ie, good (≤1) versus poor (≥2)) after induction or transplant.

Sensitivity

To evaluate the sensitivity of the MDASI-MM, we used 2 methods.

First, we assessed the MDASI-MM’s ability to detect change in ECOG PS during the course of treatment. We compared change in MDASI-MM ratings with change in ECOG PS scores between 2 time points: either between the first and last MDASI-MM assessments during induction therapy or between pre-HSCT and 7 days post-HSCT. ECOG PS was considered stable/improving if it remained the same or decreased relative to baseline, and worsening if it increased one or more points during treatment. Change scores for the MDASI-MM subscales and individual items were considered clinically meaningful at 0.5 standard deviation (SD) or higher [24]. We anticipated that the stable/improving group would have no significant change in MDASI-MM ratings but that the worsening group would; therefore, we conducted 1-sample t-tests to examine change in ratings for each MDASI-MM subscale.

Second, we examined the sensitivity of the MDASI-MM to detect the acute worsening of the transplant sample’s symptoms post-HSCT. We used paired t-tests to examine change in scores for the MDASI-MM subscales and individual items. Effect sizes were calculated and an effect size >0.5 was considered clinically meaningful [25,26].

Results

Demographic and clinical characteristics of the samples are summarized in Table 1. Mean age for the induction sample (n = 64) was 62.9 years and for the transplant sample (n = 68) was 62.1 years. Patients in both samples were predominantly White non-Hispanic and had good (0–1) baseline ECOG PS.

Table 1. Demographic and clinical characteristics

Validation of the MDASI-MM

Internal consistency reliability

The MDASI-MM subscales showed good reliability. Cronbach coefficient α values were 0.85 for the core subscale, 0.88 for the severity subscale, and 0.91 for the interference subscale.

Criterion validity

The MDASI-MM’s severity subscale displayed good association with the QLQ-C30 physical, role, cognitive, social, and emotional-functioning subscales (all P < .001) (Table 2). As hypothesized, the MDASI-MM’s activity-related interference subscale correlated more strongly with the QLQ-C30 physical-function subscale, whereas its mood-related-interference subscale correlated more strongly with the emotional-function subscale (all P < .001). MDASI-MM symptom subscales correlated well with the disease-symptoms and side-effects subscales of the QLQ-MY20 (all P < .001).

Table 2. Criterion validity: MDASI-MM subscales correlated with QLQ-C30 and QLQ-MY20 subscales (n= 55)

Individual MDASI-MM symptom items correlated strongly with comparable items and relevant subscales of the QLQ-C30 and QLQ-MY20 (Table 3). Strong correlations existed for pain, fatigue, nausea, shortness of breath, difficulty remembering, lack of appetite, dry mouth, numbness, constipation, diarrhea, and bone aches (all P < .001). Correlations between the MDASI-MM pain and bone-aches items and the QLQ-MY20 disease-symptoms subscale were 0.71 and 0.69 (P <.001), respectively.

Table 3. Criterion validity: MDASI-MM items compared with individual items or relevant subscales from the QLQ-C30 and QLQ-MY20 (n= 55)

Construct (known-group) validity

Patients with good ECOG PS had significantly lower scores for the MDASI-MM subscales than patients with poor ECOG PS (all P < .001) (Table 4). Similar results were seen for the MM-specific items (P < .001). Effect sizes for the differences were ≥0.7, indicating medium to large effects.

Table 4. Known-group validity: MDASI-MM symptom and interference subscale scores compared with ECOG PS scores from final MDASI-MM assessment (n= 127)

Sensitivity to change in performance status

MDASI-MM subscale change scores were significant for patients with worsening ECOG PS (core: t(65) = 8.350; severity: t(65) = 8.672; interference: t(65) =7.344; all P < .001), but were not significant for patients with stable/improving ECOG PS. Difference scores between patients whose ECOG PS worsened and patients for whom it remained stable/improved were statistically significant for each MDASI-MM subscale (all P < .001, all effect sizes ≥0.7) (Table 5). Additionally, difference scores between the groups were statistically significant for most individual symptom items.

Table 5. Sensitivity of the MDASI-MM to change in ECOG PS (n= 126)

Sensitivity to impact of therapy (HSCT)

Substantial and statistically significant increases in patients’ scores between pre-HSCT and 7 days post-HSCT were observed, with effect sizes of 1.29, 1.33, and 0.95 for the core, severity, and interference subscales, respectively (all P < .001) (Table 6). Differences in individual symptoms were also clinically significant for most items, with effect sizes ≥0.5.

Table 6. Sensitivity of the MDASI-MM to impact of therapy: comparison of subscale and individual symptom scores pre-HSCT and 7 days post-HSCT (n= 66)

Cognitive debriefing

Cognitive debriefing interviews were conducted with 20 patients. All reported that they were comfortable answering the MDASI-MM questions; that the questionnaire was easy to understand, and that it was comprehensive and non-repetitive. One patient reported swelling/edema and night sweats. No other MM or treatment-related symptoms were suggested during open interviews.

Symptom severity

In order of severity, the most-severe symptoms reported at induction baseline were fatigue, pain, disturbed sleep, drowsiness, bone aches, dry mouth, and muscle weakness; 35.9% of patients reported moderate to severe pain (≥5 on the MDASI-MM) and 45.3% reported moderate to severe fatigue [17]. At the end of induction, the most-severe symptoms reported were fatigue, pain, muscle weakness, disturbed sleep, drowsiness, numbness, and bone aches; 27.4% of patients reported moderate to severe pain and 30.6% reported moderate to severe fatigue.

The most-severe symptoms reported pre-HSCT were fatigue, numbness, pain, disturbed sleep, bone aches, and muscle weakness; 29.4% of patients reported moderate to severe pain, and 27.9% reported moderate to severe fatigue. Post-HSCT scores reflected a significant increase in symptom burden. The most-severe symptoms reported post-HSCT were fatigue, lack of appetite, diarrhea, dry mouth, drowsiness, nausea, and pain (Figure 1).

thumbnailFigure 1. Comparison of symptom severity for top 7 symptoms during induction chemotherapy with their levels before and 7 days after hematopoietic stem cell transplant.

MDASI-MM versus EORTC instruments

To examine how the top symptoms captured by the MDASI-MM would compare with the top symptoms captured by the QLQ C-30 and QLQ-MY20, we excluded non-symptom items from the latter scales and compared the top 5 symptoms identified by each instrument. Although in different order of severity, 4 of the top 5 symptoms captured by the MDASI-MM (fatigue, pain, disturbed sleep, drowsiness, bone aches) were identical to those captured by the 2 EORTC instruments (bone aches, fatigue, pain, disturbed sleep, and worry about health).

Discussion

This study evaluated an MM-specific module of the MDASI in patients undergoing treatment for MM. Our results provide strong psychometric evidence that the MDASI-MM is a valid, reliable instrument that can discriminate between clinically different patient groups and that has high sensitivity in detecting symptom change during treatment with respect both to patients’ ECOG PS and evolving symptom trajectories. Individual items and subscales of the MDASI-MM correlated strongly with corresponding items and subscales of the EORTC QLQ C-30 and QLQ MY-20. Cognitive debriefing evidenced that the MDASI-MM is easy to understand, quick to complete, and comprehensive.

One of the most useful assets of the MDASI-MM is its brevity. For example, it captured 4 of the top 5 symptoms captured by the 2 EORTC instruments. Thus, although brief, it captures patients’ most critical symptoms with minimal patient burden. Additionally, unlike the MDASI-MM, the 2 EORTC instruments are QOL scales that were not developed within the conceptual framework of symptom assessment [7,19]. As the QLQ C-30 must be administered with the QLQ MY-20 (a total of 50 items, compared with 26 items in the MDASI-MM), this adds substantially to patient burden. The MDASI-MM’s brevity also allows for efficient repeat administrations for charting a patient’s symptom trajectory over the course of treatment, which is a valuable aid to clinical decision making. Previous research indicates that patient-reported outcome measures can be effective guides to key clinical decisions [27], especially when objective evaluations of physical indices are difficult [28].

A significant advantage of MDASI modules is that each module includes all symptom and interference items from the original MDASI. Each module validation subjects the original MDASI items to further cognitive debriefing and sensitivity testing by additional patients, reinforcing the validity, reliability, and sensitivity of the original instrument. Original items can thus be included in new modules with fewer psychometric steps, enabling efficiency and cost savings in the development of disease-specific modules. Also, because each new module includes the original MDASI items, the use of MDASI modules facilitates comparison of symptom prevalence and severity across cancer types, a significant benefit in clinical trials or studies that include patients with different cancers.

During cognitive debriefing, 1 patient reported 2 symptoms not present in the MDASI-MM module (swelling/edema and transient night sweats). These items were not included in the final instrument as they were extremely rare [16]. If these items are reported in the literature with greater frequency, it may be reasonable to include them in a future revision of the MDASI-MM.

A limitation of our study was its largely racially homogenous population; future work is needed to test patients of diverse backgrounds in various treatment settings. Another limitation is that although we were able to demonstrate the sensitivity of the MDASI-MM to change in performance status and to impact of therapy, we were unable to demonstrate its sensitivity to change in patients’ disease status (eg, stable or progressive disease; partial or very good partial response) as these data were not available. Our key strengths include the development of an instrument based on symptom burden rather than health-related QOL, and inclusion of both induction and transplant patients, which extends its generalizability.

Conclusions

Numerous clinical trials are underway for patients with MM. Having a uniform, validated assessment instrument to monitor disease-related and treatment-related symptoms is therefore essential. Our study establishes that the MDASI-MM is a reliable, valid instrument developed with both patient and clinician input. Additionally, due to its brevity, simple 0–10 assessment scale, and ease of administration, it is a universally practical tool. The original MDASI is available in multiple linguistically and psychometrically validated versions [29-33], and MDASI modules such as the MDASI-MM are readily translatable. We recommend the MDASI-MM as a uniform symptom assessment instrument for patients with MM in treatment settings and clinical trials.

Abbreviations

ECOG PS: Eastern cooperative oncology group performance status;EORTC: European Organisation for Research and Treatment of Cancer;HSCT: Hematopoietic stem cell transplant;MDASI: M. D. Anderson Symptom Inventory;MDASI-MM: M. D. Anderson Symptom Inventory multiple myeloma module;MM: Multiple myeloma;QLQ-C30: EORTC Quality of Life Questionnaire;QLQ-MY20: EORTC Multiple Myeloma Module;QOL: Quality of life;REM: Mood-related interference with functioning, including relations with people, enjoyment of life, and mood;WAW: Activity-related interference with functioning, including symptom interference with work, general activity, and walking ability

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

DJ conducted patient interviews (cognitive debriefing), participated in data interpretation, and wrote the manuscript; EGV and TRM conducted statistical analysis, contributed to data interpretation, and reviewed the manuscript; XSW, LAW, and CSC designed the research study, participated in performing the research, and reviewed the manuscript; VEJ contributed to the statistical design and reviewed the manuscript., NDS, SKT, and REC contributed to the research design, performed patient recruitment, and reviewed the manuscript. All authors read and approved the final manuscript.

Statement of Prior Presentation

Presented at the 48th Annual Meeting of the American Society of Clinical Oncology, Chicago, IL, June 1-5, 2012.

Acknowledgements

This work was supported by grants from the National Cancer Institute of the National Institutes of Health (P01 CA124787 to CSC and the MD Anderson Cancer Center Support Grant P30 CA016672). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Cancer Institute or the National Institutes of Health.

The authors thank Jeanie F. Woodruff, ELS, a medical editor employed by the Department of Symptom Research at MD Anderson, for editorial services; Gary Mobley, Katherine Gilmore, and Mary Sailors in the Department of Symptom Research at MD Anderson for data management; and Jackie Joy and Venus Ilagan for symptom and clinical data collection.

References

  1. Brenner H, Gondos A, Pulte D: Recent major improvement in long-term survival of younger patients with multiple myeloma.

    Blood 2008, 111:2521-2526. PubMed Abstract | Publisher Full Text OpenURL

  2. Catley L, Anderson K: Strategies to improve the outcome of stem cell transplantation in multiple myeloma.

    The hematology journal: the official journal of the European Haematology Association/EHA 2004, 5:9-23. OpenURL

  3. Chapko MK, Syrjala KL, Schilter L, Cummings C, Sullivan KM: Chemoradiotherapy toxicity during bone marrow transplantation: time course and variation in pain and nausea.

    Bone Marrow Transplant 1989, 4:181-186. PubMed Abstract OpenURL

  4. Leger CS, Bredeson C, Kearns B, Bence-Bruckler I, Atkins H, Huebsch L: Autologous blood and marrow transplantation in patients 60 years and older.

    Biology of blood and marrow transplantation: journal of the American Society for Blood and Marrow Transplantation 2000, 6:204-210. Publisher Full Text OpenURL

  5. Sherman AC, Simonton S, Latif U, Spohn R, Tricot G: Psychosocial adjustment and quality of life among multiple myeloma patients undergoing evaluation for autologous stem cell transplantation.

    Bone Marrow Transplant 2004, 33:955-962. PubMed Abstract | Publisher Full Text OpenURL

  6. Wisloff F, Eika S, Hippe E, Hjorth M, Holmberg E, Kaasa S, Palva I, Westin J: Measurement of health-related quality of life in multiple myeloma. Nordic myeloma study group.

    British journal of haematology 1996, 92:604-613. PubMed Abstract | Publisher Full Text OpenURL

  7. Cocks K, Cohen D, Wisloff F, Sezer O, Lee S, Hippe E, Gimsing P, Turesson I, Hajek R, Smith A: An international field study of the reliability and validity of a disease-specific questionnaire module (the QLQ-MY20) in assessing the quality of life of patients with multiple myeloma.

    European journal of cancer (Oxford, England: 1990) 2007, 43:1670-1678. Publisher Full Text OpenURL

  8. Cleeland CS, Mendoza TR, Wang XS, Chou C, Harle MT, Morrissey M, Engstrom MC: Assessing symptom distress in cancer patients: the M.D. Anderson Symptom Inventory.

    Cancer 2000, 89:1634-1646. PubMed Abstract | Publisher Full Text OpenURL

  9. Dubois D, Dhawan R, van de Velde H, Esseltine D, Gupta S, Viala M, de la Loge C: Descriptive and prognostic value of patient-reported outcomes: the bortezomib experience in relapsed and refractory multiple myeloma.

    Journal of clinical oncology: official journal of the American Society of Clinical Oncology 2006, 24:976-982. Publisher Full Text OpenURL

  10. Wagner LI, Robinson D Jr, Weiss M, Katz M, Greipp P, Fonseca R, Cella D: Content development for the functional assessment of cancer therapy-multiple myeloma: Use of qualitative and quantitative methods for scale construction.

    J Pain Symptom Manage 2012, 43:1094-1104. PubMed Abstract | Publisher Full Text OpenURL

  11. Kirkova J, Davis MP, Walsh D, Tiernan E, O’Leary N, LeGrand SB, Lagman RL, Russell KM: Cancer symptom assessment instruments: a systematic review.

    Journal of clinical oncology: official journal of the American Society of Clinical Oncology 2006, 24:1459-1473. Publisher Full Text OpenURL

  12. Gning I, Trask PC, Mendoza TR, Harle MT, Gutierrez KA, Kitaka SA, Sherman SI, Cleeland CS: Development and initial validation of the thyroid cancer module of the M. D. Anderson Symptom Inventory.

    Oncology 2009, 76:59-68. PubMed Abstract | Publisher Full Text OpenURL

  13. Armstrong TS, Mendoza T, Gning I, Coco C, Cohen MZ, Eriksen L, Hsu MA, Gilbert MR, Cleeland C: Validation of the M.D. Anderson Symptom Inventory Brain Tumor Module (MDASI-BT).

    Journal of neuro-oncology 2006, 80:27-35. PubMed Abstract | Publisher Full Text OpenURL

  14. Mendoza TR, Wang XS, Lu C, Palos GR, Liao Z, Mobley GM, Kapoor S, Cleeland CS: Measuring the symptom burden of lung cancer: the validity and utility of the lung cancer module of the M. D. Anderson Symptom Inventory.

    The oncologist 2011, 16:217-227. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Rosenthal DI, Mendoza TR, Chambers MS, Asper JA, Gning I, Kies MS, Weber RS, Lewin JS, Garden AS, Ang KK: Measuring head and neck cancer symptom burden: the development and validation of the M. D. Anderson symptom inventory, head and neck module.

    Head Neck 2007, 29:923-931. PubMed Abstract | Publisher Full Text OpenURL

  16. Willis GRB, Barofsky I: The use of cognitive interviewing techniques in quality of life and patient-reported outcomes assessment. In Outcomes Assessment in Cancer: Measures, Methods, and Applications. Edited by Lipscomb J, Gotay CC, Snyder C. Cambridge: Cambridge University Press; 2005:610-622. OpenURL

  17. Serlin RC, Mendoza TR, Nakamura Y, Edwards KR, Cleeland CS: When is cancer pain mild, moderate or severe? Grading pain severity by its interference with function.

    Pain 1995, 61:277-284. PubMed Abstract | Publisher Full Text OpenURL

  18. Mendoza TR, Wang XS, Cleeland CS, Morrissey M, Johnson BA, Wendt JK, Huber SL: The rapid assessment of fatigue severity in cancer patients: use of the Brief Fatigue Inventory.

    Cancer 1999, 85:1186-1196. PubMed Abstract | Publisher Full Text OpenURL

  19. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de Haes JC: The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.

    J Natl Cancer Inst 1993, 85:365-376. PubMed Abstract | Publisher Full Text OpenURL

  20. Oken MM, Creech RH, Tormey DC, Horton J, Davis TE, McFadden ET, Carbone PP: Toxicity and response criteria of the Eastern Cooperative Oncology Group.

    Am J Clin Oncol 1982, 5:649-655. PubMed Abstract | Publisher Full Text OpenURL

  21. Cleeland CS, Gonin R, Baez L, Loehrer P, Pandya KJ: Pain and treatment of pain in minority patients with cancer. The Eastern Cooperative Oncology Group Minority Outpatient Pain Study.

    Annals of internal medicine 1997, 127:813-816. PubMed Abstract | Publisher Full Text OpenURL

  22. Cleeland CS, Gonin R, Hatfield AK, Edmonson JH, Blum RH, Stewart JA, Pandya KJ: Pain and its treatment in outpatients with metastatic cancer.

    N Engl J Med 1994, 330:592-596. PubMed Abstract | Publisher Full Text OpenURL

  23. Nunnally J, Bernstein IH: Pscyhometric Theory. 3rd edition. New York: McGraw-Hill; 1994. OpenURL

  24. Sloan JA, Vargas-Chanes D, Kamath CC, Sargent DJ, Novotny PJ, Atherton P: Detecting worms, ducks and elephants: A simple approach for defining clinically relevant effects in qualty-of-life measures.

    J Cancer Integr Med 2003, 1(1):41-47. OpenURL

  25. Cohen J: Statistical Power Analysis for the Behavioral Sciences. 2nd edition. NJ: Lawrence Earlbaum Associates; 1988. OpenURL

  26. Cohen J: A power primer.

    Psychol Bull 1992, 112:155-159. PubMed Abstract | Publisher Full Text OpenURL

  27. Efficace F, Novik A, Vignetti M, Mandelli F, Cleeland CS: Health-related quality of life and symptom assessment in clinical research of patients with hematologic malignancies: where are we now and where do we go from here?

    Haematologica 2007, 92:1596-1598. PubMed Abstract | Publisher Full Text OpenURL

  28. Fairclough DL: Patient reported outcomes as endpoints in medical research.

    Stat Methods Med Res 2004, 13:115-138. PubMed Abstract | Publisher Full Text OpenURL

  29. Mystakidou K, Cleeland C, Tsilika E, Katsouda E, Primikiri A, Parpa E, Vlahos L, Mendoza T: Greek M.D. Anderson Symptom Inventory: validation and utility in cancer patients.

    Oncology 2004, 67:203-210. PubMed Abstract | Publisher Full Text OpenURL

  30. Nejmi M, Wang XS, Mendoza TR, Gning I, Cleeland CS: Validation and application of the Arabic version of the M. D. Anderson symptom inventory in Moroccan patients with cancer.

    Journal of pain and symptom management 2010, 40:75-86. PubMed Abstract | Publisher Full Text OpenURL

  31. Okuyama T, Wang XS, Akechi T, Mendoza TR, Hosaka T, Cleeland CS, Uchitomi Y: Japanese version of the MD Anderson Symptom Inventory: a validation study.

    J Pain Symptom Manage 2003, 26:1093-1104. PubMed Abstract | Publisher Full Text OpenURL

  32. Wang XS, Wang Y, Guo H, Mendoza TR, Hao XS, Cleeland CS: Chinese version of the M. D. Anderson Symptom Inventory: validation and application of symptom measurement in cancer patients.

    Cancer 2004, 101:1890-1901. PubMed Abstract | Publisher Full Text OpenURL

  33. Yun YH, Mendoza TR, Kang IO, You CH, Roh JW, Lee CG, Lee WS, Lee KS, Bang SM, Park SM: Validation study of the Korean version of the M. D. Anderson Symptom Inventory.

    Journal of pain and symptom management 2006, 31:345-352. PubMed Abstract | Publisher Full Text OpenURL