Pediatric Research Course

Questionnaire Results

by

R.J. Rosychuk, Ph.D.

Assistant Professor

Department of Pediatrics

M. Hailemariam, M.Sc.

Ph.D. Student

Department of Mathematical Sciences

July 17, 2001

Executive Summary

In response to a 2001 Pediatric Retreat recommendation, the development of a research methods course has been pursued. During the months of May and June 2001, a questionnaire was mailed to members of the Department of Pediatrics. The questionnaire queried members about their interest in participating in a research methods course. About 60% of the members responded to the questionnaire.

The respondents indicated:

  • Both Faculty and Resident members are interested in a research methods course.
  • Potential participants have different levels of experience with research methods.
  • Most are unaware of other opportunities for research methods courses within the University of Alberta.
  • Most are willing to commit at least five hours to a research methods course.
  • Many are interested in learning more about Study Design, Sample Size and Power, Clinical Trials, Basic Statistics and Proposal Writing in a research methods course.

Introduction

In May 2001, Drs. Rosychuk and Spady of the Department of Pediatrics at the University of Alberta were assigned the task of addressing the 2001 Department of Pediatrics Retreat recommendation for a Research Methods Course. A questionnaire was designed and mailed to Department of Pediatrics members (hereafter referred to as members) to try to assess the interest in the implementation of a possible course. The specific objectives of the questionnaire were to assess the:

  • desire of members to participate in a research methods course
  • topics of interest to members
  • hours available for members to participate
  • suitability of Academic Half Day as a course time
  • awareness of research methods courses available within the University of Alberta.

This report outlines the methods and results associated with the Research Methods Course Questionnaire.

Methods

Drs. Rosychuk and Spady designed a two-sided, single page questionnaire attached in Appendix A. Previous versions of the questionnaire were circulated to individuals for feedback and clarification.

A list of Department of Pediatrics members was obtained from Rhonda Chaput, Departmental Executive Secretary. The list included Residents, Faculty and Community Pediatricians, yielding 172 members. Rhonda Chaput generated address labels and handled the off-campus mailings. Drs. Rosychuk and Spady, as well as a future staff member, were included on the list but were not asked to complete questionnaires.

Questionnaire packages comprised of an information slip, questionnaire (in green), and a self-addressed return envelope. The packages were assembled by Dr. Rosychuk and her research assistants: Meseret Hailemariam, Cynthia Yau and Eunha Yang, all from the Department of Mathematical Sciences. Initial packages were sent during the latter half of May 2001. Meseret Hailemariam tracked the incoming questionnaires and by Friday June 8, 2001, a second questionnaire package was mailed to the non-responders. This questionnaire package included the same information as the first along with a reminder notice and self-addressed stamped return envelopes for off-campus members.

Meseret Hailemariam entered questionnaire data and provided descriptive summaries requested by Dr. Rosychuk. The statistical software package SPSS was used for analysis.

Results

Of the 169 questionnaires mailed, 101 were received prior to the return deadline yielding a 59.76% response rate. Four questionnaires were subsequently received after the June 29, 2001 deadline and were not entered in the analysis. The questionnaires are summarized in terms of all responders as well as those responders willing and able to participate in a research methods course. Detailed summaries appear in Appendix B.

All Responders

Seventy five Faculty, 13 Resident/Fellow and 13 Other members responded. The majority (64/101) considered themselves to be somewhat experienced with research methods. Twenty and 17 responders classified themselves as having none or extensive experience with research methods, respectively.

When asked if interested in a research methods course, 70 were interested, 22 were not interested and 8 were unsure. Respondents indicated they either would attend (66/78) or were unsure about attending (9/78) in a research methods course. Most of the responders (84/101) did not know of any research methods courses available in the Faculty of Medicine/University of Alberta. Six members indicated that they knew of courses in Radiology and Public Health.

Some respondents provided comments on their returned questionnaire. Themes of the comments included a desire forofficial credit /recognition, inclusion of critical appraisal, integration of biostatistics and small group sessions.

Responders Willing and Able to Participate in a Research Methods Course

Seventy-five respondents indicated they were willing and able to attend and participate actively in a research methods course. Most of these responders identified themselves as having some experience in research methods (Table 1).

Table 1: Research experience of members considering participating.

Research experience / Willing/able to attend / Total
Yes / Unsure
None / 14
43
9
66 / 1
5
3
9 / 15
48
12
75
Some
Extensive
Total

Most responders (56/75) felt that Academic Half-Day was a suitable meeting time. The time commitment most popular to respondents was 5-10 hours (28/75). Several other individuals specified 1-5 hours or more than 10 hours as their preference (Figure 1).

Figure 1: Number of hours available to commit to a research methods course.

The respondents were asked to mark a selection of topics that the research methods course should address. Most respondents indicated several topics and a few respondents were interested in all topics displayed. No respondents specified additional topics to be addressed. The frequencies of topic preferences appear in Table 2. Topics such as Study Design, Sample Size and Power, Clinical Trials and Basic Statistics top the list.

Table 2: Topics preferred in research methods course.

Topic / Frequency
Study Design / 64
Sample Size & Power / 58
Clinical Trials / 52
Basic Statistics / 50
Proposal Writing / 45
Questionnaire Design / 44
Data Management / 44
Data/Results Presentation / 40
Data Collection / 37
Confidence Intervals / 36
Correlation, Regression / 35
Summarizing Data / 35
Data Quality / 35
Hypothesis Testing / 34
Experimental Design / 32
Case-Control Studies / 30
Measures of Association / 30
Cohort Studies / 29
Ethics Procedure / 25
Survival Methods / 23

The most popular topics for the resident respondents were generally popular topics chosen by the members as a whole (Table 3). The resident respondents reported a greater interest in Cohort Studies than other respondents.

Table 3: Top 10 topics preferred by residents for a research methods course.

Topic / Frequency
Study Design / 10
Data/Results Presentation / 10
Data Management / 10
Sample Size & Power / 9
Clinical Trials / 9
Basic Statistics / 9
Proposal Writing / 9
Questionnaire Design / 8
Cohort Studies / 8
Data Collection / 8

Summary

The questionnaire respondents have clearly indicated their support for the development of a research methods course. The supporters have different levels of experience with research methods, are interested in a variety of issues related to research, are willing to commit several hours to a research methods course and unaware of other potential research methods courses available within the University of Alberta.

Work is now underway to formulate a proposal for the content of a research methods course.

Appendix A: Questionnaire

Research Methods Course Needs Assessment

Participants at the 2001 Pediatric Retreat indicated a need for a course on research methods. While the course was suggested, the objectives, format, topics, and duration have not been proposed. Drs. Rosychuk and Spady of the Department of Pediatrics have been assigned the task of forming a research methods course and they need your help to guide the course development.

Most likely the course will concentrate on methods for clinical research but will also have topics relevant to basic science researchers. To enable a successful course, your input is required regarding the topics to be discussed and your commitment to such a course. All Faculty, Residents, and Fellows within the Department of Pediatrics are asked to please complete the attached questionnaire to facilitate a course that reflects the needs of department members. Please take 5 minutes to have your voice heard. All responses will be confidential.

Please return your completed questionnaire in the addressed envelope enclosed by May 28, 2001. On May 29, 2001, those who have not returned their questionnaire will be contacted again with a reminder notice. If you have any questions or concerns, please contact Dr. Rhonda J. Rosychuk at 492-0318 or .

Thank you in advance for your participation!

#

Research Methods Course Questionnaire

Please mark an “” in the most appropriate box for each question. Please answer all questions. About 5 minutes is required to complete this questionnaire. Your responses will be kept confidential.

1. What type of staff member are you?


 / Faculty

Resident/Fellow

Other  Please specify:
2. What is your experience with research methods such as study design, analysis and interpretation?


 / None
Some
Extensive
3. Are you interested in a course on research methods, so that you can prepare/supervise/do your own research more effectively?


 / Yes
No  Please skip to question 8.
Unsure
4. Would you be willing and able to attend and participate actively in a course on research methods? Such a course would span at least 3 (2 hour) sessions and probably more.


 / Yes
No  Please skip to question 8.
Unsure
5. What topics would you like a research methods course to address? Please mark all that apply.







 / Study Design
Sample Size and Power
Correlation, Regression
Data/Results Presentation
Hypothesis Testing
Questionnaire Design
Case-Control Studies
Clinical Trials / 






 / Data Management
Ethics Procedures
Experimental Design

Survival Methods

Basic Statistics
Summarizing Data

Cohort Studies

Measures of Association / 



 / Confidence Intervals
Data Collection
Proposal Writing
Data Quality
Other Please specify:
6. Portions of Academic Half Day have been suggested as a time for the research methods course. Would you attend the course held during this time (1-3pm Wednesdays)?


 / Yes
No  If Academic Half Day is unsuitable, please specify an alternative:
Unsure
7. How many hours would you commit to a research methods course?



 / 1 hour
1 - 5 hours
5 - 10 hours
> 10 hours
8. Are you aware of any research methods courses in the Faculty of Medicine/University of Alberta?


 / Yes  Please specify:
No
Unsure
Please turn over
9. Please include any comments on a research methods course in the space below.

 Please mail your completed questionnaire by May 28, 2001 in the addressed envelope to:

Dr. Rhonda Rosychuk

9423 Aberhart Centre

Please contact Dr. Rosychuk at 492-0318 for further information.

Thank you for your participation.

Appendix B: Detailed Summaries

Question 1.

Question 2.

Question 3.

Question 4.

Question 5.

Question 6.

Question 7.

Question 8.

Question 9. Selected Comments.

  • Give official credit /recognition
  • Include critical appraisal
  • Should integrate biostatistics
  • Urgently needed
  • Small group sessions if possible
  • Start with a basic short course
  • A different level & time for faculty

Question 1 by Question 4.

Question 2 by Question 4.

Question 3 by Question 4.

Question 2 by Question 3.