| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
From the Department of Anesthesiology and Pain Medicine, University of Alberta, Edmonton, Alberta, Canada.
Address correspondence to: Dr. Ban C.H. Tsui, Department of Anesthesiology and Pain Medicine, 8-120 Clinical Sciences Building, University of Alberta, Edmonton, Alberta, T6G 2G3, Canada. E-mail: btsui{at}ualberta.
| Abstract |
|---|
|
|
|---|
Methods: In this observational study, the MEDLINE database was searched for publications listed by anesthesiology departments at Canadian universities as the primary corresponding source from 20002004. Abstracts were reviewed and each publication categorized into its respective methodological design. Impact factors of the journals in which the articles appeared were taken into consideration. "Total impact score" was defined as the total number of articles from a particular journal in a particular year multiplied by the impact factor value. Changes in overall publication numbers over the five-year period were compared and analyzed using Pearson correlation coefficients.
Results: Total Canadian anesthesia publications remained constant from 20002004. In this five-year time frame, the University of Toronto had the highest number of publications (271) followed by the University of Montreal (86), and McGill University (84). These universities conducted primarily randomized controlled trials (RCTs) whereas smaller Canadian universities mainly published case reports, reviews, and cohort studies. The number of RCTs conducted seems to be decreasing whereas the number of case reports and reviews being published are remaining constant over the five-year period.
Conclusion: Although overall numbers in anesthesia publications do not suggest a significant decline, the number of RCTs decreased during the years 20002004. The quality of anesthesia research appears to be comparable to those in other medical specialties, with larger institutions conducting RCTs and smaller institutions publishing more case reports.
| Introduction |
|---|
|
|
|---|
Aside from sharing knowledge and new findings, publications increase an authors recognition within the medical community, and may also enable easier access to research funding resulting in future studies.5 Productivity in a certain medical area is reflected by the number of articles published.6 In this study, our objective was to estimate the research productivity of Canadian anesthesiology departments over a five-year period (January 2000 to December 2004, inclusive). To ensure consistency, we selected publications using Canadian anesthesiology departments in the corresponding address. We also aimed to classify the articles by publication type, and evaluated them using impact factors (IF) associated with the medical journals of interest.
| Methods |
|---|
|
|
|---|
"Total impact score" was defined as the total number of articles from a particular journal in a particular year multiplied by the IF value. The IF for the resulting journals was obtained through the Institute for Scientific Information (ISI) Journal Citation Reports at the ISI Web of Knowledge website7 and they define IF as the number of citations of a specific journal divided by the number of articles published by the journal in a two-year period. The total impact score values were calculated in order to take into account IF, and inclusion criteria required journal articles to be: 1) included in Medical Literature Analysis and Retrieval System Online (MEDLINE), 2) included in the Science Citation Index and 3) published by a Canadian university or affiliated hospital between January 2000 and December 2004. Any journals that were found in PubMed but not in the Science Citation Index were excluded from total impact score calculations.
Articles found to be published by Canadian universities between January 2000 and December 2004 were sorted by correspondence address into their respective universities and separated by year. When only a hospital was stated, the article was accredited to the affiliated university. Within each university, the number of articles for a certain journal in a particular year was counted. The abstracts of all results were manually reviewed, categorized into 14 methodological research designs (Table I
) and counted. The research design categories included: animal studies, basic science research, case control studies, case reports, case series, clinical trials, cohort studies, meta-analysis, non-clinical studies (descriptive reports, historical articles, etc.), randomized controlled trials (RCTs), RCT multicentre, reviews, surveys and systematic reviews. For those results without an abstract available, the full text article was assessed and the article was categorized according to the various methodological designs.
|
| Results |
|---|
|
|
|---|
|
|
|
|
|
|
|
|
|
| Discussion |
|---|
|
|
|---|
|
The University of Montreal had the second highest total number of papers published between the study period (Table II
, Figure 2
). This institution is also the only Canadian university that shows a consistent and steady increase (r = +0.95) in the number of anesthesia publications each year. Though 85% of residency programs have mandatory research requirements,10 only the University of Montreal has a mandatory research rotation in their program; this rotation has been implemented for more than ten years.A Protocol preparation and submission is completed in the second year of the program, followed by a three- to four-month rotation in the third year during which the residents collect most of their data; data analysis and manuscript preparation is then completed concurrently or in the following year. More than 90% of the University of Montreal resident research is presented at anesthesiology meetings and is published in peer-reviewed journals. According to their program director, residents and supervising professors appreciate this research rotation. In fact, in a recent survey, most residents felt the biggest barrier to research was the lack of time.10 It is likely that this structured research rotation has allowed more time for residents to pursue research and consequently, has lead to an increase in research productivity in this university department.
| Types of anesthesia publications |
|---|
|
|
|---|
It is evident that major university centres are conducting a larger proportion of large-scale clinical trials such as RCTs, whereas smaller institutions are publishing more case reports, cohort studies and reviews. This may be explained by the fact that larger institutions with a greater faculty size have increased human resources, as well as a much larger patient population for patient recruitment. Consequently, a larger working clinical environment appears to be more conducive to studies such as RCTs. On the other hand, institutions of a smaller size would require a lengthier study period in order to complete a RCT because there are fewer patients and fewer researchers conducting these studies. Results from a recent study evaluating Emergency Medicine programs at various centres from across the United States demonstrates similar findings.16 In Henderson and Brestkys study, faculty size was taken into account and it was concluded that understandably, a larger faculty would be in a position to have higher academic output, since there would be an assumed greater diffusion of administrative and clinical burden.16 This is essentially what is seen from our results, despite the fact that actual faculty member numbers were not reported.
The majority of anesthesia articles published in 20002004 were in anesthesia-specific journals such as the Canadian Journal of Anesthesia (28%), Anesthesia and Analgesia (14%), and Anesthesiology (10%). A similar study conducted in pediatric anesthesia gave similar results, showing that the majority of anesthesia articles were published in the three mentioned journals.17 Journals for various medical disciplines were also publishing anesthesia research articles from our Canadian universities, ranging from basic science journals such as the Journal of Physiology and Circulation, to critical care medicine and surgery journals. It was important to include all types of journals, because all variations of anesthesia research were included in our search strategy, including animal studies, basic science investigations and human research.
| Future direction of anesthesia research |
|---|
|
|
|---|
| Limitations of current investigation |
|---|
|
|
|---|
In response to the increasing volume of information being published in a larger number of journals,20 the IF was established in 1961 as an index of a journals quality. However, the use of IF for measuring the quality of journals has been questioned. Opthof et al. suggests that IF does not reveal the quality of individual papers, but it can be used to compare the quality of journals.21 Others remain doubtful as to the validity of IF when assessing the scientific merit of a journal.2225 Selfcitation, author bias and counting methodology can inflate citation counts.2628 Despite the controversy,23,24,28,29 IF is being used more frequently by institutions such as libraries. Consequently, the influence of IF is real, and must be accounted for.
A similar but more comprehensive study comparing Canadian research output between institutions for the period of 19941999 was published previously.30 However, this study by Gagnon et al. differs not only in the study period, but also in the methodology used for counting the number of publications. The authors included all articles published on anesthetic and analgesic topics in major Canadian cities in their analysis; thus, their data may have included articles published by departments other than anesthesia in the same institution. Our study differed from that of Gagnon et al. as we have aimed to estimate the research output from each anesthesia department in all major Canadian universities, and we have included only those publications originating from all anesthesia departments across Canada between January 2000 and December 2004.
| Conclusion and recommendations |
|---|
|
|
|---|
| Footnotes |
|---|
Assessed October 4, 2004. Accepted for publication July 16, 2005. Revision accepted August 25, 2005.
A Girard F. Program director, Department of Anesthesia, University of Montreal, Quebec, Canada [Personal Communication] 2004. ![]()
| References |
|---|
|
|
|---|
2 Orser BA, Miller DR. New opportunities for anesthesia research in Canada (Editorial). Can J Anesth 2002; 49: 8959.
3 Figueredo E, Sanchez Perales G, Munoz Blanco F. International publishing in anaesthesia - how do different countries contribute? Acta Anaesthesiol Scand 2003; 47: 37882.[Medline]
4 Szokol JW, Murphy GS, Avram MJ, Nitsun M, Wynnychenko TM, Vender JS. Declining proportion of publications by American authors in major anesthesiology journals. Anesth Analg 2003; 96: 5137.
5 Kumararatne M. A piece of my mind. Why publish? JAMA 1997; 277: 957.[Medline]
6 Stossel TP, Stossel SC. Declining American representation in leading clinical-research journals. N Engl J Med 1990; 322: 73942.[Abstract]
7 Science Citation Index (SCI) Journal Citation Reports. A bibliometric analysis of science journals in the ISI database. Philadelphia: Institute for Scientific Information; 19982003.
8 Myles PS, Gin T. Regression and correlation. In: Myles PS, Gin T (Eds). Statistical Methods for Anaesthesia and Intensive Care. Oxford: Reed Educational and Professional Publishing Ltd.; 2000: 80.
9 Rosner B. Regression and correlation methods. In: Crockett C (Ed.). Fundamentals of Biostatistics, 5th ed. Pacific Grove, CA: Duxbury; 2000: 4513.
10 Silcox LC, Ashbury TL, Milne B, VanDenKerkhof EG. Do anesthesiology residents want to be involved in research? Can J Anesth 2004; 51: A13 (abstract).
11 Pandit JJ, Yentis SM. All that glisters... how to assess the value of a scientific paper. Anaesthesia 2005; 60: 37383.[Medline]
12 Horlocker TT, Brown DR. Evidence-based medicine: haute couture or the emperors new clothes? (Editorial). Anesth Analg 2005; 100: 180710.
13 Strippoli GF, Craig JC, Schena FP. The number, quality, and coverage of randomized controlled trials in nephrology. J Am Soc Nephrol 2004; 15: 4119.
14 Brölmann HA, Kesteren PJ. Levels of evidence in endoscopic research: a longitudinal survey. Gynecol Surg 2004; 1: 913.
15 Greenfield ML, Rosenberg AL, OReilly M, Shanks AM, Sliwinski MJ, Nauss MD. The quality of randomized controlled trials in major anesthesiology journals. Anesth Analg 2005; 100: 175964.
16 Henderson SO, Brestky P. Predictors of academic productivity in emergency medicine. Acad Emerg Med 2003; 10: 100911.[Medline]
17 Brambrink AM, Ehrler D, Dick WF. Publications on paediatric anaesthesia: a quantitative analysis of publication activity and international recognition. Br J Anaesth 2000; 85: 55662.
18 Royal College of Physicians and Surgeons of Canada Clinician Investigator Program. Clin Invest Med 1997; 20: 261.[Medline]
19 Lindberg DA. National Library Of Medicine provides access for all. U.S. Medicine [serial online]; [cited 2005 Jun 27] 2003: 46. URL available from; http://www.usmedicine.com/column.cfm?columnID=120&issueID=46.
20 Greene NM. Anesthesiology journals, 1992. Anesth Analg 1992; 74: 11620.
21 Opthof T. Sense and nonsense about the impact factor. Cardiovasc Res 1997; 33: 17.
22 Hansson S. Impact factor as a misleading tool in evaluation of medical journals (Letter). Lancet 1995; 346: 906.[Medline]
23 Rydholm A. Impact factors (Editorial). Acta Orthop Scand 1998; 69: 221.[Medline]
24 Seglen PO. Citation frequency and journal impact: valid indicators of scientific quality? (Editorial). J Intern Med 1991; 229: 10911.[Medline]
25 Seglen PO. Why the impact factor of journals should not be used for evaluating research. BMJ 1997; 314: 498502.
26 Campbell FM. National bias: a comparison of citation practices by health professionals. Bull Med Libr Assoc 1990; 78: 37682.[Medline]
27 Gallagher EJ, Barnaby DP. Evidence of methodologic bias in the derivation of the Science Citation Index impact factor. Ann Emerg Med 1998; 31: 836.[Medline]
28 Gisvold SE. Citation analysis and journal impact factors--is the tail wagging the dog? Acta Anaesthesiol Scand 1999; 43: 9713.[Medline]
29 Zetterstrom R. Impact factor and the future of Acta Paediatrica and other European medical journals. Acta Paediatr 1999; 88: 7936.[Medline]
30 Gagnon RE, Macnab AJ, Blackstock D. An inventory of Canadian anesthesiology. Human research from 1995 through 1999. Can J Anesth 2001; 48: 4528.
31 Rahman M, Sakamoto J, Fukui T. Research output in anaesthesia: a quantitative ranking (Letter). Anaesthesia 2002; 57: 12134.[Medline]
32 Alderson P, Green S, Higgins J. [Glossary of Terms in the Cochrane Collaboration.] Cochrane Handbook for Systematic Reviews of Interventions 4.2.4 [updated March 2003]. Available from URL; http://www.cochrane.org/resources/glossary.htm [accessed 2005 Jun 27].
This article has been cited by other articles:
![]() |
M. Swaminathan, B. G. Phillips-Bute, and K. P. Grichnik A Bibliometric Analysis of Global Clinical Research by Anesthesia Departments Anesth. Analg., December 1, 2007; 105(6): 1741 - 1746. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. A. Finley, O. Hung, T. J. Coonan, and R. Hall Anesthesia research productivity in Canadian universities: a full picture? (I). Can J Anesth, August 1, 2006; 53(8): 845 - 845. [Full Text] [PDF] |
||||
![]() |
D. Cheng Anesthesia research productivity in Canadian universities: a full picture? (III). Can J Anesth, August 1, 2006; 53(8): 846 - 847. [Full Text] [PDF] |
||||
![]() |
F. Donati and J.-F. Hardy Anesthesia research productivity in Canadian universities: a full picture? (II). Can J Anesth, August 1, 2006; 53(8): 845 - 846. [Full Text] [PDF] |
||||
![]() |
R. J. Byrick Anesthesia research productivity in Canada: role of academic departments/La productivite en recherche anesthesique : le role des departements universitaires. Can J Anesth, March 1, 2006; 53(3): 217 - 221. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |