| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
From the Departments of Paediatrics and Anaesthesia, Children's & Women's Health Centre of British Columbia, Vancouver, British Columbia, Canada.
Address correspondence to: Dr. Andrew Macnab, Critical Care Research Office, Room L317, Mail Box 80, Children's & Women's Health Centre of British Columbia, 4480 Oak Street, Vancouver, British Columbia, V6H 3V4, Canada. Phone: 604-875-3524; Fax: 604-263-5031; E-mail: regagnon{at}interchange.ubc.ca
| Abstract |
|---|
|
|
|---|
Methods: The survey was undertaken using the Medical Literature Analysis and Retrieval System (MEDLARS) medical literature archive for the years 1995 through 1999. The principal categories and subcategories of MEDLARS' anesthesia classifications were counted for 70 countries contributing to the archive.
Results: Canadian contributions ranged from 141 (1992) to 185 (1999) and represented annually 3% of the world total in the anesthesia categories. The greatest number of studies (3038%) were about adults aged 19 to 44 yr, and there were between 4% and 14% more studies of females than males. "Pharmacology" and "therapeutic use" were the most frequent topics, lidocaine, fentanyl, and propofol were the most studied anesthetics, and non-steroidal anti-inflammatories, opium, morphine, and fentanyl were the most studied analgesics. Among the types of studies, those classified as "quality of health care" occurred most frequently (16%). Canadian trends closely follow world trends.
Conclusion: The collected counts provide a comprehensive overview of research trends for the past five years.
MEDICAL research has long benefited from the availability of computerized data bases to enumerate areas of interest. One of the world's largest databases, the Medical Literature Analysis and Retrieval System (MEDLARS) is part of the National Library of Medicine (Bethesda, MD, USA) archive. MEDLARS now (March 2001) has almost 11 million entries in its database and can be accessed free of charge through the Internet via its web site at: www.ncbi.nlm.nih.gov/PubMed. This allows medical researchers around the world to cite related works, compile a current state-of-knowledge, and benefit from having their own works be made universally available.
Since 1987, articles archived in MEDLARS have been catalogued with the author's affiliation address. This feature allows retrieving and counting of articles having a specific content in conjunction with specific countries, cities, or institutions.
MEDLARS has an extensive quality control process to scrutinize and codify the submissions from its 3,900 contributing journals. The journals themselves must meet certain requirements (Index Medicus) before being eligible for inclusion in the archive. The code system medical subject headings (MESH) used to describe any particular article is standardized and has been updated and enlarged by committee consensus to keep it consistent with current topics. Combined, the standardized coding, quality control system, and restricted input imply that MEDLARS retrieval counts will reliably indicate patterns of change in research reporting.
We investigated the publication record of Canadian research reports archived in MEDLARS with respect to anesthesiology, anesthetics, anesthesia, analgesics, and analgesia for the years 1995 through 1999.
| Methods |
|---|
|
|
|---|
Only articles coded as "human[mh]" were counted; thus human studies containing an animal component were also included.
Five principal categories were investigated separately and as combined totals using the expression "AND (anesthesiology[mh] OR anesthetics[mh] OR anesthesia[mh] OR analgesics[mh] OR analgesia[mh])", as well as the diphthong variants. Similarly, the years 1995 through 1999 were counted using the expression "AND (1995[dp] OR 1996[dp] OR 1997[dp] OR 1998[dp] OR 1999[dp])".
Since we wanted to count only articles having original research, we excluded other types of publications by using the expression "NOT (case reports[mh] OR letter[pt] OR editorial[pt] OR comment[pt] OR review[pt] OR review tutorial[pt] OR practice guidelines[pt])".
Wherever possible Canadian counts were compared with world wide counts. World counts were obtained using the same inclusion and exclusion expressions as used for the Canadian counts, except that the term "Canada[ad]" was omitted. Therefore, world counts, by default, contain the archives of 70 contributing countries including those from Canada.
We counted anesthesia, anesthetic, analgesia, analgesic, anesthesiology, and their diphthong variants, combined with respect to major Canadian cities, medical schools, international journals, types of publications, test subject's age, and, test subject's gender.
To compare the research output of anesthesiologists vs other clinical specialties we counted the original Canadian research articles from 1988 through 1998 made by those specialties as listed by the Royal College of Physician and Surgeons of Canada.
| Results |
|---|
|
|
|---|
The total annual Canadian output of original research articles in the combined principal categories of anesthesia, anesthetics, analgesia, analgesics, and anesthesiology ranged from 141 (1992) to 185 (1999) and represented annually 3% of the world total in those categories.
The five-year survey (19951999) of test subjects' gender showed an equal distribution between sexes in the analgesic studies. There were 4% more females than males in the study of anesthetics, 7% more females in the study of anesthesia, and 14% more females in the analgesia studies.
In all principal categories there were no studies anywhere in the world with test subjects greater than 80 yr of age. In Canada, between 30% and 38% of the studies in each principal category involved adults aged 19 to 44 yr. The next greatest age group in all categories was middle-aged (4564 yr), and it was in 18% to 21% of the studies. The third greatest age group involved, and once again this was true for each principal category, were children aged six to 12 yr; and they were involved in either 12% or 17% of the studies, depending upon category.
Among the ten publication types, in Canada, "Journal Article"(s) had the greatest number of publications in each of the principal categories and accounted for 45% to 58% of the total output. "Clinical Trial"(s) and "Randomized Controlled Trials" were the next most predominant publications with between 13% and 26% of the output depending upon the principal category.
Most original research by Canadians was published in the "Canadian Journal of Anesthesia", which represented 45% of the Canadian total for the principal categories counted from 19 international journals. The journal, "Anesthesia and Analgesia" was the next greatest source of Canadian publications with 18% of the Canadian total. By comparison "Anesthesia and Analgesia" had the greatest proportion of the world totals (i.e., 20%), and "Canadian Journal of Anesthesia" had the fifth greatest total world wide (8%).
Across Canada, among 12 cities and 13 universities, most of the original research publications in the principal categories, came from affiliations in Toronto (32% of Canadian total) and the University of Toronto with 19% of the Canadian total. These were followed by Montreal (15%), Vancouver (10%), and the University of Alberta (10%).
Each of the principal categories, "anesthetic", "anesthesia", "analgesic", "analgesia", has 43 subcategories such as "adverse effects", "diagnostic use", "metabolism", "urine". In the Canadian original articles, "pharmacology" was the greatest subcategory (1417%) in each principal category. "Therapeutic use" was the second greatest subcategory in each principal category (1315%). These placings were also the same world wide.
Seventeen local anesthetics were counted and among these "lidocaine" had the greatest number (39%) of Canadian original research publications. This was also true among all the countries world wide (31%).
Seventeen iv anesthetics were also counted, and among these "fentanyl" had the greatest number (30%) and "propofol" the second greatest (26%) of Canadian original research publications, and again this was true world wide (25 and 23% respectively).
Twenty-three non-narcotic analgesics were counted, and among them the broad category of "anti-inflammatory agents, non-steroidal" had by far the greatest number (64%) of Canadian original research articles. The next greatest count (10%) was from "acetaminophen". Again, this was also true world wide (70 and 7% respectively).
Thirty-five analgesic opiates were counted and among these "morphine" and "opium" were tied for the greatest Canadian count (27%) of original research articles. "Fentanyl" was the next greatest Canadian count (19%). World wide, "opium" was first (27%), "morphine" second (22%), and "fentanyl" third (16%).
When all of the principal categories combined were counted with respect to 59 study types (e.g., "clinical trial", "intervention study", "prospective study" etc.), those coded "quality of health care" had the greatest Canadian (15%) and greatest world wide (16%) count of original research articles.
When the categories of "anesthetics", "anesthesia", "analgesics", "analgesia", "anesthesia and analgesia", " anesthesiology", and their diphthong variants there were 916 Canadian publications and 30,009 publications world wide. When this same search strategy was appended to the list of 19 anesthesiology journals there were 263 Canadian publications and 5,431 publications world wide. Thus, only 28.7% of Canadian anesthesiology publications were found in anesthesiology journals, compared with 18.1% world wide.
| Discussion |
|---|
|
|
|---|
Although we have reliably reported the publications that we did retrieve, we cannot be certain that we have retrieved all relevant publications. MEDLARS contains over 19 million entries and we must trust that the National Library of Medicine's PUBMED search engine thoroughly searches the archive.
We believe our quantity survey is accurate because the manual work involved in the MEDLARS retrievals was cross-verified between the Canadian counts and world-wide counts and the search algorithms required were applied systematically with a minimal alteration in search parameters. Manual counting was unnecessary, as MEDLARS provided a count with each retrieval. The principal source of human error is the initial MEDLARS coding of publications upon archiving. In a previous study we found the affiliation coding process to have an error ratio of 1:2100 (0.05%).1
It is possible to retrieve from MEDLARS each author's contributions, or those of all authors within a given institutional department. Thus it is feasible that a survey could be made of the contributions of all Canadian anesthesiologists, if desired. We have not endeavoured to do so because the task would be arduous and too difficult to replicate thereby leaving its results suspect. We recognize that it could be useful to know, for example, the number of anesthesiologists that have never published, the average number of publications among those that do publish, or whether most anesthesiologists are now part of multidisciplinary research teams that publish in non-anesthesiology journals. However, to use MEDLARS to find these numbers would involve scrutinizing each retrieval list while retrieving an uncertain number of strategic variants (e.g., On., Ont., Ontario, Ontario-Canada, NOT Ontario-California, and NOT Ont.-California). Ours was a much simpler process since we used only the global counts.
The determination that only 28.7% of Canadian anesthesiology publications occur in the anesthesiology journals (18.1% world wide) should be viewed with the consideration that 34 search terms in a single pass were required to obtain the result. We cannot confirm that the search engine functioned correctly, however, we did repeat the search with the terms re-arranged and obtained the same results.
Other investigators have attempted to make comparisons between institutions and journals by measuring research output in terms of quantity, quality, or the ratio of quality to quantity (i.e., impact factors).24 Each method is flawed. Quantities can be inflated by subdividing and/or substantively duplicating reports. If citation counts are used, these can be inflated by self-citation, author bias, counting methodology, or continued citation of retracted articles.57 Quality surveys, being subjective, are likely to be more heavily biassed than quantity surveys. We have attempted to have an unbiased census, which is why columns in the included tables are not summed. Since many publications can be categorized to more than one topic within a given table, rather than adjudicate which topic was primary (in order to establish a single count), we counted all categories. Thus, a table grand sum does not correctly represent the total number of publications comprising the table, but a table grand average does correctly represent the average number of publications for a single table topic.
In common usage, any census supplements decisions where need and merit are not obviously apparent. In this regard, our MEDLARS counts may be broadly useful since there is little inherent bias in the counts. We have not employed any weighting strategies, for example, a contribution in a pediatric physiology journal is not counted differently from a contribution in an anesthesia journal. Instead, we have based our counts on the anesthesiology topics defined by the National Library of Medicine's MESH sub-committees. Our counts may also be beneficial in providing medical students, residents, and fellows an awareness of the research trends in this field.
|
|
|
|
|
|
|
|
|
|
| References |
|---|
|
|
|---|
2 Garfield E. Which medical journals have the greatest impact? Ann Intern Med 1986; 105: 31320.
3
Garfield E. How can impact factors be improved? BMJ 1996; 313: 4113.
4 Larson JS, Kershaw R. Rating journals in health care administration by the textbook citation method. Med Care 1993; 31: 105761.[Medline]
5 Campbell FM. National bias: a comparison of citation practices by health professionals. Bull Med Libr Assoc 1990; 78: 37682.[Medline]
6 Gallagher EJ, Barnaby DP. Evidence of methodologic bias in the derivation of the science citation index impact factor. Ann Emerg Med 1998; 31: 836.[Medline]
7
Budd JM, Sievert M, Schultz TR. Phenomena of retraction. Reasons for retraction and citations to the publications. JAMA 1998; 280: 2967.
This article has been cited by other articles:
![]() |
B. C.H. Tsui, L. X.Y. Li, V. Ma, A. M. Wagner, and B. T. Finucane Declining randomized clinical trials from Canadian anesthesia departments?: [Declin des etudes randomisees et controlees des departements d'anesthesie canadiens?]. Can J Anesth, March 1, 2006; 53(3): 226 - 235. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. A.E. Shephard The changing pattern of anesthesia, 1954-2004: a review based on the content of the Canadian Journal of Anesthesia in its first half-century: [La transformation du modele de l'anesthesie, 1954-2004 : une revue fondee sur le contenu du premier demi-siecle du Journal canadien d'anesthesie] Can J Anesth, March 1, 2005; 52(3): 238 - 248. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |