Skip to Main Content

Measuring Research Impact in the Sciences

An overview of tools for measuring journal and author metrics

What are Alternative/Emerging Metrics?

Altmetrics attempt to broaden the scope of metrics for scholarly impact beyond the typical article citation counts. Altmetrics focus on other types of usage indicators that are possible to track thanks to modern technology and the internet. These metrics can include journal article indicators (page views, downloads, saves to social bookmarks), social media indicators (tweets, Facebook mentions), non-scholarly indicators (Wikipedia mentions) and more.

Downloads, views, bookmarking, and conversations on social media are all examples of possible emerging metrics to measure a scholar's impact. There are three major players in aggregating and providing altmetrics to researchers: Altmetrics, PlumX and ImpactStory. Each of them track similar metrics, but they are all available in different ways. Other databases, such as PubMed Central (PMC) and Web of Science, are starting to provide their own usage statistics as well.

Altmetric

 

The data that Altmetric gathers is used to calculate an Altmetric score, which is a measure of the quality and quantity of attention that an article has received.  The colors surrounding the number reflect the mix of sources where the article has been mentioned.  A recent article in the Annals of Emergency Medicine describes how the Altmetric score is calculated, and the potential impact and limitations of this score.

You can get Altmetric scores when reading an article on a journal or publisher's website 

Several publishers and journals including Nature Publishing Group and JAMA, provide the Altmetric score.  Look for the Altmetric  donut or  box when viewing articles on a journal or publisher's site.

 

You can also use the free Altmetric bookmarklet, which allows you to get Altmetric details when reading an article online.  Due to the methods that Altmetric uses to gather data, the bookmarklet may not work for every article.

CINAHL: PlumX

Plum Analytics recently partnered with EBSCO and their product, PlumX, is now embedded into CINAHL results

PlumX â€‹categorizes metrics into 5 types:

  • Usage
    • clicks, downloads, views, library holdings, video plays
  • Captures
    • bookmarks, code forks, favorites, readers, watchers
  • Mentions
    • blog posts, comments, reviews, Wikipedia links
  • Social Media
    • +1s, likes, shares, tweets
  • Citations
    • citation indexes, patent citations, clinical citations

Now, in addition to seeing the usual "times cited" for an article in CINAHL, you may also be able to see how many times the abstract was viewed, how many times the article's pdf was requested through link-outs (find it buttons), how many times the record was exported or saved, how many times and to which citation management system the citation was saved, and if the article has been shared on social media.

To see how it works, run a search in CINAHL and look for a result that has the PlumX Metrics widget:

 

By hovering over the widget you can see a brief summary of metrics for the article:

 

If you click on see details, you will be taken to a separate page with an expanded view of the metrics for that article:

 

Images in this section from: Juhl, B. (2016). "Pulling out a Plum: PlumX Metrics in CINAHL." University of Arkansas 365 McIlroy Blog. https://librariesblog.uark.edu

PMC Usage Statistics

Once an article is made publicly available in PMC, you can go to NIHMS and see

  • The number of users who have accessed an article 
  • times the article was accessed in a specific format (Full Text or PDF) will be available in NIHMS once an article is made publicly available in PMC.  
  • Note: Data is only available for articles submitted through NIHMS.  Statistics are limited to PMC usage and do not include access from a publisher's site or anywhere else the article may be posted.

 

Find PMC Access Statistics in NIHMS

  • Log in to NIHMS. 
  • Click the Available in PMC tab on the Manuscript List page.
  • A list of articles that are currently available in PMC will be displayed. 
    • Articles that are in process in NIHMS or under embargo do not have usage statistics and therefore, will not appear on this list.
  • Click the PMC access statistics link in the Status column of a record to view access statistics.

ImpactStory

An individual's Impactstory profile supplies raw metrics and 'badges' for each research product.  The badges provide context for the metrics by indicating how a product has performed in both the scholarly and public arenas, compared to similar products in the same discipline.  

 

To create your own ImpactStory profile:

  • Join for free with an ORCID (Open Researcher and Contributor ID)
  • Journal articles, data sets, slides, and other research products can be added to your profile by entering a digital object identifier (DOI), PMID or URL, or imported from Google Scholar, ORCID, Figshare and other sources.