Published on September 18, 2014
Raising your research profile Evidence of exposure: measuring your research IMPACT Research Support Team
By the end of the session you will be able to: • Understand the role of research impact metrics • Identify and apply relevant metrics to your research • Create alerts to monitor the continued impact of your research • Understand the potential of social media (and alternative metrics) to increase research impact 18 September 2014 2
Research impact metrics (Bibliometrics) what are they? • A quantifiable way of measuring research output (beyond the traditional peer-review process) • They can be used to measure the impact of many aspects of research (research groups, universities, journals and individuals) • Found in a variety of places: Scopus, Web of Science, Google Scholar etc. • Traditionally impact measured by the ‘quality’ of where you publish – now there is marked move towards article levels metrics (ALMs) • Based on citations of your papers • h-index most commonly used for measuring individuals. 18 September 2014 3
Where to find citation information about your papers • Google Scholar • Web Of Science • Scopus 18 September 2014 4
Get notified when you get cited: setting up alerts • Google Scholar – Setting up Google Scholar profile will enable you to track when your work is cited http://scholar.google.co.uk/intl/en/scholar/citations.html 18 September 2014 5
Scopus alerts • Register for a personal account for Scopus / go to your author page / select either Follow this Author or Get citation alerts • You can also create citation alerts for your individual papers 18 September 2014 6
Web of Science alerts • Register for a personal account / perform an author search / go to search history and save search – you then get the option to set up alert • Citation alerts for individual papers 18 September 2014 7
What is the h-index? • Developed by Professor Jorge E. Hirsch • h short for highly cited or Hirsch • Measures the impact and quantity of an individual’s research performance i.e. their body of work (unaffected by other factors). • Enables easier evaluation of authors within specific subject area • Can helps publishers find new reviewers • Can help predict future success (Hirsch 2007) - could help with funding applications /employment. • Recognised way of showing impact. 18 September 2014 8 h-index
How it works • Based on a formula A scientist has index h if h of his numbers of papers (NP) have at least h citations each and his other papers (NP-h) have fewer then h citations each. 18 September 2014 9
Where to find your h-index Web of Science (via a Citation report) 18 September 2014 10
Scopus (via ‘Author Search’) 18 September 2014 11
Google Scholar 18 September 2014 12
Which h-index to use? • Variants are due to different source data. – WOS includes references of an author regardless of whether cited items are indexed by WOS or not. – Scopus only provides citation data for items indexed by it. – Google Scholar indexes free abstract data, from open access sources such as institutional repositories, personal websites. Supports disciplines are supported better than others (Computing, Mathematics etc.) due to limited content in traditional databases. • The one that gives you the HIGHEST score! 18 September 2014 13
Things to note • h values will vary between subject disciplines (so this must be considered when comparing authors). • No accounting for age – a more seasoned researcher could potentially have higher h-index as he has had a longer to publish and be cited. • Check for currency – a researcher may have a high h-index but may not have published for some time and conversely an active (new) researcher may have a low h-index (but of course may has the potential to be cited in the future.) • h-index is only applicable to traditional research outputs (articles, conference proceedings) • It can’t capture influence on public policy, improved global health etc. 18 September 2014 14
Alternative metrics (or Altmetrics): what are they? • They “expand our view of what impact looks like, but also of what’s making the impact.” (Altmetrics manifesto, 2011 http://altmetrics.org/manifesto/) • New(ish) way of measuring scholarly impact beyond traditional citation counting in the online environment. • They can reflect the broader social impact of research (a different view of the influence of your work) • They capture social media references to scholarly output and can reflect public/social engagement • They are more timely than traditional metrics – can quickly see impact quickly (citation data takes time to accrue). • Also include PDF downloads and information about abstract/article views. 18 September 2014 15
Examples of Altmetric tools • Impact Story creates a metrics report for your articles, data sets, slides, software, or webpages. 16 • Altmetric Labels articles with an altmetrics score, which is a volume,
Altmetric Labels articles with a quantitative measure of the quality and quantity of attention that a scholarly article has received. 18 September 2014 17
PLoS article level metrics Available for all articles published by PLOS. 18 September 2014 18
ResearchGate 18 September 2014 19
Altmetrics and you • They can offer a more nuanced insight into impact – enabling you to see if your article is being read and discussed. • Can demonstrate the influence of your research on a more diverse audience (not just academics) practitioners, educators, general public etc. • Public engagement can help engaging with funding, securing employment/promotion and being accountable. • They can complement traditional citation metrics. • For early career researchers (or those changing direction) you can showcase impact earlier. 18 September 2014 20
References & further reading • Ael 2, [online]. Wikipedia. Available at: http://en.wikipedia.org/wiki/File:H-index-en.svg [Accessed 19th February 2014]. • Bar-Ilan, J., 2008. Which h-index?—A comparison of WoS, Scopus and Google Scholar. Scientometrics, 74 (2), 257-271. Available at: http://188.8.131.52/hindex/pdf/Bar-Ilan2008.pdf [Accessed 5th August 2014]. • Google Scholar coverage: http://scholar.google.co.uk/intl/en/scholar/metrics.html#coverage • Hirsch, J.E., 2007. Does the H index have predictive power? Proceedings of the National Academy of Sciences of the United States of America, 104 (49), 19193-19198. Available at: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2148266/ [Accessed 06/08/2014]. • Hirsch, J.E., 2005. Proceedings of the National Academy of Sciences of the United States of America, 102 (46), 16569- 16572. An index to quantify an individual's scientific research output. Available at: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1283832/?iframe=true&width=100%25&height=100%25 [Accessed 19th February 2014]. • Neylon, C. and Wu, S., 2009. Article-level metrics and the evolution of scientific impact. PLoS Biology, 7 (11), e1000242. Available at: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1000242 [Accessed 06/08/2014]. • Piwowar, H., 2013. Introduction altmetrics: What, why and where? Bulletin of the American Society for Information Science and Technology, 39 (4), 8-9. Available at: http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.pdf [Accessed 5th August 2014]. • Piwowar, H. and Priem, J., 2013. The power of altmetrics on a CV. Bulletin of the American Society for Information Science and Technology, 39 (4), 10-13. Available at: http://www.asis.org/Bulletin/Apr-13/AprMay13_Piwowar_Priem.pdf [Accessed 5th August 2014]. 18 September 2014 21
Further help • Scopus tutorials • Web of Science help pages • Setting up your Google Scholar profile • h-index variants • List of alternative metrics tools 18 September 2014 22
Raising Your Research Profile and Measuring Your ... Profile and Measuring Your Impact: Impact ... Ways of Assessing the Research Value of ...
Raising Your Research Profile and Measuring Your ... " The Impact of Social Media on ... Use to share a research profile as well as track your citations ...
... as well as setting up and managing your research profiles. ... measures may also change depending on the purpose for measuring research impact.
examining the effects of the physical environment ... children’s exposure to chronic stress. The research outlined ... exposure to risk. What You ...
Measuring the Impact of Microfinance ... Until recently there has been very little rigorous evidence to ... This project investigates a randomized impact ...
See also Levels of Evidence. These study designs ... Observational studies investigate and record exposures ... The Levels of Evidence help you to target ...
Validity and reliability of measurement instruments ... viewers requires evidence that any ... your research. 2.
Validity of Your Survey ... a relationship between what you are measuring and ... with observational research you can’t control for ...