Going beyond counts: understanding impact

100 %
0 %
Information about Going beyond counts: understanding impact
Technology

Published on February 20, 2014

Author: kristiholmes

Source: slideshare.net

Description

Webinar: Librarians & #altmetrics: tools, tips and use cases

Altmetrics are becoming an integral part of looking at the impact and reach of research. Tracking social and online outlets, altmetrics provide quick feedback from a wide range of sources. In this webinar, library experts will discuss how altmetrics work, tools available, and the application of altmetrics in a range of institutions and for various user groups. What steps should librarians be taking to incorporate altmetrics into their workflows and reports? - See more at: http://libraryconnect.elsevier.com/articles/2014-01/webinar-librarians-altmetrics-tools-tips-and-use-cases#sthash.Lfdao6rU.dpuf

Kristi Holmes Bioinformaticist Washington University in St. Louis Going beyond counts: understanding impact Webinar #LCwebinar

http://icts.wustl.edu/ Translational Research The bench to the bedside and beyond Webinar Going beyond counts: understanding impact Kristi Holmes

Why do we need to think about research impact? • Quantify and document research impact • Justify future requests for funding • Quantify return on research investment • • Discover how research findings are being used • • Identify similar research projects • Identify possible collaborators • Determine if research findings are duplicated, confirmed, corrected, improved or repudiated https://becker.wustl.edu/impact-assessment/model Going beyond counts: understanding impact • • • • • Determine if research findings were extended (different human populations, different animal models/species, etc.) Confirm that research findings were properly attributed/credited Demonstrate that research findings are resulting in meaningful health outcomes Discover community benefit as a result of research findings Progress reports Tenure Promotion dossiers Webinar Kristi Holmes

How do we think about productivity? Don’t knock publications • Citations – Rates and rankings – Networks – Dissemination patterns • • • • Collaboration Dissemination Grant funding Research trends Webinar http://www.philnel.com/2010/10/14/procrastigrading/ Going beyond counts: understanding impact Kristi Holmes

…but there’s so much more! Webinar http://www.philnel.com/2010/10/14/procrastigrading/ Going beyond counts: understanding impact Kristi Holmes

Research Impact “It is no longer enough to measure what we can – we need to measure what matters.” So how do we measure what matters? Webinar Wells R, Whitworth A. 2007. Assessing outcomes of health and medical research: do we measure what counts or count what we can measure? Australia and New Zealand Health Policy, 4:14 Going beyond counts: understanding impact Kristi Holmes

Going beyond the counts to find meaningful impact In everyone’s CV, we’ll find • Reviews • New funding awarded • New types of funding mechanisms • New research studies • Invited lectures, new focus areas at conferences • Membership on committees • Awards Consider specific pathways* to uncover meaningful impact…  Advancement of Knowledge  Clinical Implementation  Legislation and Policy Enactment  Economic Benefit  Community Benefit *can be adapted to reflect any number of disciplines Webinar Going beyond counts: understanding impact Kristi Holmes

Going beyond the counts to find meaningful impact • New diagnostic criteria • • • • • • • • • http://icts.wustl.edu/ • http://icts.wustl.edu/ Going beyond counts: understanding impact New standard of care Curriculum guidelines Measurement instruments Continuing education materials Clinical/practice guidelines Quality measure guidelines Private healthcare benefit plans Cost-effective intervention Consensus development conferences American Medical Association Current Procedural Terminology (CPT) codes Change in delivery of healthcare services Webinar Kristi Holmes

Slide title https://becker.wustl.edu/impact-assessment Going beyond counts: understanding impact Webinar Kristi Holmes

The Becker Model • Provides a supplement to publication analysis to provide a more robust and comprehensive perspective of biomedical research impact. – reporting templates, glossary of resources and terms, examples of relevant indicators of impact across the research process, and readings • Straightforward framework for tracking diffusion of research outputs and activities to locate indicators that demonstrate evidence of biomedical research impact – individual, core, and institutional-level; modify for different disciplines • Guidance for quantifying and documenting research impact as well as resources for locating evidence of impact. • Strategies for enhancing the impact of research Webinar Going beyond counts: understanding impact Kristi Holmes

Strategies for enhancing the impact of research Optimizing discoverability and access of your research is the surest way to enhance its visibility and impact. The strategies focus upon Preparing for Publication, Dissemination, and Keeping Track of Your Research. Repetition, consistency, and an awareness of the intended audience form the basis of most the strategies. Suggestions for researchers and recommendations to reach out to their library for assistance. Webinar https://becker.wustl.edu/impact-assessment/strategies Going beyond counts: understanding impact Kristi Holmes

Understanding the impact of a single paper can be challenging. How do we understand the impact of a person? A research center? A university? How do we scale up and operationalize this process? Webinar Going beyond counts: understanding impact Kristi Holmes

Research networking and discovery systems • • • • • Enable more efficient means of collecting & representing meaningful outputs en masse Showcase achievements and expertise Facilitate diffusion of research products Support team-based science and collaboration Allow better understanding of the research enterprise – Peer comparisons – Strategic planning – Emerging trends Webinar Going beyond counts: understanding impact Kristi Holmes

What is VIVO? 1. An open source semantic web application 2. An information model 3. An open community* * A big, welcoming OS community! Let us know if you have questions or need information, connections, or materials: http://vivoweb.org/contact Going beyond counts: understanding impact Webinar Kristi Holmes

Tying it all together Continue to represent typical profile information – absolutely! Enhance profiles by incorporating meaningful outputs, as described by the Becker Model or other frameworks, to enhance their content and value http://vivo.ufl.edu/display/n86607 Going beyond counts: understanding impact Can facilitate the dissemination of scholarship and more Webinar Kristi Holmes

Tying it all together PlumX supports VIVO 1. Aggregate information about our researchers 2. Harvest research outputs from the profile 3. Plum’s harvesting engine calculates metrics and provides both an analytics dashboard as well as visualizations. 4. Widgets can be embedded back into the VIVO profile! http://blog.plumanalytics.com/post/57707501083/plumx-now-supports-vivo Going beyond counts: understanding impact Webinar Kristi Holmes

Tying it all together http://vivo.ufl.edu/display/n86607 FigShare, lab notebooks, project outputs, code/data repositories SlideShare, etc. PlumX supports VIVO 1. Aggregate information about our researchers 2. Harvest research outputs from the profile 3. Plum’s harvesting engine calculates metrics and provides both an analytics dashboard as well as visualizations. 4. Widgets can be embedded back into the VIVO profile! Webinar http://blog.plumanalytics.com/post/57707501083/plumxnow-supports-vivo Going beyond counts: understanding impact Kristi Holmes

Acknowledgements Thanks: • • • • Cathy Sarli, MLS, AHIP Karen Gutzman – NLM Fellow Jae Allen Washington University ICTS and WU ICTS Tracking & Evaluation Team • Andrea Michalek at Plum @amichalek • VIVO Community @VIVOcollab • Becker Medical Library Funding: • Washington University Institute of Clinical and Translational Sciences, NIH award UL1 RR024992 • VIVO - DuraSpace Webinar Going beyond counts: understanding impact Kristi Holmes

Add a comment

Related presentations

Related pages

Going beyond bibliometric and altmetric counts to ...

Home > Articles > Going beyond bibliometric and altmetric counts to understand impact.
Read more

Articles | Library Connect

Read articles from librarians on their experience with library marketing, information literacy, research impact, research data, bibliometrics and ...
Read more

PLOS ONE: The Pagerank-Index: Going beyond Citation Counts ...

... Going beyond Citation Counts in Quantifying Scientific Impact of ... because it is able to go beyond mere citation counts and rewards ...
Read more

The Pagerank-Index: Going beyond Citation Counts in ...

... Going beyond Citation Counts in Quantifying Scientific Impact of ... considers not only the number of citations but also the actual impact of each ...
Read more

Understanding Early Retirement of Combined Heat and Power ...

Understanding Early Retirement of Combined Heat and Power (CHP) Systems: Going Beyond First Year Impacts ... Metered data compiled for impacts evaluation ...
Read more

Going beyond the data - Cutting Through Complexity | KPMG | US

To gain a more concrete understanding of the ... It is widely anticipated that big data will impact ... Going beyond the data: ...
Read more

Session 5 Feelings Count: Emotions and Learning

Session 5 Feelings Count: Emotions and Learning ... emotions have an impact on learning. ... are going through a divorce, ...
Read more

Beyond Hangovers - Publications & Multimedia | National ...

Beyond Hangovers: Understanding alcohol’s impact on your health. ... NIAAA: Understanding the impact of alcohol on human health and well-being ...
Read more

Going Beyond Words, the Arapaho Immersion Program

Going Beyond Words: The Arapaho ... is not having well defined examples and a clear understanding of methods that can ... nine colors, count to ...
Read more

Clinical Trial Patient-Reported Outcomes Data Going Beyond ...

Going Beyond the Label in Oncology Yanni Hao, ... and health-related quality of life impacts. ... can lead to a better understanding of what is impor-
Read more