Stakeholder Involvement in Evaluation: Does it Effect Observers’ Perceptions of an Evaluation? And Which Stakeholder Group(s) Do People Prefer to Participate?

Stakeholders are often involved in evaluation, such as in the selection of specific research questions and the interpretation of results. Except for the topic of whether stakeholder involvement increases use, a paucity of research exists to guide practice regarding stakeholders.

Objectives: We address two questions: (1) If a third-party observer knows stakeholders were involved in an evaluation, does that affect the perceived credibility, fairness, and relevance of the evaluation? (2) Among individuals with a possible stake in an evaluation, which stakeholder group(s) do they want to see participate; in particular, do they prefer that multiple stakeholder groups, rather than a single group, participate?

Research Design: Six studies are reported. All studies address the former question, while Studies 3 to 5 also focus on the latter question. To study effects of stakeholder involvement on third-party views, participants read summaries of ostensible evaluations, with stakeholder involvement noted or not. To examine a priori preferences among potential stakeholders, participants completed a survey about alternative stakeholder group involvement in an evaluation in which they would likely have an interest.

Results and Conclusions: Across studies, effects of reported stakeholder participation on third-parties’ views were not robust; however, small effects on perceived fairness sometimes, but not always, occurred after stakeholder involvement and its rationales had been made salient. All surveys showed a large preference for the involvement of multiple, rather than single stakeholder groups. We discuss implications for research and practice regarding stakeholder involvement, and for research on evaluation more generally.

Melvin M. Mark et al, Stakeholder Involvement in Evaluation: Does it Affect Observers’ Perceptions of an Evaluation? And Which Stakeholder Group(s) Do People Think Should to Participate?, Evaluation Review (, ) pp. . Copyright © 2021. DOI: 10.1177/0193841x211055937. Users who receive access to an article through a repository are reminded that the article is protected by copyright and reuse is restricted to non-commercial and no derivative uses. Users may also download and save a local copy of an article accessed in an institutional repository for the user's personal reference. For permission to reuse an article, please follow our Process for Requesting Permission.

Files

Metadata

Work Title Stakeholder Involvement in Evaluation: Does it Effect Observers’ Perceptions of an Evaluation? And Which Stakeholder Group(s) Do People Prefer to Participate?
Access
Open Access
Creators
  1. Melvin M. Mark
  2. Julian B. Allen
  3. Joshuah L. Goodwin
Keyword
  1. Stakeholder
  2. Participatory evaluation
  3. Research on evaluation
License In Copyright (Rights Reserved)
Work Type Article
Publisher
  1. SAGE Publications
Publication Date June 2021
Publisher Identifier (DOI)
  1. 10.1177/0193841x211055937
Source
  1. Evaluation Review
Deposited May 23, 2022

Versions

Analytics

Collections

This resource is currently not in any collection.

Work History

Version 1
published

  • Created

    May 23, 2022 16:34 by Scholarly Communications and Copyright

  • Added Stakeholders Revision CLEAN FIN-1.docx

    May 23, 2022 16:34 by Scholarly Communications and Copyright

  • Added Creator Melvin M. Mark

    May 23, 2022 16:34 by Scholarly Communications and Copyright

  • Added Creator Julian B. Allen

    May 23, 2022 16:34 by Scholarly Communications and Copyright

  • Added Creator Joshuah L. Goodwin

    May 23, 2022 16:34 by Scholarly Communications and Copyright

  • Published

    May 23, 2022 16:34 by Scholarly Communications and Copyright

  • Updated Description Show Changes

    May 26, 2022 09:45 by pmk5516

    Description
    • <jats:sec><jats:title>Background</jats:title><jats:p> Stakeholders are often involved in evaluation, such as in the selection of specific research questions and the interpretation of results. Except for the topic of whether stakeholder involvement increases use, a paucity of research exists to guide practice regarding stakeholders. </jats:p></jats:sec><jats:sec><jats:title>Objectives</jats:title><jats:p> We address two questions: (1) If a third-party observer knows stakeholders were involved in an evaluation, does that affect the perceived credibility, fairness, and relevance of the evaluation? (2) Among individuals with a possible stake in an evaluation, which stakeholder group(s) do they want to see participate; in particular, do they prefer that multiple stakeholder groups, rather than a single group, participate? </jats:p></jats:sec><jats:sec><jats:title>Research Design</jats:title><jats:p> Six studies are reported. All studies address the former question, while Studies 3 to 5 also focus on the latter question. To study effects of stakeholder involvement on third-party views, participants read summaries of ostensible evaluations, with stakeholder involvement noted or not. To examine a priori preferences among potential stakeholders, participants completed a survey about alternative stakeholder group involvement in an evaluation in which they would likely have an interest. </jats:p></jats:sec><jats:sec><jats:title>Results and Conclusions</jats:title><jats:p> Across studies, effects of reported stakeholder participation on third-parties’ views were not robust; however, small effects on perceived fairness sometimes, but not always, occurred after stakeholder involvement and its rationales had been made salient. All surveys showed a large preference for the involvement of multiple, rather than single stakeholder groups. We discuss implications for research and practice regarding stakeholder involvement, and for research on evaluation more generally. </jats:p></jats:sec>
    • Stakeholders are often involved in evaluation, such as in the selection of specific research questions and the interpretation of results. Except for the topic of whether stakeholder involvement increases use, a paucity of research exists to guide practice regarding stakeholders.
    • Objectives:
    • We address two questions: (1) If a third-party observer knows stakeholders were involved in an evaluation, does that affect the perceived credibility, fairness, and relevance of the evaluation? (2) Among individuals with a possible stake in an evaluation, which stakeholder group(s) do they want to see participate; in particular, do they prefer that multiple stakeholder groups, rather than a single group, participate?
    • Research Design:
    • Six studies are reported. All studies address the former question, while Studies 3 to 5 also focus on the latter question. To study effects of stakeholder involvement on third-party views, participants read summaries of ostensible evaluations, with stakeholder involvement noted or not. To examine a priori preferences among potential stakeholders, participants completed a survey about alternative stakeholder group involvement in an evaluation in which they would likely have an interest.
    • Results and Conclusions:
    • Across studies, effects of reported stakeholder participation on third-parties’ views were not robust; however, small effects on perceived fairness sometimes, but not always, occurred after stakeholder involvement and its rationales had been made salient. All surveys showed a large preference for the involvement of multiple, rather than single stakeholder groups. We discuss implications for research and practice regarding stakeholder involvement, and for research on evaluation more generally.
  • Updated Keyword Show Changes

    May 26, 2022 09:52 by pmk5516

    Keyword
    • Stakeholder, Participatory evaluation, Research on evaluation