The world after COP26

Please note: this exercise is still underway and so this page is still under construction

  1. Purpose
  2. Participants
  3. Process
  4. Instructions
  5. Results
    1. Contents of storylines
    2. Participants’ evaluations
    3. Participants’ relationships
    4. Network structure of storylines
  6. Analysis
    1. Storyline contents
    2. Participant behaviors
  7. Conclusions
  8. Your comments

Purpose

The purpose of this study is:

  1. To explore the usefulness of crowdsourcing participants in a ParEvo exercise, as a way of undertaking more ‘field tests ‘of the ParEvo app.
  2. To explore the effects of involving a second type of participants, known as “Commentators”. These do not participate in the building of the storylines (which is done by the Contributors), but they are allowed to insert Comments on contributions, which Contributors could subsequently read and take in to account, if they wanted to, when writing their next contribution.
  3. To explore the manageability of expanding the number of participants up to 15, from the previous maximum of twelve

Participants

Contributors

The exercise participants were crowdsourced through Prolific.co (an online participant recruitment for surveys and market research). Criteria used to find participants via that platform were:

  • Age: Greater than 20
  • Nationality and place of residence: United Kingdom
  • Education: Undergraduate degree or higher

Once the participants were recruited Prolific.co then provided this additional information on the self-selected participants :

  • Gender: 12 women, 3 men
  • Age: median 26
  • Employment: 7 full-time, 2 part-time, 4 unemployed-seeking work, 2 Not in paid work (e.g. homemaker’, ‘retired or disabled)
  • The average approval rate for submissions in previous prolific.co studies was 99.26%
  • No information about Contributors’ individual identities was made available to anyone, apart from the exercise Facilitator

Commentators (..so far)

  • Three commentators were recruited from the ParEvo Google Groups email list. All had previously expressed interest in the use of ParEvo, and had participated in at least one previous ParEvo exercise.
    • Two men, one women – resident in Australia, Canada and UK respectively
    • No information about Commentators’ individual identities was made available to anyone, apart from the exercise Facilitator

Process

The exercise involves eight iterations (each involving a contributions and comments phase) plus a final evaluation stage. Participants were introduced to the exercise, and to each iteration within the exercise, through the contents of a dedicated Prolific.co web page (as is required). They were then directed to a Survey Monkey survey where they made their contributions to each iteration (again as required by Prolific). On completion, they were returned to another Prolific web page, to have their work contributions reviewed and payments triggered . The participants contributions were then manually entered by the Facilitator into a ParEvo.org exercise and the ParEvo exercise web page was then shared with the Commentators. After their inputs were posted the Contributors were notified of the start of the next iteration. The final evaluation involved the same sequence but used a different Survey Monkey survey page. This is a much more cumbersome process than normal because the participants are being sourced and managed through prolific.co.

All participants were asked to give their consent at the start of each iteration (See the survey instrument link below). All contribution were anonymous, in the eyes of other participants. All participants were paid at a rate above the UK minimum wage rate (per hour), with each iteration being paid for a 30 minute span of time. In practice, the median time spent per participant per iteration was 23 minutes, thus in effect increasing the hourly rate. Aggregated results of the evaluation stage were shared with all participants via this web page, and all participants retained access to the completed exercise on https://www.parevo.org/

Instructions to participants

Pdf copies are available for the following:

Exercise results

Contents

The storylines generated by this exercise can be seen here: https://parevo.org/exercise/public/c016a2b8-bdfc-4c54-9590-1111333253fe

More details will be posted here as the exercise proceeds

Leave a comment or ask a question

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.