Please note: this exercise is still underway and so this page is still under construction
- Your comments
The purpose of this study is:
- To explore the usefulness of crowdsourcing participants in a ParEvo exercise, as a way of undertaking more ‘field tests ‘of the ParEvo app.
- To explore the effects of involving a second type of participants, known as “Commentators”. These do not participate in the building of the storylines (which is done by the Contributors), but they are allowed to insert Comments on contributions, which Contributors could subsequently read and take in to account, if they wanted to, when writing their next contribution.
- To explore the manageability of expanding the number of participants up to 15, from the previous maximum of twelve
- Age: Greater than 20
- Nationality and place of residence: United Kingdom
- Education: Undergraduate degree or higher
Once the participants were recruited Prolific.co then provided this additional information on the self-selected participants :
- Gender: 12 women, 3 men
- Age: median 26
- Employment: 7 full-time, 2 part-time, 4 unemployed-seeking work, 2 Not in paid work (e.g. homemaker’, ‘retired or disabled)
- The average approval rate for submissions in previous prolific.co studies was 99.26%
- No information about Contributors’ individual identities was made available to anyone, apart from the exercise Facilitator
Commentators (..so far)
- Three commentators were recruited from the ParEvo Google Groups email list. All had previously expressed interest in the use of ParEvo, and had participated in at least one previous ParEvo exercise.
- Two men, one women – resident in Australia, Canada and UK respectively
- No information about Commentators’ individual identities was made available to anyone, apart from the exercise Facilitator
The exercise involves eight iterations (each involving a contributions and comments phase) plus a final evaluation stage. Participants were introduced to the exercise, and to each iteration within the exercise, through the contents of a dedicated Prolific.co web page (as is required). They were then directed to a Survey Monkey survey where they made their contributions to each iteration (again as required by Prolific). On completion, they were returned to another Prolific web page, to have their work contributions reviewed and payments triggered . The participants contributions were then manually entered by the Facilitator into a ParEvo.org exercise and the ParEvo exercise web page was then shared with the Commentators. After their inputs were posted the Contributors were notified of the start of the next iteration. The final evaluation involved the same sequence but used a different Survey Monkey survey page. This is a much more cumbersome process than normal because the participants are being sourced and managed through prolific.co.
All participants were asked to give their consent at the start of each iteration (See the survey instrument link below). All contribution were anonymous, in the eyes of other participants. All participants were paid at a rate above the UK minimum wage rate (per hour), with each iteration being paid for a 30 minute span of time. In practice, the median time spent per participant per iteration was 23 minutes, thus in effect increasing the hourly rate. Aggregated results of the evaluation stage were shared with all participants via this web page, and all participants retained access to the completed exercise on https://www.parevo.org/
Instructions to participants
Pdf copies are available for the following:
- Instructions for the first iteration
- Instructions for the following iterations
- Survey Monkey evaluation survey instrument *(Draft)
The storylines generated by this exercise can be seen here: https://parevo.org/exercise/public/c016a2b8-bdfc-4c54-9590-1111333253fe
More details will be posted here as the exercise proceeds