October Article

A Teenager on Tik Tok Disrupted Thousands of Scientific Studies With a Single Video.

By SurveyBeta

Published 10/1/21

 

The July 23rd video is short and simple. It opens with recent Florida high school graduate and self-described “teen author” Sarah Frank sitting in her bedroom and smiling at the camera. “Welcome to side hustles I recommend trying — part one,” she says in the video, pointing users t​o the website Prolific.co. “Basically, it’s a bunch of surveys for different amounts of money and different amounts of time.” That video got 4.1 million views in the month after it was posted and sent tens of thousands of new users flooding to the Prolific platform. Prolific, a tool for scientists conducting behavioral research, had no screening tools in place to make sure that it delivered representative population samples to each study. Suddenly, scientists used to getting a wide mix of subjects for their Prolific studies saw their surveys flooded with responses from young women around Frank’s age.

 

The smaller platform offers more transparency, promises to treat survey participants more ethically, and promises higher-quality research subjects than alternative platforms like Mechanical Turk. Scientists doing this sort of research in the United States generally want a pool of subjects who speak English as a first language, are not too practiced at taking psychological surveys, and together make up a reasonably representative demographic sample of the American population. Prolific, most agreed, did a good job providing high-quality subjects. The sudden change in the platform’s demographics threatened to upend that reputation. In the days and weeks after Frank posted her video, researchers scrambled to figure out what was happening to their studies. A member of the Stanford Behavioral Laboratory posted on a Prolific forum, “we have noticed a huge leap in the number of participants on the platform in the US Pool, from 40k to 80k. Which is great, however, now a lot of our studies have a gender skew where maybe 85% of participants are women. Plus the age has been averaging around 21.”

 

Articles Home/What are QR Codes and How to Make Them for Surveys