Selection bias in Vox pop interviews
Selection bias in Vox pop interviews
This struck me when the BBC visited my constituency, and the town of Buxton.
They were there in the middle of a weekday, which meant people with jobs would have been under-represented.
If you're asking questions about the attitude to Brexit, you're likely to get, and present a skewed impression of the local sentiment.
Whether this is unconscious selection bias or, simply a way of making a more provocative story, I'm not sure, but it probably does affect the debate.
They were there in the middle of a weekday, which meant people with jobs would have been under-represented.
If you're asking questions about the attitude to Brexit, you're likely to get, and present a skewed impression of the local sentiment.
Whether this is unconscious selection bias or, simply a way of making a more provocative story, I'm not sure, but it probably does affect the debate.
Have you considered stupidity as an explanation
- Woodchopper
- Princess POW
- Posts: 7144
- Joined: Sat Oct 12, 2019 9:05 am
Re: Selection bias in Vox pop interviews
Yes. The people walking down the high street on a weekday afternoon and agree to be interviewed definitely won't be a representative sample.
If a TV producer were to take the time they could construct a narrative based upon the actual demographic profile of the constituency. But it'll be easier just to interview people they accost until they get something that'll pull in the viewers.
If a TV producer were to take the time they could construct a narrative based upon the actual demographic profile of the constituency. But it'll be easier just to interview people they accost until they get something that'll pull in the viewers.
- individualmember
- Catbabel
- Posts: 654
- Joined: Mon Nov 11, 2019 4:26 pm
Re: Selection bias in Vox pop interviews
Yebbut that’s not how tv works. I mean it can if you’re making a documentary and spending a couple of months on it, but 99% of the time the crew shlepping about trying to get members of the public to talk to them are sent out at probably 9-ish in the morning (or after a production meeting at 11-ish) * and have to deliver their selection, edited into a package, to the producer (in his/her nice warm office) by teatime.Woodchopper wrote: ↑Wed Nov 13, 2019 8:35 amIf a TV producer were to take the time they could construct a narrative based upon the actual demographic profile of the constituency. But it'll be easier just to interview people they accost until they get something that'll pull in the viewers.
ETA * then waste an hour trying to work out why the camera isn’t receiving sound from the microphone and trying to find a spare battery that actually has some charge in it and a mIni LED lamp that works and deciding to give up on those and hope the sun shines and the battery lasts.
- Woodchopper
- Princess POW
- Posts: 7144
- Joined: Sat Oct 12, 2019 9:05 am
Re: Selection bias in Vox pop interviews
Certainly, so to go back to the op, the people who appear on vox pop segments are unlikely to represent the population in the area.individualmember wrote: ↑Wed Nov 13, 2019 8:44 amYebbut that’s not how tv works. I mean it can if you’re making a documentary and spending a couple of months on it, but 99% of the time the crew shlepping about trying to get members of the public to talk to them are sent out at probably 9-ish in the morning (or after a production meeting at 11-ish) * and have to deliver their selection, edited into a package, to the producer (in his/her nice warm office) by teatime.Woodchopper wrote: ↑Wed Nov 13, 2019 8:35 amIf a TV producer were to take the time they could construct a narrative based upon the actual demographic profile of the constituency. But it'll be easier just to interview people they accost until they get something that'll pull in the viewers.
ETA * then waste an hour trying to work out why the camera isn’t receiving sound from the microphone and trying to find a spare battery that actually has some charge in it and a mIni LED lamp that works and deciding to give up on those and hope the sun shines and the battery lasts.
- individualmember
- Catbabel
- Posts: 654
- Joined: Mon Nov 11, 2019 4:26 pm
Re: Selection bias in Vox pop interviews
I agree entirely. You have what people are going to be outside at the time and which of those are willing to talk on camera before you even get to how the questions are framedWoodchopper wrote: ↑Wed Nov 13, 2019 12:15 pmCertainly, so to go back to the op, the people who appear on vox pop segments are unlikely to represent the population in the area.
Re: Selection bias in Vox pop interviews
Surely these days you don't even need to send a camera crew out, you just hoik some spiel from twitter.
- Stephanie
- Stummy Beige
- Posts: 2902
- Joined: Wed Sep 25, 2019 4:38 pm
- Location: clinging tenaciously to your buttocks
Re: Selection bias in Vox pop interviews
Do we have any stats on the groups who voted for Brexit (employed, retired, etc)?
"I got a flu virus named after me 'cause I kissed a bat on a dare."
Re: Selection bias in Vox pop interviews
There might be some in this.
The half-truths, repeated, authenticated themselves.
- Stephanie
- Stummy Beige
- Posts: 2902
- Joined: Wed Sep 25, 2019 4:38 pm
- Location: clinging tenaciously to your buttocks
Re: Selection bias in Vox pop interviews
"I got a flu virus named after me 'cause I kissed a bat on a dare."
- Vertigowooyay
- Snowbonk
- Posts: 423
- Joined: Mon Nov 11, 2019 1:25 pm
Re: Selection bias in Vox pop interviews
Calm yourself Doctor NotTheNineO’ClockNews. We’re men of science. We fear no worldly terrors.
Re: Selection bias in Vox pop interviews
I did that to someone once, sadly it was pre-recorded for radio rather than live for TV, so I'm sure it got binned.Vertigowooyay wrote: ↑Thu Nov 14, 2019 2:25 pmBut this is rather good...
https://twitter.com/i/status/1194376085812760576
I got grabbed outside a railway station during some period or other of rail carnage and proceeded to tell the woman how actually I think the service was quite good and how they do a decent job given the circumstances. It was not what she was fishing for.
- individualmember
- Catbabel
- Posts: 654
- Joined: Mon Nov 11, 2019 4:26 pm
Re: Selection bias in Vox pop interviews
A few years ago I was walking along Oxford Street with my brother when we were approached for a vox pop, I declined and nipped behind the camera but my brother said sure... the question was about public sector finance for the arts, so my brother gave them a very earnest explanation of why funding is so important, then said 'and if that's not what you're after....' and gave them a very earnest argument as to why it's a terrible idea. I've no idea whether either was used.
Re: Selection bias in Vox pop interviews
I think the current PM did something similar about 4 years agoindividualmember wrote: ↑Thu Nov 14, 2019 3:33 pmA few years ago I was walking along Oxford Street with my brother when we were approached for a vox pop, I declined and nipped behind the camera but my brother said sure... the question was about public sector finance for the arts, so my brother gave them a very earnest explanation of why funding is so important, then said 'and if that's not what you're after....' and gave them a very earnest argument as to why it's a terrible idea. I've no idea whether either was used.
My avatar was a scientific result that was later found to be 'mistaken' - I rarely claim to be 100% correct
ETA 5/8/20: I've been advised that the result was correct, it was the initial interpretation that needed to be withdrawn
Meta? I'd say so!
ETA 5/8/20: I've been advised that the result was correct, it was the initial interpretation that needed to be withdrawn
Meta? I'd say so!
- Woodchopper
- Princess POW
- Posts: 7144
- Joined: Sat Oct 12, 2019 9:05 am