Scrutable

bob sterman wrote: ↑

Mon Oct 23, 2023 7:53 pm

Statistical associations between cues in images - and aspects of people's lives. Our lives are not as unique as we think. Many people have probably had their first kiss at the same romantic spot, tripped and fallen in the same stream, broken the same gadget, had the same recipe go wrong in the same way etc.

Or - social media - events in your life may be on social media even if you didn't put them there yourself.

discovolante wrote: ↑

Mon Oct 23, 2023 8:06 pm

bob sterman wrote: ↑

Mon Oct 23, 2023 7:53 pm

Statistical associations between cues in images - and aspects of people's lives. Our lives are not as unique as we think. Many people have probably had their first kiss at the same romantic spot, tripped and fallen in the same stream, broken the same gadget, had the same recipe go wrong in the same way etc.

Or - social media - events in your life may be on social media even if you didn't put them there yourself.

ChatGPT claims not to scrape data from social media etc, which is why people are getting upset I think.

discovolante wrote: ↑

Mon Oct 23, 2023 7:18 pm

You all may know about this, but apparently people are asking ChatGPT to do things e.g. describe a photo, tell a story etc and it is giving answers that could only be created if it had personal knowledge of the individual or their friends, family, location etc. But when they then tell ChatGPT what they think it's doing, it denies it and says it's just a coincidence, etc. Has this been reported on?

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:33 pm

discovolante wrote: ↑

Mon Oct 23, 2023 7:18 pm

You all may know about this, but apparently people are asking ChatGPT to do things e.g. describe a photo, tell a story etc and it is giving answers that could only be created if it had personal knowledge of the individual or their friends, family, location etc. But when they then tell ChatGPT what they think it's doing, it denies it and says it's just a coincidence, etc. Has this been reported on?

The problem with it having scraped massive amounts of personal data has been widely reported.

ChatGPT can’t lie because it doesn’t know what the truth is. It just identifies patterns.

Either that response has been hard coded if anyone asks about the data, or ChatGPT has learnt from its human sources that claiming something is a coincidence is how humans respond to such questions.

discovolante wrote: ↑

Mon Oct 23, 2023 8:06 pm

bob sterman wrote: ↑

Mon Oct 23, 2023 7:53 pm

Statistical associations between cues in images - and aspects of people's lives. Our lives are not as unique as we think. Many people have probably had their first kiss at the same romantic spot, tripped and fallen in the same stream, broken the same gadget, had the same recipe go wrong in the same way etc.

Or - social media - events in your life may be on social media even if you didn't put them there yourself.

ChatGPT claims not to scrape data from social media etc, which is why people are getting upset I think.

Admission: Señor von Laté perhaps unwisely tried this by uploading a photo of 3 of our friends sitting outside, with a bit of tree in the background but not much else, and asked it to tell a story based on the photo. It got all 3 of their names (the middle one was a more Scottish Gaelic spelling but the other two were identical), the country (Scotland), and some personality features that were probably more likely to be coincidental, although still a bit odd. One of them isn't on social media at all but does get referred to in photos the other uploads onto Facebook (they are a couple).

discovolante wrote: ↑

Mon Oct 23, 2023 8:37 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:33 pm

discovolante wrote: ↑

Mon Oct 23, 2023 7:18 pm

You all may know about this, but apparently people are asking ChatGPT to do things e.g. describe a photo, tell a story etc and it is giving answers that could only be created if it had personal knowledge of the individual or their friends, family, location etc. But when they then tell ChatGPT what they think it's doing, it denies it and says it's just a coincidence, etc. Has this been reported on?

The problem with it having scraped massive amounts of personal data has been widely reported.

ChatGPT can’t lie because it doesn’t know what the truth is. It just identifies patterns.

Either that response has been hard coded if anyone asks about the data, or ChatGPT has learnt from its human sources that claiming something is a coincidence is how humans respond to such questions.

So the last paragraph is the main thing I guess, if it's hard coded why are they continuing to lie; if it's learned behaviour they presumably haven't figured out how to address this but the result seems to be making people even more mad with it. Although maybe they're a small minority of users.

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:37 pm

discovolante wrote: ↑

Mon Oct 23, 2023 8:06 pm

bob sterman wrote: ↑

Mon Oct 23, 2023 7:53 pm

Statistical associations between cues in images - and aspects of people's lives. Our lives are not as unique as we think. Many people have probably had their first kiss at the same romantic spot, tripped and fallen in the same stream, broken the same gadget, had the same recipe go wrong in the same way etc.

Or - social media - events in your life may be on social media even if you didn't put them there yourself.

ChatGPT claims not to scrape data from social media etc, which is why people are getting upset I think.

Admission: Señor von Laté perhaps unwisely tried this by uploading a photo of 3 of our friends sitting outside, with a bit of tree in the background but not much else, and asked it to tell a story based on the photo. It got all 3 of their names (the middle one was a more Scottish Gaelic spelling but the other two were identical), the country (Scotland), and some personality features that were probably more likely to be coincidental, although still a bit odd. One of them isn't on social media at all but does get referred to in photos the other uploads onto Facebook (they are a couple).

A face is a unique bio-marker. My phone recognises mine pretty reliably. If a person’s name and face are linked anywhere on the internet then OpenAI (ChatGPT’s creator) will have scraped the data. That includes employers staff pages, local news stories, blogs, Flickr etc

discovolante wrote: ↑

Mon Oct 23, 2023 8:50 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:37 pm

discovolante wrote: ↑

Mon Oct 23, 2023 8:06 pm

ChatGPT claims not to scrape data from social media etc, which is why people are getting upset I think.

Admission: Señor von Laté perhaps unwisely tried this by uploading a photo of 3 of our friends sitting outside, with a bit of tree in the background but not much else, and asked it to tell a story based on the photo. It got all 3 of their names (the middle one was a more Scottish Gaelic spelling but the other two were identical), the country (Scotland), and some personality features that were probably more likely to be coincidental, although still a bit odd. One of them isn't on social media at all but does get referred to in photos the other uploads onto Facebook (they are a couple).

A face is a unique bio-marker. My phone recognises mine pretty reliably. If a person’s name and face are linked anywhere on the internet then OpenAI (ChatGPT’s creator) will have scraped the data. That includes employers staff pages, local news stories, blogs, Flickr etc

Two of them probably don't have much online at all but of course there's a good chance there's something somewhere.

If you think my questions are silly, we showed this to someone else and he suggested we write a letter of complaint

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:09 pm

discovolante wrote: ↑

Mon Oct 23, 2023 8:50 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:37 pm

A face is a unique bio-marker. My phone recognises mine pretty reliably. If a person’s name and face are linked anywhere on the internet then OpenAI (ChatGPT’s creator) will have scraped the data. That includes employers staff pages, local news stories, blogs, Flickr etc

Two of them probably don't have much online at all but of course there's a good chance there's something somewhere.

If you think my questions are silly, we showed this to someone else and he suggested we write a letter of complaint

Not silly at all. If you were in the US you might join the class action lawsuit.

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:37 pm

A face is a unique bio-marker. My phone recognises mine pretty reliably. If a person’s name and face are linked anywhere on the internet then OpenAI (ChatGPT’s creator) will have scraped the data. That includes employers staff pages, local news stories, blogs, Flickr etc

philbo wrote: ↑

Mon Oct 23, 2023 9:12 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:37 pm

A face is a unique bio-marker. My phone recognises mine pretty reliably. If a person’s name and face are linked anywhere on the internet then OpenAI (ChatGPT’s creator) will have scraped the data. That includes employers staff pages, local news stories, blogs, Flickr etc

A face is by no means a unique bio-marker: as biometrics go, it's a reasonable assumption in a small data set - your phone recognizing your face is verification rather than identification; as cold searching goes, facial recognition is awful - useful as part of MFA, but lousy as an identifier. I'm not aware of anyone who has it reliably working to identify within a general population: police love the idea of it but get amazingly frustrated that it doesn't work like ANPR for people - if you have it scanning for too many people, it'll give you so very many suggestions to look at

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:20 pm

philbo wrote: ↑

Mon Oct 23, 2023 9:12 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 8:37 pm

A face is a unique bio-marker. My phone recognises mine pretty reliably. If a person’s name and face are linked anywhere on the internet then OpenAI (ChatGPT’s creator) will have scraped the data. That includes employers staff pages, local news stories, blogs, Flickr etc

A face is by no means a unique bio-marker: as biometrics go, it's a reasonable assumption in a small data set - your phone recognizing your face is verification rather than identification; as cold searching goes, facial recognition is awful - useful as part of MFA, but lousy as an identifier. I'm not aware of anyone who has it reliably working to identify within a general population: police love the idea of it but get amazingly frustrated that it doesn't work like ANPR for people - if you have it scanning for too many people, it'll give you so very many suggestions to look at

OK. But then how is it identifying disco's friends from a photograph? Or perhaps it is all a coincidence.

bob sterman wrote: ↑

Mon Oct 23, 2023 9:33 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:20 pm

philbo wrote: ↑

Mon Oct 23, 2023 9:12 pm

A face is by no means a unique bio-marker: as biometrics go, it's a reasonable assumption in a small data set - your phone recognizing your face is verification rather than identification; as cold searching goes, facial recognition is awful - useful as part of MFA, but lousy as an identifier. I'm not aware of anyone who has it reliably working to identify within a general population: police love the idea of it but get amazingly frustrated that it doesn't work like ANPR for people - if you have it scanning for too many people, it'll give you so very many suggestions to look at

OK. But then how is it identifying disco's friends from a photograph? Or perhaps it is all a coincidence.

I assume it was 3 first names?

If thousands of people upload photos you'll get some triple matches - and hear about them. But the thousands for whom there weren't 3 matches won't be posting online about this.

If there are cues to the country, time period (clothes) and age (so year of birth) of the people in the photos - this gives statistical information on the probability of certain names.

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:37 pm

bob sterman wrote: ↑

Mon Oct 23, 2023 9:33 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:20 pm

OK. But then how is it identifying disco's friends from a photograph? Or perhaps it is all a coincidence.

I assume it was 3 first names?

If thousands of people upload photos you'll get some triple matches - and hear about them. But the thousands for whom there weren't 3 matches won't be posting online about this.

If there are cues to the country, time period (clothes) and age (so year of birth) of the people in the photos - this gives statistical information on the probability of certain names.

Sounds plausible if the names are relatively common.

bob sterman wrote: ↑

Mon Oct 23, 2023 9:33 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:20 pm

philbo wrote: ↑

Mon Oct 23, 2023 9:12 pm

A face is by no means a unique bio-marker: as biometrics go, it's a reasonable assumption in a small data set - your phone recognizing your face is verification rather than identification; as cold searching goes, facial recognition is awful - useful as part of MFA, but lousy as an identifier. I'm not aware of anyone who has it reliably working to identify within a general population: police love the idea of it but get amazingly frustrated that it doesn't work like ANPR for people - if you have it scanning for too many people, it'll give you so very many suggestions to look at

OK. But then how is it identifying disco's friends from a photograph? Or perhaps it is all a coincidence.

I assume it was 3 first names?

If thousands of people upload photos you'll get some triple matches - and hear about them. But the thousands for whom there weren't 3 matches won't be posting online about this.

If there are cues to the country, time period (clothes) and age (so year of birth) of the people in the photos - this gives statistical information on the probability of certain names.

discovolante wrote: ↑

Mon Oct 23, 2023 9:50 pm

bob sterman wrote: ↑

Mon Oct 23, 2023 9:33 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:20 pm

OK. But then how is it identifying disco's friends from a photograph? Or perhaps it is all a coincidence.

I assume it was 3 first names?

If thousands of people upload photos you'll get some triple matches - and hear about them. But the thousands for whom there weren't 3 matches won't be posting online about this.

If there are cues to the country, time period (clothes) and age (so year of birth) of the people in the photos - this gives statistical information on the probability of certain names.

So you're suggesting some sort of bias? I suppose it's possible, but it seems quite a coincidence to get three in a row. Apparently there were less than 100 people born with one of the people's names in this country in their year of birth, but it is also quite a traditional name (I'm revealing quite a lot here aren't I?!). There were also less than 100 of one of the others in their year of birth (I've edited this to be more vague because it's too easy to look up, even though that ship has clearly sailed by now otherwise I wouldn't have started this thread!). To be honest, I feel like data scraping seems like a more plausible reason than a coincidence.

dyqik wrote: ↑

Mon Oct 23, 2023 9:47 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:37 pm

bob sterman wrote: ↑

Mon Oct 23, 2023 9:33 pm

I assume it was 3 first names?

If thousands of people upload photos you'll get some triple matches - and hear about them. But the thousands for whom there weren't 3 matches won't be posting online about this.

If there are cues to the country, time period (clothes) and age (so year of birth) of the people in the photos - this gives statistical information on the probability of certain names.

Sounds plausible if the names are relatively common.

It doesn't sound that plausible.

Country/first language, age and time maybe narrows it to maybe 50 common names per gender if all the persons are from the same race/country/background. To get a triple match, the odds would be 3C50 = 1:19,600. If one or more of the names is unusual, if there's more than one set of common names represented (due to first language/race/background) or some of those clues are ambiguous or missing, then that goes way way up (as in Disco's example).

bob sterman wrote: ↑

Tue Oct 24, 2023 7:28 am

dyqik wrote: ↑

Mon Oct 23, 2023 9:47 pm

Woodchopper wrote: ↑

Mon Oct 23, 2023 9:37 pm

Sounds plausible if the names are relatively common.

It doesn't sound that plausible.

Country/first language, age and time maybe narrows it to maybe 50 common names per gender if all the persons are from the same race/country/background. To get a triple match, the odds would be 3C50 = 1:19,600. If one or more of the names is unusual, if there's more than one set of common names represented (due to first language/race/background) or some of those clues are ambiguous or missing, then that goes way way up (as in Disco's example).

Remember if 19,600 people upload a photo - it is probably only the 1 person who got an uncanny triple name match who posts on an internet forum about the experience. The other 19,599 don't or may upload another photo and keep doing so until they get something uncanny.

Recently, the app stopped giving Mr. Mosen information about people’s faces, saying they had been obscured for privacy reasons. He was disappointed, feeling that he should have the same access to information as a sighted person.

The change reflected OpenAI’s concern that it had built something with a power it didn’t want to release.

The company’s technology can identify primarily public figures, such as people with a Wikipedia page, said Sandhini Agarwal, an OpenAI policy researcher, but does not work as comprehensively as tools built for finding faces on the internet, such as those from Clearview AI and PimEyes. The tool can recognize OpenAI’s chief executive, Sam Altman, in photos, Ms. Agarwal said, but not other people who work at the company.

Making such a feature publicly available would push the boundaries of what was generally considered acceptable practice by U.S. technology companies. It could also cause legal trouble in jurisdictions, such as Illinois and Europe, that require companies to get citizens’ consent to use their biometric information, including a faceprint.

Additionally, OpenAI worried that the tool would say things it shouldn’t about people’s faces, such as assessing their gender or emotional state. OpenAI is figuring out how to address these and other safety concerns before releasing the image analysis feature widely, Ms. Agarwal said.

Woodchopper wrote: ↑

Tue Oct 24, 2023 7:30 am

bob sterman wrote: ↑

Tue Oct 24, 2023 7:28 am

dyqik wrote: ↑

Mon Oct 23, 2023 9:47 pm

It doesn't sound that plausible.

Country/first language, age and time maybe narrows it to maybe 50 common names per gender if all the persons are from the same race/country/background. To get a triple match, the odds would be 3C50 = 1:19,600. If one or more of the names is unusual, if there's more than one set of common names represented (due to first language/race/background) or some of those clues are ambiguous or missing, then that goes way way up (as in Disco's example).

Remember if 19,600 people upload a photo - it is probably only the 1 person who got an uncanny triple name match who posts on an internet forum about the experience. The other 19,599 don't or may upload another photo and keep doing so until they get something uncanny.

The key data then is whether this has only happened to one in 19 000 photo uploaders (or the chances for different images), or whether its more common. We could try this out ourselves.