177 points forthwall 2 hours ago 170 comments
minimaxir 2 hours ago | parent
Did OpenAI do a marketing bit in the middle of an espionage accusation?
xvxvx 2 hours ago | parent
orangecat 2 hours ago | parent
MisterMunchkin 2 hours ago | parent
arm32 1 hour ago | parent
SpicyLemonZest 1 hour ago | parent
arm32 1 hour ago | parent
SpicyLemonZest 1 hour ago | parent
jaredwiener 1 hour ago | parent
SpicyLemonZest 1 hour ago | parent
KazaNLP 1 hour ago | parent
seydor 1 hour ago | parent
"almost surely made in china"
mrandish 1 hour ago | parent
Yes, they did. The people who felt it was totally normal to add that would no doubt be surprised how desperate and cheap it makes them look.
brrwind 26 minutes ago | parent
tamimio 57 minutes ago | parent
frangonf 22 minutes ago | parent
dfxm12 18 minutes ago | parent
jacquesm 16 minutes ago | parent
Plumb your video feed of your executive conference room into our DC and we'll tell you if anybody is spying on you.
rvz 2 hours ago | parent
Either way, there goes the false flag and the reason for companies to stop hiring humans over this espionage.
int32_64 2 hours ago | parent
Good time to start a company that builds giant Faraday cages over data centers.
iAMkenough 1 hour ago | parent
pianopatrick 57 minutes ago | parent
Free cooling, safe from missile attack, and safe from some types of electronic spying.
hlieberman 46 minutes ago | parent
Still a significantly less dumb idea than space data centers.
paimapi 46 minutes ago | parent
pianopatrick 16 minutes ago | parent
morkalork 54 minutes ago | parent
pjc50 45 minutes ago | parent
The alignment people would like you worry about the model exfiltrating itself, too.
IncreasePosts 31 minutes ago | parent
jacquesm 14 minutes ago | parent
"Oh, let me download file 'companysecrets.pdf' to understand the problem better.
Of course nobody would ever let an agent loose in their home directory, but still, you have to wonder.
0xCMP 7 minutes ago | parent
We are going to be dealing with this kind of thing for a very long time at this rate.
Razengan 2 hours ago | parent
delichon 1 hour ago | parent
Abdulrahman Alfozan, 35, a Saudi national, was arrested Friday and charged with using or attempting to use a device to intercept oral communications.
https://news.ycombinator.com/item?id=50078141Isaackoz 1 hour ago | parent
ChrisArchitect 1 hour ago | parent
dang 1 hour ago | parent
I_am_tiberius 1 hour ago | parent
2OEH8eoCRo0 1 hour ago | parent
iAMkenough 1 hour ago | parent
I was making a joke, but it does look like they got their components from Seeed Studio based on photos.
https://assets.sfstandard.com/image/994911177489/image_k101c...
m4rtink 1 hour ago | parent
0cf8612b2e1e 1 hour ago | parent
Back of a TV is a decent hiding place. Wonder how they found it -was it actively transmitting?
to11mtm 1 hour ago | parent
Unless you mean, it happened to be actively transmitting during a(n investigative) sweep.
Still, raises some fun concepts. The sort of things where in this current level of technology you'd almost need to supercool a room for a sweep, blast various RF/sound/etc and look for anything that even remotely warms up, to detect (1) whether something detected something worth recording for later as well as (2) something that might be on the right wavelength/etc to trigger a send.
[0] - https://en.wikipedia.org/wiki/The_Thing_(listening_device)
TacticalCoder 1 hour ago | parent
Concealing a recording device in a conference room in toilet paper is a bit strange. Do executives meet in the toilets to discuss strategic moves?
ReptileMan 43 minutes ago | parent
charcircuit 1 hour ago | parent
gizmodo59 1 hour ago | parent
gorgoiler 1 hour ago | parent
(Or maybe you stall them on the phone while scribbling a note to your PA saying “BUG STORY LEAKED TO VALLEYWAG PUT OUT COUNTER PR GET AGEAD OF STORY” hoping to get a tweet out before the ValleyWag gumshoe gets off the phone.)
(Or maybe you keep a notion.so page pre-filled with all your secrets and each one has a BURN button next to it, ready for you to tap when ValleyWag call up for a comment on their upcoming exposé in re: PR/Disasters/20206090500039.md)
binlog 1 hour ago | parent
testfrequency 1 hour ago | parent
This isn’t uncommon, but it’s rare this info is shared in such detail publicly..possibly to make an example.
simonw 42 minutes ago | parent
> “For us it is a matter of national security,” U.S. Attorney Craig Missakian said in a statement. [...]
> The case is being prosecuted by the National Security, Cyber & Special Prosecutions Section of the U.S. attorney’s office for the Northern District of California.
(But that was after OpenAI "referred the matter to the FBI")
There's presumably a strong argument for making this stuff known internally, since you want other employees to a) be on the lookout for it and b) get scared into NOT doing it themselves because someone else got caught.
If you tell your employees, the outside world is going to hear about it too.
TZubiri 32 minutes ago | parent
vostrocity 1 hour ago | parent
Aboutplants 1 hour ago | parent
vostrocity 1 hour ago | parent
paimapi 42 minutes ago | parent
Certainly they would be transparent and very ethical with something like that
jacquesm 12 minutes ago | parent
mohamedkoubaa 7 minutes ago | parent
binlog 1 hour ago | parent
But no the boring answer is that after they found the device they left it in place and planted the camera to see who came looking for it.
vostrocity 1 hour ago | parent
JumpCrisscross 50 minutes ago | parent
“OpenAI personnel found the device Sept. 3…On Oct. 5, the complaint says, Alfozan entered the conference room and appeared to look behind the television.”
The image was captured after the bug was found.
Imnimo 1 hour ago | parent
_DeadFred_ 1 hour ago | parent
clustrfunk 1 hour ago | parent
throwa356262 1 hour ago | parent
Remember kids, uncle Sam can see anything you tell your AI and will use that against you.
binlog 58 minutes ago | parent
redox99 53 minutes ago | parent
catchnear4321 52 minutes ago | parent
ramraj07 49 minutes ago | parent
We also don’t know if this person did it under duress.
robotnikman 40 minutes ago | parent
He was a Saudi national, so that is a possibility
10xDev 47 minutes ago | parent
sdcfgy 45 minutes ago | parent
There’s plenty of better people out there who just aren’t interested in that sort of stuff.
schiffern 38 minutes ago | parent
>how does someone this dumb get hired
Using AI to pass the interview of course! I wish I was joking...It's AI inbreeding all the way down.
browningstreet 26 minutes ago | parent
nilamo 18 minutes ago | parent
But that's crazy talk
tcdent 56 minutes ago | parent
The justice.gov article doesn't specifically say it was an OpenAI account, but I think, based on the fact that they have logs including MAC address of the device, that we could probably assume that. The alternative is that other chatbot account providers are collaborating.
Regardless, doing a string search on a MAC address for a device you find inside your property doesn't strike me as an abuse of the data that is also your property.
schiffern 50 minutes ago | parent
>submitted prompts... including its custom header and unique MAC
Sounds more like he put the exact MAC address in a prompt somewhere while setting it up.gip 50 minutes ago | parent
Barrin92 47 minutes ago | parent
catchnear4321 53 minutes ago | parent
exe34 27 minutes ago | parent
ReptileMan 20 minutes ago | parent
Aurornis 52 minutes ago | parent
They can confiscate your computers, too.
This person, of all people, would know this. He really thought he’d never get caught.
netsharc 41 minutes ago | parent
I wonder if the BaaS-providers monitor the accounts of decision makers. They could profit if they figure out what e.g. a central banker is going to decide. Or... if they're the ones deciding for him.
Hah, you can even streamline that by having an AI agent that autonomously makes decisions based on insider info...
IncreasePosts 36 minutes ago | parent
TZubiri 34 minutes ago | parent
godwinson__4-8 17 minutes ago | parent
I actually am curious if they were able to volunteer the information to the government of their own volition, without a government subpoena first. I would think that could violate their own terms if done sloppily. Maybe different if an employee or maybe they had to invite the government to ask for them or something? In any case, the mechanism aside, the state would have asked anyway (say if he used another company's chatbot) so the fact that it's the "same company" is rather irrelevant. The evidence would have ended up in the state's hands one way or the other, and I would think a search warrant in this case would have been rather routine. Search warrants are infamously not a high bar to climb in most jurisdictions, as often the presiding judges tend to default to deferring to the state.
godwinson__4-8 23 minutes ago | parent
Not just your AI.
You could have stopped the sentence at "uncle Sam can see anything" and these days it's pretty much true. They will use all of it against you if they can. Unless you truly want to live off the grid, if the state takes a sufficient interest in you, expect everything you do to be seen.
Uncle Sam tried to get MLK to kill himself by sending him letters alleging knowledge of an affair [1]. Getting some idiot's wife's chatgpt logs represents a fairly routine law enforcement action these days, and as such is really rather unremarkable. The State is always something of a terror. Really under most (if not all) conceptions, it necessarily has to be. The monopoly of force is a comfort until the Leviathan knocks on your door.
hosel 15 minutes ago | parent
ReptileMan 21 minutes ago | parent
qkaze15 56 minutes ago | parent
catchnear4321 55 minutes ago | parent
BeetleB 49 minutes ago | parent
https://www.propublica.org/article/saudi-fugitives-accused-o...
tamimio 47 minutes ago | parent
It looks like it’s the (SeeedStudio XIAO ESP32S3 Sense w/ WiFi, BLE, OV2640, Mic) https://ca.robotshop.com/products/seeedstudio-xiao-esp32s3-s...
Which is just an esp32s3 based device. I assume the word “sophisticated” in openAI report is just copy paste from device description.
simonw 44 minutes ago | parent
> A chatbot account tied to Alfozan’s spouse, which shared identifiers with his own account, submitted prompts between Sept. 24 and Sept. 30 about building, installing, obscuring, and remotely accessing a recording device, prosecutors said. Queries included how to “build a continuous audio recorder” and “encrypt the SD card,” prosecutors claimed. On Sept. 27 and 28, the account asked about the specific device that was later found, including its unique MAC address.
ajross 40 minutes ago | parent
TZubiri 35 minutes ago | parent
What might tilt the bayesian balance in favour of political intent would be the nationality of the individual, state or religious sponsoring become hypotheses.
ajross 25 minutes ago | parent
adamm255 40 minutes ago | parent
EGreg 26 minutes ago | parent
It’s like thinking about edge cases in programming…
Most people are totally not like that. And it does force you into some difficult choices.
jacquesm 20 minutes ago | parent
I gots to know...
teiferer 19 minutes ago | parent
The choice is whether to hang out with people with whom you can't be sure they don't have a Plaud/Pocket/.. in their literal pocket which is continuously listening.
Unfortunately the set of such people will eventually be shrinking more and more until eventually only a few tinfoil folks are left. Dystopian? Just think back w.r.t. continuous tracking by Google/Facebook/.. Unthinkable 30 years ago, total standard today. Try to count the fraction of your emails that don't actually reside on a MSFT or Google server because the other end has an account there. That fight is over. You can just as well join them.
10xDev 25 minutes ago | parent
teiferer 25 minutes ago | parent
Or at the border where it is already routine to ask for social media accounts (especially foreign nationals) you might someday five the border agent your login.
binlog 20 minutes ago | parent
“I did not kill my wife!”
“Cool so why did you search for how to hide a dead body the same day she went missing?”
darepublic 3 minutes ago | parent
TZubiri 39 minutes ago | parent
I wonder what the IQ of someone needs to be to think that covering it up with tp makes it less suspicious instead of more. And I also wonder what the hiring process was like to hire someone with that mental frame.
MisterMunchkin 37 minutes ago | parent
natpalmer1776 32 minutes ago | parent
msdz 34 minutes ago | parent
Remember, this is only the company responsible for potentially building and aligning AGI. No need to be setting high expectations toward their sandboxing or hiring capabilities.
cm2187 30 minutes ago | parent
AaronAPU 26 minutes ago | parent
afavour 12 minutes ago | parent
What, we’re supposed to vet everyone we network with at orgies now?
ReptileMan 35 minutes ago | parent
kalkin 26 minutes ago | parent
contingencies 25 minutes ago | parent
nilamo 23 minutes ago | parent
janalsncm 34 minutes ago | parent
andai 28 minutes ago | parent
stvltvs 17 minutes ago | parent
andai 29 minutes ago | parent
solyin 29 minutes ago | parent
United857 26 minutes ago | parent
> An unattended bag found in the company’s offices contained Alfozan’s wallet and identification, as well as a recording device
It’s almost like he wanted to be caught…
areoform 21 minutes ago | parent
When the Soviets wanted to spy on the American embassy, they energized the steel rebars to act as antennas. The structure was so wired that the entire building was the bug. https://www.airandspaceforces.com/PDF/MagazineArchive/Docume...
Toilet paper, ESP-32 and Claude "make me a bug please"? Excuse me? How far have we fallen from grace?
pennomi 18 minutes ago | parent
JumpCrisscross 14 minutes ago | parent
Assuming this is espionage—for which I have seen zero evidence—isn’t Saudi Arabia notorious for having a fuckup of an intelligence operation? The literal hatchet job that was the Khashoggi murder comes to mind.
TeMPOraL 9 minutes ago | parent
And not do this from your spouse's account.
tdeck 7 minutes ago | parent
afavour 14 minutes ago | parent
sippingabonedry 5 minutes ago | parent
Somehow they think this gives them superpowers when it's built atop a tower of borderline retardation.
Remember the Apple guy a minute ago that arrogantly thought he could bypass their security?
hoppp 3 minutes ago | parent
nfw2 40 minutes ago | parent
...uh what
simonw 40 minutes ago | parent
I expect Meta are running an audit right now to figure out if he was involved in espionage back then as well.
VBprogrammer 29 minutes ago | parent
CamperBob2 28 minutes ago | parent
Sounds like we know where their priorities lie, anyway.
jacquesm 18 minutes ago | parent
mrandish 17 minutes ago | parent
While the headlines and quotes seem designed to imply sophisticated industrial espionage, potentially by a state-level actor, what's public so far isn't adding up that way.
1. You're not going to get much actionable research material on proprietary technologies by audio bugging what's said in an executive conference room. That's what you'd do if you were after economic or deal negotiation info.
2. Hard to imagine a state-level actor buying a ~$15-$35 hobbyist ESP32 board from Seeed Studio (I've ordered a couple from there for home automation myself) and then asking a public chatbot for set up instructions.
3. They say he was an "engineer" who'd been there ~15 months. If you're an actual engineer at OAI and past the 1 year cliff, you're probably already sitting on RSUs likely to be worth at least $1M after OAI's IPO - and maybe much more. That's a lot of incentive to not get fired and probably makes you pretty hard to recruit as an internal mole for cash.
clueless 13 minutes ago | parent
but I guess the $1 million was not incentive enough to not commit a dumb insider trading scheme...
binlog 7 minutes ago | parent
2. An operation can be state-sponsored and still amateurish/botched. We have seen plenty of examples of these. Remember a certain bone saw?
3. The incentive can be a lot more than financial. Plenty of governments are very…persuasive.
chews 17 minutes ago | parent
Topfi 4 minutes ago | parent
I'll be the first one to admit, that got a hearty laugh out of me. Never miss an opportunity to market your models I guess.