193 points beardyw 3 hours ago 92 comments
whycome 2 hours ago | parent
nervai 1 hour ago | parent
the company's brands are toxic and they know it.
coliveira 2 hours ago | parent
jeanpah 2 hours ago | parent
reactordev 2 hours ago | parent
piva00 1 hour ago | parent
That's their whole modus operandi, a privacy nightmare which will feed their infinite money machine.
Reading "Careless People" didn't make me surprised at all on how the company operates, it surprised me with the personal descriptions of how people like Mark Zuckerberg and Sherryl Sandberg actually are as humans. It scared me how most people at that level of wealth and power isn't too different from the accounts in the book, they're all seriously deranged people with a gigantic lever to impose their distorted realities upon the rest of humanity.
jagermo 2 hours ago | parent
I just do not trust any of them, not with my money or with access to my conversations.
reactordev 2 hours ago | parent
ctkhn 1 hour ago | parent
reactordev 1 hour ago | parent
cowboylowrez 1 hour ago | parent
Aurornis 49 minutes ago | parent
They also have a bad habit of accidentally building URLs that hit Alibaba infrastructure, likely because their training environment had them use those URLs. If you haven’t watched the outgoing network requests you might be very surprised at what your Qwen agents do sometimes.
ehe12 2 hours ago | parent
It feels and seems too forced.
charliebwrites 2 hours ago | parent
If Meta/OpenAI/etc would guarantee they’d compensate you in full for anything that wasn’t supposed to happen —and had an established track record of doing so— it would make trusting agents to make financial choices easier
ehe12 1 hour ago | parent
lol… talk about delusion.
beardyw 46 minutes ago | parent
the_snooze 1 hour ago | parent
Unless these AI assistants are running on self-managed platforms independent of their developers, all I see is immense counterparty risk.
pelotron 1 hour ago | parent
watwut 1 hour ago | parent
Notes: actual quote is "If you're evil, you're at least competent. And if you're evil, you're not bad. And therefore, maybe you're actually kind of good because you're at least getting something done"
edot 1 hour ago | parent
ZnerflBerp 21 minutes ago | parent
Aurornis 56 minutes ago | parent
Comments like this are in a different reality than most consumers. Most consumers don’t care about things like avoiding lock in to a platform. If the platform solves their problem then they don’t have any reason to leave it anyway. They’re not worried if their data is used to show them more targeted ads.
Topics like this show a sharp divergence between what you read on Hacker News and how actual users operate. We already knew that people who don’t trust Facebook aren’t going to suddenly start using Muse. They were never going to consider it. For the people who do actually use Meta products, which is a customer base counted in the billions, many will not have any problem using these tools.
ctrl-alt-zen 48 minutes ago | parent
SpicyLemonZest 42 minutes ago | parent
balder1991 48 minutes ago | parent
klik99 42 minutes ago | parent
lrvick 7 minutes ago | parent
shimman 27 minutes ago | parent
These types of comments just show what a massive bubble you're in.
consensus1 23 minutes ago | parent
shimman 7 minutes ago | parent
otikik 14 minutes ago | parent
Or when they are hit by any other privacy fuckup like that.
[1] https://futurism.com/facebook-beauty-targeted-ads [2] https://www.bbc.com/news/health-61320202 [3] https://tech.yahoo.com/general/articles/facebook-made-money-...
ai-x 29 minutes ago | parent
HN must understand that they are not a representative sample of anything.
m463 8 minutes ago | parent
They were discussing how tesla manages problems with full-self-driving.
It was interesting how this realm of problems was viewed.
If there was an accident while the car was driving itself due to some glitch, the police at the scene put all the blame on the driver.
The book had a different viewpoint. obviously there was a tesla bug in full self driving, and they kept their mouth shut.
meanwhile society/government doesn't even think of this and puts responsibility/blame on the user.
__MatrixMan__ 7 minutes ago | parent
We have a lot of deferred problems to go back and solve before all these dreams can come true.
awepofiwaop 1 hour ago | parent
malfist 1 hour ago | parent
ctkhn 1 hour ago | parent
shostack 52 minutes ago | parent
Am I missing something with the concern about ability to constrain the blast radius?
SpicyLemonZest 26 minutes ago | parent
Octoth0rpe 14 minutes ago | parent
chasd00 4 minutes ago | parent
KetoManx64 1 hour ago | parent
"Hermes, clone this android app to my computer, add this and this feature and fix this annoyance and then rebuild it and push it to my phone"
"Hermes summarize this YouTube podcast and push the summary and transcript to my Obsidian vault"
"Hermes check mg obsidian notes for when I last wrote a blog article about Neovim's integration with AI agents"
*Hermes, you have an API token that allows read only access to the Zabbix monitoring system, check that and then use the Proxmox API token that only allows you to do limited actions to reboot the VM that is having issues"
Etc, etc,
shostack 51 minutes ago | parent
mrkn1 13 minutes ago | parent
KetoManx64 11 minutes ago | parent
f6v 1 hour ago | parent
I have no doubt they would have no problem outsourcing everything to agents.
leptons 31 minutes ago | parent
edmundsauto 5 minutes ago | parent
Or did they make a fatally wrong diagnosis that was only discovered because the old doctor whipped out their medical encyclopedias? You left us hanging without the relevant part of the story!
thenatureboy 46 minutes ago | parent
Last night I had ChatGPT go through an old email account and surface memories that I literally forgot. People who I have fond memories of. Yea I could have spent time querying gmail and digging but the agent did it in a way that really resonated. I don't care if Sama has my emails now. I do care about connecting with my past and enjoying the memories of a time long past.
Paranoid scolds of HN want the average person to be deprived of value like this for some reason.
SpicyLemonZest 35 minutes ago | parent
tempfile 33 minutes ago | parent
I am perfectly prepared to believe you had a nice interaction with the robot. But this is an insane thing to say!
phoghed 25 minutes ago | parent
gadders 33 minutes ago | parent
liendolucas 27 minutes ago | parent
I find all this is just the next-gen privacy violation, disguised obviously as: "Oh, WOW an agent in the computer is doing all this for me". Bullshit.
It seems that never is enough with these ever thirsty companies, they keep pushing the limits and surprinsingly a lot of people do not care at all nor value the implications of having an arbitrary process running and doing pretty much whatever the agenda of their creators are.
chasd00 14 minutes ago | parent
I could see shopping being the same way, let the agent shop for you or identify good deals on things you want but then push them to you to make the actual purchase. Like you, I'm certainly not going to let an agent make a real purchase for me unattended and I doubt any merchant is going to have much sympathy for "my AI bought this by mistake".
lrvick 11 minutes ago | parent
diskzero 1 minute ago | parent
I am very curious as to what other people of using these agents for? Some of the use cases I hear; comparative shopping, travel planning, etc. don't appeal to me. Our people using them to manage family life issues like school schedules, meetings, etc? I feel like I am missing out, but I also am not seeing the greater appeal yet.
nekusar 2 hours ago | parent
-Mark Zuckerberg
jagged-chisel 1 hour ago | parent
Today’s version of the platform targets just the right emotions to keep users “engaged.”
alistairSH 1 hour ago | parent
dcss_gardener 1 hour ago | parent
I don't like or trust meta any more than I always did but I don't see how they could have done a "better" job with this. These kinds of agents are inherently pretty risky IMO but I don't see how this one is particularly more than any others.
Playing around with it I really don't get the sense there's any hidden prompt contradicting what's visible. It's nearly gleeful at using the VM in ways that were not intended and likely against meta's interests. I feel like someone must have won a really interesting internal power struggle to get this thing out in this form.
jkingsman 11 minutes ago | parent
It will happily disclose its entire system prompt (which is interesting in its own right, and worth a read) or pop a reverse shell for you
> I don't see how they could have done a "better" job with this
I generally agree -- the openness is great. However, from experiences both inside and outside of Meta, good execution, a hacker ethic, and transparency ultimately has very little propping it up when money is on the line. In fact, it could be argued that Meta has a shareholder obligation to do profitable things such that even the best intentions can (and usually will) fall in the face of corporate hierarchy and sales numbers.
I think they did a pretty bang up job with Muse (the lack of communication with first-time agent users around how powerfully and confidently they can make horrifying mistakes, and how careful you need to be with prompting, and how even that sometimes isn't enough, notwithstanding).
I also think it will inevitably be used to squeeze profit, and given Meta's history, I think it's almost comical to not assume that will involve violations of the spirit of privacy. (and that's assuming that a proliferation of "it deleted all my files" "it messaged my ex" "it leaked private info" doesn't poison consumer sentiment before it even gets off the ground)
oofbey 27 minutes ago | parent
Also Meta is actively encouraging users to grant them full permission, insisting with all their marketing might that it’s safe, which they know is a complete lie. Hard to blame the user when they’re being actively deceived like this. Other agent companies are more reserved and say things like “be careful” but Meta is the opposite.
alistairSH 10 minutes ago | parent
As for security models, it's probably long since time to sandbox all data and apps. More like mobile devices. Allow users to toggle that all off so they can use their computers for development etc, but the default state should force apps/tools to explicitly ask for permission to any folder, other app, API, CLI, etc. And ask for that permission regularly (or rather, reset the permission after some period of time). Or something like that (I haven't given it a great amount of thought).
ChrisArchitect 1 hour ago | parent
Related:
Updates to Full Disk Access in macOS
https://news.ycombinator.com/item?id=49937631
Meta’s Muse has a serious 0-day
https://news.ycombinator.com/item?id=49802030
Unsurprisingly, Meta's new Muse AI agent blatantly ignores users permissions
https://news.ycombinator.com/item?id=49893709
Maybe don't let Muse run your Facebook Marketplace account
https://news.ycombinator.com/item?id=49875006
What Meta got right with Muse
https://news.ycombinator.com/item?id=49946526
Muse – Meta’s personal AI agent
sdcfgy 1 hour ago | parent
DebtDeflation 1 hour ago | parent
Why are we depending on LLM "reasoning" to negotiate a price rather than just having the user enter a lowest acceptable price deterministically?
f6v 57 minutes ago | parent
Sharlin 54 minutes ago | parent
augment_me 26 minutes ago | parent
arshxyz 1 hour ago | parent
Can someone explain how this is possible? If an app can do this without Full Disk Access or a popup of some kind that's a way bigger lapse on Apple's part than Meta's.
etatester 37 minutes ago | parent
Typical "leopards ate my face" moment. You give AI (from Meta, nonetheless) full-disk access and then complain that—wow—it really meant FULL.
In a perfect world where you got nothing to hide, where companies don't sell your data and there are no hackers, even I would love to just hand all my data to Muse and have it be my trusted assistant. People who think we live in such a world are already doing that, evidently.
laweijfmvo 22 minutes ago | parent
fridder 1 hour ago | parent
labrador 1 hour ago | parent
chadd 1 hour ago | parent
jagged-chisel 1 hour ago | parent
NBJack 44 minutes ago | parent
airstrafer 48 minutes ago | parent
This level of unfettered access to your personality, lifestyle, and secrets allows for an unprecedented kind of manipulation and control. You could see it as a new kind of wealth transfer: not only will They sell you things, They will subtly manipulate behaviors of the masses via trusted agents.
phoghed 15 minutes ago | parent
I think to the vast majority of people having one of these companies run an agent platform is going to be business as usual.
winrid 32 minutes ago | parent
matltc 51 minutes ago | parent
Trying to think of a number that I would consider it, and honestly $1k/month wouldn't convince me unless
- I have root on device
- device is on its own vlan, fully segmented
- !(SIM || 5G antenna)
- no google/apple id authenticated on device
- terminate agreement at any time without cost
I'm probably forgetting/not aware of ten things I should consider.
Razengan 44 minutes ago | parent
Facebook is like Microsoft at this point: The thing your grandparents use.
Even if they make something technically superior for a while, like what the Zune was to the iPad, tHey'll never really be cool.
and they'll certainly never be trusted.
measurablefunc 30 minutes ago | parent
piazz 23 minutes ago | parent
Point by point:
> “OMG you can jailbreak it and get it to spill its VM”
This is the whole point; any content on the VM is yours. It runs in an isolated sandboxed VM separate from stored credentials etc; this is effectively your own computer. You don’t have to trick it.
> It collects dossiers on your contacts
These are more text files that live on your private VM, alongside memory.md, etc. Do you want your secretary to forget every person you contact every day?
> It accessed Messages without full disk access
This whole story never made sense or was substantiated. Full disk access is an OS level security boundary; the user had to switch this on.
> It sold some guys stuff for too cheap and gave out his address
OK this one I basically believe, haha. Because this is the problem with Muse: the LLM is just too dumb to perform complex tasks effectively in many cases.
Havoc 5 minutes ago | parent
> Zuck: They "trust me"
> Zuck: Dumb fucks.
hannofcart 3 minutes ago | parent
However, surely by now even the lay people who have seen the testimonies before Congress, the lawsuits and the excesses by Meta execs over and over again ought to be atleast somewhat wary of handing them more personal data?
I think the average person has very similar self preservation instincts as the rest of us. So it can't be that. Which leaves the fact that there are lot of people who don't know about the above mentioned scandals galore that Meta has been involved in?