Is modal running every single service inside gvisor?
I have heard that gvisor isn't recommended to run every single production but rather only some front facing or some other activities but it has some serious performance degradation which is why most end up using firecracker
This is really cool though, does this mean that we could probably have AI models that are snapshotted?
Are the states of checkpoint/recovery encrypted by default or how would that even work? Like what are the privacy aspects of it. I don't think even using something like modal would be the private llm that many people sometimes want on subreddits like localllama but the people dont have gpu. of course nothing beats privacy if you have your own gpu's but I'd be curious to know what people's thoughts are
the thing is modal is running untrusted containers, so there's not really a concept of "some front facing" containers. Any container running an untrusted workload is at high risk / is "front facing".
If Modal's customers' workloads are mainly GPU-bound, then the performance hit of gvisor isn't as big as it might be for other workloads. GPU activity does have to go through the fairly heavyweight nvproxy to be executed on the host, but most gpu activity is longer-lived async calls like running kernels so a bit of overhead in starting / retrieving the results from those calls can be tolerated.
Okay something's wrong with Mistral Large as it seems to be the most contrarian out of everything no matter how much I ask it. Interesting
I asked a lot of questions and I am sorry if it might be burning some tokens but I found this website really fascinating.
This seems really great and simple to explore the biases within AI models and the UI is extremely well built. Thanks for building it and I wish your project good wishes from my side!
I'm not sure this actually means anything, though. Like, what information is being taken into account to reach their conclusions? How are they reaching their conclusions? Is someone messing with the input to make the models lean in a certain direction? Just knowing which ones said yes and which ones said no doesn't provide a whole lot of information.
This might explain why there are sooooooooo many vps providers/cloud providers, this might be one valid reason as to why.
I am sure that this might not be the only reason but still, its a valid reason for many. Do you know of companies/people which do this and how widespread this practise is?
To me it still feels like malicious compliance tho for what its worth.
I said this in jest as a reaction to what post-tax SWE salaries in Europe top out at, all while the same companies have no problem burning insane money on vendors. There is zero incentive to do good work as an employee as it won't be compensated anywhere near what even a shoddy vendor gets paid.
But given the rise of many SaaSes selling exactly the same thing every full-stack web framework used to provide for free - think Auth0, Okta, etc, it may very well be happening.
To be really honest, I share a similar stance to you overall but I would still admit that there is some partial truth to it
I would like to expand this not only to foreign state actors that people mention but also companies inside which are actively trying to do nefarious stuff
As an example, Tobacco industry knew that the damages were there but they still tried to spur up medical confusion around it all so that people would still think that medical discussion is going on when it was 100% clear that tobacco harms. Who knows how many people died
The man who discovered that washing hands saved lives was so ridiculed and I think met with hostility because doctors couldn't comprehend the idea that it was they would could spread diseases. This is decades before germ theory was invented
His name is Ignaz Semmelweis and the world was unjust to him. Doctors ridiculed and threatend him and he was labelled obsessive and doctors called it mere coincidence. His career crumbled as he was forced out of vienna/his hospital and his mental health deteriorated as his warnings were ignored
in 1865 Semmelwise was commited to an asylum where he died just two weeks later at age 47
Only after pasteur developed germ theory and lester pioneered antisceptic surgery, semmelwise was finally vindicated.
This simple practise of handwashing is now considered the most basic medical standard worldwide saving countless millions of lives in the process.
(I had to write it by hand here basically transcribing this really amazing video that I watched about such a topic, I would highly suggest watching it)
There is a big difference between danger for democracy because of these addiction farming Social media platforms with propaganda and something like piracy as well though.
Yes (sort of), but the definition of best has changed so drastically built on completely different benchmarks (engagement)
As an example, watch a really good documentary on something, I would consider it best
But it might have less views than some AI slop video perhaps even generated in a minute
Another aspect relevant to the propaganda discussion is that I think modern algorithms have decided that ragebait is the best form of engagement and this is why propaganda might spread fast and how social media might actually actively help the foreign nation
I would argue that this is one of the reasons social media actively harms but its that profit over all for social media seems genuinely harmful. We need more focus on bluesky and mastodon and other alternatives as well to establish a network effect there but also that I would argue that prosecuting social media / large tech companies should have such a case where something can be prosecuted criminally for a class law suit case so that these social medias can stay better in shape than being deranged
But the issue to me feels like I am already protesting Italian even fining because in this case to me it feels like abusing the vagueness of the law and other factors so I am sure that if we give govts more power they might have the ability to abuse it as well for some lobbying powers (in this case it seems to be football)
Everything boils down to what the genuine incentives of the govts are I guess. I mean some are trying to do somethings but I guess all of this is just really tricky and the answer is in a series of changes and not a single one. There is nuance to this like every other discussion
I am not on any social media so I don't even know what the propaganda is that you are talking about but there are ways to really filter out youtube in such a way (by following unbiased media houses) and I haven't seen much propaganda on youtube (I think)
> This is not about normal politics, Europe is under siege.
I am not European but this seems such an dangerous precedent to set upon. You mention destroying liberal democracy but also the fact that Europe is under siege makes people think of providing war time resolutions to Countries even for small details (and Mind you this ban itself has nothing to do with russia that much, its just the amount of influence football has in italy)
To me it feels as if by saying Europe's under siege, it gives more war time resolutions or justificiations for unmoral behaviour. In fact that's what happened right now. This also actively undermines democracy and one can clearly see how.
I understand your comment's in good faith and I appreciate it but I am just not even sure how this move of fining Cloudflare for not being in line for their censorship is related to this other instance.
Not sure why people downvoted but this is sort of true
Microsoft was absolutely dominating and buying up everything (similar to today's tech giants) and they were literally the most mega corporation ever
Until they got hit by the monopoly lawsuit. That alone scared microsoft so much that it backed off
After the backing off is when Companies like google, heck Apple was directly invested to be saved by microsoft just so that they dont get threatened by the govt as monopoly and amazon.
In a way people mention so why couldn't Microsoft create their own engine but its also the fact that blink/chromium is based on fork of webkit which itself is a fork of KHTML from the kde team but webkit added many features (from what I could tell) and is a really complex software in it of itself
This was created by apple and apple as we know it would not have been able to exist without Microsoft backing off them
My point here is that in previous times, Microsoft was a large curtain blocking any innovation if they wanted but after it was feared by even a threat like monopoly, they took it very seriously and thus we have the cultural innovation in many ways that we have
Now the monopoly question was a genuine question still launched by the government.
Today the landscape is different, Google and these large tech companies would buy things and the meta strategy has become to sell, its a very cynical point of things which really just ends up screwing the customers in the end.
The government doesn't care, it might slap some 1% fine and there is a quote that if crime's punishment becomes only fines, then crime becomes legal and the fines compared to company are so small and they got legal structure so high that they strech it for as much as possible
Overall, the govt.'s being really lobbied by these tech giants and they stiffle tech innovation in the end
In the end all of them are the same, they all kind of want to be a microsoft pre monopoly era.
Govt's lack of understanding of the matters around the world is the reason why tech feels so intrusive. This has real consequences to you and me, now I don't trust the govt will be able to improve if its gets lobbied or corrupted and that's a seperate matter and might take new laws all around the world to prevent such corruption / lobbying but right now, the other best thing is to showcase support by being the minor fraction of the population who supports/donates to open source / msme businesses
I doubt Microsoft gives a minute's thought to government monopoly concerns. One of their "punishments" after the monopoly lawsuit was to give schools free copies of Microsoft Office products. Teachers and administrators adopted them, forcing parents to also buy copies of Office. Now practically everyone's documents are locked up in Office formats, which Microsoft can change on a whim. Sure, there are products to read Office formats with varying levels of success, but Microsoft has the control and can make everyone jump through hoops whenever they feel like it.
Well yes but I feel like its because the threats of monopolization got less and less due to lobbying efforts but for the time, there are reports where microsoft was scared in the internal emails after what happened.
"Microsoft was more scared of taking over companies that were competitors because of this anti trust trial. They had to back off a little and this created this tiny little gap, this little window from which many flowers can bloom. These flowers ended up growing into massive trillion dollars competitors (google and apple)"
I would consider that much of what I wrote in the previous comment was I think something I had thought about but this particular video definitely helped me and you could say did influence me in a way to write the comment.
It also mentions how it was provable that Microsoft was scared about it. I am not sure about this contradiction though but I would consider that it atleast created a gap for around 10-18 years from which the tech giants emerged.
Brother, I have been trying to follow iranian discussions and I think me and you both but once again, this is not a dupe as I wanted to discuss on hackernews about the death mounts
Is there a specific thread for the sad deaths of protestors of iran, people should discuss about it as its a recent development and one which can have farspread consequences
Even aside from that, morally speaking, Rest in peace to the protestors who died an unjust death.
I have heard that gvisor isn't recommended to run every single production but rather only some front facing or some other activities but it has some serious performance degradation which is why most end up using firecracker
This is really cool though, does this mean that we could probably have AI models that are snapshotted?
Are the states of checkpoint/recovery encrypted by default or how would that even work? Like what are the privacy aspects of it. I don't think even using something like modal would be the private llm that many people sometimes want on subreddits like localllama but the people dont have gpu. of course nothing beats privacy if you have your own gpu's but I'd be curious to know what people's thoughts are
reply