Tag Archives: Hugging face

A setting to consider

I saw an article that the Conversation released yesterday (at https://theconversation.com/sam-altman-says-were-in-the-singularity-with-ai-heres-why-hes-wrong-288514) the headline reads ‘Sam Altman says we’re ‘in the singularity’ with AI. Here’s why he’s wrong’, I have my own ideas of that Altman fellow and it is not all good. But this article reads right or better stated, it reads into my train of thought and I thought it was important to counter these thoughts whilst adding my own. So here goes:

Then we get “These deep neural network algorithms get pre-trained with vast amounts of training data. By the time you use one of them, the network itself is frozen in time. Every one of its billions of internal functions and weights – or “parameters” – is fixed. These AI models cannot change (or “learn”) while running. The model that broke into Hugging Face was identical afterwards to what it had been before. It learned nothing from what it did. Making an AI model smarter requires another training run with new, human-curated data, tens of thousands of specialist chips, and enormous energy.

So with “Every one of its billions of internal functions and weights – or “parameters” – is fixed.” Is dealt with above and I used merely 10,000 and not billions, so you start getting the issue, there is more and more data, none of this is verified or validated and as the data grows, so do the gaps. And these gaps are starting to get nasty. We are given “The model that broke into Hugging Face was identical afterwards to what it had been before. It learned nothing from what it did” the important part is the “learned nothing”, which gives rise to the (flatly called BS) that Sam Altman is giving us, because if there was a singularity, something would have been learned, that is seemingly not the case. 

So when we get to “Nor do these systems hold any goals of their own. They act on goals we hand them. Even AI agents – systems that run an LLM in a loop to work through complex tasks step by step – do not hold any goal internally. It has to be stored outside the model and fed back in with every single prompt cycle. Remove the loop, the scaffolding and the prompt, and nothing happens inside of it.” As well as “And yet, it has been trained on more text than any human could read in a thousand lifetimes, and will outperform nearly all of us at drafting a contract, writing code, or explaining a diagnosis empathetically. So, which is more intelligent? The question does not compute. There is no single ladder that humans and machines are climbing. AI already vastly exceeds us at some tasks, while being hopeless at others any child can do.

Then we get “In the end, the Hugging Face story points to a gross failure of security governance on OpenAI’s behalf, not an emerging super intelligence. This is why the framing of “agent going rogue” is so problematic. It elevates and blames the technology, but excuses OpenAI’s engineering.

I raised this setting on the 25th of July in. ‘Rerun anyone?’ (at https://lawlordtobe.com/2026/07/25/rerun-anyone/) which also links to ‘Is it real or is it media?’ The day before. So, I raised that part a week ago and I have done so a few times. They are all ‘blessing’ the engineers, but it is there where the problems begin and I am not giving the engineers a hard time, trying to type Japanese in a single byte language and you see the problem, it is a double byte language and that is the setting for these AI systems as well. It relies on binary whilst more is needed and the engineers are pushed to do the impossible (as I see it). So this is even before verification and validation. So the errors are stacked onto the errors and it goes downhill from there. 

The story ends with “The machines are not waking up. They are doing exactly what we built them to do, extremely fast. Because they are probabilistic they sometimes run in directions we forgot to fence off. That is worth worrying about. We need guardrails, governance, and most of all, education – so we start worrying about the right things.” 

I believe that these systems can never wake up. As I see it, these systems require 100% focus and they are giving it to a system with narcolepsy. How long until the system stalls, fails and falters? And it is not a nice setting to have, because this can falter at any time, the data gaps merely make it happen faster. So when you see that a system is handed billions cases of data you need to wonder where the gaps are and what data is validated and verified. The answer might surprise you and that is where the dance floor gets wobbly. 

So this is how I see stuff and other articles give you more on several foundations where there are issues and I commented on them, feel free to embrace it, or reject it. I am fine with that, several options are presumptions and I have decent knowledge of validation and verifications, which is why I asked around on this. There is more on all this and it is spread over a year of writing. 

So have a great day and feel free to not rely on any AI systems for making coffee, because cold coffee is so overrated.

Leave a comment

Filed under IT, Media, Science