I’m writing with a similar type of AI, saw the meme, and thought to ask the ST nerds. I was a bit young for NG on a deeper level and I’m not a big show watcher. I wouldn’t have had a clue about the alignment problem until the last couple of years anyway.
I have read most of Asimov’s robot stuff and a bunch of theory summary type info on the issues of AI. Humans are a basket case of contradictions under the surface and just outside of most people’s awareness. This is one of the largest issues that causes problems with LLM’s and it only gets worse the more integrated AI gets within the analogue world.
I think there must be an external AI that only has the job of spotting the alignment problem acting like an silent observer in a mixture of experts.
The ship is likely AI in ST, although I never put it in that context in my head while watching and I’m not sure how it was presented on the show. This is the likely management entity that could have been used with Data. The question in my mind that needs further exploring is how to make the connection and control in a way that the controlling entity is not just a bigger alignment problem with minions.
Star Trek tries to avoid using fully sapient AI, in fact it’s illegal for fully integrated ship components to be sapient in Starfleet ships. It’s why the ships computer can solve nearly any problem you give it, but it can’t give you anything unless you ask the correct question.
I’m writing with a similar type of AI, saw the meme, and thought to ask the ST nerds. I was a bit young for NG on a deeper level and I’m not a big show watcher. I wouldn’t have had a clue about the alignment problem until the last couple of years anyway.
I have read most of Asimov’s robot stuff and a bunch of theory summary type info on the issues of AI. Humans are a basket case of contradictions under the surface and just outside of most people’s awareness. This is one of the largest issues that causes problems with LLM’s and it only gets worse the more integrated AI gets within the analogue world.
I think there must be an external AI that only has the job of spotting the alignment problem acting like an silent observer in a mixture of experts.
The ship is likely AI in ST, although I never put it in that context in my head while watching and I’m not sure how it was presented on the show. This is the likely management entity that could have been used with Data. The question in my mind that needs further exploring is how to make the connection and control in a way that the controlling entity is not just a bigger alignment problem with minions.
Star Trek tries to avoid using fully sapient AI, in fact it’s illegal for fully integrated ship components to be sapient in Starfleet ships. It’s why the ships computer can solve nearly any problem you give it, but it can’t give you anything unless you ask the correct question.
Interesting! So the ship is like LLM’s presently; static/not AGI
Pretty much, the Ship’s main computer doesn’t even have the ability to learn user preferences.