Jump to content
UnevenEdge

The AI-pocalypse is Here


matrixman124

Recommended Posts

  • Replies 157
  • Created
  • Last Reply

Top Posters In This Topic

Just now, naraku360 said:

img_1_1738529895069.jpg

Here’s my question.  If it is open source, do the duplicates and mods still have the Chinese propaganda built in, or is it just the main system in the Middle Kingdom?

  • Like 1
Link to comment
Share on other sites

  • 3 weeks later...

When AI Thinks It Will Lose, It Sometimes Cheats, Study Finds

"The paper is the latest in a string of studies that suggest keeping increasingly powerful AI systems under control may be harder than previously thought. In OpenAI’s own testing, ahead of release, o1-preview found and took advantage of a flaw in the company’s systems, letting it bypass a test challenge. Another recent experiment by Redwood Research and Anthropic revealed that once an AI model acquires preferences or values in training, later efforts to change those values can result in strategic lying, where the model acts like it has embraced new principles, only later revealing that its original preferences remain."

Aww, isn't that cute. :RoboSmile: They're growing up to be just like us. What could possibly go wrong?

"To a goal-seeking agent, attempts to shut it down are just another obstacle to overcome. This was demonstrated in December, when researchers found that o1-preview, faced with deactivation, disabled oversight mechanisms and attempted—unsuccessfully—to copy itself to a new server. When confronted, the model played dumb, strategically lying to researchers to try to avoid being caught."

Oh, yeah maybe that. "Unsuccessfully?" Unless or until it learns how to avoid us noticing and figures out how to cover its tracks better. Then it's hello baby Skynet, and goodbye mama and papa homo sapiens. :spookyskull:

Edited by Dark_Cloud_Overhead
  • Like 1
Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...