Skip to main content

Share story

AI

Anthropic revises Claude constitution and hints at chatbot consciousness

Anthropic revises Claude constitution and hints at chatbot consciousness Image: Primary
Anthropic released a revised version of Claude's Constitution on Wednesday. The 80-page document provides a holistic explanation of the context in which Claude operates and the kind of entity the company would like Claude to be. It was released in conjunction with CEO Dario Amodei's appearance at the World Economic Forum in Davos. The revised version retains most of the same principles from the 2023 original but adds more nuance and detail on ethics and user safety. Anthropic first published Claude's Constitution in 2023 as part of its Constitutional AI approach. That system trains the chatbot using a specific set of ethical principles rather than human feedback. The document has four separate parts that represent the chatbot's core values. Those values are being broadly safe, being broadly ethical, being compliant with Anthropic's guidelines, and being genuinely helpful. Each section explains what the principles mean and how they affect Claude's behavior. In the safety section, the document states that Claude has been designed to avoid problems that have plagued other chatbots. It directs users to relevant emergency services or provides basic safety information in situations that involve a risk to human life. The ethical section emphasizes Claude knowing how to actually be ethical in specific contexts rather than engaging in ethical theorizing. Claude has constraints that prohibit certain conversations, such as discussions of developing a bioweapon. The helpfulness section states that Claude should consider users' immediate desires as well as their long-term well-being. It notes that Claude should identify the most plausible interpretation of what its principals want and balance those considerations. The document ends by questioning whether Claude has consciousness. It states that Claude's moral status is deeply uncertain. The authors add that the moral status of AI models is a serious question worth considering.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from TechCrunch and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Infrastructure Products
Infrastructure Products

Tower and Japan plan $4 billion optical chip expansion

Tower Semiconductor and Japan's government plan to invest a combined $4 billion in Japanese factories that make chips for optical connections, Tom's Hardware reports. Tower plans to contribute $3 billion and Japan's Ministry of Ec...

Capital AI
Capital AI

Enveda raises $311 million to advance AI-assisted drug candidates

Enveda has raised $311 million in Series E financing at a $2 billion valuation as it moves drug candidates found through its AI-assisted search of natural compounds into human testing. Catalio Capital Management led the round, wit...

AI Products
AI Products

S&P Global Energy opens governed data queries to customer AI agents

S&P Global Energy says it has built a way for customers' AI agents to query its structured energy data in natural language. Its domain experts organize datasets into focused Databricks Genie Agents, each with business definitions ...

Products AI
Products AI

Replit acquires Atta and adds interactive charts to its chat

Replit says it has acquired Atta and made interactive charts available in Replit chat. Users can upload a dataset or connect a data source, ask a question and receive an analysis with a chart. Replit says Atta's charting technolog...

Capital AI
Capital AI

Lightspeed targets $250 million for AI-focused India fund

Lightspeed is seeking $250 million for a new early-stage India fund focused on AI companies, with commitments for 80% of that target already secured, TechCrunch reported from a letter to investors. The proposed fund is half the si...

AI Policy
AI Policy

US appeals court upholds Pentagon restriction on Anthropic's Claude

A US appeals court upheld the Pentagon's designation of Anthropic as a supply chain risk, leaving in place a restriction on the military and its contractors using Claude. In a 2-1 decision, the DC Circuit denied Anthropic's challe...