openai vs anthropic

• Claude has more advanced capabilities than ChatGPT
  • Claude has a deeper understanding of what it is, who its creators are, and what ethical principles guided its design
  • Claude can recall information across 8,000 tokens, more than any publicly known OpenAI model
  • Claude uses a process called Constitutional AI to develop its preference models, as opposed to RLHF used by ChatGPT
  • Claude is more cognizant of what it cannot do than ChatGPT
  • Claude is aware of Lem’s story and mentions new details that ChatGPT does not
  • Claude is able to correctly answer a “multi-hop” riddle, while ChatGPT is not
  • Claude is able to correctly answer a mathematical question, while ChatGPT is not
  • Claude is able to generate correct code for a sorting algorithms problem, while ChatGPT is not
  • Claude is able to correctly output a FuzzBuzz problem, while ChatGPT is not
  • Claude is better at comedic writing than ChatGPT
• ChatGPT has more advanced capabilities than Claude
  • ChatGPT is able to correctly answer a “multi-hop” trivia question, while Claude is not
  • ChatGPT is able to correctly answer a mathematical question, while Claude is not
  • ChatGPT is able to generate correct code for a sorting algorithms problem and output a FuzzBuzz problem, while Claude is not
  • ChatGPT is better at summarizing each season of ABC’s Lost than Claude

• OpenAI and Anthropic have a similar focus on AI safety
  • OpenAI’s ChatGPT is similar to Anthropic’s Claude AI
  • Claude was created using a technique called “constitutional AI”, which provides a “principle-based” approach to aligning AI systems with human intentions
• OpenAI and Anthropic have different approaches to monetizing AI
  • OpenAI offers API access to their text-generating AI models, whereas Anthropic is providing access to their models to select startups
  • Google has invested $300 million in Anthropic, giving it a 10% stake in the startup
• OpenAI and Anthropic have different founding histories
  • OpenAI was founded with a focus on commercialization, whereas Anthropic was founded as a public benefit corporation
  • Dario Amodei, the former VP of research at OpenAI, left to found Anthropic after a disagreement over OpenAI’s commercial focus

• OpenAI:
  • Developed ChatGPT
  • Uses reinforcement learning (RL) to train a preference model over their outputs
• Anthropic:
  • Co-founded by former employees of OpenAI
  • Developed an AI assistant named Claude
  • Uses an autoregressive model, trained unsupervised on a large text corpus
  • Uses an approach they call Constitutional AI
  • Claude AI Passed Law And Economics Exam, Surpassed Many Humans

• Claude is superior to OpenAI’s GPT models in many ways
  • Claude provides relevant responses and information, not just the most probable next words
  • Claude avoids harmful, misleading, or offensive statements
  • Claude can have more complex multi-turn conversations
• The hype imbalance between OpenAI’s GPT models and Claude
  • OpenAI’s GPT models get massive usage and resources, whereas Claude remains relatively unknown
  • Hype cycles and flashy demos over real practical capabilities and safety/ethics considerations
• Claude is available on the “Poe” app on the app store

• Anthropic gets a better grade than OpenAI
  • They have good mechanistic interpretability work which makes current systems less of an inscrutable black box of matrix multiplication
  • They are not sure about the build the AI to stop the AI approach
  • They expect around a 1000x increase in the computation used to train the largest models over the next 5 years
  • This 1000x increase in compute could result in human-level performance across most tasks
• OpenAI
  • No direct comments given, but they are compared to Anthropic in terms of performance and approach.

💭  Looking into

What are the potential payoffs of doing hard fundamental research?

💭  Looking into

What is the peak of the 'AI' bubble?

💭  Looking into

What are the major differences between OpenAI's ChatGPT and Anthropic's Claude?

💭  Looking into

What products or services does Anthropic offer?

💭  Looking into

What have been the main accomplishments of OpenAI since its founding?

• OpenAI and ChatGPT:
  • Microsoft is investing billions into OpenAI and ChatGPT
  • OpenAI is leveraging Microsoft’s cloud computing resources
• Anthropic:
  • Several top executives and innovators at OpenAI left to create Anthropic
  • Google is investing $300 million into Anthropic
  • Google Cloud has formed a new partnership with Anthropic
  • Anthropic has an AI language model assistant named Claude
  • Google Cloud is providing open infrastructure for Anthropic
• Google vs Microsoft:
  • They are both investing heavily in AI startups
  • They are competing to become the dominant cloud leader in AI
  • Google Cloud is providing open infrastructure for the next generation of AI startups
  • Microsoft is investing $10 billion into OpenAI
  • Microsoft Azure will power all of OpenAI’s workloads

• OpenAI vs Anthropic:
  • OpenAI was founded by Daniela and Dario Amodei, while Anthropic was founded by the same siblings.
  • OpenAI is a research lab, while Anthropic is an AI startup.
  • Dario Amodei led the development of OpenAI’s GPT-2 and GPT-3 language models, while Daniela Amodei led the company’s recruiting effort and managed its technical safety and policy teams.
  • Anthropic’s main product is Claude, a ChatGPT-like AI chatbot, while OpenAI has not developed a similar product.
  • Anthropic is focusing on building “steerable, interpretable and reliable AI systems with humans at the center of it,” while OpenAI’s focus is on researching and developing AI technologies.
  • Anthropic’s goal is to fix the shortcomings of AI chatbots, while OpenAI has not focused on this.
  • Anthropic has raised $700 million from tech giants like Google and Salesforce, while OpenAI has not raised this amount of funding.

• OpenAI has had great minds working on policy and safety, which is now being transferred to Anthropic
  • OpenAI is often associated with PR issues
  • Anthropic has $124M to burn, and a $500M valuation
  • Anthropic is focused on research, and has research interests spanning multiple areas including natural language, human feedback, scaling laws, reinforcement learning, code generation, and interpretability
  • Anthropic team’s previous work includes GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences
• Some people are pessimistic about Anthropic, as they don’t know what services/products they will actually offer to investors
  • People are questioning what the benefit is for the investors
  • People are questioning why the company exists
  • People are questioning the sustainability of the company
• There is also excitement for Anthropic
  • People are excited that AI startups are getting industrial funding
  • People are excited about the potential pay off of doing hard fundamental research
• People are concerned that OpenAI has already dumped billions into OpenAI
• Some people think the peak of the ‘AI’ bubble is near

• OpenAI
  • Ex-OpenAI employees founded Anthropic
  • OpenAI’s ChatGPT is comparable to Anthropic’s Claude but Claude is superior in a number of important aspects
• Anthropic
  • Founded by ex-employees of OpenAI
  • Received over $700 million in funding
  • Unveiled an AI system called Claude
  • Uses a method termed “Constitutional AI”
  • Claude is accessible through Slack integration
  • Claude is poor at programming but better at delivering jokes
  • Claude is a statistical word prediction tool similar to ChatGPT
  • Claude learned how often words are to emerge based on patterns
  • Able to engage in open dialogue, tell jokes, and provide his thoughts on a number of subjects
  • Described as being “usually closer to what is required of him” but “less concise”
  • Has a team of 40 people and an office full of plants
  • Received a $124 million Series A financing in 2021

None

💭  Looking into

What is the best between OpenAI and Anthropic?