Elon Musk founded xAI earlier this year, and is already going head-to-head with one-time trillion-dollar-company Amazon, founded by Jeff Bezos. These two cutting-edge AI models have one thing in common, however – neither of them are publicly available. In fact, these are the two most recent entrants to the AI race, running alongside OpenAI’s ChatGPT, Google’s Bard, and Microsoft’s Bing Chat. Here’s what we know so far about the two most mysterious generative AI Chatbots – xAI Grok vs Amazon Olympus AI.
xAI Grok vs Amazon Olympus AI
Despite neither artificial intelligence seeing the light of day, we already have test results that tell us roughly what to expect. xAI recently conducted research into the largest models of big tech, benchmarking each large language model (LLM) against four key tests – GSM8k, MMLU, HumanEval, and MATH.
Included in this comprehensive comparison were OpenAI’s GPT-4 model, Anthropic’s Claude-2, Google’s PaLM 2, xAI’s Grok-1, OpenAI’s GPT-3.5, Pi’s Inflection-1, Meta’s LLaMA 2, and xAI’s Grok-0, listed in descending order. These are the AI models that power all of your favourite AI chatbots, like OpenAI’s ChatGPT, Microsoft’s Bing Chat, and Google Bard. xAI found its own pre-release model to already rank 3rd after OpenAI’s ChatGPT and Anthropic’s Claude!
| Benchmark | Grok-0 | LLaMa 2 | Inflection-1 | GPT-3.5 | Grok-1 | PaLM 2 | Claude-2 | GPT-4 |
|---|---|---|---|---|---|---|---|---|
| GSM8k | 56.8% | 56.8% | 62.9% | 57.1% | 62.9% | 80.7% | 88% | 92% |
| MMLU | 65.7% | 68.9% | 72.7% | 70.0% | 73.0% | 78% | 75% | 86.4% |
| HumanEval | 39.7% | 29.9% | 35.4% | 48.1% | 63.2% | N/A | 70% | 67% |
| MATH | 15.7% | 13.5% | 16.0% | 23.5% | 23.9% | 34.6% | N/A | 42.5% |
Grok is already a strong contender, and its “rebellious streak” is sure to keep things interesting. As for Amazon’s Olympus LLM, less is known.
| Company | CEO | AI Chatbot | LLM | API | Open-source |
|---|---|---|---|---|---|
| xAI | Elon Musk | Grok | Grok-1 | No | No |
| OpenAI | Sam Altman | ChatGPT | GPT-3.5, GPT-4, GPT-4V, or GPT-4 Turbo | Yes | No |
| Sundar Pichai | Bard | Gemini (succeeded PaLM 2) | Yes | No | |
| Microsoft | Satay Nadella | Copilot (formerly Bing Chat) | GPT-4 | No | No |
| Meta | Mark Zuckerberg | Meta AI | LLaMA 2 | No | Yes |
| Anthropic | Dario Amodei | Claude | Claude-2 | Yes | No |
| Amazon | Andy Jassy | Olympus (rumored) | Olympus (rumored) | No | No |
FAQ – Will Grok or Olympus AI come out first?
Leading project Olympus is former Head of Alexa, Rohit Prasad. The SVP and Chief Scientist of Artificial General Intelligence, who reports directly to CEO Andy Jassy, is not keen to give out details just yet. An official release date is expected in early 2024. After release, Amazon Olympus will be integrated into Alexa AI, making it the most competent voice assistant on earth. For now, the e-commerce giant has Amazon Titan, a previous attempt to dethrone ChatGPT, which is already available through AWS (Amazon Web Services).
xAI’s Grok is now available to X Premium+ subscribers in the US. UK Premium+ subscribers will be next to access the bot. Public access rollout began on December 8th, 2023.
