xAI has officially announced Grok, a new AI assistant designed to answer almost anything and even suggest questions you might not have thought to ask. Inspired by the Hitchhiker's Guide to the Galaxy, Grok aims to provide information with a touch of wit and a rebellious streak, setting it apart from more conventional AI models.
Grok is more than just another AI chatbot. It's designed with a unique personality, offering humorous and sometimes edgy responses. Key features include:
The primary goal behind Grok is to create AI tools that assist humanity in the pursuit of understanding and knowledge. xAI intends to achieve this by:
Grok is powered by Grok-1, xAI's Large Language Model (LLM), which has been developed over four months. Key milestones include:
Grok-1 has demonstrated strong performance in several machine learning benchmarks:
| Benchmark | Grok-1 | GPT-3.5 | GPT-4 |
|---|---|---|---|
| GSM8k | 62.9% | 62.9% | 92.0% |
| MMLU | 73.0% | 73.0% | 86.4% |
| HumanEval | 63.2% | 48.1% | 67% |
| MATH | 23.9% | 23.5% | 42.5% |
Grok-1 surpasses other models in its compute class, including ChatGPT-3.5 and Inflection-1. While it's outperformed by models like GPT-4, the efficiency of Grok-1's training is noteworthy.
To validate these results, xAI tested Grok-1 on the 2023 Hungarian National High School Math Exam. Grok-1 scored 59%, passing the exam, and proving its capabilities in a real-world scenario.
Creating Grok involved overcoming significant engineering challenges. xAI built a custom training and inference stack using Kubernetes, Rust, and JAX. The team focused on:
xAI is actively exploring several research directions to enhance Grok's capabilities:
xAI is offering early access to Grok for a limited number of users in the United States. You can join the waitlist here.
The release of Grok is just the beginning. xAI has an exciting roadmap with new features and capabilities planned for the coming months.
If you're passionate about AI and want to contribute to xAI's mission, you can apply to join the team here.
