Big breakthroughs in Chat. Upleveling Command, JetBrains, remote indexing, and a number of other core experiences. Top enterprise asks like Analytics APIs. Overall, a very productive July!
Better Chat
A culmination of a lot of breakthroughs across the model, reasoning, and UX layers to create a Chat experience that we believe to be the best Chat experience for developers in the industry. Some of the highlights:
- Model: We deployed a Llama 3.1-70B based Codeium chat model for all users, and an additional Llama 3.1-405B based Codeium chat model for all paying users. The Codeium versions of these models are tightly integrated with our reasoning stack, leading to better quality suggestions than GPT-4 for coding tasks, and are hosted on our industry leading infrastructure so that we can offer them for free (or very cheaply) to our users.
- Reasoning: We rolled out our next generation retrieval engine, which has a recall that is 2x better than state-of-the-art embedding-based RAG systems. Simply put, all of our users will now get more relevant, grounded Chat responses.
- UX: We rolled out a large suite of UX features and improvements: inline citations, chat history, slash commands, inline context pinning, deep insights, copy to clipboard, and a whole lot more.
Any great AI product needs a combination of model, reasoning, UX, and accessibility. As a company, we have full control of the entire stack, so we have innovated on all axes. Read and see the full list of breakthroughs here.
Analytics API
We love numbers. So do our customers. That is why our detailed analytics are very popular. That being said, our customers often have a lot of other analytics sources, and there is clear value in seeing metrics from Codeium side-by-side with metrics from these other sources. So, we built an API to our analytics dashboards, where our customers can get all of the value of our dashboards wherever they want.
Extension Diagnostics
AI is moving fast, and we are trying to move faster. Given how many modalities, SCMs, IDEs, OSs, languages, and deployment methods that we work on, we are realistic that issues will pop up every now and then. With a single click in the Codeium panel, developers can now instantly download a local file with the required metadata and logs for our team to try to reproduce and resolve the issue quickly.
Improvements to Codeium Command
Codeium Command is a lesser known, but incredibly powerful, feature that allows developers to perform refactors directly in editor. Over the last couple of months, we have massively improved the quality of Codeium Command in VSCode and JetBrains, and have cleaned up the UX, such as removing the +/- markers at the start of changed lines of code. With faster results, larger models, and more task-specific training, Codeium Command usage has taken off. Read more about how we did it.
JetBrains gets Better
The JetBrains suite of IDEs are incredibly popular, especially in enterprises. Our JetBrains plugin is the highest rated JetBrains code assistant plugin on the marketplace, but in order to bring Codeium in JetBrains to feature parity with our Visual Studio Code plugin, we have improved the selection toolbar, added change log notifications, built the insert from/apply diff functionality from Chat to the editor, improved rendering performance, cleaned up the login and update process, and more. Update to the most recent version of JetBrains to get an even sleeker experience!
Autogenerated Commit Messages
On Visual Studio Code, you can now generate commit messages automatically from the IDE. This is a prototype feature that we will be iterating on more in coming months.
Content
Some content on Codeium from around the Internet:
- Zillow Case Study: Read why one of the most well known consumer technology companies chose Codeium as their AI assistance tool for its development teams.
- Stack Overflow Survey Results: As compared to 2023, we saw a 400% increase in usage, became the fourth most admired AI tool overall, and increased our share in respondents stating they desired Codeium.
- AI Engineer Summit: Kevin, our Head of Product Engineering, talked through some of the perspective and intuition behind our most recent reasoning breakthrough.
- Prof G First Time Founders Podcast: Stories from growing Codeium and our company culture.
- Artificial Intelligence podcast: Another podcast with our CEO, Varun Mohan.
More exciting news around the corner, and the velocity continues to increase for both product development and customer success.