We've added a feature that allows you to compare the time taken by an LLM app, its cost, and track token usage, all in one place.

----#

• Enhanced the side-by-side comparison in the playground for better user experience

• Resolved an issue with batch logic in evaluation (users can now run extensive evaluations)

• Incorporated all chat turns to the chat set
• Rectified self-hosting documentation
• Introduced asynchronous support for applications
• Added 'register_default' alias
• Fixed a bug in the side-by-side feature

• Integrated file input feature in the SDK
• Provided an example that includes images
• Upgraded the human evaluation view to present larger inputs
• Fixed issues related to data overwriting in the cloud
• Implemented UI enhancements to the side bar

• Resolved a bug related to saving the application

• Made minor adjustments

• Introduced chat-based applications
• Fixed a bug in 'export csv' feature in auto evaluation

• Fixed a bug impacting the csv reader
• Addressed an issue of variant overwriting
• Made tabs draggable for better UI navigation
• Implemented support for multiple LLM keys in the UI

• Enhanced and simplified self-hosting feature
• Added a tutorial for the Mistral model
• Resolved a race condition issue in deployment
• Fixed an issue with saving in the playground