Launch of SDK Version 2 and Cloud-hosted Version
- Launched SDK version 2
- Launched the cloud-hosted version
- Completed a comprehensive refactoring of the application
This necessitated modifications to the SDK. Now, the LLM application API returns a JSON instead of a string. The JSON includes the output message, usage details, and cost:
{
"message": string,
"usage": {
"prompt_tokens": int,
"completion_tokens": int,
"total_tokens": int
},
"cost": float
}