The Next Big Thing in .NET Development!

The .NET team has just unveiled the game-changing Dev Proxy version 0.28, packed with exciting new features that enhance observability, plugin extensibility, and seamless integration with AI models!

Introducing the OpenAITelemetryPlugin!

A star player in this release is the OpenAITelemetryPlugin. This powerful tool allows developers to monitor usage and estimated costs associated with OpenAI and Azure OpenAI language models in their applications. Imagine having the ability to intercept requests and log key metrics like the chosen model, token counts, and cost estimates—all in real-time!

Visualize Your Data!

With the help of external tools like OpenLIT, users can visualize this data to understand usage patterns better and optimize AI expenses. Say goodbye to overspending!

Local Integration for Greater Cost Efficiency!

The update does more than just monitor; it also supports Microsoft’s cutting-edge Foundry Local. This local AI runtime allows developers to reroute cloud-based LLM calls to a local environment, slashing costs and enabling offline development.

Boost Your Performance!

Initial tests showcase significant performance boosts when using the Phi-4 mini model on Foundry Local. The development team has ambitious plans to make this integration the default setting in forthcoming versions!

New Features for .NET Aspire Users!

For .NET Aspire aficionados, a preview version of Dev Proxy extensions is now on offer. These extensions simplify the integration process, allowing Dev Proxy to run locally or via Docker with ease. This is a game-changer for distributed development teams!

Expanded OpenAI Support!

The update also broadens support for OpenAI’s capabilities. Now, Dev Proxy isn't just limited to text completions; it unlocks compatibility with a wider variety of completion types. Talk about flexibility!

Enhanced TypeSpec Generation!

In adherence to the latest TypeSpec v1.0 updates, the plugin now supports enhanced PATCH operation generation, making it easier to define merge patch behaviors—yet another way Dev Proxy is stepping up the game!

Streamlined Configuration!

Dev Proxy has introduced JSONC support—allowing comments within configuration files. This means developers can now add inline documentation, boosting team collaboration and easing long-term maintenance.

Improvements in Concurrency!

With new improvements in logging and mocking, logs from parallel requests are now grouped accurately. This feature will help developers trace request behaviors more efficiently!

Breaking Changes to Note!

This release does include two breaking changes: the GraphConnectorNotificationPlugin has been removed following the end of the Graph connector's support in Microsoft Teams, and the --audience flag in the devproxy jwt create command has been renamed to --audiences (but fear not, the shorthand alias -a remains the same!).

Updated CRUD API Plugin!

The CRUD API plugin has also been revamped! With improved CORS handling and more consistent JSON responses, its reliability in client-side applications has never been better.

Visual Studio Code Toolkit Upgrade!

Last but not least, the Dev Proxy Toolkit for Visual Studio Code has been updated to version 0.24.0. This release introduces new snippets and commands, including support for the OpenAITelemetryPlugin, along with better process detection and improved compatibility with Dev Proxy Beta.