Building the world's fastest AI Gateway - streaming transformers
In January of this year, we released unified routes for file uploads and batching inference requests. With these changes, users on Portkey can now:
1. Upload a single file for asynchronous batching and use it across different providers without having to transform the file to model model-specific format
2. Upload