Data Service

​

v1.2.4

​

Fixes and Improvements

• Fixed issue with custom batches missing cost calculation for some provider models

​

v1.2.3

​

Fine-tuning and Batch Processing

• Added support for configurable FINETUNE_STATUS_CHECK_INTERVAL for provider fine-tuning status check operations.
• Added support for configurable BATCH_STATUS_CHECK_INTERVAL for provider batch processing status check operations.
• Both values should be in milliseconds. Minimum value is 10000 milliseconds.
• If not provided, will default to 10 seconds.

​

v1.2.2

​

Observability

• Added support for below Prometheus Counters
  • batch_count
  • batch_cost
  • batch_input_tokens
  • batch_total_tokens
  • batch_process_time
  • batch_success_row_count
  • batch_failure_row_count
  • batch_row_count
• With the below labels
  • provider
  • type (provider/custom)

​

Fixes and Improvements

• Fixed issue with attributing incorrect created at time stamp for batch processing
• Including error source as control plane for control plane failures

​

v1.2.1

​

Data exports

• Added support for Data exports for hybrid deployments.

​

Fixes and Improvements

• Fixed issue with custom batches for small batch files

​

v1.2.0

​

Custom S3 Support

• Added support for s3_custom log store option for batches and fine-tunes.

​

Fixes and Improvements

• Fixed issue with STS token generation for AWS.

​

v1.1.12

​

Fixes and Improvements

• Fixed issue with cost calculation for custom batches.

​

v1.1.11

​

Fixes and Improvements

• Fixed issue where queue remains stuck in a queued state during file validation.

​

v1.1.10

​

S3 Upload Improvements

• Added support for passing encryption headers while uploading stream data to S3.
• Added support for both file path and direct value from environment variables for secrets like redis connection.

​

Stream Handling

• Improved stream cleanup for validation processes.

​

v1.1.9

​

File Handling Fixes

• Fixed issue with extra bytes being added to files during processing.

​

v1.1.8

​

File Upload Improvements

• Updated socket timeout for long requests during file uploads to prevent timeouts.

​

v1.1.7

​

Fireworks Fine-tuning Support

• Added support for Fireworks fine-tuning operations using Version2.

​

Batch Processing Improvements

• Included response tokens calculation in provider batch output.
• Fixed file loading in memory issues for better performance.

​

v1.1.6

​

S3 SDK Updates

• Upgraded S3 SDK to latest version for fixing issue with S3 streaming.

​

v1.1.5

​

Batch Processing Enhancements

• Improved provider batch output handling.
• Added support for custom batch output paths.
• Increased maximum lines for custom batches to 500k and chunk size to 5MB for better performance.

​

v1.1.4

​

Vertex Embeddings Batches Support

• Added support for Vertex batch embeddings.

​

Batch Processing Updates

• Included model information in log objects.
• Implemented custom batch processing output generations.

​

Internal POD to POD HTTPS Support

• Added support for internal POD to POD HTTPS communication.
• This can be enabled by mounting a volume with certificate and key.
• TLS_KEY_PATH and TLS_CERT_PATH environment variables will be used to fetch the certificate and key from the volume.

​

v1.1.3

​

Infrastructure Updates

• Streamlined uploaded file location for Bedrock operations.

​

v1.1.2

​

Vertex Integration

• Added support for Vertex provider options for batches.

​

Infrastructure Updates

• Implemented cluster mode Redis for queues.
• Updated fine-tune status handling.

​

v1.1.1

​

S3 Enhancements

• Made S3 bucket optional for Bedrock batches.
• Added S3 encryption header support for finetunes and batches.
• Implemented SSE file upload support.

​

Logging Improvements

• Added filtering for log exports.
• Implemented end limit for log export records.

​

Performance Optimizations

• Implemented internal memory cache for better performance.

​

v1.1.0

​

Bull Board Integration

• Added Bull Board for visualizing job queues and their status.

​

Batch Job Retry Support

• Implemented retry functionality for batch jobs to handle failures gracefully.

​

Prometheus Metrics Enhancements

• Added Prometheus metrics for batch jobs and fine-tuning operations.

​

v1.0.8

​

Azure Fine-tuning Support

• Added support for Azure OpeAI fine-tuning operations.

​

v1.0.7

​

Fine-tune v2

• Implemented version 2 of the fine-tuning functionality.

​

v1.0.6

​

Prompt Slug Filter

• Added support for data exports filtering by PromptSlug.

​

v1.0.5

​

Batch Processing

• Added provider and custom [Batch] (/product/ai-gateway/batches) processing functionality.

​

v1.0.4

​

Code Quality Improvements

• Fixed dynamic port retrieval from environment variables.

​

v1.0.3

​

Vision Fine-tuning Support

• Added support for vision fine-tuning validation for OpenAI.
• Implemented S3 bucket support for fine-tunes.

​

AWS Integration Improvements

• Fixed assumed role handling for Bedrock fine-tuning dataset URLs.
• Improved S3 bucket path handling for Bedrock fine-tune operations.
• Achieved parity with Enterprise Gateway for data sources.

​

v1.0.2

​

Fine-tuning Enhancements

• Added support for OpenAI job start and Fireworks upload.
• Improved handling of chunk type failures with JSON.

​

v1.0.1

​

Fireworks Fine-tuning Support

• Added support for Fireworks fine-tuning operations.

​

v1.0.0

​

Initial Release

• Base version of the Data Service with core functionality.