New Feature:

• Shield can now run on GPUs for Kubernetes deployments, resulting in low latency evaluations. The new GPU based deployment configuration is tested and supported for ASW EKS.

Enhancements:

• The API key metadata lookup endpoint now contains the enrolled RBAC role names
• Fully automated the process of updating Shield ingress URL from the installers
• The task rules cache configuration is now tunable from the installers

New Feature:

• Any Shield task can now be assigned as the Arthur Chat firewall via API endpoint call

Enhancements:

• Optimized the toxicity detection model for significant reduction of speed and compute cost (45+% latency reduction) without compromising accuracy
• Optimized the prompt injection detection model for reduction of speed and compute cost without compromising accuracy
• AWS ECS deployments can now configure warm instances on the GPU autoscaling group via CloudFormation for scaling out faster
• Reduced the instance warmup time for faster dynamic autoscaling
• OSS library upgrades

New Features:

• AWS ECS GPU deployments now supports fast dynamic scaling
• Added the capability for AWS ECS GPU deployments to scale-in and scale-out on a configurable schedule

New Feature:

• RBAC added to API keys. See the permissions <> roles matrix for the available roles.

Product Enhancements:

• Caching is now used for rules lookups to improve the speed of inference validations
• Concurrency improvement made for GPU deployments
• The Arthur Auth cluster coordinator now works with self-signed certificates

New Feature:

• Shield can now run on GPUs for ECS deployments, resulting in significantly faster performance.

Product Enhancements:

• Users can now see the subcategories of toxicity or toxicity violation types in the UI
• The sentence transformer model is now bundled inside the Shield container image instead of downloading it during server startup. This change results in a more reliable and faster server startup.
• Improved the performance of the inference query endpoint

Bug Fixes:

• Fixed an issue with refreshing the task list in the UI
• The delete functionality when managing keyword rules in the UI now works as expected

Product Enhancements:

• OSS library upgrades

Bug Fixes:

• Fixed the problem in Shield that was requiring unnecessary embedded model configuration when Arthur Chat is disabled

Product Enhancements:

• Further restricted what's on the Shield container by building on a distroless image

Product Enhancements:

• Vulnerability fixes

Bug Fix:

• Fixed the problem that was preventing API keys to be able to create default task rules