Pool ownership
Every scale target belongs to one capacity pool. The target should change capacity that serves the destinations in that pool. For example, a pool containing destinations backed by one model deployment can own the target for that deployment. Destinations backed by unrelated deployments belong in separate pools with separate targets. One pool can have several scale targets when separate components contribute capacity to the same work. A metric binding can identify the component represented by each target.Scale targets and autoscaling
Many platforms already include an autoscaler. Arklow can work with that controller or request a replica count directly, depending on the target type.
Admission control remains active while new capacity provisions. Work can wait during that interval and resume as the destination becomes ready.
Target configuration
The minimum and maximum form the target’s scale envelope. Recommendations, accepted proposals, and automatic changes remain within this range.
Metric binding
A target can bind to a query from one of your metric sources. The query identifies measurements that describe the scalable resource. If a query returns measurements for several resources, add a tag projection. The projection names the metric tag and value that select this target:model_id=M1 to the target. It applies only to target selection; work tags and routing remain unchanged. The projection key and value must be set together.
A binding is optional. Pool demand remains available without one; add a binding when a query covers several resources and this target needs one matching series.
Proposals and Casper
With Casper disabled, scale changes appear under Proposals for review. Accepting a proposal applies the change to the provider. Saving changes to a target may reconcile the provider with the target’s current settings. Casper is the organization-wide setting that permits automatic scale changes. When it is enabled, Arklow can apply changes within each target’s envelope without waiting for approval. A provider-side change may cause Arklow to reapply the accepted value. Deleting a target stops future writes. The provider retains its last setting.Providers
Baseten
Adjust the autoscaling range for a model deployment.
Together AI
Adjust the autoscaling range for a dedicated endpoint.
Google Cloud
Control a managed instance group through its autoscaler or target size.
HTTP scale API
Connect another platform through a small HTTPS contract.
State and history
The target page shows observed replicas, the last observation, current and requested scale values, the last write outcome, health conditions, and adjustment history. Together, these fields distinguish the requested setting from the capacity the provider currently reports. The pool page combines adjustments from every target attached to that pool. Dashboard notifications call out conditions that need attention, including a stopped endpoint or sustained pressure with no matching target.Create a scale target
1
Prepare the pool
Create the destinations the target will serve. Group them into a shared pool only when they use the same underlying capacity.
2
Open scale targets
Go to Scale Targets and click New scale target.
3
Choose the provider
Select the platform and scaling mode. Enter the fields that identify the resource.
4
Add authentication
Select a compatible credential for provider observations and changes.
5
Select capacity
Choose the destination or shared pool served by the target.
6
Set the envelope
Enter the minimum and maximum replica counts.
7
Bind a metric if needed
Select a metric query. Add a tag projection when the query covers several scalable resources.
8
Save and observe
Create the target, then review its observations and adjustment history.