Live Optimization Study

Live Optimization studies are optimization studies where the workload is real: the system that needs to be optimized operates with respect to varying workloads observed while running live.

Live optimization studies are typically used to optimize systems in production environments. For example, a microservices application can be optimized while running in production by having Kubernetes and JVM parameters dynamically tuned for multiple microservices so as to minimize costs while matching response time objectives.

The following figure represents the iterative process associated with offline optimizations:

The following 5 phases can be identified for each iteration:

1. Collect KPIs: Akamas collects the metrics of the system required to observe its behavior under the current parameter configuration by leveraging the associated telemetry provider - here Akamas is also observing and categorizing the different workload contexts that are used to recommend configurations that are appropriate for each specific workload context

2. Score vs Goal: Akamas scores the applied parameter configuration under the specific workload context against the defined goal and constraints

3. Recommend Conf: Akamas provides a recommendation for parameter configuration based on the observed behavior under the specific workload context and leveraging the Akamas AI

4. Human Approval: this is an optional step as there are two operational modes:

   • autonomous mode: no human intervention is required

   • human-approval mode: recommendations need to be approved by users before configuration changes get applied - recommendations can be changed by users

5. Apply Conf: Akamas applies the recommended (and possibly revisited) configuration, by leveraging the defined workflow.

Notice that configurations can be applied by Akamas via integrations with native interfaces (e.g. Kubectl), by leveraging any orchestration and automation tool in place (e.g. OpenShift), or by triggering a pull request to a configuration repository (e.g. Git). This can be applied to either the entire target system or to a canary deployment.

Safety Policies

Akamas provides several customizable policies for live optimization studies to ensure that recommended configuration changes to production environments are as safe as possible. Akamas safety policies include gradual optimization, smart constraints, and outlier detection.

Commands

A live optimization study is an Akamas resource that can be managed via CLI using resource management commands.

User Interface

The Akamas UI shows live optimization studies in a specific top-level menu.

The details and results of an offline optimization study are displayed when drilling down.