Documentation Grafana Cloud Adaptive Telemetry Adaptive Logs Review and apply recommendations

Review and apply recommendations

Adaptive Logs provides you with a list of patterns and recommendations on which logs to drop based on usage patterns. You can filter, review, and edit drop rates to suit your needs.

After reviewing, you apply the drop rates to implement the changes. The logs are then dropped upon ingestion into Grafana Cloud, reducing unnecessary log storage costs while ensuring that your observability remains intact.

Adaptive Logs recalculates its pattern list and recommended drop rates every 24 hours using a rolling 15-day window of your log ingest and query behavior. When a pattern is first detected, Adaptive Logs delays displaying it for 7 days to gather enough usage information to recommend a reasonable drop rate. To see newly detected patterns sooner, refer to view early detection patterns.

The following topics provide you with guidance on how to manage your recommendations.

View early detection patterns

Log lines with little business value are often introduced into production, leading to unnecessary ingestion costs and noise. By filtering for early detection patterns, you can identify and remove ingest spikes quickly; only ingesting the most valuable telemetry.

To view early detection patterns, use the Show early detection patterns toggle. The toggle also shows you the number of early patterns available.

Review recommendations

To review patterns and recommendations for drop rates, navigate to the Patterns page in Adaptive Logs.

Filter patterns

Use the following controls to narrow down the patterns list:

• Select segment: Filter patterns by segment. The default segment shows log volume that does not match any defined segments.
• Filter: Search for patterns by text.
• Query frequency: Filter by how often patterns are queried: Never, Rarely, Sometimes, Often, or Always.
• Show early detection patterns: Toggle to display patterns detected in real time before processing by the recommendation engine. Refer to view early detection patterns for details.
• Show selected: Toggle to display only the patterns you have selected.

Patterns table

For each pattern, the table shows the following columns:

• Pattern: The log line pattern. Expand a row to view the full pattern with token explanations, and copy the pattern text.
• Queried: The query frequency for this pattern over the past 15 days.
• Volume: Total ingested volume in the past 15 days.
• Drop rate: Percentage of log lines currently being dropped.
• Recommended: Recommended percentage of log lines to drop.
• Projected savings: Estimated savings with the recommended rate based on the last 15 days.
• Actions: Edit the drop rate, lock or unlock the pattern, or open matching log lines in Explore.

Apply recommendations

Applying recommendations is the most effective and efficient way to optimize your log management. As well as saving time and effort compared to manually reviewing and applying each recommendation individually, it also gives you immediate realization of cost savings.

You can apply recommendations to all patterns in the selected segment, or select specific patterns first.

To apply recommendations, complete the following steps.

1. Optionally, select one or more patterns using the checkboxes.

2. Click Apply all recommendations to apply to every pattern in the segment, or Apply selected recommendations to apply only to the patterns you selected.

3. Review the projected savings.

   The Apply recommended drop rates dialog box shows the projected dropped volume by segment and in total, including ingest volume, projected volume, and projected savings.

4. Click Apply to confirm.

Modify a single recommendation

To modify a single recommendation, complete the following steps.

1. In the Actions column, click the edit icon.

2. Enter a drop rate for the pattern.

   Valid values for the percentage of logs to be dropped are between 0 and 100. The drop rate supports up to two decimal places.

   The projected savings of making this change are displayed.

3. Click Apply.

Modify multiple recommendations

To modify multiple recommendations at once, complete the following steps.

1. Select the patterns you want to modify using the checkboxes.
2. Click Bulk edit drop rates.
3. Enter a drop rate to apply to all selected patterns.
4. Click Apply.

Lock and unlock patterns

Lock a pattern to prevent its drop rate from being changed by bulk edits or recommendation updates.

• To lock a pattern, click the lock icon in the Actions column for that pattern.
• To unlock a pattern, click the unlock icon.

To view all locked patterns, navigate to the Exemptions page and select the Lock tab.