You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: Add Intelligent Context Condensing feature and enable by default (#215)
- Introduced Intelligent Context Condensing documentation with setup instructions and configuration options.
- Updated experimental features list to reflect the new feature.
- Enhanced context condensing functionality with improved UI and metrics.
- Streamlined navigation by reorganizing modes and settings.
- Added new release notes for versions 3.19.0 and 3.19, highlighting key updates and bug fixes.
- Improved sidebar configuration to include new context condensing feature.
- Added images for context condensing UI.
The Intelligent Context Condensing feature helps manage long conversations by summarizing earlier parts of the dialogue. This prevents important information from being lost when the context window nears its limit. This is an **experimental feature** and is **disabled by default**.
The Intelligent Context Condensing feature helps manage long conversations by summarizing earlier parts of the dialogue. This prevents important information from being lost when the context window nears its limit. This feature is **enabled by default**.
As your conversation with Roo Code grows, it might approach the context window limit of the underlying AI model. When this happens, older messages would typically be removed to make space. Intelligent Context Condensing aims to prevent this abrupt loss by:
@@ -31,29 +36,32 @@ As your conversation with Roo Code grows, it might approach the context window l
31
36
***Summarization Impact:** While original messages are preserved if you use [Checkpoints](/features/checkpoints) to rewind, the summarized version is what's used in ongoing LLM calls to keep the context manageable.
32
37
***Cost:** The AI call to perform the summarization incurs a cost. This cost is included in the context condensing metrics displayed in the UI.
33
38
34
-
## Enabling This Feature
39
+
## Configuration
35
40
36
-
As an experimental feature, Intelligent Context Condensing is **disabled by default**.
41
+
Intelligent Context Condensing is **enabled by default** and offers several configuration options:
37
42
38
43
1. Open Roo Code settings (<Codiconname="gear" /> icon in the top right corner of the Roo Code panel).
39
-
2. Navigate to the "Experimental" section.
40
-
3. Toggle the "Automatically trigger intelligent context condensing" (`autoCondenseContext`) option to enable it.
41
-
4. Optionally, adjust the "Threshold to trigger intelligent context condensing" (`autoCondenseContextPercent`) slider to control the trigger point for automatic context condensing.
42
-
5. Save your changes.
43
-
44
-
<imgsrc="/img/intelligent-context-condensation/intelligent-context-condensation-1.png"alt="Settings for Intelligent Context Condensing"width="600" />
45
-
*The image above shows settings for Intelligent Context Condensing: the toggle to "Automatically trigger intelligent context condensing" and the "Threshold to trigger intelligent context condensing" slider.*
46
-
44
+
2. Navigate to the "Context" settings section.
45
+
3. Configure the available options:
46
+
-**Automatically trigger intelligent context condensing**: Enabled by default, this controls whether condensing happens automatically
47
+
-**Threshold to trigger intelligent context condensing**: A percentage slider (default 100%) that determines when condensing activates based on context window usage
48
+
-**API Configuration for Context Condensing**: Choose which API configuration to use for condensing operations (defaults to your current active configuration)
49
+
-**Custom Context Condensing Prompt**: Customize the system prompt used for context condensing operations
50
+
51
+
<imgsrc="/img/intelligent-context-condensing/intelligent-context-condensing.png"alt="Settings for Intelligent Context Condensing"width="600" />
52
+
*Intelligent Context Condensing configuration options: automatic triggering toggle, threshold slider, API configuration selection, and custom prompt customization.*
47
53
## Controlling and Understanding Context Condensing
48
54
49
55
Roo Code provides several ways to control and understand the Intelligent Context Condensing feature:
50
56
51
57
### Controlling Context Condensing
52
-
***Automatic Threshold:** In Roo Code Settings (<Codiconname="gear" />) > "Experimental," the `autoCondenseContextPercent` setting allows you to define a percentage (e.g., 80%). Roo Code will attempt to condense the context automatically when the conversation reaches this level of the context window's capacity.
53
-
***Manual Trigger:** A **Condense Context** button (<Codiconname="fold" /> icon) is available when a task is expanded, typically located at the bottom of the task view, next to other task action icons like the trash can. This allows you to initiate the context condensing process at any time.
58
+
***Automatic Threshold:** The threshold slider in "Context" settings allows you to define a percentage (e.g., 80%) of context window usage. Roo Code will attempt to condense the context automatically when the conversation reaches this level of capacity.
59
+
***API Configuration:** Select which API configuration to use for context condensing operations. This allows you to use a different provider or model specifically for condensing if desired.
60
+
***Custom Prompts:** Modify the system prompt used for condensing to better suit your workflow or to emphasize certain aspects of conversation summarization.
61
+
***Manual Trigger:** A **Condense Context** button is available at the top of the task, positioned to the right of the context bar. This allows you to initiate the context condensing process at any time.
54
62
55
-
<imgsrc="/img/intelligent-context-condensation/intelligent-context-condensation-2.png"alt="Manual Condense Context button in expanded task view"width="600" />
56
-
*The Manual Condense Context button (highlighted with a yellow arrow) appears in the expanded task view.*
63
+
<imgsrc="/img/intelligent-context-condensing/intelligent-context-condensing-1.png"alt="Manual Condense Context button in expanded task view"width="600" />
64
+
*The Manual Condense Context button (highlighted with a yellow arrow) is easily accessible for manual control.*
57
65
58
66
### Understanding Context Condensing Activity
59
67
***Context Condensing Metrics:** When context condensing occurs, Roo Code displays:
@@ -72,13 +80,7 @@ Roo Code provides several ways to control and understand the Intelligent Context
72
80
73
81
* The task header also displays the current context condensing status.
74
82
* The `ContextWindowProgress` bar offers a visual representation of token distribution, including current usage, space reserved for the AI's output, available space, and raw token numbers.
75
-
***Interface Clarity:** The "Condense Context" button includes a tooltip explaining its function, available in all supported languages. The icon for context condensing-related actions is `codicon-compress`.
76
-
77
-
### Accurate Token Information
78
-
* Roo Code employs accurate token counting methods, with some AI providers utilizing their native token counting endpoints. This ensures that context size and associated costs are calculated reliably.
79
-
80
-
### Internationalization
81
-
* All user interface elements for this feature, such as button labels, tooltips, status messages, and settings descriptions, are available in multiple supported languages.
83
+
***Interface Clarity:** The "Condense Context" button includes a tooltip explaining its function, available in all supported languages.
82
84
83
85
## Technical Implementation
84
86
@@ -96,24 +98,3 @@ Roo Code uses a sophisticated token counting system that:
96
98
- This reservation can be overridden by model-specific settings
97
99
- The system automatically calculates available space while maintaining this reservation
98
100
99
-
## Performance Considerations
100
-
101
-
### Optimization
102
-
- The system optimizes token counting to minimize performance impact
103
-
- Token calculations are cached where possible
104
-
- Background processing prevents UI blocking during context condensing
105
-
106
-
### Resource Usage
107
-
- Context condensing operations are performed asynchronously
108
-
- The UI remains responsive during the process
109
-
- System resources are managed to prevent excessive memory usage
110
-
111
-
## Feedback
112
-
113
-
Your experience with experimental features is valuable. When reporting issues, please include:
114
-
- The current threshold setting
115
-
- The token counts before and after context condensing
116
-
- Any error messages displayed
117
-
- Steps to reproduce the issue
118
-
119
-
Please report any issues or suggestions regarding Intelligent Context Condensing on the [Roo Code GitHub Issues page](https://github.com/RooCodeInc/Roo-Code/issues).
Copy file name to clipboardExpand all lines: docs/update-notes/v3.17.0.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -35,7 +35,7 @@ Here's how it works:
35
35
36
36
<imgsrc="/img/intelligent-context-condensation/intelligent-context-condensation.png"alt="Settings for Intelligent Context Condensation"width="600" />
37
37
38
-
For more details on this experimental feature, including how to enable it, please see the [Intelligent Context Condensing documentation](/features/experimental/intelligent-context-condensing).
38
+
For more details on this feature, please see the [Intelligent Context Condensing documentation](/features/intelligent-context-condensing).
39
39
40
40
## Smoother Chat and Fewer Interruptions! (thanks Cline!)
Copy file name to clipboardExpand all lines: docs/update-notes/v3.17.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -35,7 +35,7 @@ Here's how it works:
35
35
36
36
<imgsrc="/img/intelligent-context-condensation/intelligent-context-condensation.png"alt="Settings for Intelligent Context Condensation"width="600" />
37
37
38
-
For more details on this experimental feature, including how to enable it, please see the [Intelligent Context Condensing documentation](/features/experimental/intelligent-context-condensing).
38
+
For more details on this feature, please see the [Intelligent Context Condensing documentation](/features/intelligent-context-condensing).
39
39
40
40
## Smoother Chat and Fewer Interruptions! (thanks Cline!)
Copy file name to clipboardExpand all lines: docs/update-notes/v3.18.0.mdx
+6-6Lines changed: 6 additions & 6 deletions
Original file line number
Diff line number
Diff line change
@@ -2,8 +2,8 @@
2
2
3
3
This release introduces comprehensive context condensing improvements, YAML support for custom modes, new AI model integrations, and numerous quality-of-life improvements and bug fixes.
4
4
5
-
## Context Condensing Upgrades (Experimental)
6
-
Our **experimental**Intelligent Context Condensing feature sees significant enhancements for better control and clarity. Remember, these are **disabled by default** (enable in Settings (⚙️) > "Experimental").
5
+
## Context Condensing Upgrades
6
+
Our Intelligent Context Condensing feature sees significant enhancements for better control and clarity. **Note**: As of version 3.19.0, this feature is enabled by default.
7
7
8
8
Watch a quick overview:
9
9
<divstyle={{width: '50%', margin: 'auto'}}>
@@ -19,11 +19,11 @@ Watch a quick overview:
19
19
</div>
20
20
</div>
21
21
Key updates:
22
-
***Adjustable Condensing Threshold & Manual Control**: Fine-tune automatic condensing or trigger it manually. [Learn more](/features/experimental/intelligent-context-condensing#controlling-context-condensing).
23
-
***Clear UI Indicators**: Better visual feedback during condensing. [Details](/features/experimental/intelligent-context-condensing#understanding-context-condensing-activity).
24
-
***Accurate Token Counting**: Improved accuracy for context and cost calculations. [More info](/features/experimental/intelligent-context-condensing#accurate-token-information).
22
+
***Adjustable Condensing Threshold & Manual Control**: Fine-tune automatic condensing or trigger it manually. [Learn more](/features/intelligent-context-condensing#controlling-context-condensing).
23
+
***Clear UI Indicators**: Better visual feedback during condensing. [Details](/features/intelligent-context-condensing#understanding-context-condensing-activity).
24
+
***Accurate Token Counting**: Improved accuracy for context and cost calculations. [More info](/features/intelligent-context-condensing#accurate-token-information).
25
25
26
-
For full details, see the main [Intelligent Context Condensing documentation](/features/experimental/intelligent-context-condensing).
26
+
For full details, see the main [Intelligent Context Condensing documentation](/features/intelligent-context-condensing).
0 commit comments