Progress Reporting Feature

[evalstate]

Draft of Progress Capture.

Intent was to build on existing Logging System and provide a convenient way to produce rich display of progress events. Design should be simple to be able to add/filter scopes, add/easily enrich UX/progress display mechanisms and later use "Progress" log event types for high volume ephemeral comms.

Main changes:

• File Logger saves in JSONL format
• Secrets are obscured by the JSON serializer unless environment variable overrides
• Addition of ProgressLogger which captures the log event stream to convert log events to progress info
• Addition of contextual data to important log events for progress reporting
• Rudimentary formatter for progress events (on by default, can be switched off with config option progress_display=False)
• Offline summarizer, viewer, rich progress stimulator for further development and testing of display.

Future enhancements could include

• Use of "Progress" log events specifically to capture ephemeral high volume status updates (e.g. token streaming, MCP notifications).
• Abstractions in the augmented_llm areas etc. to avoid duplication of intent. Better use of constants/common methods to allow identification of important progress events.
• Console redirection and better use of Rich to make it more visually appealing.
• Better display of intent (e.g. Agent Call vs. Assistant Call) for Chatting.

[saqadri]

@evalstate thank you for this incredible change. It's superb, and I will merge it in and we can fix-forward any minor issues from there!