-
Notifications
You must be signed in to change notification settings - Fork 16
Open
Description
Description:
To collect more runtime data and to help us debug, I suggest that we use AG2's custom logging framework to collect runtime data. This implementation will allow us to monitor the CMBAgent's behavior and provide a full runtime record of where the agents got it right and wrong. Eventually, we may even be able to use the logs to fine-tune the agents.
Proposal
- Integrate AG2's custom logging system into the project.
- Configure the logging framework to capture runtime data, such as:
- Full decision tree stack.
- Whether the run was successful or not.
- Make sure that logs are structured, consistent, and saved to a designated folder.
- Provide configuration options for log verbosity and output destinations (e.g., console, files, or external logging systems).
Goals
- Improves visibility into the model's runtime behavior.
- Simplifies the debugging process by capturing detailed logs of errors and events.
Misc Notes
- We could implement this ourselves using the Python standard library, but it seems like AG2 team has already been implemented it (https://docs.ag2.ai/docs/reference/runtime_logging). So, it’s probably just a matter of using this feature throughout and also making it configurable at runtime.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels