An Evaluator class that reads through the traces autonomously would be great. Automated failure diagnostics are becoming more common. Equipping an evaluator with tools to explore traces on its own could be very useful.
E.g. expose a Traces tool to the evalutor with methods such as get_models() etc would be useful. Basically, almost a json-like interface.
An
Evaluatorclass that reads through the traces autonomously would be great. Automated failure diagnostics are becoming more common. Equipping an evaluator with tools to explore traces on its own could be very useful.E.g. expose a
Tracestool to the evalutor with methods such asget_models()etc would be useful. Basically, almost ajson-like interface.