Class EvaluationResultContent
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<EvaluationResultContent.Builder,EvaluationResultContent>
The comprehensive result of an evaluation containing the score, explanation, evaluator metadata, and execution details. Provides both quantitative ratings and qualitative insights about agent performance.
- See Also:
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionbuilder()final Contextcontext()The contextual information associated with this evaluation result, including span context details that identify the specific traces and sessions that were evaluated.final booleanfinal booleanequalsBySdkFields(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.final StringThe error code indicating the type of failure that occurred during evaluation.final StringThe error message describing what went wrong if the evaluation failed.final StringThe Amazon Resource Name (ARN) of the evaluator used to generate this result.final StringThe unique identifier of the evaluator that produced this result.final StringThe human-readable name of the evaluator used for this evaluation.final StringThe detailed explanation provided by the evaluator describing the reasoning behind the assigned score.final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz) final inthashCode()final booleanFor responses, this returns true if the service returned a value for the IgnoredReferenceInputFields property.The list of reference input field names that were provided but not used by the evaluator.final Stringlabel()The categorical label assigned by the evaluator when using a categorical rating scale.static Class<? extends EvaluationResultContent.Builder> Take this object and create a builder that contains all of the current property values of this object.final TokenUsageThe token consumption statistics for this evaluation, including input tokens, output tokens, and total tokens used by the underlying language model during the evaluation process.final StringtoString()Returns a string representation of this object.final Doublevalue()The numerical score assigned by the evaluator according to its configured rating scale.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
evaluatorArn
The Amazon Resource Name (ARN) of the evaluator used to generate this result. For custom evaluators, this is the full ARN; for built-in evaluators, this follows the pattern
Builtin.{EvaluatorName}.- Returns:
- The Amazon Resource Name (ARN) of the evaluator used to generate this result. For custom evaluators, this
is the full ARN; for built-in evaluators, this follows the pattern
Builtin.{EvaluatorName}.
-
evaluatorId
The unique identifier of the evaluator that produced this result. This matches the
evaluatorIdprovided in the evaluation request and can be used to identify which evaluator generated specific results.- Returns:
- The unique identifier of the evaluator that produced this result. This matches the
evaluatorIdprovided in the evaluation request and can be used to identify which evaluator generated specific results.
-
evaluatorName
The human-readable name of the evaluator used for this evaluation. For built-in evaluators, this is the descriptive name (e.g., "Helpfulness", "Correctness"); for custom evaluators, this is the user-defined name.
- Returns:
- The human-readable name of the evaluator used for this evaluation. For built-in evaluators, this is the descriptive name (e.g., "Helpfulness", "Correctness"); for custom evaluators, this is the user-defined name.
-
explanation
The detailed explanation provided by the evaluator describing the reasoning behind the assigned score. This qualitative feedback helps understand why specific ratings were given and provides actionable insights for improvement.
- Returns:
- The detailed explanation provided by the evaluator describing the reasoning behind the assigned score. This qualitative feedback helps understand why specific ratings were given and provides actionable insights for improvement.
-
context
The contextual information associated with this evaluation result, including span context details that identify the specific traces and sessions that were evaluated.
- Returns:
- The contextual information associated with this evaluation result, including span context details that identify the specific traces and sessions that were evaluated.
-
value
The numerical score assigned by the evaluator according to its configured rating scale. For numerical scales, this is a decimal value within the defined range. This field is not allowed for categorical scales.
- Returns:
- The numerical score assigned by the evaluator according to its configured rating scale. For numerical scales, this is a decimal value within the defined range. This field is not allowed for categorical scales.
-
label
The categorical label assigned by the evaluator when using a categorical rating scale. This provides a human-readable description of the evaluation result (e.g., "Excellent", "Good", "Poor") corresponding to the numerical value. For numerical scales, this field is optional and provides a natural language explanation of what the value means (e.g., value 0.5 = "Somewhat Helpful").
- Returns:
- The categorical label assigned by the evaluator when using a categorical rating scale. This provides a human-readable description of the evaluation result (e.g., "Excellent", "Good", "Poor") corresponding to the numerical value. For numerical scales, this field is optional and provides a natural language explanation of what the value means (e.g., value 0.5 = "Somewhat Helpful").
-
tokenUsage
The token consumption statistics for this evaluation, including input tokens, output tokens, and total tokens used by the underlying language model during the evaluation process.
- Returns:
- The token consumption statistics for this evaluation, including input tokens, output tokens, and total tokens used by the underlying language model during the evaluation process.
-
errorMessage
The error message describing what went wrong if the evaluation failed. Provides detailed information about evaluation failures to help diagnose and resolve issues with evaluator configuration or input data.
- Returns:
- The error message describing what went wrong if the evaluation failed. Provides detailed information about evaluation failures to help diagnose and resolve issues with evaluator configuration or input data.
-
errorCode
The error code indicating the type of failure that occurred during evaluation. Used to programmatically identify and handle different categories of evaluation errors.
- Returns:
- The error code indicating the type of failure that occurred during evaluation. Used to programmatically identify and handle different categories of evaluation errors.
-
hasIgnoredReferenceInputFields
public final boolean hasIgnoredReferenceInputFields()For responses, this returns true if the service returned a value for the IgnoredReferenceInputFields property. This DOES NOT check that the value is non-empty (for which, you should check theisEmpty()method on the property). This is useful because the SDK will never return a null collection or map, but you may need to differentiate between the service returning nothing (or null) and the service returning an empty collection or map. For requests, this returns true if a value for the property was specified in the request builder, and false if a value was not specified. -
ignoredReferenceInputFields
The list of reference input field names that were provided but not used by the evaluator. Helps identify which ground truth data was not consumed during evaluation.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that you can differentiate between null and empty), you can use the
hasIgnoredReferenceInputFields()method.- Returns:
- The list of reference input field names that were provided but not used by the evaluator. Helps identify which ground truth data was not consumed during evaluation.
-
toBuilder
Description copied from interface:ToCopyableBuilderTake this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilderin interfaceToCopyableBuilder<EvaluationResultContent.Builder,EvaluationResultContent> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
-
equals
-
equalsBySdkFields
Description copied from interface:SdkPojoIndicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojoclass, and is generated based on a service model.If an
SdkPojoclass does not have any inherited fields,equalsBySdkFieldsandequalsare essentially the same.- Specified by:
equalsBySdkFieldsin interfaceSdkPojo- Parameters:
obj- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
-
getValueForField
-
sdkFields
-
sdkFieldNameToField
- Specified by:
sdkFieldNameToFieldin interfaceSdkPojo- Returns:
- The mapping between the field name and its corresponding field.
-