uqlm.white_box.single_logprobs.SingleLogprobsScorer#
- class uqlm.white_box.single_logprobs.SingleLogprobsScorer(scorers=['normalized_probability', 'min_probability', 'sequence_probability'])#
Bases:
LogprobsScorer- __init__(scorers=['normalized_probability', 'min_probability', 'sequence_probability'])#
Class for computing WhiteBox UQ scores with a single generation
Methods
__init__([scorers])Class for computing WhiteBox UQ scores with a single generation
evaluate(logprobs_results)Compute scores from logprobs results
extract_logprobs(single_response_logprobs)Extract log probabilities from token data
extract_probs(single_response_logprobs)Extract probabilities from token data
extract_top_logprobs(single_response_logprobs)Extract top log probabilities for each token
- evaluate(logprobs_results)#
Compute scores from logprobs results
- Return type:
Dict[str,List[float]]
- static extract_logprobs(single_response_logprobs)#
Extract log probabilities from token data
- Return type:
ndarray
- extract_probs(single_response_logprobs)#
Extract probabilities from token data
- Return type:
ndarray
- static extract_top_logprobs(single_response_logprobs)#
Extract top log probabilities for each token
- Return type:
List[ndarray]
References