README.md

metadata

license: mit
datasets:
  - sms1097/self_rag_tokens_train_data

Support Model

This generates the IsSupported token as descirbed in Self-RAG.

We are testing to see if a generated LLM answer is supported by the document. This is similar to testing for a hallucination in the model result.

The expected input to the model is shown here:

Context: {'doc'}\nAnswer: {answer}"

Training results:

{'eval_loss': 0.11030498147010803, 
'eval_mse': 0.11030498147010803, 
'eval_mae': 0.14249496161937714, 
'eval_r2': 0.6906673524053266, 
'eval_accuracy': 0.9117161716171617}