Evaluation

Node: evaluation · Full type: n8n-nodes-base.evaluation · Version: 4.8

Credentials

googleApi (alias: @google) / googleSheetsOAuth2Api (alias: @google)

CREDENTIAL @google = googleApi "My Evaluation"

Operations

setInputs

Parameter	Type	Default	Details
inputs	fixedCollection	{}	groups: values

setOutputs

Parameter	Type	Default	Details
source	options	"dataTable"	dataTable, googleSheets
source	options	"googleSheets"	dataTable, googleSheets
documentId	resourceLocator	{...}	required; modes: list, url, id
sheetName	resourceLocator	{...}	required; modes: list, url, id
outputs	fixedCollection	{}	groups: values

setMetrics

Parameter	Type	Default	Details
metric	hidden	"customMetrics"
metric	options	"correctness"	correctness, helpfulness, stringSimilarity, categorization, toolsUsed, customMetrics
expectedAnswer	string	""
actualAnswer	string	""
userQuery	string	""
actualAnswer	string	""
expectedTools	string	""
intermediateSteps	string	""
prompt	string	"You are an expert factual evaluator a..."
prompt	string	"You are an expert evaluator assessing..."
metrics	assignmentCollection	{...}
options	collection	{}	keys: metricName, inputPrompt
options	collection	{}	keys: metricName, inputPrompt
options	collection	{}	keys: metricName
options	collection	{}	keys: metricName
options	collection	{}	keys: metricName

checkIfEvaluating

No additional parameters.

Common Parameters

Parameter	Type	Default	Details
authentication	options	"oAuth2"	serviceAccount, oAuth2
dataTableId	resourceLocator	{...}	required; modes: list, id

Parameter Details

outputs children:

values group:

Parameter	Type	Default	Details
outputName	string	""
outputValue	string	""

inputs children:

values group:

Parameter	Type	Default	Details
inputName	string	""
inputValue	string	""

options children:

Parameter	Type	Default	Details
metricName	string	"Correctness"
inputPrompt	string	"Output: {actual_answer}

Ground truth..." | |

Example

NODE "evaluation" @google AS "Evaluation" {
  operation: "setInputs"
}