Comparison of ChatBots
Based on text similarity between ground truth chat and generated chat messages
Comparison of ChatBot scores (max 10)
7.92
7.36
7.63
OpenAI API
PrivateGPT
asya.ai
Comparison of ChatBot scores (max 10)
Comparison of ChatBot accuracy
87.5%
77.5%
90.0%
OpenAI API
PrivateGPT
asya.ai
Comparison of ChatBot accuracy
ChatBot embeddings for extracting meaning (smaller distance better)
0.35
0.21
0.16
0.12
0.12
0.09
0.08
alfaneo
OpenAI API
jinja_emb
multi_miniLM_L12
all_mpnet_base
smlr
asya.ai
ChatBot embeddings for extracting meaning (smaller distance better)
ChatBot embeddings for extracting structure (larger distance better)
0.39
0.59
0.59
0.60
0.61
0.59
0.60
alfaneo
OpenAI API
jinja_emb
multi_miniLM_L12
all_mpnet_base
smlr
asya.ai
ChatBot embeddings for extracting structure (larger distance better)