Maxkb加载gpt2失败
问题描述#
在Maxkb使用AI高级编排时,使用AI对话会抛出Can’t load tokenizer for ‘gpt2’的异常
Can't load tokenizer for 'gpt2. if you were trying to load it from "htps://huggingface.co/models, make sure you don't have a
local directory with the same name. 0therwise, make sure 'gpt2 is the correct path to a directory containing all relevant files for
a GPT2TokenizerFast tokenizer.
解决方法#
这是由于用于计算token