-
Notifications
You must be signed in to change notification settings - Fork 360
Description
Bug Description
几千份文件,多层级的文文件组织,文件比较大,执行报错
多个错误:
1、Error: Network error: HTTP request failed: error sending request for url (http://localhost:1933/api/v1/resources)
2、多次执行,ov add-resource /Users/dszhao/source/dwstore2ov/dw_store_it 每次生成新的虚拟目录,应该幂等更新,减少token浪费(瞬间烧了240RMB)
3、执行ov add-resource /Users/dszhao/source/dwstore2ov/dw_store_it时,ov status 是阻塞的
4、费token要用一种机制,类似cursor,没有变化的文件不要每次都构建索引或者embedding,要增量索引
Steps to Reproduce
1、配置open ai的模型
2、执行 ov add-resource 初始化数据
3、报错如截图
4、有大部分数据执行成功
5、重复执行一次,依旧报错
6、生成新的虚拟目录
Expected Behavior
1、支持幂等索引
2、支持增量索引
3、token节约机制
Actual Behavior
1、报错
2、重复索引
3、重复全量索引
4、费token
Minimal Reproducible Example
Error Logs
OpenViking Version
ov --version openviking 0.2.0
Python Version
python --version Python 3.13.1
Operating System
macOS
Model Backend
OpenAI
Additional Context
cat ~/.openviking/ov.conf
{
"storage": {
"workspace": "/Users/dszhao/source/dwstore2ov/openviking_workspace"
},
"log": {
"level": "INFO",
"output": "stdout"
},
"embedding": {
"dense": {
"api_base" : "https://www.dmxapi.cn/v1/",
"api_key" : "sk-pmzGuSxxExxxxxxxxxx",
"provider" : "openai",
"dimension": 1536,
"model" : "text-embedding-3-small"
},
"max_concurrent": 10
},
"vlm": {
"api_base" : "https://www.dmxapi.cn/v1/",
"api_key" : "sk-pmzGuSxxEW9Vxxxxx",
"provider" : "openai",
"model" : "gpt-5-mini",
"max_concurrent": 100
}
}
Metadata
Metadata
Assignees
Labels
Type
Projects
Status