milvus-v2.4.6集群启动报错datacoord报错，求助

[jhyever]

@yhmo 麻烦帮忙看下感谢

milvus-v2.4.6集群启动报错datacoord报错，导致其他的也启动不起来
open pid file: /run/milvus/datacoord.pid
lock pid file: /run/milvus/datacoord.pid
[2025/01/09 05:37:12.785 +00:00] [INFO] [roles/roles.go:307] ["starting running Milvus components"]
[2025/01/09 05:37:12.785 +00:00] [INFO] [roles/roles.go:170] ["Enable Jemalloc"] ["Jemalloc Path"=/milvus/lib/libjemalloc.so]
[2025/01/09 05:37:12.796 +00:00] [DEBUG] [config/refresher.go:67] ["start refreshing configurations"] [source=FileSource]
[2025/01/09 05:37:12.800 +00:00] [DEBUG] [config/etcd_source.go:52] ["init etcd source"] [etcdInfo="{"UseEmbed":false,"EnableAuth":false,"UserName":"","PassWord":"","UseSSL":false,"Endpoints":["my-release-etcd:2379"],"KeyPrefix":"by-dev","CertFile":"/path/to/etcd-client.pem","KeyFile":"/path/to/etcd-client-key.pem","CaCertFile":"/path/to/ca.pem","MinVersion":"1.3","RefreshInterval":5000000000}"]
[2025/01/09 05:37:12.800 +00:00] [INFO] [etcd/etcd_util.go:49] ["create etcd client"] [useEmbedEtcd=false] [useSSL=false] [endpoints="[my-release-etcd:2379]"] [minVersion=1.3]
[2025/01/09 05:37:12.804 +00:00] [DEBUG] [config/etcd_source.go:91] ["etcd refreshConfigurations"] [prefix=by-dev/config] [endpoints="[my-release-etcd:2379]"]
[2025/01/09 05:37:12.806 +00:00] [DEBUG] [config/refresher.go:67] ["start refreshing configurations"] [source=EtcdSource]
[2025/01/09 05:37:12.806 +00:00] [INFO] [paramtable/component_param.go:3566] ["DeployModeEnv is not set, use default"] [default=0.5]
[2025/01/09 05:37:12.808 +00:00] [INFO] [paramtable/hook_config.go:21] ["hook config"] [hook={}]
[2025/01/09 05:37:12.808 +00:00] [INFO] [roles/roles.go:256] [setupPrometheusHTTPServer]
[2025/01/09 05:37:12.808 +00:00] [DEBUG] [config/refresher.go:67] ["start refreshing configurations"] [source=FileSource]
[2025/01/09 05:37:12.808 +00:00] [INFO] [http/server.go:152] ["management listen"] [addr=:9091]
[2025/01/09 05:37:12.808 +00:00] [INFO] [etcd/etcd_util.go:49] ["create etcd client"] [useEmbedEtcd=false] [useSSL=false] [endpoints="[my-release-etcd:2379]"] [minVersion=1.3]
[2025/01/09 05:37:12.810 +00:00] [DEBUG] [datacoord/service.go:150] ["network port"] [port=13333]
[2025/01/09 05:37:12.911 +00:00] [INFO] [dependency/factory.go:86] ["try to init mq"] [standalone=false] [mqType=pulsar]
[2025/01/09 05:37:12.911 +00:00] [INFO] [etcd/etcd_util.go:49] ["create etcd client"] [useEmbedEtcd=false] [useSSL=false] [endpoints="[my-release-etcd:2379]"] [minVersion=1.3]
[2025/01/09 05:37:12.914 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
[2025/01/09 05:37:12.916 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
[2025/01/09 05:37:12.919 +00:00] [DEBUG] [sessionutil/session_util.go:315] [getServerID] [reuse=true]
[2025/01/09 05:37:12.924 +00:00] [DEBUG] [sessionutil/session_util.go:373] ["Session get serverID success"] [key=id] [ServerId=19]
[2025/01/09 05:37:12.924 +00:00] [INFO] [sessionutil/session_util.go:289] ["start server"] [name=indexcoord] [address=100.121.51.75:13333] [id=19]
[2025/01/09 05:37:12.924 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
[2025/01/09 05:37:12.925 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
[2025/01/09 05:37:12.927 +00:00] [DEBUG] [sessionutil/session_util.go:315] [getServerID] [reuse=true]
[2025/01/09 05:37:12.927 +00:00] [INFO] [sessionutil/session_util.go:289] ["start server"] [name=datacoord] [address=100.121.51.75:13333] [id=19]
[2025/01/09 05:37:12.927 +00:00] [DEBUG] [sessionutil/session_util.go:257] ["Session try to connect to etcd"]
[2025/01/09 05:37:12.928 +00:00] [DEBUG] [sessionutil/session_util.go:272] ["Session connect to etcd success"]
[2025/01/09 05:37:12.929 +00:00] [INFO] [datacoord/server.go:343] ["init rootcoord client done"]
[2025/01/09 05:37:12.929 +00:00] [ERROR] [datacoord/server.go:548] ["chunk manager init failed"] [error="Endpoint url cannot have fully qualified paths."] [stack="github.com/milvus-io/milvus/internal/datacoord.(*Server).newChunkManagerFactory\n\t/workspace/source/internal/datacoord/server.go:548\ngithub.com/milvus-io/milvus/internal/datacoord.(*Server).initDataCoord\n\t/workspace/source/internal/datacoord/server.go:348\ngithub.com/milvus-io/milvus/internal/datacoord.(*Server).Init\n\t/workspace/source/internal/datacoord/server.go:334\ngithub.com/milvus-io/milvus/internal/distributed/datacoord.(*Server).init\n\t/workspace/source/internal/distributed/datacoord/service.go:129\ngithub.com/milvus-io/milvus/internal/distributed/datacoord.(*Server).Run\n\t/workspace/source/internal/distributed/datacoord/service.go:256\ngithub.com/milvus-io/milvus/cmd/components.(*DataCoord).Run\n\t/workspace/source/cmd/components/data_coord.go:52\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/workspace/source/cmd/roles/roles.go:114"]
[2025/01/09 05:37:12.929 +00:00] [ERROR] [datacoord/service.go:130] ["dataCoord init error"] [error="Endpoint url cannot have fully qualified paths."] [stack="github.com/milvus-io/milvus/internal/distributed/datacoord.(*Server).init\n\t/workspace/source/internal/distributed/datacoord/service.go:130\ngithub.com/milvus-io/milvus/internal/distributed/datacoord.(*Server).Run\n\t/workspace/source/internal/distributed/datacoord/service.go:256\ngithub.com/milvus-io/milvus/cmd/components.(*DataCoord).Run\n\t/workspace/source/cmd/components/data_coord.go:52\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/workspace/source/cmd/roles/roles.go:114"]
[2025/01/09 05:37:12.929 +00:00] [ERROR] [components/data_coord.go:53] ["DataCoord starts error"] [error="Endpoint url cannot have fully qualified paths."] [stack="github.com/milvus-io/milvus/cmd/components.(*DataCoord).Run\n\t/workspace/source/cmd/components/data_coord.go:53\ngithub.com/milvus-io/milvus/cmd/roles.runComponent[...].func1\n\t/workspace/source/cmd/roles/roles.go:114"]
panic: Endpoint url cannot have fully qualified paths.

goroutine 202 [running]:
panic({0x56dbe00?, 0xc000caa300?})
/usr/local/go/src/runtime/panic.go:1017 +0x3ac fp=0xc00015bf70 sp=0xc00015bec0 pc=0x1de2aec
github.com/milvus-io/milvus/cmd/roles.runComponent[...].func1()
/workspace/source/cmd/roles/roles.go:115 +0x108 fp=0xc00015bfe0 sp=0xc00015bf70 pc=0x4d4b2a8
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00015bfe8 sp=0xc00015bfe0 pc=0x1e1c341
created by github.com/milvus-io/milvus/cmd/roles.runComponent[...] in goroutine 1
/workspace/source/cmd/roles/roles.go:106 +0x138

goroutine 1 [semacquire]:
runtime.gopark(0x110?, 0x5499d80?, 0x20?, 0x4?, 0x7f310e5ab218?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00191f5c0 sp=0xc00191f5a0 pc=0x1de6b0e
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.semacquire1(0xc000a77c98, 0x80?, 0x1, 0x0, 0x0?)
/usr/local/go/src/runtime/sema.go:160 +0x218 fp=0xc00191f628 sp=0xc00191f5c0 pc=0x1df8718
sync.runtime_Semacquire(0x59fe038?)
/usr/local/go/src/runtime/sema.go:62 +0x25 fp=0xc00191f660 sp=0xc00191f628 pc=0x1e17b65
sync.(*WaitGroup).Wait(0x51daf80?)
/usr/local/go/src/sync/waitgroup.go:116 +0x48 fp=0xc00191f688 sp=0xc00191f660 pc=0x1e3e548
github.com/milvus-io/milvus/cmd/roles.(*MilvusRoles).Run(0xc000b98730)
/workspace/source/cmd/roles/roles.go:403 +0xe29 fp=0xc00191fbb8 sp=0xc00191f688 pc=0x4d490e9
github.com/milvus-io/milvus/cmd/milvus.(*run).execute(0xc00143fcf0?, {0xc000052810?, 0x3, 0x3}, 0xc000a10d20)
/workspace/source/cmd/milvus/run.go:47 +0x2c9 fp=0xc00191fc88 sp=0xc00191fbb8 pc=0x4d55449
github.com/milvus-io/milvus/cmd/milvus.RunMilvus({0xc000052810?, 0x3, 0x3})
/workspace/source/cmd/milvus/milvus.go:60 +0x204 fp=0xc00191fd00 sp=0xc00191fc88 pc=0x4d550e4
main.main()
/workspace/source/cmd/main.go:95 +0x425 fp=0xc00191ff40 sp=0xc00191fd00 pc=0x4d59c05
runtime.main()
/usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc00191ffe0 sp=0xc00191ff40 pc=0x1de669b
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00191ffe8 sp=0xc00191ffe0 pc=0x1e1c341

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000bcfa8 sp=0xc0000bcf88 pc=0x1de6b0e
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.forcegchelper()
/usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc0000bcfe0 sp=0xc0000bcfa8 pc=0x1de6973
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bcfe8 sp=0xc0000bcfe0 pc=0x1e1c341
created by runtime.init.6 in goroutine 1
/usr/local/go/src/runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000bd778 sp=0xc0000bd758 pc=0x1de6b0e
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.bgsweep(0x0?)
/usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000bd7c8 sp=0xc0000bd778 pc=0x1dce99f
runtime.gcenable.func1()
/usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000bd7e0 sp=0xc0000bd7c8 pc=0x1dc3745
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bd7e8 sp=0xc0000bd7e0 pc=0x1e1c341
created by runtime.gcenable in goroutine 1
/usr/local/go/src/runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]:
runtime.gopark(0xc0000e6000?, 0x5e894e8?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000bdf70 sp=0xc0000bdf50 pc=0x1de6b0e
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.(*scavengerState).park(0x853fb60)
/usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc0000bdfa0 sp=0xc0000bdf70 pc=0x1dcc009
runtime.bgscavenge(0x0?)
/usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc0000bdfc8 sp=0xc0000bdfa0 pc=0x1dcc5d9
runtime.gcenable.func2()
/usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc0000bdfe0 sp=0xc0000bdfc8 pc=0x1dc36e5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bdfe8 sp=0xc0000bdfe0 pc=0x1e1c341
created by runtime.gcenable in goroutine 1
/usr/local/go/src/runtime/mgc.go:201 +0xa5

goroutine 5 [finalizer wait]:
runtime.gopark(0x0?, 0x59fcf18?, 0x20?, 0x40?, 0x2000000020?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000bc620 sp=0xc0000bc600 pc=0x1de6b0e
runtime.runfinq()
/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000bc7e0 sp=0xc0000bc620 pc=0x1dc26e7
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bc7e8 sp=0xc0000bc7e0 pc=0x1e1c341
created by runtime.createfing in goroutine 1
/usr/local/go/src/runtime/mfinal.go:163 +0x3d

goroutine 6 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000be750 sp=0xc0000be730 pc=0x1de6b0e
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1295 +0xe5 fp=0xc0000be7e0 sp=0xc0000be750 pc=0x1dc52c5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000be7e8 sp=0xc0000be7e0 pc=0x1e1c341
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1219 +0x1c

goroutine 18 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b8750 sp=0xc0000b8730 pc=0x1de6b0e
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1295 +0xe5 fp=0xc0000b87e0 sp=0xc0000b8750 pc=0x1dc52c5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b87e8 sp=0xc0000b87e0 pc=0x1e1c341
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1219 +0x1c

goroutine 19 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b8f50 sp=0xc0000b8f30 pc=0x1de6b0e
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1295 +0xe5 fp=0xc0000b8fe0 sp=0xc0000b8f50 pc=0x1dc52c5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b8fe8 sp=0xc0000b8fe0 pc=0x1e1c341
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1219 +0x1c

goroutine 20 [GC worker (idle)]:

[yhmo]

["chunk manager init failed"] [error="Endpoint url cannot have fully qualified paths."]
相似的issue：
#38637
#28032

这是跟minio的设置强相关的问题，datacoord无法连接minio，你可以参考一下#28032看是不是同一个

[jhyever]

已解决，感谢

[fanbaoming123]

How did you solve it?