â ð ð¶ð¹ððð ð¯.ð¬ ð¶ð»ðð¿ðŒð±ðð°ð²ð ðð ðð²ð¿ð»ð®ð¹ ððŒð¹ð¹ð²ð°ðð¶ðŒð»ð, ð® ðð®ð ððŒ ...

TL;DR · AI æèŠ
Milvus 3.0 åŒå ¥ External CollectionsïŒå®ç°æ¹æ°æ®é¶æ·èŽçŽ¢åŒïŒè§£å³æ°æ®åäœäžæçŽ¢æçé®é¢ã
æ žå¿èŠç¹
- External Collections æ¯æ Parquet/Lance/Iceberg çæ¹æ ŒåŒïŒæ éæ°æ®è¿ç§»
- äžç§å 蜜暡åŒå¹³è¡¡ååšææ¬äžæ¥è¯¢å»¶è¿ïŒäœååš/äœå»¶è¿/æ··åæš¡åŒïŒ
- é¿å ETL 忥æµçšïŒåå°æé管çåè°è¯å·¥äœé
ç»ææçº²
æç« èå¿«é跳蜬ã
- §åŒèš
Milvus 3.0 æšåº External Collections æ°ç¹æ§ïŒè§£å³æ¹æ°æ®æçŽ¢éŸé¢ã
å€å¶æ°æ®å°åéæ°æ®åºå¯ŒèŽåäœïŒçŽæ¥æ¥è¯¢æ¹æ°æ®çŒºä¹çŽ¢åŒæçäœäžã
éè¿æ å°å€éšå段æå»ºçŽ¢åŒïŒå®ç°æ¹æ°æ®åå°æçŽ¢ã
é¶æ·èŽè¯»åãå¢éçŽ¢åŒæå»ºãäžç§å 蜜暡åŒçµæŽ»é 眮ã
- âºéçšåºæ¯
éçšäºéèŠç产级æçŽ¢äžæ°æ®æéç±æ¹ç®¡æ§çåºæ¯ã
æç»Žå¯ŒåŸ
çšäžåŒ åŸçæž äž»é¢ä¹éŽçå ³ç³»ã
æ¥çå€§çº²ææ¬ïŒæ éç¢ / æ JS å奜ïŒ
- External Collections
- é®é¢èæ¯
- æ°æ®åäœïŒå€å¶å°åéæ°æ®åºïŒ
- æçŽ¢æçäœïŒçŽæ¥æ¥è¯¢æ¹æ°æ®ïŒ
- è§£å³æ¹æ¡
- é¶æ·èŽçŽ¢åŒæå»º
- æ¯æ Parquet/Lance/Iceberg æ ŒåŒ
- äžç§å 蜜暡åŒ
- äŒå¿
- é¿å ETL 忥
- éäœæé管çå€æåºŠ
éå¥ / Highlights
åŒåŸæ¶èäžå享çå ³é®å¥ã
External Collections æ¯è¯»åæ¹æ°æ®çæ°æ¹æ³ïŒæ éå€å¶æ°æ®å°æ°æ®åº
â 第 1 段
äžç§å 蜜暡åŒè®©å¢éåšååšææ¬åæ¥è¯¢å»¶è¿éŽååŸå¹³è¡¡
â 第 3 段
çžæ¯äŒ ç»æ¹æ¡åå° ETL 管éå忥工äœéïŒéäœè¿ç»Žå€æåºŠ
â 第 2 段
Milvus on X: "â ð ð¶ð¹ððð ð¯.ð¬ ð¶ð»ðð¿ðŒð±ðð°ð²ð ðð ðð²ð¿ð»ð®ð¹ ððŒð¹ð¹ð²ð°ðð¶ðŒð»ð, ð® ðð®ð ððŒ ðºð®ðžð² ð¹ð®ðžð²-ð¿ð²ðð¶ð±ð²ð»ð ðð²ð°ððŒð¿ ð±ð®ðð® ðð²ð®ð¿ð°ðµð®ð¯ð¹ð² ðð¶ððµðŒðð ð°ðŒðœðð¶ð»ðŽ ð¶ð ð¶ð»ððŒ ð® ðð²ð¿ðð¶ð»ðŽ ð±ð®ðð®ð¯ð®ðð². Many teams already have embeddings and metadata in object storage: Parquet files in S3, Lance datasets, Iceberg tables, or other lakehouse formats. Before Milvus 3.0, there were usually two ways to make that data searchable. ð¢ðœðð¶ðŒð» ðŒð»ð²: ð°ðŒðœð ð¶ð ð¶ð»ððŒ ð® ðð²ð°ððŒð¿ ð±ð®ðð®ð¯ð®ðð². You get low-latency ANN search, but now you have a second copy and an ETL pipeline to keep in sync. ð¢ðœðð¶ðŒð» ðððŒ: ðŸðð²ð¿ð ððµð² ð¹ð®ðžð² ð±ð¶ð¿ð²ð°ðð¹ð. You avoid duplication, but without ANN indexes, vector search turns into a brute-force scan. ðð ðð²ð¿ð»ð®ð¹ ððŒð¹ð¹ð²ð°ðð¶ðŒð»ð ð¶ð»ðð¿ðŒð±ðð°ð² ð® ððµð¶ð¿ð± ðœð®ððµ. You keep the data where it is, map external fields into a Milvus schema, and use the same Milvus search and query APIs. Milvus builds vector, BM25 inverted, JSON, and scalar indexes over the lake-resident data. The source files do not move. For teams where the lake owns permissions and freshness, every extra copy creates sync, access-control, and debugging work. ð ð³ð²ð ðœð¿ð®ð°ðð¶ð°ð®ð¹ ð±ð²ðð®ð¶ð¹ð ðºð®ððð²ð¿: ⢠External Collections are read-only and zero-copy. ⢠Milvus can index newly added fragments instead of rebuilding the whole collection. ⢠Three load modes let teams choose between lower storage cost and lower latency. Native Milvus collections are better for write-heavy serving. External Collections are for lake datasets that need production search without another copy. Know the details: https://t.co/NR2QfOORyC" / X
Milvus
@milvusio
â ð ð¶ð¹ððð ð¯.ð¬ ð¶ð»ðð¿ðŒð±ðð°ð²ð ðð ðð²ð¿ð»ð®ð¹ ððŒð¹ð¹ð²ð°ðð¶ðŒð»ð, ð® ðð®ð ððŒ ðºð®ðžð² ð¹ð®ðžð²-ð¿ð²ðð¶ð±ð²ð»ð ðð²ð°ððŒð¿ ð±ð®ðð® ðð²ð®ð¿ð°ðµð®ð¯ð¹ð² ðð¶ððµðŒðð ð°ðŒðœðð¶ð»ðŽ ð¶ð ð¶ð»ððŒ ð® ðð²ð¿ðð¶ð»ðŽ ð±ð®ðð®ð¯ð®ðð². Many teams already have embeddings and metadata in object storage: Parquet files in S3, Lance datasets, Iceberg tables, or other lakehouse formats. Before Milvus 3.0, there were usually two ways to make that data searchable. ð¢ðœðð¶ðŒð» ðŒð»ð²: ð°ðŒðœð ð¶ð ð¶ð»ððŒ ð® ðð²ð°ððŒð¿ ð±ð®ðð®ð¯ð®ðð². You get low-latency ANN search, but now you have a second copy and an ETL pipeline to keep in sync. ð¢ðœðð¶ðŒð» ðððŒ: ðŸðð²ð¿ð ððµð² ð¹ð®ðžð² ð±ð¶ð¿ð²ð°ðð¹ð. You avoid duplication, but without ANN indexes, vector search turns into a brute-force scan. ðð ðð²ð¿ð»ð®ð¹ ððŒð¹ð¹ð²ð°ðð¶ðŒð»ð ð¶ð»ðð¿ðŒð±ðð°ð² ð® ððµð¶ð¿ð± ðœð®ððµ. You keep the data where it is, map external fields into a Milvus schema, and use the same Milvus search and query APIs. Milvus builds vector, BM25 inverted, JSON, and scalar indexes over the lake-resident data. The source files do not move. For teams where the lake owns permissions and freshness, every extra copy creates sync, access-control, and debugging work. ð ð³ð²ð ðœð¿ð®ð°ðð¶ð°ð®ð¹ ð±ð²ðð®ð¶ð¹ð ðºð®ððð²ð¿: ⢠External Collections are read-only and zero-copy. ⢠Milvus can index newly added fragments instead of rebuilding the whole collection. ⢠Three load modes let teams choose between lower storage cost and lower latency. Native Milvus collections are better for write-heavy serving. External Collections are for lake datasets that need production search without another copy. Know the details:
milvus.io/docs/create-anâŠ
3:30 PM · Jul 28, 2026
200
Views
5
1