feat: update docker.io/qdrant/qdrant docker tag to v1.13.2

[sebastien-prudhomme]

This PR contains the following updates:

Package	Update	Change
docker.io/qdrant/qdrant (source)	minor	v1.4.1 -> v1.13.2

---

Release Notes

qdrant/qdrant (docker.io/qdrant/qdrant)

v1.13.2

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5891 - Add support for GPUs not featuring half floats, falling back to full floats

Bug fixes

• https://github.com/qdrant/qdrant/pull/5882 - Fix blob store for payloads and sparse vectors potentially panicking when inserting large value
• https://github.com/qdrant/qdrant/pull/5866 - Fix optimizers reusing points with no version, improving data resilience

v1.13.1

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5820 - Improve performance and memory usage of segment merging in optimizers

Bug fixes

• https://github.com/qdrant/qdrant/pull/5848 - Fix potential panic in search after GPU HNSW building
• https://github.com/qdrant/qdrant/pull/5847 - Fix potential panic in GPU HNSW building when having empty payload index
• https://github.com/qdrant/qdrant/pull/5819 - Fix set payload by key on in-memory payload storage not persisting properly
• https://github.com/qdrant/qdrant/pull/5861 - Fix memory mapped sparse vector storage not flushing mappings properly
• https://github.com/qdrant/qdrant/pull/5838 - Fix user-defined sharding not persisting numeric shard keys properly
• https://github.com/qdrant/qdrant/pull/5842 - Do not flush empty memory maps to prevent panic on macOS
• https://github.com/qdrant/qdrant/pull/5843 - Do not flush explicitly when unloading blob storage
• https://github.com/qdrant/qdrant/pull/5845 - Fix potential panic in full text index due to missed bound check

v1.13.0

Compare Source

Change log

Features 🎨

• milestone/18 - Add GPU support for HNSW super fast indexing
• milestone/3 - Add resharding in our cloud offering, change the number of shards at runtime
• milestone/13 - Add strict mode to restrict certain type of operations on collections
• https://github.com/qdrant/qdrant/pull/5303 - Add Has Vector filtering condition, check if a named vector is present on a point

Improvements 🚀

• https://github.com/qdrant/qdrant/pull/5783 - Switch to mmap storage for payloads by default to make it more efficient, eliminating unexpected latency spikes
• https://github.com/qdrant/qdrant/pull/5784 - Switch to mmap storage for sparse vectors to make it more efficient, allowing better resource management
• https://github.com/qdrant/qdrant/pull/5781 - Compress HNSW graph links
• https://github.com/qdrant/qdrant/pull/5796 - Remove peer metadata for removed peers
• https://github.com/qdrant/qdrant/pull/5634 - Allow to set max_optimization_threads back to automatic
• https://github.com/qdrant/qdrant/pull/5178 - Stream snapshots in snapshot transfer, don't put snapshots on disk first

Bug fixes 💢

• https://github.com/qdrant/qdrant/pull/5810 - Fix incorrect validation rules on deleted threshold in gRPC API
• https://github.com/qdrant/qdrant/pull/5808 - Don't allow conflicting names for dense and sparse vectors

---

Thanks to @​gulshan-rs @​ashwantmanikoth @​kartik-gupta-ij @​palash25 @​redouan-rhazouani @​weiwch @​n0x29a @​pedjak @​agourlay @​xzfc @​JojiiOfficial @​tellet-q @​coszio @​ffuugoo @​KShivendu @​joein @​IvanPleshkov @​generall @​timvisee for their contributions!

v1.12.6

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5687 - Support 64-bit dimension indices for sparse vectors
• https://github.com/qdrant/qdrant/pull/5609 - Support issues API with limited API keys
• https://github.com/qdrant/qdrant/pull/5602 - Add support for logging in JSON format
• https://github.com/qdrant/qdrant/pull/5630 - Add web UI to Debian package

Bug fixes

• https://github.com/qdrant/qdrant/pull/5629 - Properly flush files with fsync to prevent storage issues
• https://github.com/qdrant/qdrant/pull/5627 - Atomically save quantization metadata
• https://github.com/qdrant/qdrant/pull/5628 - Atomically save chunked mmap configuration
• https://github.com/qdrant/qdrant/pull/5738 - Fix search panic due to unaligned data when loading old Qdrant snapshot (pre v1.8.2)
• https://github.com/qdrant/qdrant/pull/5643 - Improve collection validation, disallow replication factor 0 causing a panic
• https://github.com/qdrant/qdrant/pull/5690 - Ignore empty filter conditions rather than showing an error
• https://github.com/qdrant/qdrant/pull/5676 - Enforce TLS for internal node communication if URL is not explicitly provided

v1.12.5

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5505 - Improve point retrieval across shards by streaming results
• https://github.com/qdrant/qdrant/pull/5521 - Improve point searches across segments by streaming results
• https://github.com/qdrant/qdrant/pull/5514 - Improve facet computing across shards by streaming results
• https://github.com/qdrant/qdrant/pull/5405 - Make /readyz catch up to latest consensus commit
• https://github.com/qdrant/qdrant/pull/5506 - Improve handling of non-transient errors, making shard transfers more robust
• https://github.com/qdrant/qdrant/pull/5478 - When peer starts, cancel all shard transfers related to it
• https://github.com/qdrant/qdrant/pull/5536 - Improve error message on sparse vector validation error
• https://github.com/qdrant/qdrant/pull/5546, https://github.com/qdrant/qdrant/pull/5580 - Improve error messages on various structure variants on validation error
• https://github.com/qdrant/qdrant/pull/5540 - Improve point counting on proxy segments by deduplicating point IDs
• https://github.com/qdrant/qdrant/pull/5522 - Expose shards keys in telemetry
• https://github.com/qdrant/qdrant/pull/5591 - Improve payload performance in gRPC API
• https://github.com/qdrant/qdrant/pull/5486 - Remove support for reading HNSW graphs of Qdrant 0.8.4 and older, simplifying behavior
• https://github.com/qdrant/qdrant/pull/5579 - Improve gRPC logging and error handling
• https://github.com/qdrant/qdrant/pull/5493 - Always log all errors when applying update to replica set

Bug fixes

• https://github.com/qdrant/qdrant/pull/5585 - Improve data consistency, fix point deduplication on start potentially removing newest point version
• https://github.com/qdrant/qdrant/pull/5527, https://github.com/qdrant/qdrant/pull/5528, https://github.com/qdrant/qdrant/pull/5531 - Improve data consistency, fix mixing point versions when applying updates, always use latest point
• https://github.com/qdrant/qdrant/pull/5543 - Improve data consistency, fix segment builder mixing point versions during segment optimization
• https://github.com/qdrant/qdrant/pull/5573 - Improve data consistency, fix proxy segment not using correct point versions when propagating point deletes
• https://github.com/qdrant/qdrant/pull/5581 - Improve data consistency, fix proxy segment not using correct versions when propagating payload index changes
• https://github.com/qdrant/qdrant/pull/5553 - Improve data consistency, fix proxy segment not flushing changes if sharing a write segment
• https://github.com/qdrant/qdrant/pull/5557 - Improve data consistency, fix flushing proxied segment acknowledging operations that were not actually persisted
• https://github.com/qdrant/qdrant/pull/5510 - Improve data consistency, fix marking points as deleted not working in all cases
• https://github.com/qdrant/qdrant/pull/5598 - Fix peer getting stuck on start if consensus snapshots are used
• https://github.com/qdrant/qdrant/pull/5484 - Fix panic on huge search limit
• https://github.com/qdrant/qdrant/pull/5600 - Fix prefetch with group-by internally using wrong request limit, significantly reducing search time
• https://github.com/qdrant/qdrant/pull/5488 - Fix incorrect timeout handling in distance matrix API
• https://github.com/qdrant/qdrant/pull/5495 - Fix incorrect timeout handling on remote shards
• https://github.com/qdrant/qdrant/pull/5596 - Fix broken replication factor in gRPC create shard key API
• https://github.com/qdrant/qdrant/pull/5551 - Fix potential division by zero in facets API
• https://github.com/qdrant/qdrant/pull/5593, https://github.com/qdrant/qdrant/pull/5603, https://github.com/qdrant/qdrant/pull/5605, https://github.com/qdrant/qdrant-web-ui/pull/262 - Bump some dependencies to patch potential security vulnerabilities

v1.12.4

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5440 - ✨ Optimize mmap sequential access for full-scan segments and reading of large vectors
• https://github.com/qdrant/qdrant/pull/5428 - Leverage ahash in search results
• https://github.com/qdrant/qdrant/pull/5414 - Improvements for update clocks to improve updates consistency
• https://github.com/qdrant/qdrant/pull/5448 - Sync consensus at the end of stream records transfer
• https://github.com/qdrant/qdrant/pull/5378 - Introduce a unique identifier for collections for easier consensus snapshots resolution

Bug fixes

• https://github.com/qdrant/qdrant/pull/5457 - ✨ Fixes for rescoring param usage and usage of disabled HNSW
• https://github.com/qdrant/qdrant/pull/5439 - Fix the file name too long error during collection deletion

v1.12.3

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5411 - Do not report peer address replaced as warning if it's still the same
• https://github.com/qdrant/qdrant/pull/5426 - Expose usage of async scorer in telemetry

Bug fixes

• https://github.com/qdrant/qdrant/pull/5427 - Fix potential panic during search over deleted points or with payload filters

v1.12.2

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/5313, https://github.com/qdrant/qdrant/pull/5314, https://github.com/qdrant/qdrant/pull/5303, https://github.com/qdrant/qdrant/pull/5317 - Improve performance of matrix API
• https://github.com/qdrant/qdrant/pull/5219, https://github.com/qdrant/qdrant/pull/5251, https://github.com/qdrant/qdrant/pull/5254, https://github.com/qdrant/qdrant/pull/5305 - Improve performance by not capturing backtrace if not necessary
• https://github.com/qdrant/qdrant/pull/5336, https://github.com/qdrant/qdrant/pull/5365, https://github.com/qdrant/qdrant/pull/5393 - Improve HNSW search performance by tweaking visited list
• https://github.com/qdrant/qdrant/pull/5301, https://github.com/qdrant/qdrant/pull/5309 - Improve performance by reusing RocksDB options, do not recreate them all the time
• https://github.com/qdrant/qdrant/pull/5265 - Add support for reinitializing consensus with new peer URLs
• https://github.com/qdrant/qdrant/pull/5373 - Put quantized data in RAM by default to prevent competing with memory mapped vectors
• https://github.com/qdrant/qdrant/pull/5252 - Use streaming creation of snapshot in shard snapshot transfer
• https://github.com/qdrant/qdrant/pull/5343 - Prevent killing replicas eagerly if node is out of sync, making replicas more robust
• https://github.com/qdrant/qdrant/pull/5266 - Report memory usage in metrics and telemetry
• https://github.com/qdrant/qdrant/pull/5307 - Enable Jemalloc in RocksDB
• https://github.com/qdrant/qdrant/pull/5312 - Enable Jemalloc background thread to gradually release unused memory
• https://github.com/qdrant/qdrant/pull/5292 - Report storage bytes estimate for each segment in telemetry
• https://github.com/qdrant/qdrant/pull/5380 - Add log message when shard transfer is aborted
• https://github.com/qdrant/qdrant/pull/5391 - Prevent unused repeated calls to other peers when waiting on /readyz
• https://github.com/qdrant/qdrant/pull/5180 - Report CPU endianness in telemetry output
• https://github.com/qdrant/qdrant/pull/5228 - Minimize point version lookups during search
• https://github.com/qdrant/qdrant/pull/5399 - Improve error when using unknown vector name

Bug fixes

• https://github.com/qdrant/qdrant/pull/5346 - Fix mishandling point deletions with payload indices
• https://github.com/qdrant/qdrant/pull/5211 - Fix panic in query API if vector name is missing
• https://github.com/qdrant/qdrant/pull/5232 - Fix potential panic if Qdrant crashed during sparse vector deletion
• https://github.com/qdrant/qdrant/pull/5271, https://github.com/qdrant/qdrant/pull/5286, https://github.com/qdrant/qdrant/pull/5302 - Fix potentially missing an update on WAL delta transfer with empty delta
• https://github.com/qdrant/qdrant/pull/5141, https://github.com/qdrant/qdrant/pull/5147 - Fix consensus errors on new peers if first peer is removed, now remember first ever peer
• https://github.com/qdrant/qdrant/pull/5367 - Properly update all collection configuration properties when Raft snapshot is applied
• https://github.com/qdrant/qdrant/pull/5350 - Fix consensus synchronization waiting on the wrong value, now speeding up synchronization
• https://github.com/qdrant/qdrant/pull/5383 - In /readyz wait for consensus operations to be applied, instead of just being received
• https://github.com/qdrant/qdrant/pull/5227, https://github.com/qdrant/qdrant/pull/5296 - Fix shard snapshot operations when using S3
• https://github.com/qdrant/qdrant/pull/5237 - Properly clean up temporary snapshot files when using S3
• https://github.com/qdrant/qdrant/pull/5253 - Properly clean up temporary segment files if optimization is cancelled
• https://github.com/qdrant/qdrant/pull/5386 - Fix flushing of point ID mappings potentially causing inconsistencies

v1.12.1

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/5222 - prevents panic in case of geo-radius is 0

v1.12.0

Compare Source

Change log

Features 🍹

• #milestone-4 - Facets API - adds ability to retrieve unique payload values with counts for a given index field under the given filter. [Docs]
• #milestone-11 - Distance Matrix API - adds ability to calculate many-to-many distances between stored vectors. This feature is useful for clustering, dimensionality reduction, visualization, and other data exploration tasks. [Docs]

Improvements 🎢

• https://github.com/qdrant/qdrant/pull/5188 - Use mmap vector storage by default. This change have several important implications:
  • We avoid using expensive rocksdb to make upload significantly faster, especially for large datasets.
  • Vectors are stored in memory-mapped files, which means that the OS will manage the memory for us. Qdrant process will consume less RSS Anon memory, but will use disk cache instead. That means that in case of high memory usage qdrant will slow down instead of crashing with OOM.
• #milestone-14 - Enable sparse snapshots, which means that allocated but empty files in the vector storage no longer occupy extra disk space in the snapshot. See Sparse files. This change rely on the upstream changes in tar-rs crate - https://github.com/alexcrichton/tar-rs/pull/375
• #milestone-12 - Ability to offload text-index on disk
• https://github.com/qdrant/qdrant/pull/4841 - Ability to offload geo-index on disk
• https://github.com/qdrant/qdrant/pull/5140 - Trigger optimizers when uploading snapshots.
• https://github.com/qdrant/qdrant/pull/5173 - Instantly self-elect Raft leader, when cluster contains single peer

Bug fixes 🎭

• https://github.com/qdrant/qdrant/pull/5176 - Make shards removal atomic, prevents partial shard recovery on restart.

Web-UI Dashboard 🍱

• Improved graph visualization, which allows to sample large chunk of data from the collection
• Improvements in visualization panned UX
• More interactive tutorials and examples
• Full list - https://github.com/qdrant/qdrant-web-ui/releases/tag/v0.1.32

v1.11.5

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/5113 - Fix set payload with nested key not updating nested structure properly in some cases
• https://github.com/qdrant/qdrant/pull/5111 - Fix optimizations potentially getting stuck if low optimization limit is configured
• https://github.com/qdrant/qdrant/pull/5105 - Properly configure RocksDB to use LZ4 compression for payload index
• https://github.com/qdrant/qdrant/pull/5123 - If populating mmap with syscall fails, fall back to naive population

v1.11.4

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4940 - Add grey collection status if optimizations are pending after restart
• https://github.com/qdrant/qdrant/pull/5073 - Parallelize deduplication of points on start, making startups faster
• https://github.com/qdrant/qdrant/pull/5072 - Significantly improve performance of lookup/delete in keyword index, making startups faster
• https://github.com/qdrant/qdrant/pull/5091 - Buffer reads when loading quantized vectors, making startups faster
• https://github.com/qdrant/qdrant/pull/5061, https://github.com/qdrant/qdrant/pull/4943 - Create snapshots without intermediate files, making it faster and requiring less disk space
• https://github.com/qdrant/qdrant/pull/4997 - Save shard configuration only once when creating snapshot
• https://github.com/qdrant/qdrant/pull/5041 - Add template in configuration to configure logging to disk
• https://github.com/qdrant/qdrant/pull/5066 - Report more detailed error if consensus stops due to an error
• https://github.com/qdrant/qdrant/pull/5035 - Improve error reporting for malformed JSON path strings
• https://github.com/qdrant/qdrant/pull/4992 - Reuse HTTP client for telemetry reporting
• https://github.com/qdrant/qdrant/pull/4581 - Print warning in log if JWT RBAC key has low entropy
• https://github.com/qdrant/qdrant/pull/5058 - Remove mention of max_segment_number from OpenAPI definition, because we don't use this anymore
• https://github.com/qdrant/qdrant/pull/4964 - Use geohash packing, which improves memory usage by geo index by up to 30%

Bug fixes

• https://github.com/qdrant/qdrant/pull/5039 - Fix potential data race in collection aliases file leaving corrupted state
• https://github.com/qdrant/qdrant/pull/5043 - Fix shard/collection status blinking green between optimizations
• https://github.com/qdrant/qdrant/pull/5075 - Fsync files to physical storage when restoring snapshot, fixing inconsistencies in volume based snapshots
• https://github.com/qdrant/qdrant/pull/4994 - Fix potential out of memory error when uploading large snapshot to S3
• https://github.com/qdrant/qdrant/pull/5089 - Fix keyword index not excluding deleted points properly
• https://github.com/qdrant/qdrant/pull/5088 - Fix panic on start if mmap metadata file is grown by misbehaving file systems, ignore and continue instead
• https://github.com/qdrant/qdrant/pull/5090 - Clean temporary segments if optimization is cancelled
• https://github.com/qdrant/qdrant/pull/5079 - Fix consensus logic of deleting shard which is being transferred

v1.11.3

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/4977 - Fix match payload filters on string and UUID indices

v1.11.2

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/4973 - Fix potential panic during payload index building

v1.11.1

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4855 - Allow to modify data before writing on disk for copy-on-write operations
• https://github.com/qdrant/qdrant/pull/4941 - Non-blocking payload index building
• https://github.com/qdrant/qdrant/pull/4947 - Include list of peers in telemetry
• https://github.com/qdrant/qdrant/pull/4961 - Support for MatchAny and Except conditions for UUID index

Bug fixes

• https://github.com/qdrant/qdrant/pull/4952 - Fix point deletions on mmap segment optimization.
• https://github.com/qdrant/qdrant/pull/4909 - Fix Max Upload Size for s3 snapshot storage
• https://github.com/qdrant/qdrant/pull/4929 - Fix configuration of bool and geo index params with explicit schema
• https://github.com/qdrant/qdrant/pull/4953 - Proper handle of UUID index in issue reporting

Web UI

• https://github.com/qdrant/qdrant-web-ui/releases/tag/v0.1.31 - Improved navigation and collection view

v1.11.0

Compare Source

Change Log

Features 🪄

• milestone#6 - GroupBy support for query API
• milestone#8 - Introduce UUID payload index
• milestone#2 - On-disk support for Keyword, Integer, Datatime, Float and UUID indexes
• milestone#5 - Random sampling support in Query API
• https://github.com/qdrant/qdrant/pull/4614 - Distribution-based Score Fusion

Improvements 🏇

• milestone#9 - Improve long-running update operations to not block reads
• milestone#7 - Data-locality performance improvements for multitenant and filterable collections
• https://github.com/qdrant/qdrant/pull/4664 - Performance improvement for prefetch queries
• https://github.com/qdrant/qdrant/pull/4403 - Persistent immutable id tracker allows faster load form disk
• https://github.com/qdrant/qdrant/pull/4658 - In-memory id tracker used avoid extra IO during segment optimization routine
• https://github.com/qdrant/qdrant/pull/4691 - Expose more CPU instruction set flags into CPU telemetry
• https://github.com/qdrant/qdrant/pull/4733 - Convert app and cluster info metrics from counters to gauges
• https://github.com/qdrant/qdrant/pull/4723 - Set RocksDB compression to LZ4
• https://github.com/qdrant/qdrant/pull/4688 - Improve result order preservation in replicated response resolution
• https://github.com/qdrant/qdrant/pull/4827 - Make scroll requests cancellable
• https://github.com/qdrant/qdrant/pull/4844, https://github.com/qdrant/qdrant/pull/4849, https://github.com/qdrant/qdrant/pull/4850 - Non-blocking retrieve with timeout and cancellation support

Bug Fixes

• https://github.com/qdrant/qdrant/pull/4661 - Fix NaN score for zeroed uint8 vectors
• https://github.com/qdrant/qdrant/pull/4663 - Fix payload update operation internal
• https://github.com/qdrant/qdrant/pull/4722 - Fix Charabia Chinese tokenization
• https://github.com/qdrant/qdrant/pull/4812, https://github.com/qdrant/qdrant/pull/4823 - Add missing API to metrics whitelist
• https://github.com/qdrant/qdrant/pull/4842 - Add and fix missing timeout in the retrieve APIs

Web UI Highlights 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/197 - Graph-based collection exploration tool
• https://github.com/qdrant/qdrant-web-ui/pull/199 - Tool to check search quality in real time

v1.10.1

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/4611 - Fix offset being applied twice in query API
• https://github.com/qdrant/qdrant/pull/4630 - Fix handling of score threshold for fusion requests in query API
• https://github.com/qdrant/qdrant/pull/4631 - Fix locally disabling last shard replica in some cases, making a shard unavailable
• https://github.com/qdrant/qdrant/pull/4653 - Fix not properly deleting points with delete by filter request right before hard crash
• https://github.com/qdrant/qdrant/pull/4589 - Make point counts when using memmap a bit more accurate

v1.10.0

Compare Source

Change Log

Features 🐯

• https://github.com/qdrant/qdrant/issues/4225 - Universal query API - [Docs]

  • Support search, recommendations, discovery, ordering by payload in a single request
  • Perform hybrid search by merging results from different queries with fusion
  • Build multi-stage queries with re-scoring to achieve better performance

• https://github.com/qdrant/qdrant/issues/3684 - Support for multivectors - [Docs]

  • Use late interaction (such as ColBERT) models natively in Qdrant
  • Store dynamic number of vectors per point with shared payload

• https://github.com/qdrant/qdrant/pull/4122 - Support for float16 datatype for dense vectors - [Docs]

  • Reduce memory consumption for dense vectors by 2x
  • Minimal accuracy loss for compared to full precision vectors

• https://github.com/qdrant/qdrant/pull/4454, https://github.com/qdrant/qdrant/pull/4514 - Support for float16 and uint8 datatype for sparse vectors index - [Docs]

  • Reduce memory consumption for sparse vectors by factor of 2 and 4 correspondingly
  • Minimal accuracy loss for compared to full precision vectors

• https://github.com/qdrant/qdrant/pull/4126 - Support for Inverse Document Frequency (IDF) in sparse vectros - [Docs]

  • Provides an option to automatically account for IDF in sparse vectors search
  • Unlocks the ability to stream updates for BM25 and BM42 embeddings

• https://github.com/qdrant/qdrant/issues/3324 - Support for S3-compatible storage for snapshots - [Docs]

• https://github.com/qdrant/qdrant/issues/3471 - Issue reporting

  • Get notified about potential performance issues and misconfigurations

• https://github.com/qdrant/qdrant/pull/4299 - Ability to configure default collection parameters

  • Pre-configure quantization, vector storage and replication factor for new collections

• https://github.com/qdrant/qdrant/pull/4317 - Ability to overwrite global optimizer configuration for collections

  • Allows to separate roles for indexing and searching within the single qdrant cluster

Improvements 🦈

• https://github.com/qdrant/qdrant/pull/4253, https://github.com/qdrant/qdrant/pull/4350 - Delta Encoding and bitpacking compression for sparse vectors

  • Reduce memory consumption for sparse vectors by up to 75%

• https://github.com/qdrant/qdrant/pull/4527 - Skip serialization of empty fields in the search response

  • Less confusion in the search response
  • Reduce network traffic

• https://github.com/qdrant/qdrant/pull/4267 - Add test for OOD during indexing, prevents crash on out-of-disk

Bug Fixes 🦟

• https://github.com/qdrant/qdrant/pull/4553 - Fix exclusion of ids in discovery api
• https://github.com/qdrant/qdrant/pull/4583 - Fix potential storage corruption during hard shutdown

---

Highlights 💡

• Significant refactoring of the Rust Client making it more extendable, easier to use and more idiomatic
• New API reference web-page - https://api.qdrant.tech/
• New fast sparse embedding model - BM42, aimed to resolve limitations of SPLADE and fix full-text search issue for RAG

v1.9.7

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4517 - Do not allow embedding the web UI in an iframe
• https://github.com/qdrant/qdrant/pull/4556 - Include HNSW configuration in snasphots to fix some edge cases

Bug fixes

• https://github.com/qdrant/qdrant/pull/4555 - Fix panic on start with sparse index from versions 1.9.3 to 1.9.6
• https://github.com/qdrant/qdrant/pull/4551 - Fix positive/negative points IDs being excluded when using recommendation search with lookup_from

v1.9.6

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/4472 - fix potential panic on recovery sparse vectors from crash
• https://github.com/qdrant/qdrant/pull/4426 - improve error message on missing payload index
• https://github.com/qdrant/qdrant/pull/4375 - fix in-place updates for sparse index
• https://github.com/qdrant/qdrant/pull/4523 - fix missing payload index issue, introduced in v1.9.5

v1.9.5

Compare Source

Change log

Features

• https://github.com/qdrant/qdrant/pull/4254 - Add pyroscope integration for continuous profiling on demand

Improvements

• https://github.com/qdrant/qdrant/pull/4309 - Allow to configure default number of shards per node
• https://github.com/qdrant/qdrant/pull/4317 - Allow to overwrite optimizer settings via config
• https://github.com/qdrant/qdrant/pull/4312, https://github.com/qdrant/qdrant/pull/4369 - Improve vector size estimations, making index thresholds more reliable
• https://github.com/qdrant/qdrant/pull/4428 - Improve default maximum segment size, base it on number of CPUs used for indexing
• https://github.com/qdrant/qdrant/pull/4370 - Use consistent RocksDB settings for both put and remove
• https://github.com/qdrant/qdrant/pull/4376 - Improve ordering of insertions and deletions in RocksDB
• https://github.com/qdrant/qdrant/pull/4371 - Log error if segment flushing failed on drop
• https://github.com/qdrant/qdrant/pull/4352 - Promote REST request processing problems from warning to error
• https://github.com/qdrant/qdrant/pull/4368 - Improve error messages in cases of missing vectors
• https://github.com/qdrant/qdrant/pull/4391 - Improve shard state log message, not strictly related to snapshot recovery
• https://github.com/qdrant/qdrant/pull/4414 - Improve Dockerfile, don't invalidate caches each commit and allow debug settings

Bug fixes

• https://github.com/qdrant/qdrant/pull/4402 - Fix deadlock caused by concurrent snapshot and optimization
• https://github.com/qdrant/qdrant/pull/4411 - Fix potentially losing vectors on crash by enabling RocksDB WAL
• https://github.com/qdrant/qdrant/pull/4416, https://github.com/qdrant/qdrant/pull/4440 - Respect max_segment_size on data ingestion with optimizers disabled, create segments as needed
• https://github.com/qdrant/qdrant/pull/4442 - Fix potentially having bad HNSW links on multithreaded systems

v1.9.4

Compare Source

Change log

Bug fixes

• https://github.com/qdrant/qdrant/pull/4332 - Fix potentially losing a segment when creating a snapshot with ongoing updates
• https://github.com/qdrant/qdrant/pull/4342 - Fix potential panic on start if there is no appendable segment
• https://github.com/qdrant/qdrant/pull/4328 - Prevent panic when searching with huge limit

v1.9.3

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4165 - Handle Out-Of-Disk on insertions gracefully
• https://github.com/qdrant/qdrant/pull/3964 - Faster consensus convergence with batched updates
• https://github.com/qdrant/qdrant/pull/4301 - Deduplicate points by ID for custom sharding

Bug fixes

• https://github.com/qdrant/qdrant/pull/4307 - Fix overflow panic if scroll limit is usize::MAX
• https://github.com/qdrant/qdrant/pull/4322 - Fix panic with missing sparse vectors after recovery of corrupted storage

Web UI

• https://github.com/qdrant/qdrant-web-ui/pull/183 - Notification for miss-configured collections

Full change log: https://github.com/qdrant/qdrant-web-ui/releases/tag/v0.1.26

v1.9.2

Compare Source

Change log

Improvements

• https://github.com/qdrant/qdrant/pull/4148 - Greatly improve proxy segment performance when a lot of changes are tracked
• https://github.com/qdrant/qdrant/pull/4176 - Speed up loading of large memory mapped segments
• https://github.com/qdrant/qdrant/pull/4205 - Use distinct gRPC types for shard replication and overwriting payload requests, existing clients remain compatible
• https://github.com/qdrant/qdrant/pull/4163 - Extend sparse vector benchmarks

Bug fixes

• https://github.com/qdrant/qdrant/pull/4206 - Fix potential deadlock with concurrent searches and snapshot creation

v1.9.1

Compare Source

Change Log

Improvements

• https://github.com/qdrant/qdrant/pull/4119 - performance of the numerical values range filter
• https://github.com/qdrant/qdrant/pull/4103 - Handle antimeridians in geo bounding box filter
• https://github.com/qdrant/qdrant/pull/3931 - Speedup consensus thread
• https://github.com/qdrant/qdrant/pull/4084 - improve consistency of the scroll API with parallel updates

Bug fixes

• https://github.com/qdrant/qdrant/pull/4155 - fixes usage of snapshot shard transfer with API Key Auth.
• https://github.com/qdrant/qdrant/pull/4156 - resolves panic issue on optimization after restart (https://github.com/qdrant/qdrant/issues/4154)
• https://github.com/qdrant/qdrant/pull/4132 - resolves https://github.com/qdrant/qdrant/issues/4131

v1.9.0

Compare Source

Change log

Features 🏎️

• https://github.com/qdrant/qdrant/issues/3477 - Implement and enable shard diff transfer, greatly improve shard transfer speed on node recovery
• https://github.com/qdrant/qdrant/issues/3777 - Role-based access control with JWT
• https://github.com/qdrant/qdrant/pull/3976, https://github.com/qdrant/qdrant/pull/4049, https://github.com/qdrant/qdrant/pull/4065 - Add support for byte vectors, represent your vectors as float32 or uint8

Improvements 🕵️

• https://github.com/qdrant/qdrant/pull/3420, https://github.com/qdrant/qdrant/pull/3938 - Greatly improve write performance while creating a snapshot of a large collection
• https://github.com/qdrant/qdrant/pull/3962, https://github.com/qdrant/qdrant/pull/3971 - Report pending optimizations awaiting an update operation in collection info
• https://github.com/qdrant/qdrant/pull/3998 - Improve indexed_only reliability on proxy shards
• https://github.com/qdrant/qdrant/pull/3798 - Make shard diff transfer fall back to streaming records
• https://github.com/qdrant/qdrant/pull/3784 - Cancel shard transfers when the shard is deleted
• https://github.com/qdrant/qdrant/pull/4037 - Improve sparse vectors search performance by another 7%
• https://github.com/qdrant/qdrant/pull/3982 - Build Qdrant with a single codegen unit to allow better compile-time optimizations
• https://github.com/qdrant/qdrant/pull/4052 - Remove vectors_count from collection info because it is unreliable. Check usage of this field before upgrading
• https://github.com/qdrant/qdrant/pull/3803 - Remove shard transfer method field from abort shard transfer operation

Bug fixes 💔

• https://github.com/qdrant/qdrant/pull/3990 - Fix potentially losing points on crash
• https://github.com/qdrant/qdrant/pull/4034 - Fix potentially losing points on segment flushing
• https://github.com/qdrant/qdrant/pull/4057 - Fix potentially losing points by improper moves between segments when recovering WAL
• https://github.com/qdrant/qdrant/pull/4058 - Fix segments not being flushed properly with rapid sequential optimizations
• https://github.com/qdrant/qdrant/pull/3995, https://github.com/qdrant/qdrant/pull/3996 - Fix read ordering of segments to prevent missing points just being moved
• https://github.com/qdrant/qdrant/pull/3975 - Fix consensus operations getting stuck if they timed out
• https://github.com/qdrant/qdrant/pull/3905 - Fix collection creation if files were left behind on disk
• https://github.com/qdrant/qdrant/pull/4029 - Fix collection deletions conflicting with concurrent collection creation
• https://github.com/qdrant/qdrant/pull/3991 - Fix arbitrary path traversal when uploading snapshots with created collection names
• https://github.com/qdrant/qdrant/pull/4033 - Do not allow symlinks in snapshot archives
• https://github.com/qdrant/qdrant/pull/4047 - Fix recommendation API for sparse vectors
• https://github.com/qdrant/qdrant/pull/3965 - Fix discovery search with sparse vectors over gRPC
• https://github.com/qdrant/qdrant/pull/3928 - Stabilize vector normalization, prevent renormalizing multiple times breaking data consistency
• https://github.com/qdrant/qdrant/pull/4054 - Fix incorrect ordering when using order_by across multiple nodes
• https://github.com/qdrant/qdrant/pull/4067 - Fix timeout being ignored when dropping segment data, potentially leaving them behind forever
• https://github.com/qdrant/qdrant/pull/3980 - Internally forward operations with wait=true during shard transfers
• https://github.com/qdrant/qdrant/pull/3945 - Keep jemalloc only for amd64 and aarch64 to fix build failures

Dashboard 🍱

• https://github.com/qdrant/qdrant-web-ui/pull/175 - Add page to generate RBAC JWT tokens
• https://github.com/qdrant/qdrant-web-ui/pull/169 - Before saving payload changes, ask for confirmation with dialog showing diff
• https://github.com/qdrant/qdrant-web-ui/pull/173 - Validate collection names
• Other changes

---

Thanks to @​abhishek818 @​RPallas92 [@​tellet-q](https://redirect.git

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR has been generated by Renovate Bot.