Skip to main content

What's new in Hindsight 0.8.1

· 3 min read
Nicolò Boschi
Hindsight Team

Hindsight 0.8.1 is a patch release on top of 0.8.0: a new option to skip storing raw document text for data-minimization and privacy-sensitive deployments, plus two operational fixes for self-managed PostgreSQL. Anyone running an external PostgreSQL with VectorChord, or a single-schema deployment, should upgrade.

  • Optional Document-Text Storage: Skip persisting the raw source text of retained documents while keeping extracted memories fully searchable.
  • Operational Fixes: Correct vector-index behavior on VectorChord indexes that don't support probe tuning, and reliable installation of maintenance routines on the public schema.

Optional Document-Text Storage

By default, Hindsight keeps the raw source text of every document you retain so you can read documents back and append to them later. For data-minimization, privacy, or compliance reasons, some deployments would rather not persist that raw text at all.

0.8.1 adds the HINDSIGHT_API_STORE_DOCUMENT_TEXT flag (default true). Set it to false and Hindsight stops persisting the raw source text — extracted memories, entities, and links are still stored and fully searchable, but the original document body is not retained.

export HINDSIGHT_API_STORE_DOCUMENT_TEXT=false

With storage disabled:

  • Reads still work. Fetching a document returns its metadata with the text field empty, rather than erroring, so existing clients keep working.
  • Append is rejected. Appending to a document needs the existing body to build on, so append requests return a clear error instead of silently producing a partial result.
  • The Control Plane tells you. Document views show a notice that text storage is turned off, so the empty text is never mistaken for data loss.

The setting is server-level. Memories you've already retained keep whatever text they were stored with.

Operational Fixes

Two fixes make self-managed PostgreSQL deployments more robust:

  • VectorChord probe tuning. Hindsight no longer forces the vchordrq.probes session setting on VectorChord indexes that don't support it, so vector search works correctly across VectorChord index types instead of failing on the ones without list-based probing.
  • Maintenance routines on the public schema. The background maintenance routines added in 0.8.0 are now installed correctly on deployments that run in the default public schema, so periodic consolidation reconciliation and retention enforcement run as intended on a standard single-schema setup.

Other Notable Changes

  • Dependency cap for local ML extras. tokenizers is pinned to a compatible range for the local-ML extras so fresh installs resolve cleanly.
  • Cleaner Control Plane URLs. The locale prefix is no longer added to Control Plane URLs.