localai-org-maint-bot 0761bd02c7 feat(chat): add end-to-end context compression (#11556) ...

* feat(config): add context compression policy

Define the opt-in model configuration contract before the chat middleware consumes it. Document each policy field so later request handling does not invent a second schema.\n\nRefs #9534\n\nAssisted-by: Codex:gpt-5

* fix(config): register compression fields

The model editor metadata gate rejects new config fields without descriptions and suitable controls. Register the compression policy so operators can edit its six fields safely.

Assisted-by: Codex:gpt-5 [monitoring-prs]

* feat(chat): compress long contexts

Long conversations currently fail once they reach the model context window. The opt-in policy now summarizes complete older turns before primary inference and preserves the newest tool chains.

Both OpenAI and MCP chat routes share the same transformation. Usage metadata and metrics expose each compression event.

Refs #9534

Assisted-by: Codex:gpt-5

---------

Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>

2026-08-18 11:31:03 +00:00

..

agent_jobs.go

feat(api): Allow coding agents to interactively discover how to control and configure LocalAI (#9084)

2026-04-04 15:14:35 +02:00

anthropic_test.go

feat: interleaved thinking with tool calls (reasoning_content alias + Anthropic thinking blocks) (#10744)

2026-07-08 16:45:43 +00:00

anthropic.go

feat: interleaved thinking with tool calls (reasoning_content alias + Anthropic thinking blocks) (#10744)

2026-07-08 16:45:43 +00:00

audio_transform.go

feat(audio-cpp): add the audio.cpp native backend (#11141)

2026-07-30 12:11:56 +02:00

backend.go

feat: Add backend gallery (#5607)

2025-06-15 14:56:52 +02:00

diarization.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

elevenlabs.go

feat(audio-cpp): add the audio.cpp native backend (#11141)

2026-07-30 12:11:56 +02:00

finetune.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

gallery-model.schema.json

feat(gallery): let one gallery entry offer several builds of the same model (#10943)

2026-07-20 18:43:02 +02:00

jina.go

fix(reranker): tests and top_n check fix #7212 (#7284)

2025-11-16 17:53:23 +01:00

localai.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

message_test.go

feat: interleaved thinking with tool calls (reasoning_content alias + Anthropic thinking blocks) (#10744)

2026-07-08 16:45:43 +00:00

message.go

feat: interleaved thinking with tool calls (reasoning_content alias + Anthropic thinking blocks) (#10744)

2026-07-08 16:45:43 +00:00

model_loading.go

fix(distributed): run cold model loads as durable jobs instead of holding the advisory lock (#11514)

2026-08-15 13:20:11 +02:00

moderation.go

feat(api): add text moderation endpoint (#11316)

2026-08-03 18:03:46 +02:00

ollama_test.go

fix(ollama): accept float-encoded integer options (fixes #9837) (#9849)

2026-05-16 18:38:19 +02:00

ollama.go

fix(ollama): accept float-encoded integer options (fixes #9837) (#9849)

2026-05-16 18:38:19 +02:00

openai.go

feat(chat): add end-to-end context compression (#11556)

2026-08-18 11:31:03 +00:00

openresponses.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

pii.go

feat(pii): NER tier engine — privacy-filter.cpp backend + NER-centric PII filter (#10360)

2026-06-18 11:45:22 +01:00

prediction.go

feat(router): make KNN a first-class classifier with a persisted, curated corpus (#10652)

2026-08-18 09:37:43 +02:00

quantization.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

request.go

feat: Add 3d generation UI/API and trellis2cpp backend (#10979)

2026-07-29 16:15:04 +02:00

schema_suite_test.go

feat(llama.cpp): consolidate options and respect tokenizer template when enabled (#7120)

2025-11-07 21:23:50 +01:00

sound_classification.go

feat(ced): sound-event classification backend (CED audio tagger) (#10425)

2026-06-22 01:00:28 +02:00

tokenize.go

feat(api): add /v1/detokenize endpoint (#9620)

2026-07-30 16:01:47 +02:00

transcription_format.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

transcription.go

feat(realtime): Semantic VAD EOU token (#10444)

2026-06-30 09:01:22 +02:00