Commit Graph

18 Commits

Author SHA1 Message Date
Julian Risch d25a42182d ci: pin container images by digest (#11460)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-01 14:29:04 +02:00
Stefano Fiorucci 0cdccae226 ci: refactor/optimize Docker builds (#10387)
* ci: docker refactor - WIP

* retry

* fix

* improvements

* retry

* try amd64 only

* retry

* try arm

* try uv

* clean

* fix

* revert test changes

* use venv and test

* fix

* try simplification

* try setting stable

* better bake

* again

* clean up again

* fix

* try caching and test

* try separate caches

* trigger cache invalidation

* try triggering again

* Revert "try triggering again"

This reverts commit bbc42a6e2a2ae8975209f1beb80270e07066006d.

* Revert "trigger cache invalidation"

This reverts commit b37310b9a14cd3a5f6ad2dc4748fe49e95a8d4a3.

* Revert "try separate caches"

This reverts commit 9ef381c9aaa452f5d90b6e8c10685dd179372bfc.

* Revert "try caching and test"

This reverts commit e50d57611a0428f07c7e166be86e07f4c263b5d1.
2026-01-16 10:46:03 +01:00
Massimiliano Pippi 722919c452 use the latest Python image (#7540) 2024-04-11 19:05:03 +02:00
Massimiliano Pippi 1887dac667 ci: push Docker image for 2.x (#6479)
* cleanup

* use a smaller runner

* main branch
2023-12-04 12:52:58 +01:00
Vladimir Blagojevic 395854d823 Add cpu-remote-inference Docker image (#5225)
* Add cpu-remote-inference Docker image

* Add web lfqa pipeline as an example for cpu-remote-inference Docker image

* WebRetriever must have document_store attribute

* Add cpu-remote-inference-latest

* Add image testing in CI

---------

Co-authored-by: Silvano Cerza <silvanocerza@gmail.com>
2023-07-07 10:23:14 +02:00
Stefano Fiorucci cbc9dcfdad add inference dependency to docker images (#5215) 2023-06-27 11:47:40 +02:00
ZanSara d8ac30fa47 refactor!: extract preprocessing and file conversion deps (#4605)
* isolate file-conversion deps

* pylint

* add to all extra

* chain was missing

* move langdetect into preprocessing and fix tika

* add file-conversion extra
2023-04-14 11:34:16 +02:00
ZanSara ba11d1c2a8 refactor!: extract evaluation and statistical dependencies (#4457)
* try-catch sklearn and scipy

* haystack imports

* linting

* mypy

* try to import baseretriever

* remove typing

* unused import

* remove more typing

* pylint

* isolate sql imports for postgres, which we don't use anyway

* remove stats

* replace expit

* als inmemory

* mypy

* feedback

* docker

* expit

* re-add njit
2023-04-12 15:38:56 +02:00
Massimiliano Pippi 322652c306 fix: provide a fallback for PyMuPDF (#4564)
* add a fallback xpdf alternative to PyMuPDF

* add xpdpf to the base images

* to be reverted

* silence mypy on conditional error

* do not install pdf extras in base images

* bring back the xpdf build strategy

* remove leftovers from old build

* fix indentation

* Apply suggestions from code review

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>

* revert test workflow

---------

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
2023-03-31 14:37:05 +02:00
bogdankostic f33829fabf Remove xpdf dependencies (#4314) 2023-03-02 11:12:03 +01:00
Silvano Cerza a05836589b ci: Add Docker images testing (#3943)
* Fix typo in Dockerfile.base ARG

* Add workflow to test Docker images

* Fix base image name

* Simplified Docker images testing

* Fix wrong command to retrieve current version

Co-authored-by: Mayank Jobanputra <mayankjobanputra@gmail.com>
2023-01-27 09:48:05 +01:00
Fabian e53cc2bc3f fix(docker): Use IMAGE_NAME in api image (#3786)
If you set the IMAGE_NAME variable, then the base image will use that name,
but the api image would previously use a hardcoded `deepset/haystack` image name.
2023-01-03 12:26:26 +01:00
Vladimir Blagojevic 19e9b06b4e feat: Bump python to 3.10 for gpu docker image, use nvidia/cuda (#3701)
* Update pytorch base image

* Small corrections

* Revert back to load_schema() call

* reverted to import haystack for schema generation

Co-authored-by: Mayank Jobanputra <mayankjobanputra@gmail.com>
2022-12-30 16:04:27 +05:30
Sebastian 4afdbc33b2 fix: Removed overlooked torch scatter references (#3719)
* Removed torch scatter references

* Add back /
2022-12-16 10:36:19 +01:00
Sara Zan f24cbdbb5d remove beir from the base GPU image (#3692) 2022-12-13 11:11:58 +01:00
Massimiliano Pippi 8ddb6d7821 feat: add multi-platform Docker images (#3354)
* add arm platform to the build

* add a note about multi-platforms build

* test on current branch

* setup qemu on Github actions

* better naming

* Revert "test on current branch"

This reverts commit b0e5ea77b46e3e0bafd579c95e434c6a3c8ef84f.
2022-10-11 12:29:33 +02:00
Massimiliano Pippi 859c303c16 include fontconfig in the final image and fix tagging (#3230) 2022-09-16 15:33:24 +02:00
Massimiliano Pippi 64b0c43885 refactoring: reimplement Docker strategy (#3162)
* setup base images

* add cpu flavor

* use the same Dockerfile for cpu and gpu

* better naming, add docs

* add docker workflow

* add missing image input

* change cwd for bake

* also push api images

* try conditional tagging for releases

* revert testing code

* update docker readme

* document variable override

* use Python 3.10

* allow empty HAYSTACK_EXTRAS

* Apply suggestions from code review

Co-authored-by: Sara Zan <sara.zanzottera@deepset.ai>

* remove repo description step, can't make it work so far

* add docs to the last step as it's tricky

* manage tags for the newest images

* tests are passing, checking in the last bit

Co-authored-by: Sara Zan <sara.zanzottera@deepset.ai>
2022-09-12 16:33:56 +02:00