348 Commits

Author SHA1 Message Date
Adam Gibson ced73f1c80 Updates github actions builds. (#10242)
* Add files for pr_1_1_github_actions

* Update GitHub Actions workflows with CUDA 12.3 build fixes

* Remove pp-step-clone and engineers-guide-to-llms folders

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

* Update .github/actions/install-cmake-linux/action.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update .github/workflows/build-deploy-linux-cuda-12.6.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update .github/workflows/build-deploy-linux-cuda-12.6.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update .github/workflows/build-deploy-android-arm64.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update .github/workflows/build-deploy-android-arm64.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update .github/workflows/build-deploy-android-arm64.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Initial plan (#10355)

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

* Initial plan (#10357)

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

* [WIP] Address feedback on GitHub Actions builds updates (#10359)

* Initial plan

* Add missing releaseRepoId input and matrix variable to build-deploy-linux-x86_64.yml

Co-authored-by: agibsonccc <1144306+agibsonccc@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: agibsonccc <1144306+agibsonccc@users.noreply.github.com>

* [WIP] Address feedback on GitHub Actions builds updates (#10358)

* Initial plan

* Remove redundant MAVEN_GPG_KEY and GPG_SIGNING_KEY env vars from Windows workflow

Co-authored-by: agibsonccc <1144306+agibsonccc@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: agibsonccc <1144306+agibsonccc@users.noreply.github.com>

* Initial plan (#10360)

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
2025-12-16 18:18:05 +09:00
sebastien.heurtematte 70d4281523 feat: migrate creds to EF naming convention (#10213)
Related to https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/issues/5935

Signed-off-by: sebastien.heurtematte <sebastien.heurtematte@eclipse-foundation.org>
2025-06-10 17:41:49 +09:00
Adam Gibson 0f94605d5f ADR/publishing prep for renamespacing and release updates (#10212)
* ADR for renamespacing and release updates

* ADR for renamespacing and release updates

* use new secrets for publishing

* use new secrets for publishing

* remove old distribution management

* remove try catch for cuda build

* update string functionality for cuda

* update string functionality for cuda

* update string functionality for cuda

* update string functionality for cuda

* update string functionality for cuda

* update string functionality for cuda

* remove old distribution management

* remove more ossrh references

* update environment variables

* update lombok version

* clean up test dependencies errant linker flags

* get rid of dup flags
2025-05-27 12:02:19 +09:00
Adam Gibson 722592d8a9 Update for publishing to snapshots (#10211)
* fix extra quote inserted by intellij

* Fix path

* fix executable permissions usage

* improve directory resolution and restore some files from the previous PR

* remove old unused dep versions
Update to new march 2024 central release plugin

* update central publishing version

* temp disable mirror

* fix hallucinated version

* update maven invoker version for jetspeed

* remove old build properties
add better directory resolution for copy flatc

* fix helpers sources for cpu (api updates)
perform maven antrun upgrade

* more fixes for onednn helpers

* update more antrun usage

* fix pooling param usage

* remove findbugs on the 2 files it was used on

* debug odd build path issues

* try again

* remove bad ls

* try again

* another attempt

* Add troubleshooting logs again

* Remove specific gcc versions

* update build

* cd to original directory instead

* Remove enforcer check

* remove debug steps

* remove extra steps

* update linux, android and cuda versions

* update arm usage defaults

* remove 32 bit builds

* alternative path

* alternative path get rid of old tools

* get rid of over simplified bootstrap libnd4j download usage

* remove extra cmake

* remove manual path setting

* arm compilation fix

* debug armcompute

* update android-x86_64 openblas

* upgrade gcc

* minor armcompute const changes

* update openblas version

* fix armcompute paths

* remove ls

* update cuda versions and envrionment variables

* fix syntax errors

* fix syntax errors

* fix syntax errors

* fix syntax errors

* another rev

* update msys command

* rev

* fix classifier

* rev android-x86_64

* rev android-x86_64

* update cuda env passing

* fix linux-arm64 syntax error

* cuda rev

* cuda rev

* update arm else if branches for matching

* remove external PS script?

* remove external PS script?

* remove external PS script?

* improve architecture detection

* update list operation conv2d armcompute

* add flatbuffer generated code

* remove old maven auth

* remove old legacny average and accumulate

* remove cache due to 422 error

* ensure armcompute is optional

* ensure armcompute is optional

* disk space clean up on all workflows

* deal with windows service issue

* ensure nvcc is on path

* Add arm64 protoc
Update cuda paths

* convert to use numeric types only mitigating lld errors found by clang

* Add arm64 protoc
Update cuda paths

* fix syntax error

* fix overriding properties causing libnd4j not to be built with cuda

* update windows version

* try to update cl.exe paths

* update debugging for nvcc

* update cuda flags to work with linux/windows

* remove extra cuda install

* fix duplicate sources

* more unsupported compiler changes

* remove unneeded source and javadoc

* better cudnn detection

* update where we put unsupported compiler

* Collapse cmake logic

* Collapse cmake logic

* clean up consolidated file

* flatbuffers fix

* fix hallucinated paths

* generate flatbuffers by default

* fix hallucinated paths

* ensure imports present

* fix flatc target order

* fix elif syntax

* more rearrange

* fix git tag

* update template to allow proper configuration generation

* remove guard

* change quotes

* change quotes

* test default

* fix missing functions

* rearrange dependencies

* set the engine

* reintegrate some old cuda logic

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* Add back in function defs

* update api to use proper cuda versions

* update api to use proper cuda versions

* update api to use proper cuda versions

* Add back in function defs

* delete old paths

* aDd back include_ops.h generation

* delete old paths

* reinroduce old comand

* delete old paths

* delete old paths

* better tar unpacking

* fix for suffixes

* Add missing cpu sources

* fix duplicate profile

* change mac image

* change mac image

* get rid of old gpg key step

* get rid of javadoc on mac

* remove unneeded deps for mac

* update arm compute path

* remove old command checks

* remove gpg key step

* clang specific type erro

* clang specific type erro

* add another missing cpu path

* add another missing cpu path

* fix helpers sources ordering

* fix helpers sources ordering

* Add back createFromDescriptor

* fix helpers sources ordering

* fix helpers sources ordering

* fix helpers sources ordering

* fix helpers sources ordering

* Add back createFromDescriptor

* add debug for onednn

* add debug for onednn

* SFINAE for type aliases

* SFINAE for type aliases

* SFINAE for type aliases

* SFINAE for type aliases

* ensure we tell compiler we're ok with certain apple version minimums

* ensure we tell compiler we're ok with certain apple version minimums

* ensure we tell compiler we're ok with certain apple version minimums

* ensure we tell compiler we're ok with certain apple version minimums

* fix imports

* update linker path

* fix lock type usage

* change order of sources

* share mutex types

* share mutex types

* share mutex types

* update linker path

* share mutex types

* share mutex types

* share mutex types

* decrease type pairs for sort

* decrease type pairs for sort

* decrease type pairs for sort

* decrease type pairs for sort

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* update the special methods to use combinations

* standardize output paths

* fix template paths

* refactor compiler flags

* update onednn to use similar approach to armcompute

* refactor compiler flags

* fix paths

* fix paths

* fix paths

* fix paths

* fix paths

* fix paths

* fix paths

* fix paths

* change target expand types

* change target expand types

* add new pairwise types

* add new pairwise types

* add new pairwise types

* update linker paths

* add new pairwise types

* add new pairwise types

* add new pairwise types

* fix strings with transform

* fix strings with transform

* update linker paths

* update default values for libnd4j.outputPath

* update default values for libnd4j.outputPath

* update default values for libnd4j.outputPath

* update pom.xml namespaces

* Update .github/workflows/build-deploy-linux-cuda-12.6.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update .github/workflows/build-deploy-linux-x86_64.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-08 04:52:38 +09:00
Adam Gibson 3714478a8c update build files cuda versions (#10117)
fix left over cuda build issue with col2im
2024-08-13 17:03:28 +09:00
Adam Gibson b7184956d4 Update OS for CI (github actions deprecation) (#9922) 2023-02-22 16:55:17 +09:00
Adam Gibson 83daf79c49 Add deallocator references (#9907)
* Add new  reference metadata to cover when deallocators are dealing with constant buffers
Shorten PV concurrency test for automated tests

* Add new  reference metadata to cover when deallocators are dealing with constant buffers
Shorten PV concurrency test for automated tests
Remove dll export from hidden function

* Fix cbow inference segfaults
Fix scalar definition
Misc spacing fixes
Remove commented code
Remove extra print

* Add new  reference metadata to cover when deallocators are dealing with constant buffers
Shorten PV concurrency test for automated tests
Remove dll export from hidden function
Remove tmate

* Add new  reference metadata to cover when deallocators are dealing with constant buffers
Shorten PV concurrency test for automated tests
Remove dll export from hidden function
Remove tmate
Change default version release version to M3

* Add new  reference metadata to cover when deallocators are dealing with constant buffers
Shorten PV concurrency test for automated tests
Remove dll export from hidden function
Remove tmate
Change default version release version to M3

* WIP with printing

* WIP with printing

* Add deletes for new descriptor creation

* Rewrite shape desriptor allocation. Migrate to heap based pointers rather than stack based references to control
deallocation of references better.
Update external allocation counts to be correct

* Rewrite shape desriptor allocation. Migrate to heap based pointers rather than stack based references to control
deallocation of references better.
Update external allocation counts to be correct
Fix kotlin-reflect usage by default for custom op annotation scanning when using model import

* Fix up factory method deallocations

* Fix up factory method deallocations

* Fix up factory method deallocations
Remove extra printfs
Add 1 more deallocation

* Fix up factory method deallocations
Remove extra printfs
Add 1 more deallocation
Revert deallocator service threads change
2023-02-08 19:08:56 +09:00
Adam Gibson 5bd12140ea Remove old deeplearning4j.org links (#9889)
* Remove old deeplearning4j.org links
Remove old readmes

* Remove old deeplearning4j.org links
Remove old readmes
2023-01-20 00:02:45 +09:00
Adam Gibson e2b92619b2 Update build-deploy-windows.yml (#9753)
* Update build-deploy-windows.yml

* Update build-deploy-windows.yml

* Update build-deploy-windows.yml

* Update build-deploy-windows.yml
2022-08-16 16:52:22 +09:00
Adam Gibson 3a87acef06 Add proper java 11 compilation for compat (#9741)
* Misc test fixes (spark,datavec)

* Fix up release for builds

* Add missing test resources

* Update test cases

* Update PythonInterpreterTests.java

* Update TestTFGraphAllSameDiff.java

* Update TestTFGraphAllSameDiff.java

* Update compat build to use java 11

* Fix up aeron/agrona versions preventing a classpath clash

* Update build-deploy-linux-cuda-10.2-arm64.yml

* Update build-deploy-linux-cuda-10.2-arm64.yml

* Update build-deploy-mac.yml

* Set  java home

* Update build.sh

* Update build-deploy-mac-arm64.yml

* Update build.sh

* Update build-deploy-linux-x86_64-compat.yml

* Update build-deploy-linux-x86_64-compat.yml

* Update build.sh

* Update build-deploy-linux-x86_64-compat.yml

* Use zulu java 11

* Update build.sh

* Update build.sh

* Update build.sh

* Update build.sh

* Update build.sh

* Update build.sh

* Update build.sh

* Update build file default values

* More update build default values

* Add missing symbols

* Ensure platform is published for cuda 11.6

* Update build-deploy-windows.yml

* Ensure platform is only built when no helper is specified

* Formatting

* Update build-deploy-windows.yml

* Update build-deploy-windows.yml

* Update build-deploy-windows-cuda-11.6.yml

* Update build-deploy-windows-cuda-11.6.yml

* Update build-deploy-windows.yml

* Update build-deploy-windows.yml
2022-08-06 05:04:18 +09:00
Adam Gibson d60d9d2a12 Updates releases to use java 11 (#9738)
* Misc test fixes (spark,datavec)

* Fix up release for builds
2022-07-26 16:05:18 +09:00
Adam Gibson 01f340ea13 Misc 2d grad fixes, Spark test fixes test refactoring (#9735)
* Fix up create_view tests, assign operation for views

* Misc shape related fixes for gradients and tests related to old 2d assumption with vectors

* Ignore missing op

* Fix updater get with 1d standardization

* Fix up another 1d test case

* Update TestRegressionTest080.java

* Update SlicingTests.java

* Fix up booleanindexing backtracklinesearch test cases

* Fix up test assertion

* Remove old tensor array logic for tensorarray remove, fix test

* Address nits, remove noninplacevalidation listener

* Remove tests with old assumptions, migrate arrowserde test to platform-tests

* Add testresources profile to nd4j-presets-common

* More test collapsing

* Collapse tests

* Remove old profiles

* Delete old aurora backend, misc pom clean up

* Delete old test resources profiles

* Update datavec-api test locations

* More test migrations

* More tests

* Migrate tests for spark

* Collapse spark parameter server tests

* Remove old tests

* Collapse omnihub

* Rename tests for compilation errors

* Graph package moving

* Add missing dep

* nlp test adjustments

* Update names in platform-tests datavec local modules

* Add missing nlp imports

* Remove hard coded test, add deepwalk import

* Update pom.xml

* Update pom.xml

* Update pom.xml

* Add mockito dep

* Update TestGraphLoading.java

* Update pom.xml

* Remove deprecated tests, add missing dep

* Clean up intellij accidental refactoring

* Update AeronUdpTransportTest.java

* Update EndingPreProcessorTest.java

* More test updates

* More test refactoring

* More assertion clean up, remove deprecated test

* More test clean up

* Remove more deprecated tests

* More test updates

* More test updates

* More tests

* Update WeightedWalkerTest.java

* Update spark versions, dependencies

* Handle spark upgrade, add a set closeable false to prevent spark from closing arrays early
2022-07-25 07:07:14 +09:00
Adam Gibson b45b4f6304 Misc fixes for M2 (#9722)
* Add missing training config for graal

* Fixes https://github.com/eclipse/deeplearning4j/issues/9717

* Fix data type validation with scalars, misc spacing/null checks

* Allow openblas to be optional for people who don't use blas

* Enable nd4j-native-preset and cuda

* Update build-deploy-linux-cuda-11.4.yml

* Update build-deploy-linux-cuda-11.4.yml

* Update build-deploy-linux-cuda-11.4.yml

* Remove nd4j-native dep
2022-07-03 21:09:44 +09:00
Adam Gibson 3feca6d831 Python4j performance optimizations (#9688)
* WIP: adding python interpreter and new abstractions

* Add tests for python update

* fix up cuda build

* WIP: minor clean up, add netty shading

* Fix up test execution, ensure python set main thread is restored

* Add caching option for python (makes objects derived available outside of GIL)

* remove unused test case, extra printing
2022-05-11 16:57:35 +09:00
Adam Gibson c9e142e453 Update cuda builds (#9687)
* fix up cuda build

* Update build-deploy-windows-cuda-11.6.yml

* Update cuda build

* Update escape

* work around cuda caching permissions issues

* Update build-deploy-linux-cuda-11.6.yml

* Update build-deploy-linux-cuda-10.2-arm64.yml

* Update cuda permissions

* Update cuda build OS

* Try newer version for update deps

* Update build-deploy-linux-cuda-10.2-arm64.yml

* Update escape backticks

* Downgrade ubuntu

* Update action.yml

* Update action.yml

* Update build-deploy-linux-cuda-10.2-arm64.yml

* Remove caching due to permissions

* Update NDArray.cu

* change back to 18

* Update action.yml
2022-05-06 22:01:02 +09:00
Adam Gibson 4679b8907c Update build-deploy-linux-x86_64.yml (#9649)
* Update build-deploy-linux-x86_64.yml

* Update build-deploy-windows.yml

* Remove comment
2022-02-26 06:47:56 +09:00
Adam Gibson 4653c97a71 Rebase pooling changes (#9648)
* Rebase pooling changes

* revert ADSI change
2022-02-25 19:36:13 +09:00
Adam Gibson fd91c9c66e Misc fixes for java side for M2 release (#9643)
* bootstrap improvements

* Give pooling2dconfig default

* undo unintended rename

* Remove old imports

* Add better error message for null input shape in suggestVariables
2022-02-23 16:48:26 +09:00
Adam Gibson 61633eac42 Libnd4j build bootstrap updates (#9640)
* bootstrap improvements

* Update environment variable name for boostrap

* Add file name resolution to download script

* Add test for excluding libnd4j from build when download is defined

* Remove irrelevant extensions and update to add new compat file

* Add libnd4j to unspecified url code path

* Update build-deploy-linux-x86_64-compat.yml

* Update build-deploy-linux-x86_64-compat.yml

* Update libnd4j parameter to have consistent names

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Sets libnd4j home property when environment variable LIBND4J_HOME is set

* Add proper format for libnd4j home

* Copy artifacts to known location instead of trying to set variables

* Update build-deploy-linux-x86_64-compat.yml

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Add missing openblas download

* Update build-deploy-linux-x86_64-compat.yml

* Test skipping libnd4j build for pi_build

* Update build-deploy-linux-arm64.yml

* Update build-deploy-linux-arm64.yml

* Update bootstrap-libnd4j-from-url.sh

* Update libnd4j home echo for new assumptions (script copies to default directory instead)

* Add standalone build for boostrap downloads

* Add metadata to presets for bootstrapped builds

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update to use flatbuffers-src default directory

* Update bootstrap-libnd4j-from-url.sh

* Add file name url

* Add new bootstrap arguments

* Update build-deploy-linux-arm64.yml

* Update build-deploy-linux-arm64.yml

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update build-deploy-linux-arm64.yml

* Update bootstrap-libnd4j-from-url.sh

* Remove standalone

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Update bootstrap-libnd4j-from-url.sh

* Remove extra file name append

* Update more builds to skip libnd4j

* yaml

* Update NativeOps.h

* Add missing environment variables

* define nec false in cuda

* Update NativeOps.cu

* Update Nd4jCudaPresets.java

* Update Nd4jCpuPresets.java

* Add license

* Delete append.sh

* Update else if

* Fix quotes to allow variable substitution

* Change defaults to prevent building extra modules

* Add platform for nano

* fix module resolution in windows cuda

* Remove extra flag

* Update build-deploy-mac-arm64.yml

* Remove moditect for platform

* Add missing -pl declaration

* Remove default modules
2022-02-22 21:29:37 +09:00
Adam Gibson dcefdda00c Release optimizations/prep (#9638)
* Add mirror settings

* Update settings.xml

* Update settings.xml

* Create extensions.xml

* Update pom.xml

* Update settings.xml

* Remove verbose mode

* Remove deeplearning4j-cuda to conform with new build policies, extra caching, out of date guide

* Update part 2

* Add cuda caching

* Update indent

* Update build-deploy-linux-cuda-11.4.yml

* More indents

* More indents 2

* Update build-deploy-windows-cuda-11.6.yml

* ensure consistency on build versions/cache ids

* ensure consistency on build versions/cache ids

* Update cache ids

* UPdate for new functionality before renaming for testing

* indent fix

* Update run-gpu-tests-sanity-checks.yml

* / to -

* Remove extra step
2022-02-17 17:12:01 +09:00
Adam Gibson 346e722f5f Add back self hosted tests using new platform-tests module (#9637)
* Update build-deploy-mac-arm64.yml

* Update build-deploy-windows-cuda-11.4.yml

* Update build-deploy-windows-cuda-11.6.yml

* Fix  up test compilation

* Remove extra directory

* Ensure cuda profile

* Update build-deploy-linux-cuda-11.6.yml

* Update

* Update build-deploy-linux-cuda-11.6.yml

* Update build-deploy-windows-cuda-11.6.yml

* Make MemoryTracker backend agnostic

* Delete CudaWorkspaceTest.java

* Minor cuda updates, remove pre emptive validation

* Update CudaExecutioner.java

* Update build-deploy-windows-cuda-11.6.yml

* Fix broadcasting for element wise strides and non same shape

* Update TVM rename context to device

* update platform tests and action for self hosted test

* Redo https://github.com/eclipse/deeplearning4j/pull/9636

* Update cpu-sanity-check-tests.yaml

* Update cpu-sanity-check-tests.yaml
2022-02-15 16:22:16 +09:00
Adam Gibson ddfb1b6225 Update build-deploy-mac-arm64.yml (#9634)
* Update build-deploy-mac-arm64.yml

* Update build-deploy-windows-cuda-11.4.yml

* Update build-deploy-windows-cuda-11.6.yml

* Fix  up test compilation

* Remove extra directory

* Ensure cuda profile

* Update build-deploy-linux-cuda-11.6.yml

* Update

* Update build-deploy-linux-cuda-11.6.yml

* Update build-deploy-windows-cuda-11.6.yml

* Make MemoryTracker backend agnostic

* Delete CudaWorkspaceTest.java

* Minor cuda updates, remove pre emptive validation

* Update CudaExecutioner.java

* Update build-deploy-windows-cuda-11.6.yml

* Fix broadcasting for element wise strides and non same shape

* Update TVM rename context to device
2022-02-14 18:38:38 +09:00
Adam Gibson 192b3124fa Javacpp version updates (#9633)
* Javacpp version updates

* openblas version updates

* Update openblas version in pi_build, update M1 build

* Update build-deploy-mac-arm64.yml

* Update build-deploy-mac-arm64.yml

* Add libnd4j.arch argument, update mac arm64 arch

* Update pom.xml

* Remove extra dep

* Remove extra dep

* Update build-deploy-linux-x86_64-compat.yml

* Fix buildthreads param

* Update cuda versions
2022-02-10 20:25:28 +09:00
Adam Gibson 8ce2d9df8f Java support Version updates (#9626)
* Add back CI updates

* Fix android compilation error

* Update TopK.java

* Updates project for java 9+

* Remove old grpc server, rename backend packages, change flatbuffers to temp konduit fork for cuda compilation

* More renames + remove extra generated classes

* Update 0016 - Java 9+ Support.md

* Add back license from flatbuffers generation

* Remove solr modules, update java 9 module comments (fixed some leaving some ignored such as anything spark related)

* Update pom.xml

* Add cuda compute capabilities to reduce build times

* Add default flags for only building certain modules for cuda on windows

* Add back java 8 support

* Update build-deploy-windows-cuda-11.2.yml

* Update build-deploy-windows-cuda-11.4.yml

* Update build-deploy-windows-cuda-11.2.yml

* Update ccs, remove defaults

* Update build-deploy-linux-cuda-11.4.yml

* Add module info

* Update IndexedTail.java

* Add also make and remove deeplearning4j-cuda from build

* Add also make and remove deeplearning4j-cuda from build

* Update IndexedTail.java

* Add missing cuda modules

* Remove old unused concurrency module
2022-02-09 19:25:39 +09:00
Adam Gibson 5dbf3c5fb1 Fix up CI (windows gpg, actions param labels,..) (#9620)
* Add back CI updates

* gnupg2

* Add back GPG import hack

* More gpg hacks
2022-01-27 16:47:55 +09:00
Adam Gibson 851f4e2282 Update sonatype URL to allow publishing to snapshots/release (#9605)
* Update sonatype URL

* Remove old deeplearning4j-common dep

* Update pom.xml

* Migrate keras pre processors back, remove cycle in deps

* Refactor dependencies to move utils and properties/configurations around to avoid cycles

* Change nd4j-native to api and add standard test setup to omnihub

* Migrate to temurin

* Update pom.xml

* Fix up test declarations, empty string array test

* fix mnist downloads
2022-01-16 18:18:14 +09:00
Adam Gibson e746bcf7c9 Add platform test fixes (#9581)
* Create 0010 - Test module consolidation.md

* Support convolution 3d channels

* Migrate model import tests to self contained module

* Remove extra null pointer from keras, add kotlin test running for platform-tests

* Add aurora timing

* Change aurora execution to just ops

* Update AuroraOpExecutioner.java

* Update AuroraOpExecutioner.java

* Update AuroraOpExecutioner.java

* Update AuroraOpExecutioner.java

* Add sanitize to libnd4j, add libnd4j test runner with sanitize

* Update run-cpu-tests-sanity-checks.yml

* Update run-cpu-tests-sanity-checks.yml

* Model import test fixes, misc whitespace/package cleanup

* Remove extra flags

* Update cpu-sanity-check-tests.yaml

* Update cpu-sanity-check-tests.yaml

* Update model import to handle scalar cases, white space clean up

* Update for minor nits

* Update DefaultOpExecutioner.java

* Fixes https://github.com/eclipse/deeplearning4j/issues/9582

* Remove extra tests, println
2021-12-27 07:20:08 +09:00
Adam Gibson 09c19e7cf7 Migrates tests to one module for easier testing of different versions (#9579)
* Create 0010 - Test module consolidation.md

* Support convolution 3d channels

* Migrate model import tests to self contained module

* local

* Update pom.xml

* Update shape.h

* Fix test typo

* Update cpu-sanity-check-tests.yaml

* Update pom.xml

* Update pom.xml

* Update pom.xml

* Update pom.xml

* Update pom.xml

* Add downloading dl4j test resources for updates

* Update cpu-sanity-check-tests.yaml

* Update pom.xml

* More actions clean up remove noise, standardize platform.classifier

* Update pom.xml

* Fix null pointer in tests
2021-12-17 15:52:51 +09:00
Adam Gibson 551c1732f1 Add build cpu fixes 2021-12-04 08:20:14 +09:00
Adam Gibson ea67740721 Debug build update 2021-12-02 22:13:12 +09:00
Adam Gibson 8e16f62065 Update action.yml 2021-12-02 17:07:31 +09:00
Adam Gibson 5379531dac Update action.yml 2021-12-02 15:55:55 +09:00
Adam Gibson 8e4da0aa87 Update build-deploy-windows.yml 2021-12-02 12:03:23 +09:00
Adam Gibson 8f25c8a477 Update default cores for windows builds 2021-11-12 20:26:08 +09:00
Adam Gibson 1ae6b86fa0 Fix onednn includes 2021-11-12 09:44:45 +09:00
Adam Gibson f3bb8fae94 Update setup-java plugin 2021-11-12 07:16:02 +09:00
Adam Gibson 1a9e983d29 Add native preset as default for mac 2021-10-18 09:23:47 +09:00
Adam Gibson 6ebe5ff9c0 CI fixes 2021-10-18 07:29:23 +09:00
Adam Gibson 837fadeb72 Update build-deploy-cross-platform.yml 2021-10-11 21:45:09 +09:00
Adam Gibson e931fa5e7d Fix spark executable build 2021-10-11 21:14:19 +09:00
Adam Gibson 9ddfc08f41 More updates 2021-10-07 16:59:35 +09:00
Adam Gibson 8605d36a23 Update to new ubuntu 18 2021-10-07 16:59:13 +09:00
Adam Gibson a93ca84f57 Support spark 3 2021-09-06 12:24:44 +09:00
Adam Gibson b71b0a0234 Update build-deploy-linux-cuda-11.4.yml 2021-08-27 17:40:05 +09:00
Adam Gibson 1124a4f04a Update build-deploy-linux-cuda-11.2.yml 2021-08-27 17:39:11 +09:00
Adam Gibson 463df0f8fb Update build-deploy-windows-cuda-11.4.yml 2021-08-27 17:38:42 +09:00
Adam Gibson 610d903512 Update build-deploy-windows-cuda-11.2.yml 2021-08-27 17:38:10 +09:00
Adam Gibson 1a18dc113e Update build-deploy-linux-cuda-10.2-arm64.yml 2021-08-26 20:25:04 +09:00
Adam Gibson 6db3e2b9c7 Update build-deploy-linux-cuda-10.2-arm64.yml 2021-08-26 20:09:53 +09:00
Adam Gibson a4ead457d5 Update compute to ensure builds on 11.4 succeed 2021-08-25 09:14:07 +09:00