Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance improvements in TSNE algorithm #1087

Merged
merged 19 commits into from
Dec 15, 2022

Conversation

Vika-F
Copy link
Contributor

@Vika-F Vika-F commented Dec 12, 2022

Those changes enable DAAL tSNE optimizations in sklearnex and fix some mainstream sklearn test failures in TSNE tests.

@Vika-F
Copy link
Contributor Author

Vika-F commented Dec 12, 2022

@Alexsandruss
Copy link
Contributor

Rebase on latest develop and apply PEP8, please.

@samir-nasibli
Copy link
Contributor

Vika-F and others added 16 commits December 13, 2022 18:18
…intel#1071)

* Add workaround for n_iter_ SVM attribute

* Pytest onedal dir

* Exclude test_policy

* fix result_option fail for kneighbors method in knn classifier
* Downgrade build version and set test version of numpy

* Upgrade version to 1.20 for python<=3.9

* Set base numpy to be 1.19.* for build

* Set numpy for future python version

* Enabling full versions and >=3.10 python

Co-authored-by: Nikolay Petrov <nikolay.a.petrov@intel.com>
* add system info

* fix python activation on win

* add system descriptor

* fix descriptor calls

* fix descriptor calls 2

* fix cpufeature installation on mac

* change system descriptor url to oneapi-src/onedal

* Add descriptor script

* Remove extra variable
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
* add balanced branch of _compute_class_weight

* Remove extra computation of weights
* link libonedal_dpc.so with libonedal_sycl.a due to mkl depency issue

* only changing linker if linux

* additional condition for windows linkage

* removing multiply defined symbols

* windows build completes, sycl errors, trying to start job

* builds and 86/100 examples pass, cleaned up previous unnecessary additions

* initial fix for Linux DPCPP failure

* Flake8 appliance

* add env variables for Linux DPCPP

* Linux DPCPP ci update

* Linux DPCPP check: update conda build step

* moved compiler options setting into conda-recipe build

* reverting linkage changes - resolved from mkl fpk update

* address some comments

updates passing -fsycl flag

some refactoring

* rebase

* fix comments

* Update CMakeLists.txt

fix using gcc compiler

* Apply pep8

* Apply pep8 n2

* Update CMakeLists.txt

* resolving windows intel compiler issues

* MD to MT flag for compiler and removing unneeded cmake verbose flag

* updated gitignore

* link libonedal_dpc.so with libonedal_sycl.a due to mkl depency issue

* only changing linker if linux

* additional condition for windows linkage

* removing multiply defined symbols

* windows build completes, sycl errors, trying to start job

* builds and 86/100 examples pass, cleaned up previous unnecessary additions

* initial fix for Linux DPCPP failure

* Flake8 appliance

* add env variables for Linux DPCPP

* Linux DPCPP ci update

* Linux DPCPP check: update conda build step

* moved compiler options setting into conda-recipe build

* reverting linkage changes - resolved from mkl fpk update

* address some comments

updates passing -fsycl flag

some refactoring

* rebase

* fix comments

* Update CMakeLists.txt

fix using gcc compiler

* Apply pep8

* Apply pep8 n2

* Update CMakeLists.txt

* resolving windows intel compiler issues

* MD to MT flag for compiler and removing unneeded cmake verbose flag

* updated gitignore

* Update setup.py

* reverting MT flag back to MD

* undoing last commit

* reverting sycl linking addition

* removing sycl addition pt. 2

* addressing Mac comments

* link fsycl in cmake only when using dpc interface

* FIX: daal4py spmd test

* some misc fixes setup.py

Co-authored-by: Samir Nasibli <samir.nasibli@intel.com>
Co-authored-by: Alexander Andreev <alexander.andreev@intel.com>
daal4py/sklearn/manifold/_t_sne.py Outdated Show resolved Hide resolved
@napetrov napetrov merged commit 5646ed8 into intel:develop Dec 15, 2022
@SmirnovEgorRu
Copy link
Contributor

SmirnovEgorRu commented Dec 15, 2022

Do you have some perf numbers of the improvements vs stock?

@napetrov
Copy link
Contributor

Do you have some perf numbers of the improvements vs stock?

Would be published earlier next year.

@Vika-F Vika-F deleted the dev/vsfedoto/tsne_opt branch February 16, 2023 10:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants