TensorFlow 2.6 upgrade #1565

anargyri · 2021-11-04T13:02:00Z

Description

Changes required for upgrade to TensorFlow 2.6. This is a migration of the existing code to TF2 keeping the v1 style and using the tf.compat.v1 API. See https://www.tensorflow.org/guide/migrate/upgrade and https://www.tensorflow.org/guide/migrate.

In detail

Ran update script provided by TensorFlow that replaces syntax and fixed any errors caused.
Replaced references from tf.contrib (now deprecated) with other modules or packages
Edited setup.py, conda script and documentation.
Made changes to some classes (e.g. DKN, LSTUR) to work.
Replaced tf.summary, tf.logging, hparams.
Replaced batch_dot() to fix self attention layer.
Replaced optimizers that were not working e.g. LazyAdam.
Replaced deprecated imports of RNN cells.
Replaced fully connected layer with tf-slim implementation.
Pinned commit from pymanopt in order to fix GeoIMC.
Removed batch inference step from SLIRec notebook.

Related Issues

Checklist:

I have followed the contribution guidelines and code style for this project.
I have added tests covering my contributions.
I have updated the documentation accordingly.
This PR is being made to staging branch and not to main branch.

…nserted loss_reduction arg

…input_fn

…ndreas/tf

Leavingseason · 2021-11-16T11:36:04Z

Great job! I have tested some deeprec-related jupyter-notebooks, and everything is running normally.

laserprec · 2021-11-23T17:09:16Z

recommenders/datasets/movielens.py

@@ -575,6 +576,11 @@ def extract_movielens(size, rating_path, item_path, zip_path):
            shutil.copyfileobj(zf, f)


+# For more information on data synthesis, see https://pandera.readthedocs.io/en/latest/data_synthesis_strategies.html


This is awesome! ❤️

miguelgfierro · 2021-12-01T17:15:09Z

@anargyri, it's weird, do you know why the ADO pipelines are not being executed?

anargyri · 2021-12-01T18:46:47Z

@anargyri, it's weird, do you know why the ADO pipelines are not being executed?

The GitHub hosts don't have CUDA 11 installed. About spark, I am not sure, I am trying to figure what happens.

miguelgfierro · 2021-12-02T09:34:36Z

The GitHub hosts don't have CUDA 11 installed. About spark, I am not sure, I am trying to figure what happens.

But the ADO pipelines should execute. This is weird

anargyri · 2021-12-02T09:46:44Z

The GitHub hosts don't have CUDA 11 installed. About spark, I am not sure, I am trying to figure what happens.

But the ADO pipelines should execute. This is weird

Ah sorry, I missed the "ADO" in your question. Yes, it is strange, let me double check.

anargyri added 30 commits September 22, 2021 17:23

Change TF and Cuda versions

66e5d3c

Fix numpy version

3396f2c

Explain numpy version

153099e

Merge branch 'staging' into andreas/tf

d67955e

Merge branch 'staging' into andreas/tf

b572bbe

Merge branch 'staging' into andreas/tf

e8bc100

Specify no-binary install for Surprise

68af516

Update CUDA version

aafbe1a

Modifications made by tf_upgrade_v2 script provided by TF + fix for i…

899b43a

…nserted loss_reduction arg

Modifications made by tf_upgrade_v2 script provided by TF + fix for i…

cb60a2f

…nserted loss_reduction arg

Replace tf.contrib.estimator.build_supervised_input_receiver_fn_from_…

9f39411

…input_fn

Fix tf_utils

edf9b4c

Merge branch 'andreas/tf' of github.com:microsoft/recommenders into a…

a98750b

…ndreas/tf

reapply TF2

10cd5a7

Fix wide and deep tuning notebook

e1560f9

Replace tf.contrib.training.HParams with custom class

d2b03b7

Fix DKN model

2efcac0

Fix XDeepFM hparams

e5ec621

Fix tf version

f3d0437

Replace tf.logging in notebooks

ba702e5

Fix tf.summary in notebook

1b83ffe

Hparams for newsrec

d258bfe

Fix LSTUR run

1d1b211

Replace batch_dot with einsum in self attention layer

f205d15

Change Adam in RBM

df7ed26

Fix RNNs

c29bc41

Remove TF addons

de2b3f7

Remove LazyAdam optimizer

f5d28e4

Fix RNN cells import

b6ceeec

Fix sum.py

68979f1

Change heading in sequential notebook

679d50c

Leavingseason approved these changes Nov 16, 2021

View reviewed changes

anargyri added 4 commits November 16, 2021 13:52

Move pandera to core dependencies in order to fix movielens

7688dc1

Fix issue with RLRMC test

2523447

Remove numpy 1.19 from GitHub workflows

3ef366a

Fix mock movielens duplicates

ecff395

laserprec reviewed Nov 23, 2021

View reviewed changes

anargyri added 11 commits November 24, 2021 17:19

Fix mock movielens test

dd0b29e

Add blank line

8f32dda

Move surprise to experimental

23ae6e0

Update tests and docs for experimental

55a8199

Update CI tests

383c475

Update GitHb actions

5c18fb6

No binary option in tox.ini

dfc8eac

Remove experimental from GitHub actions

1dc5d5c

Disable experimental tests from workflow

292f139

Wrap surprise import in test

2bce47a

Fix bug in tf_utils

2eb8f93

miguelgfierro mentioned this pull request Dec 2, 2021

[TEST] Triggering the ADO tests #1572

Closed

4 tasks

miguelgfierro mentioned this pull request Dec 3, 2021

tfidf runtime enhancement changes #1571

Merged

4 tasks

anargyri and others added 2 commits December 6, 2021 13:52

Ignore coverage errors while reading from source files

bfbb4b0

Merge branch 'staging' into andreas/tf

3eae4b1

anargyri merged commit 6c9e720 into staging Dec 6, 2021

miguelgfierro mentioned this pull request Dec 17, 2021

[BUG] AttributeError: module 'tensorflow.keras.initializers' has no attribute 'truncated_normal'\n in multinomial_vae.py #1513

Closed

miguelgfierro mentioned this pull request Mar 19, 2024

[ASK] Stopped the support of new Tensorflow versions >= 2.16 #2073

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TensorFlow 2.6 upgrade #1565

TensorFlow 2.6 upgrade #1565

anargyri commented Nov 4, 2021 •

edited

Loading

Leavingseason commented Nov 16, 2021

laserprec Nov 23, 2021

miguelgfierro commented Dec 1, 2021

anargyri commented Dec 1, 2021

miguelgfierro commented Dec 2, 2021

anargyri commented Dec 2, 2021

		@@ -575,6 +576,11 @@ def extract_movielens(size, rating_path, item_path, zip_path):
		shutil.copyfileobj(zf, f)


		# For more information on data synthesis, see https://pandera.readthedocs.io/en/latest/data_synthesis_strategies.html

TensorFlow 2.6 upgrade #1565

TensorFlow 2.6 upgrade #1565

Conversation

anargyri commented Nov 4, 2021 • edited Loading

Description

Related Issues

Checklist:

Leavingseason commented Nov 16, 2021

laserprec Nov 23, 2021

Choose a reason for hiding this comment

miguelgfierro commented Dec 1, 2021

anargyri commented Dec 1, 2021

miguelgfierro commented Dec 2, 2021

anargyri commented Dec 2, 2021

anargyri commented Nov 4, 2021 •

edited

Loading