Add FedVSSL baseline

[yasar-rehman]

Issue

#2058

Description

Related issues/PRs

Proposal

Explanation

Checklist

• Implement proposed change
• Write tests
• Update documentation
• Update changelog
• Make CI checks pass
• Ping maintainers on Slack (channel #contributions)

Any other comments?

[jafermarq]

Hi @yasar-rehman, @yan-gao-GY

This is looking good. I was able to run the experiments fine. Interestingly i got much better results for UCF-101 results when pretraining on UCF-101 than those in the table...

Could you take some time to address the comments below?

[jafermarq]

Hi @yasar-rehman , @yan-gao-GY ,

This baseline can be merged 🥳 . But first, could you look at the comment i left below? Ping me when ready.

In the Expected Results section it says "takes a considerable amount of time without access to server-grade hardware (~5 days with a RTX 3090)". But i thought you'd need several RTX 3090? is it 6 of them as stated earlier in the README.md?

[yan-gao-GY]

@jafermarq thanks for your recent fix! It would take ~1 day if using 6 RTX 3090. Let's change the statement in the Expected Results section to keep consistent?

[jafermarq]

@yan-gao-GY , @yasar-rehman ,

Your FedVSSL baseline is ready to be merged. Many thanks for thanks for the hard work !