About training steps and correctness.

[becauseofAI]

According to the same settings in the readme, I trained 40,000 coco images.

Currently, 11,700/1_000_000 steps have been trained, but reconstruction has not been possible, as shown in the figure below.

step 20,000

step 39,000

step 54,000

The reconstruction results of the first few steps are shown in the figure below.
step 100

step 200

The training indicator curve is shown in the figure below.

So, is the current training normal? If it's not normal, can you help locate the problem? If it is normal, how many steps does it take to train to reconstruct the image? @lucidrains

[NingMa-AI]

I met the same problem, I am using 100K test images of ImageNet. The saved figures and losses behave like what you show.

[ziyannchen]

Same here. Anyone got solutions?

[kxgong]

I got better results than you (not good results), and I can see the vague shapes. I used a smaller dataset.