Software that can generate a photo of an animal based on its skeleton and a photo of an animal's skeleton based on its animal
Fedosenko Maxim
Vasilenko Vladislav
pix2pix generates an animal based on the skeleton
pix2pix_rev generates a skeleton based on an animal
crt_ftable- script for creating a training and validation table (*starts first)
data_utils- functions for generating training pairs and augmenting them
model- the model structure is described
tf_losses- the loss functions are described
train_model- the main script for training (*starts second)
*To increase the learning power, you need to replace the parameter GLOBAL_M = 32 with a larger value, for example 64
eval- the script demonstrates the operation of the neurowork
*For the network to work, you need to download the dataset to the folder
Especially for these neural networks, a small application was made on a PC
The program already contains the necessary weights to work with this version of the neural network
To launch the application, you need to open the file prog.exe and upload images.
The "преобразовать в скелет" button inverts the neural network and allows you to generate an animal skeleton based on its image.
*If you have trained your neural network and want to use our program, you need to replace the weight files in prog/pix2pix
As a result of the training, the network has learned to generate images, but rather blurry and inaccurate. You can get similar results on some images:
We believe that if you increase the power for training the neural network and increase the size of the dataset, you can improve the network performance and similar results will be generated less