Illustration of pre-training (IMAGE) Beijing Zhongke Journal Publising Co. Ltd. Caption Pre-training is a part of transfer learning. If the pre-training model is fully supervised, the pre-training objectives are required, while if the pre-training model is an unsupervised or self-supervised learning model, the pre-training process does not need the objective. Credit Beijing Zhongke Journal Publising Co. Ltd. Usage Restrictions Credit must be given to the creator. License CC BY Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.