Video dubbing method and device, electronic equipment and computer readable storage medium
- Applicant
- TikTok
- Auteurs
- N/A
- Titre
- Video dubbing method and device, electronic equipment and computer readable storage medium
- Patent Number
- CN110971969
- Publication Date
- 2020
- uri
- https://patents.google.com/patent/CN110971969
- Description
- The invention provides a video music matching method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of video processing. The method comprises the following steps: inputting a video to be subjected to music matching into a pre-trained first neural network model to obtain specific-dimension video features of the video to be subjected to music matching; inputting the video features of the specific dimension into a predetermined second neural network model to obtain an emotion category of the video to be subjected to music matching; obtaining a plurality of songs corresponding to the emotion categories from a song library pool, and respectively extracting audio features of the songs; and performing Euclidean distance calculation according to the specific dimension video features of the video to be subjected to music matching and the audio features of each track, and taking the track of which the Euclidean distance is within a preset range as a recommended track of the video to be subjected to music matching. According to the invention, based on the emotion category expressed by the video, automatic music matching can be carried out on the video, and the use experience of a user is improved.
- keywords
- Emotion
- Domaine de recherche
- Computer-Mediated Communication
- Sentiment Analysis
- Software Development
- Données collectées (type source)
- Image
- Audio
- Video
- Concepts clés
- Emotion
- Méthode
- The emotion type of the video is based on the analysis of the video characteristics obtained using neural network model. Music which accords with the emotion expressed by the video may be obtained in a song library pool based on emotion tags
- Dispositif
- Device
- Objectifs du brevet
- Determine/Identify Content Emotion
- Personalize/Improve with emotion information
Fait partie de Video dubbing method and device, electronic equipment and computer readable storage medium