Tensorflow-based automatic personality recognition used in asynchronous video interviews

Tensorflow-based automatic personality recognition used in asynchronous video interviews

PROJECT GUIDE:

PROJECT GROUP MEMBERS:

With the development of artificial intelligence (AI), the automatic analysis of video interviews to recognize individual personality traits has become an active area of research and has applications in personality computing, human-computer interaction, and psychological assessment. Advances in computer vision and pattern recognition based on deep learning (DL) techniques have led to the establishment of convolutional neural network (CNN) models that can successfully recognize human nonverbal cues and attribute their personality traits with the use of a camera. In this study, an end-to-end AI interviewing system was developed using asynchronous video interview (AVI) processing and a TensorFlow AI engine to perform automatic personality recognition (APR) based on the features extracted from the AVIs and the true personality scores from the facial expressions and self-reported questionnaires of 120 real job applicants. The experimental results show that our AI-based interview agent can successfully recognize the “big five” traits of an interviewee at an accuracy between 90.9% and 97.4%. Our experiment also indicates that although the machine learning was conducted without large-scale data, the semisupervised DL approach performed surprisingly well with regard to automatic personality recognition despite the lack of labor-intensive manual annotation and labeling. The AI-based interview agent can supplement or replace existing self-reported personality assessment methods that job applicants may distort to achieve socially desirable effects

• Resume classification: resume will be analysed with machine learning algorithm like DNN. Effectiveness with the oraganization will be analysed.

• Tone analysis: User voice tone will be classified by converting it into text . and text analyzation will identify tone of user with various machine learning algorithm like naïve bayes,svm or random forest. Which ultimately will identify effectiveness for our organization .

• Video based face feature analysis: With the help of CNN algorithm and face landmark user face will be captured by camera and feature extraction of face will be done which will result in obtaining output such as happy face,entertaining face,good gesture,good smile.Then effectiveness with the job location will be identified.

• CNN model generation: face categories will be added and trained with convolution neural network.

• Text model generation:CNN model will be prepared for tone analysis.

• Face recognition:- for employee verification we can use face recognition module associated with CNN system recognition.

• User Registration: User has to register to check the interview performance .
• User Login: User can login to system to check the interview performance.

.

• Admin: Admin adds the user and their details.

Software Requirements:

• Windows 10, Windows 7
• Python,anaconda,jupyter notebook,spyder
• Back end:-mysql,sqlyog
• tensorflow

Hardware Components:

• Processor – i3,i5
• Hard Disk – 5 GB
• Memory – 6GB RAM

Advantages:

• Helps for online interview purpose
• Students can work on there tone and improve.
• Employee can be verified by various oraganization.
• Face landmark may result in achieving enthusiastic candidate in job.
• Decision making model for employee selection for HR and other technical field

Applications:

• Interview purpose.
• Student improvement through self analysis.