Next Article in Journal
On the Use of the Multi-Agent Environment for Mobility Applications
Next Article in Special Issue
Tell Me More: Automating Emojis Classification for Better Accessibility and Emotional Context Recognition
Previous Article in Journal
Clinical Trial Classification of SNS24 Calls with Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Measuring Ethical Values with AI for Better Teamwork

1
Cologne Institute for Information Systems, University of Cologne Pohligstrasse 1, 50969 Cologne, Germany
2
MIT Center for Collective Intelligence, 245 First Street, Cambridge, MA 02142, USA
*
Author to whom correspondence should be addressed.
Future Internet 2022, 14(5), 133; https://doi.org/10.3390/fi14050133
Submission received: 11 April 2022 / Revised: 26 April 2022 / Accepted: 26 April 2022 / Published: 27 April 2022
(This article belongs to the Special Issue Affective Computing and Sentiment Analysis)

Abstract

:
Do employees with high ethical and moral values perform better? Comparing personality characteristics, moral values, and risk-taking behavior with individual and team performance has long been researched. Until now, these determinants of individual personality have been measured through surveys. However, individuals are notoriously bad at self-assessment. Combining machine learning (ML) with social network analysis (SNA) and natural language processing (NLP), this research draws on email conversations to predict the personal values of individuals. These values are then compared with the individual and team performance of employees. This prediction builds on a two-layered ML model. Building on features of social network structure, network dynamics, and network content derived from email conversations, we predict personality characteristics, moral values, and the risk-taking behavior of employees. In turn, we use these values to predict individual and team performance. Our results indicate that more conscientious and less extroverted team members increase the performance of their teams. Willingness to take social risks decreases the performance of innovation teams in a healthcare environment. Similarly, a focus on values such as power and self-enhancement increases the team performance of a global services provider. In sum, the contributions of this paper are twofold: it first introduces a novel approach to measuring personal values based on “honest signals” in emails. Second, these values are then used to build better teams by identifying ideal personality characteristics for a chosen task.

1. Introduction

Do employees with high ethics and morals perform better? Extant research has tried for a long time to identify personality characteristics, moral values, and risk-taking behavior correlated with high-performing individuals and teams. Until now, these determinants of individual personality were measured through surveys, where individuals were asked to answer a series of questions to assess their characteristics. Existing research shows that certain characteristics are related to individual and team performance. For instance, it has been found that with regards to the FFI five-factor personality inventory, entrepreneurs are more conscientious, open, and extroverted, and less neurotic and agreeable than managers [1]. Similarly, the perceived fairness of executives has a positive influence on employee performance [2]. However, individuals are notoriously bad at self-assessment, either seeing themselves in too positive a light or being overly critical of themselves. AI and machine learning put new tools at the disposal of behavioral and organizational researchers, allowing them to automatically analyze electronic traces of individuals to predict their personality characteristics. Leveraging social network analysis (SNA) and natural language processing (NLP) enables researchers to gain deep insights into the personality of individuals, computing it automatically and then comparing the predicted personality characteristics with dependent variables of individual and team performance.

Foundational Research

In his seminal research Pentland [3] introduced the concept of honest signals. These are small signs of an individual, for instance, body signals, little words, or the way how words are spoken or sent electronically, that give away the true intent, personality, emotion, or personal values of the individual. We have applied this concept of honest signals to email, for instance, measuring the speed of response to a message as a predictor of the passion of an employee, while the speed with which others respond to her is a predictor of the respect she commands [4]. Similarly, the creativity of an individual can be measured by tracking the changes in the network position of the individual in the group network [4]. The validity of these constructs has been verified many times, applying it to employee satisfaction [5], individual and team creativity [6], customer satisfaction, the likelihood of leaving the company [5], personality characteristics, and risk-taking attitude [7]. In another project, we have shown that the moral values of individuals are correlated with their honest signals expressed in their emails [8]. In this project, we will apply these insights to first compute personality characteristics, ethical values, and risk attitudes from the emails of employees and then attempt to uncover the hidden relationship between the values of these individuals and their individual and team performance.
The present work builds on previous research examining the relationship between the concepts of honest signals and personal values measured with the same surveys as in the present paper. The first relevant study links honest signals to the traits of agreeableness, neuroticism, and openness to experience. Agreeableness, for example, is linked to greater centrality and shorter response time, neuroticism to lower centrality and a lower contribution index, and openness to experience to shorter response time [9]. In a further study, correlation and regression results demonstrate significant connections of honest signals for all five moral foundations of Haidt. According to this study, for example, positive and non-emotional language and “nudging by email” are predictive of a person’s level of harm or care [8]. In sum, the study showed that honest signals account for 70% of the actors’ moral values [8]. In terms of Schwartz’s Values, the same study’s correlation results show that the value of conservation is linked to increased responsiveness and social capital [8]. Unlike the current paper, the study has not examined the values that underpin Schwartz’s dimensions. However, as these are underlying values of similar dimensions, it is presumed that they are likewise linked to honest signals. The final study on which this paper is based analyzes personality through the lens of DOSPERT values. Both email and DOSPERT survey data are collected, as in the other experiments, to investigate their relationship. The regression results suggest that honest signals can create significant predictions of people’s risk attitudes [7]. In sum, the described studies indicate that email-based honest signals can be predictive of personal and moral values, as measured by the NEO FFI-R personality survey, the Schwartz’s Values survey, the Haidt Moral Foundations questionnaire, and the DOSPERT risk-taking survey. This work builds on this previous research by developing machine learning models which predict individuals’ personal and moral values by their honest signals. Hereby, these models serve as an intermediary step to predict the survey scores of employees and link these values to their performance.

2. Method

How can we predict individual and team performance based on email communication data? The goal of this research is to leverage the “wisdom of the crowd through AI” to identify personality characteristics, moral principles, and attitudes to risk predictive of employee performance, both on the individual and on the team level. These characteristics can then be used to measure and improve performance of employees, managers [2], and entrepreneurs [1]. Towards that goal, features suitable for machine learning need to be extracted from electronic communication archives such as email. In particular, features indicative of social network structure such as degree and betweenness centrality features indicative of network dynamics such as oscillation in betweenness centrality and contribution index, and features indicative of network content such as positivity and emotionality must be computed. These features are known as “honest signals” [3]. Honest signals are signals that people express unconsciously or uncontrollably. These signals are rooted in individuals and give meaningful insights and revelations about their behavior [3]. An overview and definitions of all studied honest signals are given in Table 1. These features are then compared with morality, personality, and risk attitude of individuals measured through the NEO FFI-R personality survey [10], the Schwartz’s Values survey [11], the Haidt Moral Foundations questionnaire [12], and the DOSPERT risk-taking survey [13] to build a machine learning model that will predict these dependent variables (morality, personality, and risk attitude) automatically.
The NEO FFI-R surveys the Big Five personality traits of openness to experience, conscientiousness, extroversion, agreeableness, and neuroticism [10]. Schwartz’s Values survey is based on Schwartz’s Theory of Basic Human Values and measures the ten human values of importance for power, achievement, hedonism, stimulation, self-direction, universalism, benevolence, tradition, conformity, and security, as well as the two dimensions of self-transcendence and conservation [11]. The moral foundation questionnaire is based on the Theory of Moral Foundations and attempts to measure the moral concerns of individuals. These values include peoples’ concern for care (or harm), fairness (or cheating), loyalty (or betrayal), authority (or subversion), and sanctity (or degradation) [12]. Last, the DOSPERT risk-taking survey measures peoples’ risk-taking likelihood and perception in five behavioral domains. According to the DOSPERT scale, risk-taking decisions can be assessed by financial (e.g., investing in a speculative stock), health/safety (e.g., seatbelt usage), recreational (e.g., taking a skydiving class), ethical (e.g., cheating on an exam) and social risk decisions (e.g., confronting coworkers or family members) [13]. Further, this work defines the total risk likelihood and perception by the sum of the respective scores as an indicator of a person’s overall risk-willingness [7].
The resulting models are then used to predict morality, personality, and risk attitude of large numbers of individuals through analyzing their emails and developing further models to predict employees’ performance based on their personal and moral values. The described theoretical framework is presented in Figure 1.
Email archives of interactions of students participating in a multinational university course, professionals in a service firm as well as personal mailboxes are analyzed, where the same people have also answered the NEO FFI-R personality survey, the Schwartz’s Values survey, the Haidt Moral Foundations questionnaire, and the DOSPERT risk-taking survey. In terms of FFI surveys, data of 81 people are analyzed, while 56 people are surveyed for Moral Foundations, 61 people for Schwartz’s Values, and 49 people for DOSPERT values (Table 2). Constellation of the data sources underlying the targeted survey scores are given in the following table.
With the email data, the honest signals of these people, such as speed of response, SNA metrics, and emotionality, are computed. The “honest signals” are then used as features to predict FFI personality, Schwartz’s Values, Moral Foundations, and DOSPERT attitudes to build a generally usable machine learning model that will predict these values from email. These models will be applied to separate datasets of employees of different industries in order to predict their personalities and link them with their performance. Similar to the case of building machine models for predicting personal values, usable machine learning models that will predict performance will be built. Hereby, email and various performance measure data of employees of health care firms, professional services as well as students are collected and analyzed. Table 3 shows the origin of data as well as the targeted performance variables.
Further, data are prepared by detecting and removing outliers, identifying and merging duplicate actors in the email network, and binning the target features into the three classes of “low”, “medium”, and “high” personality or performance scores. Binning is performed for the continuous target features based on normal distribution so that the lowest-scoring 16%, the highest-scoring 16%, and the remaining 84% are binned into one category each, while categorical performance variables, e.g., managers’ ratings, are left in their natural state. After preparing the data, the process of developing the machine learning models is structured in the following way. First, a maximum of three input features are selected based on calculating the importance of the strongest correlating input features in order to avoid overfitting of the classification models. Then, the datasets are split into 90% training and 10% test data in order to ensure, in the context of the relatively small data sets, that instances of all three classes are present in the 10 folds during cross-validation as well as during testing. The classes of the training data are balanced via SMOTE, and different classification models, such as Logistic Regression, Support Vector Machines, Stochastic Gradient Descent, or XGBoost Classifiers (XGB), are approached and trained using 10-fold cross-validation (CV) [18,19,20]. Out of all approaches, the best-performing model is optimized using GridSearchCV before finally evaluating the model on the independent test set. Figure 2 describes this system setup.
Python and Jupyter Notebook are used for programming and coding tasks, including data preparation, modeling, and evaluation. Additionally, in terms of creating data statistics (e.g., correlation results), R and RStudio are used. Email data collection has been performed using Condor [21], a social network and semantic analysis software, before processing the data in Phoenix [22], a high-end analysis software to calculate and explore honest signals.

3. Results

3.1. Predicting Personal and Moral Values

Analyzing email and survey data of the cohort of students, employees in professional services, and actors in the personal mailbox, correlation results (see Appendix A) suggest relationships between honest signals and personalities. For example, the personality factor conscientiousness is associated with occupying central network positions at the significance level of 0.05, as indicated by betweenness (0.221 *) and degree centrality (0.227 *), while agreeable people tend to be positioned at peripheral positions.
Based on the most important and strongest correlating input features, the developed ML models for predicting survey ranks are shown in Table 3. In sum, the personal and moral values of agreeableness, conscientiousness, extraversion, openness to experience, neuroticism, authority/respect, fairness/reciprocity, harm/care, power, achievement, transcendence, recreational risk likelihood, social risk likelihood, social risk perception, ethical risk likelihood, ethical risk perception, and total risk likelihood result to be predictive through honest signals. For the remaining target values, no prediction model could be developed due to low validation metrics. Furthermore, a point to notice is that among all considered classification approaches, XGB classifiers indicate the best performance. Consequently, all valid models are represented by XGB models.
Regarding conscientiousness, for example, in addition to degree centrality, the oscillation of a person’s betweenness centrality has proven to be a substantial predictor. The model’s feature importance plot is shown in Figure 3. Accuracy scores of about 0.8 during CV and 0.889 on the holdout set, as well as a Cohen’s kappa coefficient of 0.75, indicate that the model has a validly high performance.
An individual’s level of valuing authorities and respect, for example, is shown to be predictive through the signals of average influence and sentiment (Figure 4). The classification model reaches an accuracy score of 0.707 during CV and 0.833 during testing. Furthermore, ROC AUC scores of greater than 0.8 on both sets and Cohen’s kappa score of 0.714 indicate accurate predictability.
In terms of Schwartz’s Values, modeling results show, for example, that the importance of power for people is predictable by the language metrics of complexity, emotionality, and influence per message (Figure 5). Beyond that, the second value of the dimension self-enhancement, which is achievement, can be predicted through the signals of betweenness centrality, contribution balance, and the number of sent messages (Figure 6). Both models for predicting an individual’s relevance of power and achievement perform well, with an accuracy of 0.714 on the test set. Furthermore, both models perform well during CV, with an accuracy of 0.858 when predicting power and an accuracy of 0.793 when predicting achievement.
Last, an exemplary DOSPERT value that is predictable by honest signals is social risk likelihood. The likelihood of engaging in social risks is predicted by the responsiveness of alters, as measured by their nudges and ART, as well as the person’s betweenness centrality. With accuracy scores of 0.733 and 0.8 during CV and testing, as well as ROC AUC scores of greater than 0.9, the model indicates high prediction performance (see Table 4).

3.2. Predicting Job Performance

These models are then used with four different datasets to predict the personality characteristics of four cohorts of students in a seminar, managers of a global services firm, and health care professionals working on a healthcare innovation project. First, the predicted personality characteristics are correlated with individual and group performance, finding that, indeed, the personality characteristics of individuals and teams predict their performance (see Appendix B). Correlation results between personality values and performance show that both concepts are related. The prediction models for six different performance measures [17] are shown in Table 5. We find that, indeed, aggregated personality characteristics of team members predict the performance of their teams.
The constructed ML models for predicting job performance are investigated using Partial Dependence Plots (PDP) to open the black boxes of the models and analyze how the input features of each model of job performance affect the prediction output [23]. Figure A3, for example, shows the PDP of the model that predicts team performance of innovation teams. On the left side, the effect of the average team level of extraversion is shown, while the effect of the average team level of conscientiousness is shown on the right side. The PDP of the model of team performance shows that the negative relationship already indicated by correlation is confirmed. The course of the input feature extraversion shows that with increasing extraversion of teams, the probability of employees being classified as “low” performing increases, and the respective class attains the highest probability of all three classes. At the same time, the probability of being “medium” performers decreases with increasing extraversion while it remains stable and unaffected for the class “high”, indicating that the level of extraversion of a team does not change the likelihood of being classified as having a “high” performance rating. On the right side of the PDP, it is shown that for most levels of team conscientiousness, having a “medium” performance is most probable. However, with an increasing level of conscientiousness in a team, the probability of being classified as a “high” performer increases and becomes the most probable for higher values. Meanwhile, the curve of the “medium” class remains relatively stable, distinguished by some fluctuations. This indicates and supports the positive effect of conscientiousness on team performance. The positive effect of conscientiousness on job performance is also presented by the PDP of the model that predicts teams’ learning behavior. When investigating the PDPs of the other performance models, the following effects can be observed. In terms of team innovation behavior, a team’s importance for Schwartz’s Value of power positively affects innovation behavior. Furthermore, the figure of the input feature measuring a team’s likelihood to engage in risks shows that this attribute negatively affects the innovation behavior of teams. For customer satisfaction, we find that teams’ agreeableness positively impacts the performance of teams, while additionally, teams’ willingness for power has a moderately positive impact. When investigating the PDPs when predicting students’ grades, a positive effect on teams’ willingness to achieve and a negative effect on teams’ respect for authorities are identified. At the individual level, we find that both the level of care as well as the total risk appetite of managers influence their performance positively. This can be explained by the idea that high levels of care indicate employees who are pro-socially motivated about the well-being of others. According to prior research, caring and pro-social behaviors at work can help both team leaders and team members by fostering positive team synergy, lowering the failure rate of a task that a team is working on, and enhancing team performance [24,25]. This is because pro-socially motivated employees are inspired to aid people who benefit from their work, including their coworkers, and are encouraged to cooperate efficiently, resulting in improved job outcomes [25,26]. The remaining PDPs are given in Appendix C.

4. Discussion and Conclusions

Team performance scores of innovation teams, for example, show a positive correlation with the average conscientiousness level of a team at the significance level of 0.01 (0.347 **), indicating that teams consisting of employees with higher levels of conscientiousness are associated with higher performance (see Table A2). As evidenced by previous researchers, the positive effect of conscientiousness is explained to be due to peoples’ autonomy and goal-setting behavior, which is advantageous to employee behaviors in terms of directing their actions [27,28,29].
Further, team performance indicates a negative relationship with the average extraversion level of the team at the significance level of 0.001 (−0.487 ***). This indicates that extroverted teams are related to worse performance than rather introverted teams. Opposed to existing research, which supports the idea that the energetic behavior and sociability of extroverts is a positive factor for job performance, this relationship shows that low levels of extroversion can also be beneficial on the job [30,31,32,33]. Further, we find that in terms of learning behavior, job performance of innovation teams is associated less agreeableness at the significance level of 0.05 (−0.298 *) and (again) less extraversion at the significance level of 0.001 (−0.625 ***). This suggests that having too much agreement within a team might be detrimental to their success because employees who have a very high level of agreeableness are less able to stand for themselves, face challenges or solve conflicts than employees who show a lower level of agreeableness. In addition, agreeableness implies less competitive and determined behavior as agreeable people avoid social conflicts and act rather unambitious [34]. Consequently, very agreeable employees do not pursue their own interests but behave in a manner that pleases their colleagues [35].
Furthermore, the innovativeness of teams is positively influenced by valuing Schwartz’s Value of power. As a result, this relationship that valuing enhancement has a positive impact on professional success. An explanation is given by previous researchers suggesting that people with greater self-enhancement are defined by a competitive character due to its underlying value of achievement, which is advantageous for individual- and team-level job performance [11]. Consequently, the valuing of power leads to increased attainment, as those who value power aim to maximize their gain [36]. Apart from the studied innovation teams, agreeableness is, apart from valuing power and transcendence, positively related to customer satisfaction. While agreeableness may interfere with supervisors’ performance assessments, it is beneficial in dealing with customers to increase their satisfaction. Teams can benefit from agreeable members due to their communicative, cooperative, and cohesive nature [37]. This personality trait is especially important in occupations that require teamwork or dealing with externals, e.g., in customer service [38,39].
Moreover, correlation results show a negative relationship between students’ grades and the value of authority/respect at the significance level of 0.001 (0.366 **), indicating that receiving better grades is related to a lower value of respect for authority. We explain this relationship to exist due to the harmful effects of “blind obedience”. People who just follow directions from superiors do not accept responsibility for their own activities. As a result, the employee’s creativity, initiative, and contributions are harmed [40,41]. Additionally, there are negative implications for teams’ performance. If everyone on the team has a high level of respect for authority, but there is no leader personality, this can be detrimental to the group. Existing research shows that successful teams require a leader personality who is reliable and whom the team can rely on as a problem solver, despite the need for respect [42]. Furthermore, apart from enhancement, students’ performance shows a positive association with their recreational risk likelihood at the significance level of 0.05 (−0.285 *). This indicates that the trait of being risky and open to recreational activities can have a positive effect on students’ performance as they are more open and engaged in tasks and can, therefore, foster new experiences [43,44]. People with a high level of openness are seen to obtain social and material advantages because of their enthusiasm to discover [44,45]. In terms of individual performance, manager ratings within the first year do not show a significant correlation with the studied traits. In the second year, managers’ ratings show a significantly negative relationship with their level of extraversion. Similar to groups’ performances, introverted managers may perform better than excessively extroverted managers. Beyond that, the positive relationship toward total risk likelihood at the significance level of 0.05 suggests that managers who show higher overall risk-taking attitudes are indicated to show better performance. Risk-taking can be helpful in general if performed reasonably for the following reasons. When people take a risk and succeed, they are usually rewarded more generously than when they choose a less risky option. By taking risks and failing, on the other hand, the individual learns something valuable about that decision and scenario and gains confidence in the future. According to previous research, successful risk-taking enhances outcomes in the workplace (e.g., being promoted), whereas failed risk-taking does not necessarily result in a disadvantage in the workplace [46].
Following the same modeling procedure as during modeling the personality models, feature selection is performed by studying the importance of features. Moreover, in the case of team-level job performance metrics, the team identification variable is examined during feature importance to control for team dynamics. Though teams’ identification variable is never used as an input feature, the feature importance plots of all models which deal with team variables show that this variable always has importance. Resultingly, the models show that both individual-level and team-level performance can be predicted by peoples’ personal and moral values. On the individual level, for example, the ratings of managers are to be determined by a manager’s level of care and likelihood to engage in generally risky activities. As both ratings are predicted by the same traits, their predictiveness is stressed. Furthermore, both models have similarly valid performance metrics. Both models achieve evaluation metrics of greater than 0.6 during CV and an accuracy of 0.778 during testing. At the team level, innovation behavior of innovation teams, for example, shows to be predictive by the values of power and the teams’ general likelihood to engage in risks
This study is the first to attempt to predict job performance through personal and moral values by building ML models based on individuals’ communication data. In terms of the effects of personal or moral values on job performance, this research implicates that there are specific personal and moral values that are predictive of individual- or team-level job performance. Therefore, this work brings new insights and implications for factors that influence the performance of employees. Particularly, the following findings and explanations, which are also summarized in Figure 7, showing the predictability between variables through flows, are derived from the developed prediction models.
Beginning with the predictors of job performance on the team level, the level of agreeableness in customer service, for example, is a positive predictor of customer satisfaction. This is explained by the cooperative spirit and pleasantness of agreeable individuals, which are highly valued by clients [38]. Meanwhile, conscientious people influence teamwork and performance positively and display higher learning behavior, validating earlier meta-analyses’ findings that conscientiousness leads to autonomy and goal-directed conduct, which may lead to success in a variety of professions [27]. Extraversion, however, is found to be disadvantageous as it is a predictor for lower team performance and also shows negative associations with managers’ performance. Even though these findings oppose earlier research, it does not imply that introverts always perform better than extroverts. Rather is suggested that the negative effect of extraversion in this paper is caused by the job characteristics of the studied jobs. As argued by further researchers, extroverts might perform worse than introverts in creative and inventive work environments because rather introverted people usually have greater analytical abilities, thinking, and reflection than more extroverted ones [47]. This leads to the conclusion that these might be particularly important characteristics in innovative and creative work environments, which are present for both studied innovation teams and managers and can therefore produce positive results in these jobs [48]. As a result, it is argued that excessive levels of extraversion lower job performance in creative and inventive environments. The trait of respecting and putting a high value on authorities has been found to have a negative effect on performance. Based on the characteristics of these traits, this work presents two probable explanations for the observed result. First, this effect is based on the notion that obedience and compliance are not necessarily the key to increased performance and success [40,41]. In the context of this research, it is assumed that a supervisor’s instructions do not necessarily result in a better grade. Instead, the people’s initiative, inventiveness, and capacity to work independently could be positively evaluated by the supervisor. An alternative or additional explanation is the notion that this attribute is associated with team members and teams that lack leaders under difficult conditions so that they perform worse than teams with a good constellation of leaders and respecters [42]. Another identified predictor of high team performance is self-enhancement, as shown by the underlying values of power and achievement. The explanation for this positive effect comes from the definition of these qualities. Self-enhancement characterizes those that are ambitious and seek to achieve and maximize the power they earn, among other things, through their work. As a result, activities that lead to great work performance follow this character [36,49]. For job performance on the individual level, the level of care of employees is found to be a predictor. It is implicated that caring managers perform better than employees who are more prone to harm. This is explained by the pro-social and motivational attitude of caring people, which enables employees and colleagues to work together efficiently, create a cooperative work culture and increase success in the workplace [24,25]. In terms of risk-taking attitudes, findings and predicting traits need more interpretation than the other values. Results suggest that while generally, high riskiness can be beneficial to individuals at work, it can also be detrimental to teams if this attitude is excessively present within the team. Therefore, in terms of general risk-taking likelihood, risk-averse members of teams are seen to be necessary to calibrate the team and team performance. Additional associations between honest signals, personal or moral values, and job performance are indicated by correlation analysis to provide answers to proposed hypotheses, but they are not discussed further because they are not used as predictors of job performance. However, there is also the suspicion that of these significant associations, other attributes might predict job performance, but they are not employed to avoid overfitting the models.

4.1. Implications for Research and Practice

Further, the following practical implications arise from the conducted study. First, the job performance predictors that emerged show that there are more variables than traditionally known job performance indicators. Apart from traditionally respected attributes that predict career success, such as social capital, present research argues that moral beliefs and qualities can also be a determinant of future job performance [50]. These determinants have a direct implication for employees, organizations, and their HR management. As previously discussed, certain personal or moral attributes can be beneficial while others can be disadvantageous in the workplace. For HR managers, this implies that, apart from the already widely distributed FFI tests, in the context of innovative and creative work environments, they should also assess moral beliefs, as measured by the Moral Foundations questionnaire, Schwartz’s Values survey, or DOSPERT. Particularly, in terms of the individual job performance of managers, organizations should focus on hiring caring employees with a high-risk appetite, while in terms of teamwork, lower-risk appetite but self-willed and -enhanced team members should be the focus. In terms of the big five personality factors, this thesis supports the argument that conscientiousness is the most desirable personality trait of the NEO FFI. In terms of agreeableness, in jobs in which employees deal with externals, such as in customer service, employers should hire agreeable employees, while within organizations, argumentative employees are recommended. In addition, employers in innovative workplaces should realize that introverts may be valuable to businesses since they can contribute analytical talents that more outgoing people may lack. In this context, capturing survey scores through honest signals might open new doors for staff selection, allowing HR departments to avoid traditional surveys, which are prone to several biases, including response biases, social desirability, or varying reference standards [16,51]. As many HR managers already analyze various types of data to add value to the company by identifying traits and talents, the present ML models may serve as a further data-driven analysis tool for analyzing both traits of employees as well as their potential performance [52]. As an alternative to existing scientific ML models that can predict personality factors, e.g., predicting NEO FFI values from Facebook or smartphone sensor data, the attributes required for personnel selection can be determined by honest signals [51,53]. Models based on communication behavior have the advantage that they reveal personalities unintentionally and are difficult to fake. Following on from this, applicants’ or employees’ performance can be determined by applying the developed ML models. Especially important in cases when monitoring the job performance of employees is difficult, the developed ML models can be used to predict the performance of employees and possibly act when performance is predicted to become low. The input data can hereby be collected manually, for example, by conducting the surveys or by applying the first type of ML model to predict personal and moral values. The second approach should be feasible as email communication is usually present within organizations.
Regardless of the ML models, further important practical implications are made in terms of individual- and team-level job performance. Given that team dynamics may potentially play a relatively substantial role as judged by the feature importance of the ML models and that more significant connections are observed at the team level than at the individual level, this may imply the following. In terms of the studied job performance metrics, an individual’s personal and moral values are not as essential as the constellation of personal and moral values within a team. The research demonstrates that organizations should not necessarily focus on an individual’s personal and moral principles but that the constellation of individual values within a team or organization, as well as job demands, have a much greater impact on job performance.

4.2. Limitations and Future Research

The work presented is subject to limitations that should be addressed in future studies. Primarily, the results of this work are limited by the small amount of data as well as the methodology. Both the developed ML models for the prediction of personalities and for the prediction of job performance are based on small data sets. Consequently, this limits the generalization of the ML models and the results so that they may not present a general picture. The current work should be replicated on a wider scale with more data in the future to uncover more general models and outcomes. The limitations of our datasets also restricted our choice of model architecture, as one dataset predicted personal values from honest signals computed from email, and a second dataset compared email honest signals with individual and team performance. We hope that in future work, we will be able to obtain a combined dataset that includes all three variables, email, personal values, and individual and business performance.
Another data restriction is the collection of subjective data. Though the applied surveys are scientifically validated and widely distributed, the gathered data are self-reported and biased. Because of the biased data, ML may yield prediction models that are biased with inferior accuracy on real-world data [54,55]. Therefore, future research should focus on gathering data through more objective personality assessment methods. For example, there are real-life virtual simulations in which individuals go through various tasks to assess personality traits based on the individuals’ choices during the tasks [56]. As also the performance ratings are not based on objective indicators, the research could also be replicated with objective key performance indicators. Furthermore, the present analysis is limited to the network of email data. Though emails fulfill the purpose of social networks, future research might expand the current study and approach to include other networks, such as LinkedIn or Slack [57].
Another limitation is given by the focus on personality and morality factors, as measured by the four surveys of NEO FFI-R, Moral Foundations questionnaire, Schwartz’s Values survey, and DOSPERT. Though the applied surveys cover many different traits, it is suggested that in future research, further personal or moral values should be tested. As an extension, future research, for example, might use the Valued Living Questionnaire, which examines people’s value systems and looks at people’s values from a different viewpoint than the surveys in the current study [58].
Further, there are limitations in the methodology and modeling process. First, no control variables are observed, and the relationship between job performance and personal characteristics is simplified. Therefore, no clear statement regarding additional contextual factors which affect job performance in addition to the studied traits can be made. There may be additional explanatory variables and circumstances which contribute to the explanatory power of the results. Furthermore, the term job performance is generalized to different performance metrics of different industries and practices. Consequently, identified effects of this study may not be applicable to all industries. However, the study can be repeated, this time focusing on specific indicators of job performance and other explanatory variables, such as job requirements, age, or tenure, to provide more detailed explanations. For the differential effects of perceptions and likelihoods of risk-taking in certain domains on job performance, this research has not provided clear effects or possible explanations and brings the following limitations. First, the implied result of general risk-taking should be viewed with caution. There is a need for more research here since the observations do not quantify whether people profit from risk-taking in the workplace, whether they effectively take risks, or whether they are foolish about taking risks on the job. Further, though this study fails to find a relationship between attitudes toward financial, health, and ethical risk-taking and job performance, it is suggested that for a given risk domain, subjective risk perception and objective risk likelihood may have different implications for a given performance metric. People’s risk perception and their likelihood to participate in each risk may have opposing effects on job performance. For example, risk-taking likelihood in the social domain is positively associated with team innovation behavior but negatively associated with team learning behavior, while the perception of social risks is negatively associated with team innovation behavior but positively associated with team learning behavior. This shows that the relationship between risk-taking in the objective and subjective sense is more complex than assumed. In addition to this, as shown by the correlation coefficients of recreational risk-taking likelihood, a given risk attitude can have both positive and negative effects on job performance. Therefore, it is assumed that (especially social) risk perceptions and likelihoods can have different effects on job performance, and the effect may additionally depend on factors that are not elaborated on in this thesis. As a result, this thesis cannot exactly state if taking risks in certain domains predicts work performance. Instead, other elements, such as the work environment, job requirements, the actual outcome of risks, risk tolerance on the job, etc., are thought to play a role. Therefore, the effect of risk-taking attitudes on job performance is suggested to be researched in a more explanatory manner.
Last, limitations are given by binning target features for both types of ML models into three classes. This may overoptimize the accuracy and validity of predictions and lead to information loss. When larger data samples are available, regression models or classification models with more classes are recommended for making more comprehensive predictions. Furthermore, because some personal or moral values lack valid ML models and because some research subjects predict the same personality level for all participants, the link between personality and work performance cannot be examined for all studied personality and moral values. For future research, it is suggested that models for the traits that could not be developed in the current work be developed using an alternate approach to identify more ML models to predict personal or moral values and investigate the effects of the remaining traits on job performance. All in all, it can be said that the current study paves the way for more research into developing ML models for predicting personality, morality, and job performance, as well as into the causes of personality or moral characteristic effects at work.

Author Contributions

Conceptualization, E.A., P.A.G.; methodology, E.A., P.B.; software, E.A.; validation, formal analysis, E.A.; data curation, P.A.G., E.A.; writing—original draft preparation, E.A.; writing—review and editing, E.A., P.A.G., P.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of MIT (protocol code 170181783) on 16 February 2017.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are not publicly available due to privacy restrictions of the participating institutions.

Acknowledgments

All the experiments conducted in this work have been approved by the Institutional Review Board (IRB) of the Massachusetts Institute of Technology (MIT).

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Pearson Correlation between Personal/Moral Values and Honest Signals.
Table A1. Pearson Correlation between Personal/Moral Values and Honest Signals.
Variables Alter ARTAlter NudgesBetween-ness CentralityBetween-ness C. OscillationCloseness CentralityAvg. Com-plexityContribu-tion IndexContribu-tion Index Osc.Degree Central-ityEgo ARTEgo NudgesAvg. EmotionalityAvg. InfluenceTotal InfluenceReceived MessagesSent MessagesTotal MessagesReach
2
Avg. Senti-ment
AgreeablenessPearson Correlation0.021−0.134−0.226 *−0.362 ***−0.286 **−0.147−0.196−0.228 *−0.243 *−0.045−0.048−0.165−0.262 *−0.221 *−0.059−0.316 **−0.177−0.091−0.169
N81818181818181818181818181818181818181
Conscien−tiousnessPearson Correlation0.2090.1830.221 *0.1800.0840.107−0.0730.1350.227 *0.0910.1560.1800.0760.1800.2000.1280.1940.1340.038
N81818181818181818181818181818181818181
ExtraversionPearson Correlation−0.076−0.0500.1470.105−0.059−0.045−0.020−0.0300.090−0.162−0.085−0.018−0.0500.006−0.0470.026−0.015−0.106−0.068
N81818181818181818181818181818181818181
NeuroticismPearson Correlation−0.021−0.091−0.200−0.311 **−0.021−0.092−0.0300.028−0.132−0.002−0.069−0.048−0.038−0.1130.041−0.044−0.005−0.008−0.102
N81818181818181818181818181818181818181
Openness to ExperiencePearson Correlation0.039−0.0580.0030.063−0.097−0.071−0.193−0.0960.0070.011−0.084−0.041−0.0690.001−0.051−0.099−0.066−0.090−0.150
N81818181818181818181818181818181818181
Authority/
Respect
Pearson Correlation−0.077−0.271 *−0.278 *−0.323 *−0.360 **−0.228−0.443 ***−0.360 **−0.304 *−0.028−0.197−0.319 *−0.310 *−0.272 *−0.207−0.365 **−0.287 *−0.234−0.421 **
N55555555555555555555555555555555555555
Fairness/
Reciprocity
Pearson Correlation0.2010.2580.1390.1850.0720.333 *−0.1040.2340.1560.1240.330 *0.305 *0.2650.2310.2180.1000.1770.374 **0.110
N55555555555555555555555555555555555555
Harm/CarePearson Correlation0.335 *0.524 ***0.393 **0.459 ***0.468 ***0.533 ***0.1040.410 **0.383 **0.2520.483 ***0.472 ***0.434 ***0.392**0.322 *0.380 **0.366 **0.55 ***0.332 *
N55555555555555555555555555555555555555
Ingroup/
Loyalty
Pearson Correlation0.36 **0.430 **0.305 *0.2120.465 ***0.399 **−0.0770.1860.294 *0.1860.371 **0.479 ***0.353 **0.1690.1270.2280.1880.420 **0.337 *
N55555555555555555555555555555555555555
Purity/
Sanctity
Pearson Correlation0.2050.1210.1030.0640.0430.191−0.1370.1740.1020.0730.1490.0890.0860.1220.1260.1010.1180.156−0.002
N55555555555555555555555555555555555555
PowerPearson Correlation−0.173−0.319 *−0.379 **−0.461 ***−0.377 **−0.419 ***−0.022−0.231−0.278 *−0.174−0.268 *−0.389 **−0.444 ***−0.345 **−0.237−0.310 *−0.291 *−0.341 **−0.242
N61616161616161616161616161616161616161
Achieve−mentPearson Correlation−0.037−0.090−0.258 *−0.315 *−0.245−0.128−0.331 **−0.088−0.1860.0540.032−0.138−0.121−0.152−0.055−0.268 *−0.153−0.078−0.200
N61616161616161616161616161616161616161
HedonismPearson Correlation−0.0290.0360.051−0.2140.108−0.0260.1390.0470.0480.0870.0510.018−0.041−0.0370.0870.0780.0810.0360.09
N61616161616161616161616161616161616161
StimulationPearson Correlation−0.035−0.0330.0530.0280.088−0.0550.0820.1430.0760.1560.0070.052−0.0140.0290.0530.0430.0530.005−0.016
N61616161616161616161616161616161616161
Self−DirectionPearson Correlation0.0970.1340.0980.1250.1220.0530.1560.2000.1900.1160.1410.1780.0320.1060.1530.140.1580.1190.114
N61616161616161616161616161616161616161
UniversalismPearson Correlation−0.0990.1110.1060.276 *0.0310.0540.0330.1940.277 *0.1200.0610.1100.1190.2110.1150.1450.1440.0510.152
N61616161616161616161616161616161616161
BenevolencePearson Correlation0.2220.2020.2510.320 *0.1230.155−0.0210.2230.310 *0.1360.1750.2490.1410.2400.1730.2040.2050.1410.116
N61616161616161616161616161616161616161
TraditionPearson Correlation−0.059−0.084−0.145−0.154−0.155−0.138−0.137−0.123−0.0810.040−0.021−0.108−0.220−0.220−0.054−0.163−0.109−0.084−0.256 *
N61616161616161616161616161616161616161
ConformityPearson Correlation−0.047−0.030−0.248−0.053−0.261 *−0.083−0.312 *−0.039−0.1310.2010.105−0.078−0.037−0.102−0.018−0.214−0.109−0.011−0.235
N61616161616161616161616161616161616161
SecurityPearson Correlation0.1090.262 *0.0440.1890.1260.180−0.1000.1800.1870.2420.316 *0.263 *0.1540.1130.1600.1060.1470.2110.026
N61616161616161616161616161616161616161
Tran-scen-dencePearson Correlation0.1200.293 *0.292 *0.488 ***0.267 *0.281 *0.0310.2130.329 **0.1120.1800.281 *0.301 *0.318 *0.1810.279 *0.2470.2210.166
N61616161616161616161616161616161616161
Conserva−tionPearson Correlation−0.191−0.204−0.226−0.263 *−0.309 *−0.245−0.336 **−0.206−0.236−0.010−0.069−0.217−0.188−0.277 *−0.150−0.293 *−0.226−0.202−0.297 *
N61616161616161616161616161616161616161
Ethical Risk LikelihoodPearson Correlation−0.122−0.028−0.257−0.2280.025−0.0700.020−0.189−0.1900.056−0.0710.060−0.039−0.271−0.292 *−0.200−0.2730.0030.020
N49494949494949494949494949494949494949
Ethical Risk PerceivedPearson Correlation−0.156−0.296 *−0.379 **−0.437 **−0.310 *−0.298 *0.046−0.274−0.385 **−0.296 *−0.326*−0.363*−0.248−0.264−0.122−0.236−0.195−0.250−0.190
N49494949494949494949494949494949494949
Financial Risk LikelihoodPearson Correlation−0.137−0.143−0.403 **−0.377 **−0.351 *−0.140−0.369 **−0.282 *−0.316 *−0.178−0.164−0.076−0.193−0.387 **−0.2310.470 ***−0.354 *−0.088−0.298 *
N49494949494949494949494949494949494949
Financial Risk PerceivedPearson Correlation0.41 **0.442 **0.314 *0.297 *0.362*0.444 **0.0700.1680.363*−0.0460.2440.418 **0.1630.2430.2350.293 *0.282 *0.378 **0.360 *
N49494949494949494949494949494949494949
Health Risk LikelihoodPearson Correlation−0.136−0.2190.009−0.129−0.108−0.191−0.079−0.114−0.067−0.194−0.263−0.089−0.110−0.109−0.173−0.086−0.144−0.202−0.045
N49494949494949494949494949494949494949
Health Risk PerceivedPearson Correlation0.2540.2370.0890.321*0.0770.255−0.044−0.0150.1460.1480.2490.0330.1170.1250.1030.0890.1030.170−0.013
N49494949494949494949494949494949494949
Recreational Risk LikelihoodPearson Correlation−0.142−0.188−0.371 **−0.308 *−0.435 **−0.236−0.461 ***−0.185−0.354 *−0.090−0.085−0.121−0.013−0.210−0.107−0.408 **−0.251−0.134−0.255
N49494949494949494949494949494949494949
Recreational Risk PerceivedPearson Correlation0.294 *0.1620.338 *0.1640.367 **0.2250.411 **0.0480.289 *−0.1090.0060.087−0.0850.0750.0820.290 *0.1820.0650.210
N49494949494949494949494949494949494949
Social Risk LikelihoodPearson Correlation0.352 *0.311 *0.430 **0.345 *0.349 *0.341 *0.0080.301 *0.407 **0.0820.285 *0.367 **0.290 *0.2030.354 *0.2540.350 *0.341 *0.304 *
N49494949494949494949494949494949494949
Social Risk PerceivedPearson Correlation0.2110.2010.1150.1330.2250.178−0.015−0.0570.080−0.073−0.0190.2160.156−0.036−0.105−0.005−0.0550.1270.096
N49494949494949494949494949494949494949
Total Risk LikelihoodPearson Correlation−0.0090.013−0.185−0.210−0.0310.008−0.197−0.104−0.143−0.034−0.0120.1300.124−0.251−0.140−0.267−0.2000.102−0.001
N49494949494949494949494949494949494949
Total Risk PerceivedPearson Correlation0.288 *0.2000.1120.2030.1350.209−0.0030.0410.1100.0150.1560.1390.0890.1310.2060.1320.1910.1910.111
N49494949494949494949494949494949494949
*** p < 0.001, ** p < 0.01, * p < 0.05.

Appendix B

Table A2. Pearson Correlation between Personal/Moral Values and Job Performance.
Table A2. Pearson Correlation between Personal/Moral Values and Job Performance.
VariablesTeam Performance Team Innovation Team Learning Student Grades Team NPS First-Year Rating Second-Year Rating
Pearson CorrelationNPearson CorrelationNPearson CorrelationNPearson CorrelationNPearson CorrelationNPearson CorrelationNPearson CorrelationN
Alter ART−0.178700.322 **70−0.14870−0.00880−0.147780.08682−0.10682
Alter Nudges0.15070−0.161700.10470−0.14680−0.304 **780.163820.00682
Betweenness Centrality0.22370−0.120700.254 *70−0.17680−0.010780.02482−0.13582
Betweenness C. Oscillation0.10270−0.095700.13370−0.07280−0.126780.054820.03582
Closeness Centrality0.09770−0.251 *700.13770−0.00980−0.185780.02782−0.03082
Avg. Complexity−0.289 *700.08670−0.366 **700.035800.066780.066820.07882
Contribution Index0.108700.040700.200700.056800.05778−0.05682−0.05082
Contribution Index Oscillation0.09670−0.111700.112700.01780−0.190780.04582−0.06082
Degree Centrality0.13170−0.190700.19270−0.13180−0.103780.01382−0.12582
Ego ART−0.150700.17970−0.06570−0.14080−0.176780.14082−0.18282
Ego Nudges−0.020700.07170−0.10670−0.065800.04078−0.103820.01882
Avg. Emotionality0.163700.011700.281 *700.248 *800.213780.09982−0.14582
Avg. Influence0.02470−0.17670−0.05770−0.063800.077780.03182−0.03982
Total Influence0.09870−0.143700.11270−0.12180−0.270 *78−0.03582−0.12482
Received Messages0.17470−0.096700.20170−0.09680−0.224 *78−0.053820.05182
Sent Messages0.23270−0.051700.248 *70−0.09180−0.278 *78−0.047820.02382
Total Messages0.19570−0.084700.21970−0.11280−0.241 *78−0.053820.04582
Reach20.02770−0.17870−0.01670−0.363 ***800.07478−0.05882−0.05982
Avg. Sentiment0.08670−0.107700.10870−0.143800.12978−0.02582−0.05382
Agreeableness−0.09370−0.249 *70−0.14770−0.035800.105780.01782−0.07182
Neuroticism7070700.05880−0.18678−0.05182−0.02082
Extraversion−0.17870−0.03470−0.229700.010800.030780.100820.253 *82
Openness to Experience7070700.06780788282
Conscientiousness0.074700.002700.05770−0.129800.11978−0.035820.11782
Authority/Respect−0.04570−0.128700.053700.18880−0.025780.123820.04282
Fairness/Reciprocity7070700.06880788282
Harm/Care0.034700.05170−0.048700.016800.08378−0.18782−0.16282
Power0.098700.179700.098700.061800.266 *78−0.04182−0.06882
Achievement707070−0.220 *80788282
Transcendence−0.00870−0.00370−0.031700.046800.152780.190820.03582
Ethical Risk Likelihood7070700.00780788282
Ethical Risk Perceived0.03270−0.242 *700.0627080−0.099780.09482−0.07882
Recreational Risk Likelihood0.01870−0.10170−0.01370−0.12280780.09482−0.07882
Social Risk Likelihood−0.142700.19070−0.192700.13180−0.084780.04182−0.09682
Social Risk Perceived0.04070−0.143700.068700.08980788282
Total Risk Likelihood−0.10370−0.11670−0.032700.04180−0.14578−0.17882−0.224 *82
Team Avg. Alter ART−0.375 **700.679 ***70−0.312 **70−0.01380−0.341 **78
Team Avg. Alter Nudges0.380 **70−0.410 ***700.264 *70−0.293 **80−0.435 ***78
Team Avg. Betweenness Centrality0.505 ***70−0.271 *700.573 ***70−0.383 ***80−0.02878
Team Avg. Betweenness C. Oscillation0.22970−0.214700.299 *70−0.09680−0.16078
Team Avg. Closeness Centrality0.20070−0.517 ***700.282 *70−0.01380−0.242 *78
Team Avg. Avg. Complexity−0.565 ***700.16970−0.715 ***700.061800.08178
Team Avg. Contribution Index0.329 **700.121700.611 ***700.144800.09078
Team Avg. Contribution Index Oscillation0.21670−0.250 *700.252 *700.02480−0.274 *78
Team Avg. Degree Centrality0.269 *70−0.391 ***700.395 ***70−0.18280−0.251 *78
Team Avg. Ego ART−0.443 ***700.529 ***70−0.19270−0.21880−0.291 **78
Team Avg. Ego Nudges−0.066700.236 *70−0.352 **70−0.098800.06078
Team Avg. Avg. Emotionality0.438 ***700.031700.756 ***700.564 ***800.296 **78
Team Avg. Avg. Influence0.05270−0.373 **70−0.12070−0.117800.13078
Team Avg. Total Influence0.21670−0.316 **700.249 *70−0.16380−0.466 ***78
Team Avg. Received Messages0.415 ***70−0.228700.478 ***70−0.10680−0.296 **78
Team Avg. Sent Messages0.551 ***70−0.122700.590 ***70−0.15280−0.431 ***78
Team Avg. Total Messages0.461 ***70−0.198700.518 ***70−0.12380−0.325 **78
Team Avg. Reach20.05770−0.384 **70−0.03570−0.372 ***800.12078
Team Avg. Avg. Sentiment0.250 *70−0.310 **700.314 **70−0.265*800.231 *78
Team Avg. Agreeableness−0.18870−0.504 ***70−0.298 *70−0.054800.395 ***78
Team Avg. Neuroticism7070700.12280−0.306 **78
Team Avg. Extraversion−0.487 ***70−0.09370−0.625 ***700.020800.06478
Team Avg. Openness to Experience7070700.1048078
Team Avg. Conscientiousness0.347 **700.007700.267 *70−0.208800.21778
Team Avg. Authority/Respect−0.08170−0.228700.095700.366 ***80−0.06378
Team Avg. Fairness/Reciprocity7070700.1168078
Team Avg. Harm/Care0.090700.13670−0.129700.025800.16978
Team Avg. Power0.187700.341 **700.186700.111800.611 ***78
Team Avg. Achievement707070−0.418 ***8078
Team Avg. Transcendence−0.02270−0.00870−0.081700.070800.262 *78
Team Avg. Ethical Risk Likelihood7070700.0118078
Team Avg. Ethical Risk Perceived0.07670−0.576 ***700.1497080−0.14778
Team Avg. Recreational Risk Likelihood0.05770−0.322 **70−0.04170−0.285 *8078
Team Avg. Social Risk Likelihood−0.419 ***700.561 ***70−0.569 ***700.20580−0.20278
Team Avg. Social Risk Perceived0.14170−0.503 ***700.240 *700.1578078
Team Avg. Total Risk Likelihood−0.265 *70−0.297 *70−0.081700.06880−0.267 *78
*** p < 0.001, ** p < 0.01, * p < 0.05.

Appendix C

Figure A1. PDP of Team Performance Model.
Figure A1. PDP of Team Performance Model.
Futureinternet 14 00133 g0a1
Figure A2. PDP of Team Innovation Model.
Figure A2. PDP of Team Innovation Model.
Futureinternet 14 00133 g0a2
Figure A3. PDP of Team Learning Model.
Figure A3. PDP of Team Learning Model.
Futureinternet 14 00133 g0a3
Figure A4. PDP of Team NPS Model.
Figure A4. PDP of Team NPS Model.
Futureinternet 14 00133 g0a4
Figure A5. PDP of Student Teams Grades Model.
Figure A5. PDP of Student Teams Grades Model.
Futureinternet 14 00133 g0a5
Figure A6. PDP of First–Year Rating Model.
Figure A6. PDP of First–Year Rating Model.
Futureinternet 14 00133 g0a6
Figure A7. PDP of Second–Year Rating Model.
Figure A7. PDP of Second–Year Rating Model.
Futureinternet 14 00133 g0a7

References

  1. Brandstätter, H. Personality Aspects of Entrepreneurship: A Look at Five Meta-Analyses. Personal. Individ. Differ. 2011, 51, 222–230. [Google Scholar] [CrossRef]
  2. Bello, S.M. Impact of Ethical Leadership on Employee Job Performance. Int. J. Bus. Soc. Sci. 2012, 3, 228–237. [Google Scholar]
  3. Pentland, A.S. Honest Signals: How They Shape Our World; MIT Press: Cambridge, UK, 2008. [Google Scholar]
  4. Gloor, P.A. Sociometrics and Human Relationships: Analyzing Social Networks to Manage Brands, Predict Trends, and Improve Organizational Performance, 1st ed.; Emerald Publishing Limited: Bingley, UK, 2017; ISBN 9781787147256. [Google Scholar]
  5. Gloor, P.A.; Zylka, M.P.; Colladon, A.F.; Makai, M. “Entanglement”—A New Dynamic Metric to Measure Team Flow. Soc. Netw. 2022, 70, 100–111. [Google Scholar] [CrossRef]
  6. Gloor, P.A.; Colladon, A.F.; Grippa, F. The Digital Footprint of Innovators: Using Email to Detect the Most Creative People in Your Organization. J. Bus. Res. 2020, 114, 254–264. [Google Scholar] [CrossRef]
  7. Sun, J.; Gloor, P. E-Mail Network Patterns and Body Language Predict Risk-Taking Attitude. Future Internet 2021, 13, 17. [Google Scholar] [CrossRef]
  8. Gloor, P.A.; Colladon, A.F. Heart Beats Brain: Measuring Moral Beliefs Through E-Mail Analysis. In Digital Transformation of Collaboration. Proceedings of the 9th International COINs Conference; Przegalinska, A., Grippa, F., Gloor, P.A., Eds.; Springer Proceedings in Complexity: Cham, Switzerland, 2020; pp. 85–93. ISBN 978-3-030-48993-9. [Google Scholar]
  9. Gloor, P.A.; Fischbach, K.; Fuehres, H.; Lassenius, C.; Niinimäki, T.; Olguin, D.O.; Pentland, S.; Piri, A.; Putzke, J. Towards “Honest Signals” of Creativity—Identifying Personality Characteristics Through Microscopic Social Network Analysis. Procedia-Soc. Behav. Sci. 2011, 26, 166–179. [Google Scholar] [CrossRef] [Green Version]
  10. McCrae, R.R.; Costa, P.T. A Contemplated Revision of the Neo Five-Factor Inventory. Personal. Individ. Differ. 2004, 36, 587–596. [Google Scholar] [CrossRef]
  11. Schwartz, S.H. Are There Universal Aspects in the Structure and Contents of Human Values? J. Soc. Issues 1994, 50, 19–45. [Google Scholar] [CrossRef]
  12. Graham, J.; Nosek, B.A.; Haidt, J.; Iyer, R.; Koleva, S.; Ditto, P.H. Mapping the Moral Domain. J. Personal. Soc. Psychol. 2011, 101, 366–385. [Google Scholar] [CrossRef]
  13. Weber, E.U.; Blais, A.-R.; Betz, N.E. A Domain-Specific Risk-Attitude Scale: Measuring Risk Perceptions and Risk Behaviors. J. Behav. Decis. Mak. 2002, 15, 263–290. [Google Scholar] [CrossRef]
  14. Bavelas, A. Communication Patterns in Task-Oriented Groups. J. Acoust. Soc. Am. 1950, 22, 725–730. [Google Scholar] [CrossRef]
  15. Hadley, B.; Gloor, P.A.; Woerner, S.L.; Zhou, Y. Analyzing VC Influence on Startup Success: They Might Not Be Good for You. In Collaborative Innovation Networks; Grippa, F., Leitão, J., Gluesing, J., Riopelle, K., Gloor, P.A., Eds.; Springer: Cham, Switzerland, 2018; pp. 3–14. [Google Scholar]
  16. Gloor, P.; Fronzetti Colladon, A.; de Oliveira, J.M.; Rovelli, P. Put Your Money Where Your Mouth Is: Using Deep Learning to Identify Consumer Tribes from Word Usage. Int. J. Inf. Manag. 2020, 51, 101924. [Google Scholar] [CrossRef]
  17. Gloor, P.A. Happimetrics: Leveraging AI to Untangle the Surprising Link Between Ethics, Happiness, and Business Success; Edward Elgar: Cheltenham, UK, 2022. [Google Scholar]
  18. Müller, A.C.; Guido, S. Introduction to Machine Learning with Python, 1st ed.; Schanafelt, D., Ed.; O’Reilly Media: Sebastopol, CA, USA, 2016; ISBN 9781449369415. [Google Scholar]
  19. Chawla, N.v.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic Minority Over-Sampling Technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
  20. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar] [CrossRef] [Green Version]
  21. Intelligent Collaborative Knowledge Networks. Available online: http://www.ickn.org/ckntools.html (accessed on 15 January 2022).
  22. Galaxylens: Galaxy Sciences. Available online: http://www.galaxysciences.com/galaxylens.php (accessed on 15 January 2022).
  23. Zhao, Q.; Hastie, T. Causal Interpretations of Black-Box Models. J. Bus. Econ. Stat. 2021, 39, 272–281. [Google Scholar] [CrossRef] [PubMed]
  24. Batson, C.D.; Ahmad, N.; Powell, A.A.; Stocks, E.L. Prosocial Motivation. In Handbook of Motivation Science; Shah, J.Y., Gardner, W.L., Eds.; Guilford Press: New York, NY, USA, 2008; pp. 135–149. ISBN 1-59385-568-0. [Google Scholar]
  25. Hu, J.; Liden, R.C. Making a Difference in the Teamwork: Linking Team Prosocial Motivation to Team Processes and Effectiveness. Acad. Manag. J. 2015, 58, 1102–1127. [Google Scholar] [CrossRef]
  26. Grant, A.M. Relational Job Design and the Motivation to Make a Prosocial Difference. Acad. Manag. Rev. 2007, 32, 393–417. [Google Scholar] [CrossRef] [Green Version]
  27. Barrick, M.R.; Mount, M.K.; Strauss, J.P. Conscientiousness and Performance of Sales Representatives: Test of the Mediating Effects of Goal Setting. J. Appl. Psychol. 1993, 78, 715–722. [Google Scholar] [CrossRef]
  28. Barrick, M.R.; Mount, M.K. Autonomy as a Moderator of the Relationships Between the Big Five Personality Dimensions and Job Performance. J. Appl. Psychol. 1993, 78, 111–118. [Google Scholar] [CrossRef]
  29. Rothman, S.; Coetzer, E. The Big Five Personality Dimensions and Job Performance. SA J. Ind. Psychol. 2003, 29, 68–74. [Google Scholar] [CrossRef] [Green Version]
  30. Barrick, M.R.; Mount, M.K. The Big Five Personality Dimensions and Job Performance: A Meta-Analysis. Pers. Psychol. 1991, 44, 1–26. [Google Scholar] [CrossRef]
  31. Bing, M.N.; Lounsbury, J.W. Openness and Job Performance in U.S.-Based Japanese Manufacturing Companies. J. Bus. Psychol. 2000, 14, 515–522. [Google Scholar] [CrossRef]
  32. Johnson, J.A. Seven Social Performance Scales for the California Psychological Inventory. Hum. Perform. 1997, 10, 1–30. [Google Scholar] [CrossRef] [Green Version]
  33. Vinchur, A.J.; Schippmann, J.S.; Switzer, F.S.; Roth, P.L. A Meta-Analytic Review of Predictors of Job Performance for Salespeople. J. Appl. Psychol. 1998, 83, 586–597. [Google Scholar] [CrossRef]
  34. Jensen-Campbell, L.A.; Knack, J.M.; Gomez, H.L. The Psychology of Nice People. Soc. Personal. Psychol. Compass 2010, 4, 1042–1056. [Google Scholar] [CrossRef]
  35. Judge, T.A.; Livingston, B.A.; Hurst, C. Do Nice Guys—and Gals—Really Finish Last? The Joint Effects of Sex and Agreeableness on Income. J. Personal. Soc. Psychol. 2011, 102, 390. [Google Scholar] [CrossRef] [Green Version]
  36. Agras, S.; Ates, H. Investigating the Predictive Abilities of Schwartz’s Ten Universal Values on Five Work Performance Outcome Behaviors. Soc. Basic Sci. Res. Rev. 2015, 3, 16–31. [Google Scholar]
  37. Bradley, B.H.; Baur, J.E.; Banford, C.G.; Postlethwaite, B.E. Team Players and Collective Performance: How Agreeableness Affects Team Performance Over Time. Small Group Res. 2013, 44, 680–711. [Google Scholar] [CrossRef]
  38. Judge, T.A.; Higgins, C.A.; Thoresen, C.J.; Barrick, M.R. The Big Five Personality Traits, General Mental Ability, and Career Success Across the Life Span. Pers. Psychol. 1999, 52, 621–652. [Google Scholar] [CrossRef]
  39. Salgado, J.F. The Five Factor Model of Personality and Job Performance in the European Community. J. Appl. Psychol. 1997, 82, 30–43. [Google Scholar] [CrossRef]
  40. Heffernan, M. Don’t Wish for Obedient Employees. Available online: https://www.inc.com/margaret-heffernan/why-you-dont-want-obedient-employees.html (accessed on 1 January 2022).
  41. Heffernan, M. Just Following Orders. In Willful Blindness: Why We Ignore the Obvious at Our Peril; Heffernan, M., Ed.; Doubleday Canada: Toronto, ON, Canada, 2011; ISBN 9780385669009. [Google Scholar]
  42. Morris, J.; Mountfort, P. The Leader and the Team. Manag. Serv. Qual. Int. J. 1997, 7, 314–317. [Google Scholar] [CrossRef]
  43. Diehm, R.; Armatas, C. Surfing: An Avenue for Socially Acceptable Risk-Taking, Satisfying Needs for Sensation Seeking and Experience Seeking. Personal. Individ. Differ. 2004, 36, 663–677. [Google Scholar] [CrossRef]
  44. Weller, J.A.; Tikir, A. Predicting Domain-Specific Risk Taking With the HEXACO Personality Structure. J. Behav. Decis. Mak. 2011, 24, 180–201. [Google Scholar] [CrossRef]
  45. Ashton, M.C.; Lee, K. Empirical, Theoretical, and Practical Advantages of the HEXACO Model of Personality Structure. Personal. Soc. Psychol. Rev. 2007, 11, 150–166. [Google Scholar] [CrossRef] [PubMed]
  46. Fisk, S.R.; Overton, J. Bold or Reckless? The Impact of Workplace Risk-Taking on Attributions and Expected Outcomes. PLoS ONE 2020, 15, e0228672. [Google Scholar] [CrossRef] [Green Version]
  47. Farrell, M. Leadership Reflections: Extrovert and Introvert Leaders. J. Libr. Adm. 2017, 57, 436–443. [Google Scholar] [CrossRef]
  48. Dannar, P. If You Want Creativity in Your Organizations, Seek Out the Introvert. J. Leadersh. Stud. 2016, 10, 40–41. [Google Scholar] [CrossRef]
  49. Arthaud-Day, M.L.; Rode, J.C.; Turnley, W.H. Direct and Contextual Effects of Individual Values on Organizational Citizenship Behavior in Teams. J. Appl. Psychol. 2012, 97, 792–807. [Google Scholar] [CrossRef] [Green Version]
  50. Burt, R.S.; Hogarth, R.M.; Michaud, C. The Social Capital of French and American Managers. Organ. Sci. 2000, 11, 123–147. [Google Scholar] [CrossRef] [Green Version]
  51. Stachl, C.; Au, Q.; Schoedel, R.; Gosling, S.D.; Harari, G.M.; Buschek, D.; Völkel, S.T.; Schuwerk, T.; Oldemeier, M.; Ullmann, T.; et al. Predicting Personality from Patterns of Behavior Collected with Smartphones. Proc. Natl. Acad. Sci. USA 2020, 117, 17680–17687. [Google Scholar] [CrossRef]
  52. Marr, B. Data-Driven HR: How to Use Analytics and Metrics to Drive Performance; Kogan Page: London, UK, 2018. [Google Scholar]
  53. Bleidorn, W.; Hopwood, C.J. Using Machine Learning to Advance Personality Assessment and Theory. Personal. Soc. Psychol. Rev. 2019, 23, 190–203. [Google Scholar] [CrossRef]
  54. Blum, A.; Stangl, K. Recovering from Biased Data: Can Fairness Constraints Improve Accuracy? arXiv 2019, arXiv:1912.01094. [Google Scholar] [CrossRef]
  55. Suresh, H.; Guttag, J. A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle. In Equity and Access in Algorithms, Mechanisms, and Optimization; Association for Computing Machinery: New York, NY, USA, 2021. [Google Scholar] [CrossRef]
  56. Santacreu, J.; Rubio, V.J.; Hernández, J.M. The Objective Assessment of Personality: Cattells’s T-Data Revisited and More. Psychol. Sci. 2006, 48, 53–68. [Google Scholar]
  57. Bird, C.; Gourley, A.; Devanbu, P.; Gertz, M.; Swaminathan, A. Mining Email Social Networks. In Proceedings of the 2006 International Workshop on Mining Software Repositories, Shanghai, China, 22–23 May 2006; pp. 137–143. [Google Scholar] [CrossRef]
  58. Wilson, K.G.; Sandoz, E.K.; Kitchens, J.; Roberts, M. The Valued Living Questionnaire: Defining and Measuring Valued Action within a Behavioral Framework. Psychol. Rec. 2010, 60, 249–272. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Theoretical Framework.
Figure 1. Theoretical Framework.
Futureinternet 14 00133 g001
Figure 2. Modeling Setup.
Figure 2. Modeling Setup.
Futureinternet 14 00133 g002
Figure 3. Feature Importance of Conscientiousness Model.
Figure 3. Feature Importance of Conscientiousness Model.
Futureinternet 14 00133 g003
Figure 4. Feature Importance of Authority/Respect Model.
Figure 4. Feature Importance of Authority/Respect Model.
Futureinternet 14 00133 g004
Figure 5. Feature Importance of Power Model.
Figure 5. Feature Importance of Power Model.
Futureinternet 14 00133 g005
Figure 6. Feature Importance of Achievement Model.
Figure 6. Feature Importance of Achievement Model.
Futureinternet 14 00133 g006
Figure 7. Summarized Prediction Results.
Figure 7. Summarized Prediction Results.
Futureinternet 14 00133 g007
Table 1. Definition of Honest Signals.
Table 1. Definition of Honest Signals.
SignalSNA/NLP TermDefinitionCalculation
Central LeadershipDegree CentralityNumber of actors each person is directly connected within a network [4]Number of nearest neighbors from an actor both as senders and receivers in the network [4]
Betweenness CentralityMeasure of the extent to which each actor acts as an information hub [4]Likelihood to be on the shortest path between any two actors in the network [4]
Closeness CentralityMeasure of the mean distance from a node to other nodes [7]Mean shortest distance from one node to each other node [14]
Reach2Proxy for individual social capital [7]Number of nodes an actor can reach in two steps [15]
Rotating LeadershipBetweenness Centrality OscillationMeasure of how frequently actors change their network position in the team, from central to peripheral, and back [4]Number of local maxima and minima in a node’s betweenness centrality curve [4]
Balanced ContributionContribution IndexBalance of communication in terms of sent and received messages [4]Subtracting messages received from the messages sent and then dividing the result by the messages sent added to the messages received [4,7]
Rotating ContributionContribution Index OscillationMeasure of how frequently actors change the balance of their communication [7]Number of local maxima and minima in a node’s contribution index curve [7]
(Rapid) ResponseEgo ARTAverage number of hours sender takes to respond to emails [4]Time until a frame is closed for the receiver after he has sent an email [4]
Ego NudgesAverage number of follow-ups that the sender needs to send to receive a response from the receiver [4]Number of pings until sender responds [4]
Alter ARTAverage number of hours receiver takes to respond to emails [4]Time until a frame is closed for the sender, after he has sent an email [4]
Alter NudgesAverage number of follow-ups that the receiver needs to send to receive a respond from the sender [4]Number of pings until receiver responds [4]
Honest LanguageAverage SentimentIndicates positivity and negativity of communication [4]Sentiment scores which are predicted through ML model trained on twitter data are averaged [4,16]
Average EmotionalityIndicates the deviations from neutral sentiment [4]Standard deviation of sentiment [4]
Shared ContextAverage Complexity Measure of complexity of word usage [4]Information distribution using Term Frequency Inverse Document Frequency (TF/IDF), independent of single words [4]
Average InfluenceMeasure of influence of word usage averaged over all messages—defined as speed with how quickly newly introduced words are picked up by others, normalized by TF/IDF [17]Counting the popularity of a word within a message compared to all other messages in the community (using TF/IDF) [17]
Total InfluenceMeasure of influence of word usage—the individual influence per message summed up over all messages of an actor [17]Summing up influence measure (described above) over all messages of an actor [17]
Table 2. Data Source Per Survey.
Table 2. Data Source Per Survey.
Survey Data SourcePercentageN
NEO FFIMultinational university course18.51%15
Professional service firm2.47%2
Personal email boxes79.01%64
Total100%81
Moral FoundationsMultinational university course25.46%14
Professional service firm1.82%1
Personal email boxes72.73%40
Total100%56
Schwartz’s ValuesMultinational university course22.95%14
Professional service firm3.28%2
Personal email boxes73.77%45
Total100%61
DOSPERTMultinational university course30.61%15
Professional service firm4.08%2
Personal e-mail box65.3%32
Total100%49
Table 3. Data Sources for each study.
Table 3. Data Sources for each study.
Data SourceObject of StudyTarget
Health care70 employees in 11 innovation teamsTeam performance, learning behavior, and innovation behavior
Professional services82 managersEmployee ratings (of two years)
Professional services78 managers in 17 teamsTeam net promoter score
Multinational university course80 master’s students in 20 teamsStudent Teams Grades
Table 4. Prediction Models for Personal and Moral Values.
Table 4. Prediction Models for Personal and Moral Values.
TargetPredictorsAccuracy (CV)Macro F1 (CV)Macro Precision (CV)Macro Recall (CV)ROC AUC (CV)Accuracy (Holdout)Macro F1 (Holdout)Macro Precision (Holdout)Macro Recall (Holdout)Cohen’s Kappa (Holdout)ROC AUC (Holdout)
AgreeablenessBetweenness C. Oscillation, Contribution Index, Total Influence0.70.6790.7120.7190.8480.6670.6430.6670.6390.4910.897
ConscientiousnessBetweenness C. Oscillation, Degree Centrality0.7970.7850.7940.8040.9110.8890.8630.9520.8330.750.86
ExtraversionBetweenness Centrality, Ego ART0.6810.6580.6740.6880.80.6670.60.60.60.4380.621
NeuroticismBetweenness C. Oscillation, Total Influence, Avg. Sentiment0.7850.7630.7910.7780.8940.6670.6310.7110.7220.4130.823
Openness to ExperienceAvg. Complexity, Ego Nudges, Reach20.6870.6480.670.6740.8480.6670.6310.60.7220.40.794
Authority/RespectAvg. Influence, Avg. Sentiment0.7070.6830.7210.740.9010.8330.8410.9170.8330.7140.843
Fairness/ReciprocityAvg. Emotionality, Reach2, Ego Nudges0.6480.6120.6340.6480.7990.6670.7220.7780.8330.50.754
Harm/CareAlter Nudges, Total Influence,0.7520.7390.7580.7780.8890.6670.7220.8330.7780.50.917
Avg. Sentiment
PowerAvg. Complexity, Avg. Emotionality, Avg. Influence0.8580.8490.8750.8740.9680.7140.60.60.60.3640.7
AchievementBetweenness Centrality, Contribution Index, Sent Messages0.7930.7760.7980.8120.8970.7140.6940.6670.8670.5330.756
TranscendenceDegree Centrality, Avg. Emotionality, Total Influence0.7480.7070.7180.750.8870.7140.7110.7220.7780.5620.694
Recreational Risk LikelihoodBetweenness Centrality, Avg. Complexity, Contribution Index0.8140.7980.8130.8130.9120.80.8220.8330.8890.6880.98
Social Risk LikelihoodAlter ART, Alter Nudges, Betweenness Centrality0.7330.7190.7390.7570.9080.80.8220.8330.8890.6880.98
Social Risk PerceivedAlter Nudges, Closeness Centrality0.6230.5940.6660.6330.7620.80.5560.50.6670.6430.75
Ethical Risk LikelihoodBetweenness C. Oscillation, Received Messages, Betweenness Centrality0.670.6550.680.6930.8340.80.8220.8330.8890.6880.944
Ethical Risk PerceivedBetweenness C. Oscillation, Avg. Complexity, Avg. Emotionality0.8030.7790.8060.8220.9310.80.8220.8330.8890.6880.98
Total Risk LikelihoodContribution Index, Betweenness C. Oscillation,0.7520.7230.7450.7590.9320.80.8220.8330.8890.690.944
Total Influence
Table 5. Prediction Models for Job Performance.
Table 5. Prediction Models for Job Performance.
TargetPredictorsAccuracy (CV)Macro F1 (CV)Macro Precision (CV)Macro Recall (CV)ROC AUC (CV)Accuracy (Holdout)Macro F1 (Holdout)Macro Precision (Holdout)Macro Recall (Holdout)Cohen’s Kappa (Holdout)ROC AUC (Holdout)
Team PerformanceTeam Avg. Extraversion, Team Avg. Conscientiousness0.9160.9130.930.9280.9840.8570.8670.8890.8890.7880.98
Team LearningTeam Avg. Conscientiousness0.9260.9140.9160.9310.980.8570.8670.8890.8890.7880.939
Team InnovationTeam Avg. Power, Team Avg. Total Risk Likelihood0.830.8090.8520.860.9690.8570.8520.9330.8330.7310.969
Student Teams GradesTeam Avg. Achievement, Team Avg. Authority/Respect0.7020.6760.7760.720.8540.750.7670.8890.7780.5560.828
Team NPSTeam Avg. Agreeableness, Team Avg. Power0.8070.7670.7960.8090.920.750.7560.7780.8330.6360.861
First-Year RatingHarm/Care, Total Risk Likelihood0.6520.6230.6670.6570.6570.7780.7750.80.8330.5710.833
Second-Year RatingHarm/Care, Total Risk Likelihood0.660.6190.6770.6530.6530.7780.750.750.8570.5260.857
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Altuntas, E.; Gloor, P.A.; Budner, P. Measuring Ethical Values with AI for Better Teamwork. Future Internet 2022, 14, 133. https://doi.org/10.3390/fi14050133

AMA Style

Altuntas E, Gloor PA, Budner P. Measuring Ethical Values with AI for Better Teamwork. Future Internet. 2022; 14(5):133. https://doi.org/10.3390/fi14050133

Chicago/Turabian Style

Altuntas, Erkin, Peter A. Gloor, and Pascal Budner. 2022. "Measuring Ethical Values with AI for Better Teamwork" Future Internet 14, no. 5: 133. https://doi.org/10.3390/fi14050133

APA Style

Altuntas, E., Gloor, P. A., & Budner, P. (2022). Measuring Ethical Values with AI for Better Teamwork. Future Internet, 14(5), 133. https://doi.org/10.3390/fi14050133

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop