CREATING AN ADAPTIVE VOICE AND
LANGUAGE MODEL CAPABLE OF EMOTIONAL
RESPONSE AND SELF-PROFILING TO
EMULATE USER PERSONALITY
CREACIÓN DE UN MODELO DE VOZ Y LENGUAJE
ADAPTATIVO CAPAZ DE RESPUESTA EMOCIONAL Y
AUTOPROFILIADO PARA EMULAR LA PERSONALIDAD DEL
USUARIO
Hernan Isaac Ocana Flores
University of Queensland

pág. 3454
DOI: https://doi.org/10.37811/cl_rcm.v9i1.16093
Creating an Adaptive Voice and Language Model Capable of Emotional
Response and Self-Profiling to Emulate User Personality
Hernan Isaac Ocana Flores1
hi.ocana@uq.net.au
https://orcid.org/0000-0001-6258-3828
University of Queensland
Brisbane - Australia
ABSTRACT
This work aims to show a cheap alternative of implementing an adaptive voice and language model,
which has the opportunity not only react to the interlocutors’ emotions but also adapt the personality of
the bot to the personality of the user. Through moderated Framework and a feedback loop process the
author explores the possibility of a system model. The conversational agent of this framework uses
Natural Language Process (NLP) technique for the psychological profiling in order to be self-directed and
self-aware. Moreover, this system can be kept current with successive activity sequences with gradual
enhancement in the identification of the user personality, which determines the manner in which the
model interacts with the user. The author also presents a plan on how to design such a model supported
by theory, method, and feasibility and possible uses
Keywords: adaptive voice model, psychological profiling, natural language processing (nlp), emotionally
intelligent systems
1 Autor principal
Correspondencia: hi.ocana@uq.net.au

pág. 3455
Creación de un Modelo de Voz y Lenguaje Adaptativo Capaz de Respuesta
Emocional y Autoprofiliado para Emular la Personalidad del Usuario
RESUMEN
Esta autoría tiene como objetivo mostrar una alternativa económica para implementar un modelo de voz y
lenguaje adaptativo, que no solo tenga la capacidad de reaccionar a las emociones de los interlocutores,
sino también de adaptar la personalidad del bot a la personalidad del usuario. A través de un marco
moderado y un proceso de bucle de retroalimentación, el autor explora la posibilidad de un modelo de
sistema. El agente conversacional de este marco utiliza técnicas de Procesamiento del Lenguaje Natural
(PLN) para el perfilado psicológico con el fin de ser autodirigido y autoconsciente. Además, este sistema
puede mantenerse actualizado mediante secuencias sucesivas de actividad, logrando una mejora gradual
en la identificación de la personalidad del usuario, lo que determina la forma en que el modelo interactúa
con él. El autor también presenta un plan sobre cómo diseñar dicho modelo, respaldado por teoría,
método, viabilidad y posibles usos.
Palabras clave: modelo de voz adaptativo, perfilado psicológico, procesamiento del lenguaje natural
(pln), sistemas emocionalmente inteligentes
Artículo recibido 05 enero 2025
Aceptado para publicación: 10 febrero 2025

pág. 3456
INTRODUCTION
The integration of two modalities of emotional intelligence and personality flexibility into conversational
agents is a promising subfield in artificial intelligence research. The recent achievements in the domains
of large language models reached levels of excellence for natural language comprehension and
production (Flores and Luna, 2024) (Ocana et al., 2023a) (Pellert et al., 2024), but these systems currently
lack sincere emotional intelligence and matched personality personalities as those. Thus, to achieve this
the author proposes a framework how to create an ‘’emotional’’ dialogue system building from already
existing cost-efficient language models such to provide an effective and affordable cost.
The improvement of conversation has taken the place of the worry that these conversational agents only
generate automatic responses (Poggi and Pelachaud, 2000) and that it integrated key psychological
models. In Saha´s et al. (2024), research it was identified that current dialog systems even have the ability
to comprehend and apperceive affective information, while Matsumoto et al., (2022) regard the emotion
to a system such that a change coincides with other studies, and recognising that interacting with an
artificial intelligence system is not only a linguistic activity, but also affects and interacting with a stable
personality (Dolgikh, 2024)(Flores and Luna, 2024)(Flores, 2023)(Sonlu et al., 2021).
Thus, personality adaptation has become a factor in which is very important for developing more realistic
interfaces for AI systems. Müller et al., (2019) reveals that users are accepting of systems that have
personalities that are manmade and can alter preference as the user would wish. The same was also seen
by Guo et al., (2024) who state that, as compared to other dialogue systems, the personality-oriented
methods offer considerably improved engagement levels and user satisfaction rates. There is a strong
interaction effect between personality modeling and the added element of emotional intelligence
according to recent studies conducted by Ma et al., (2024), Flores (2024), and Wen et al. (2024).
These adaptive systems therefore use advanced machine learning architectures and are fully reliant on the
model structures. As seen in Rathi et al., (2022) through Psychometric profiling via natural language
processing, and in Flores (2023) on frameworks of deep learning-based personality assessment, the work
in the discipline was initiated. As Flores (2023) discusses, these technological advancements have been
accompanied on one side by research in reinforcement learning approaches where these systems have
been introduced in continuing interaction and proved to learn and improve their own emotional reactions.

pág. 3457
However, one has been as equally challenging the other as has been an attempt to develop genuinely
adaptable and emotionally intelligent systems. As Flores, Luna (2024) and Llanes et al., (2024) noted this
is so because for human emotion and personality modeling, there are wide differences of margin between
the human response patterns and behaviors machine expectations. Moreover, maintaining similar
emotional consistency across such different interaction contexts is not obvious as perceived by the system
erratic behaviour– this was also addressed in the recent work of Flores (2023). AI advancement integrates
all of these components of emotional intelligence, personality adaptation and machine learning in a single
work. Despite the encouragement of mastery of the components of Fan et al., (2017) within artificial
agents, noted that emotional AI is quite desirable for an effective interaction between people and AI.
Kossack and Unger., (2023) also agree with this point by showing that emotion-aware chatbots are ideal
for enhancing user interaction and satisfaction.
This proposed framework builds from previous stablished foundations by building a robust
system and incorporating real time personality adaptation and emotional intelligence through the addition
of the mirroring approach in the feedback loop (Flores, 2023). With the latest advances in natural
language processing is possible to create a complete system for more human centred (Lee et aL, 2023)
(Flores and Luna, 2024) and personality assessment techniques according to Sikström et al., (2024).
Flores, (2023) proposed how such systems can learn and adapt their emotional responses through
continued interaction.
Although, it’s difficult to create emotional and adaptive systems, but it is possible. Compared to other
modelling approaches, such as (Llanes et al. 2024), which are simpler and less capable of handling the
small differences in user behavior and patterns of their responses to content, human emotion and
personality demand sophisticated modeling methods, as Flores and Luna (2024) and Llanes et al. (2024)
point out. Building upon these foundations, the proposed framework is derived as a robust approach to
real time personality adaptation in combination with emotional intelligence based on feedback
incorporating mirroring features (Flores 2023) (Lee et al. 2023). Thus, the use of personality assessment
techniques (Flores and Luna 2024) (Sikström et al. 2024), will serve to build robust system previous
research on how frameworks are extended is complicated by the fact that the system needs also to keep

pág. 3458
consistency between different interaction contexts, an issue that has been pointed out in recent work by
Flores (2023).
By integrating emotional intelligence and personality adaptation with machine learning into a holistic
design, is meant to take a significant challenge but also progress in AI. Fan et al., (2017) suggest that
emotional intelligence in artificial agents no longer amounts to just a desirable trait but is a requirement
required for true and productive human AI interaction supported by Kossack and Unger (2023)
METHODOLOGY
The methodology of this work is base system capable to update the model continuously and, after the
analysis of the information, the result should be saved, processed and distinguished to complete. This, as
Flores (2023), Sikström et al., (2024) and Saha et al., (2024) have demonstrated in interactive-user-
feedback-adaptive systems are much more engaging and reliable. This makes it possible for the language
model to change its response dependant on the user feedback data as proposed by Guo et al., (2024) and
Wen et al., (2024) on personality-based conversation.
The system consists of four major components:
User Profiling
The foundation of this research work is based on the reliance of the deep learning model Chat GPT that
uses inputs from the users in synch with time to build a psychological and behavioural profile. Prior work
of Flores (2023), Müller et al., 2017, and Rathi et al., (2022), shows that applied artificial intelligence to
utilisation of personality detection and analysis is feasible and advisable. Furthermore, advanced
strategies presented by Flores and Luna (2024) and Ocaña, et al., (2023b) points out, the personality
styles can be estimated accurately and reliably with the help of NLP methods.
Emotional Intelligence
Based on the study by Dolgikh, (2024) and Wang et al., (2024) the frameworks of affective
computing in conversational systems should be applied to create or emulate emotional intelligence. This
is done such as to complement the enhanced sentiment analysis methods Flores (2023), Matsumoto
etal:2022, and Ma et al.,2024 suggested that systems that emulates such emotions can gather deeper
insight of user emotions. The ability to perform the accurate sentiment analysis is enabled through use of
advance techniques endorsed by Flores (2023), Matsumoto et al., (2022),, and Ma et al., (2024). Also, the

pág. 3459
earlier work done by Kossack and Unger, 2023, Fan et al., 2017, and Bilquise et al., 2022 depicted these
same aspects enhancing the mechanism of trust and overall user engagement significantly.
Personality Emulation
Based on the study by Dolgikh, et al., (2024) and Wang et al., (2024), this introduced the
frameworks of affective computing in conversational systems. To complement the enhanced sentiment
analysis methods of Flores (2023), Matsumoto et al., (2022), and Ma et al., (2024) this provides a deeper
insight of user emotions. The ability to perform the accurate sentiment analysis is enabled through use of
advance techniques endorsed by Flores (2023), Matsumoto et al., (2022), and Ma et al., (2024). Also, the
earlier work done by Kossack and Unger, 2023, Fan et al., 2017, and Bilquise et al., 2022 depicted herein
revealed that Responses enhance the mechanism of trust and overall user engagement significantly.
Feedback Loop and Iteration
Based on the study by Dolgikh, (2024) and Wang et al., (2024), this introduced the frameworks of
affective computing in conversational systems. To complement the enhanced sentiment analysis methods
of Flores (2023), Matsumoto et al., (2022), and Ma et al., (2024) this provides a deeper insight of user
emotions. The ability to perform the accurate sentiment analysis is enabled through use of advance
techniques endorsed by Flores (2023), Matsumoto et al., (2022),, and Ma et al., (2024). Also, the earlier
work done by Kossack and Unger, (2023), Fan et al., (2017), and Bilquise et al., (2022) depicted herein
revealed that Responses enhance the mechanism of trust and overall user engagement significantly.
Basing this component the initial process flow of these components are presented as follows in Figure 1.
Figure 1.- System overview for profile creation and emulation
RESULTS
Following stipulated stablished framework this study found that the proposed system must be built upon
with the component below:

pág. 3460
User Interaction
1.-Text Inputs: Linguistic analysis of user-generated content to detect sentiment,
emotions, and underlying personality traits.
2.-Interaction Patterns: How the user responds to specific conversational prompts, how they
engage with certain topics, and the pacing of their responses.
3.-Psychological Models: Adding primary psychological models including the Five F actor
Personality Model or the Myers Briggs Type Indicator to arrive at a theoretical personality profile.
As stipulated before language models including unsupervised clustering are used to analyse the user’s
response and activities to recognise patterns (Dolgikh, 2024), Fan et al. (2017), Flores, Luna (2024) and
Ocaña (2023b). These patterns then can be related to a set of psychological characteristics in which
further behaviour will affect the model response (Lee et al., 2024).
Emotional Intelligence Integration - EMI
The developed model of EMI is itself an example of a high level of creative advancement in human-
computer interaction based on several levels of affective computing (Dolgikh, 2024) (Flores, 2023).
According to Ocaña et al. (2023a), AI systems aimed for emotional detection can be used in situations
where emotional responses are significant, for example in diagnosis of autism spectrum disorder. The
identification of the sentiment of the inputs shows that the system incorporates specialised sentiment
analysis procedures which Flores and Lunda (2024), Kossack and Unger (2023), Ocaña et al. (2023b) has
been useful in studying users’ behaviour or affective feedback in computerised contexts. assessments,
especially in specific domains including autism spectrum disorder (ASD) where emotions are particularly
important.
The detection of minor emotions from user inputs is a complex feature of the system which uses
sentiment analysis to determine emotions; techniques embraced by Flores and Luna (2024), Kossack and
Unger (2023), Ocaña et al. (2023b) while analysing users’ interactions and feelings in digital platforms.
This emotional awareness is further boosted through the incorporation of social emotional development
theories as noted in Fan et al. (2017), Le, et al. (2024) & Ocaña et al. (2021) autism spectrum disorder
assessment, where emotional recognition plays a crucial role. The system's ability to detect emotional
undertones in user inputs leverages advanced sentiment analysis techniques, which Flores and Lunda

pág. 3461
(2024), Kossack and Unger (2023), Ocaña et al. (2023b) have shown to be effective in analysing user
interactions and emotional expressions in digital environments.
This emotional awareness is further enhanced through the integration of social-emotional development
frameworks, as highlighted in Fan et al. (2017), Le, et al. (2024) Ocaña et al. (2021a) in which the system
retrieves what was described as indicator of emotion involvement by Guo et al. (2024), Ma et al. (2024),
Llanes et al. (2024), Velagaleti, et al., (2024).
Moreover, Flores and Luna (2024), Kossack and Unger (2023), and Ocaña et al. (2023b) have effectively
described the methodologies used in the system for conducting adaptive sentiment analysis. At their core,
these methodologies allow for the perceiving of user emotions in the context of number-based digital
interactions thus serving as a basis in this research work. To enrich this perception of user emotions, the
system has also been endowed with the capability for socially and emotionally intelligent interactions, in
line with the approaches of Fan et al. (2017), Le et al. (2024), and Ocaña et al. (2021a). This endowment
allows for a level of engagement with users that goes beyond responding to them at the level of basic
emotions. Finally, Guo et al. (2024), Ma et al. (2024), Llanes et al. (2024), Ocaña et al. (2021b), and Wen
et al. (2024) have described the system design as one that understands emotional engagement signals.
These are "signals" that indicate the user is expressing specific traits of emotions like sadness, happiness,
anger, or fear.
Emotional response is noticed more in cyberspace, which Le et al. (2024) and Ocaña et al. (2023c) found
to be a place with positive pathways for interaction when it comes to emotional appeals. To do this, the
response generator built upon these emotional insights to create a shift in conversation tenor.
Transformation, from less empathetic interactions to more empathetic ones. Timing was essential to
sustain the empathically relevant part of the interaction (the human bridge part of the conversation). This
was something that Ocaña et al. (2021c) gave high marks when interacting in user experience on
cyberspace. It was also something that Le et al. (2024) said was especially crucial for "learning moments¨
and implemented also by Yu et al., (2024) and Yadav et al., (2020).
Guo et al. (2024), Ma et al. (2024), Llanes et al. (2024), Ocaña et al. (2021b), Wen et al. (2024) describe
emotional involvement indicators that the system uses to categorise and respond to essential emotions
such as happiness, sadness, anger, fear. For instance, in virtual environments, Le, et al. (2024) and Ocaña