Large language models have become a default interface for many AI products, but researchers still struggle to describe their behaviour in a consistent, measurable way. A team at The Hong Kong Polytechnic University says it has built a system that aims to quantify an LLM’s personality based on linguistic output.
The tool, called Language Model Linguistic Personality Assessment, or LMLPA, is designed to translate model responses into numerical scores tied to personality traits. The researchers describe it as a step toward making model behaviour easier to compare across systems and deployments.
How the LMLPA system works
LMLPA combines two components: an adapted version of the Big Five Inventory and an AI rater that grades the model’s answers. The process focuses on patterns such as wording, style and other language features found in generated text.
By using a standardised questionnaire structure, the approach attempts to bring more consistency to assessments that often rely on subjective impressions. The researchers say the outcome is a data-driven profile that can be tracked and tested across different prompts and settings.
Why personality metrics could matter
Developers and organisations increasingly want AI assistants to behave predictably in sensitive contexts, including classrooms, customer support and internal decision workflows. The team argues that quantifying communication tendencies could help tailor a model’s tone and interaction style to a specific use case.
The researchers also point to potential value in governance and oversight, where firms are under pressure to document how AI tools behave and how risks are managed. They suggest that structured behavioural metrics could complement existing evaluation methods focused on accuracy and safety.
From research to compliance applications
PolyU said the work has also informed a business compliance platform that uses natural language processing to analyse large volumes of reports and other text. In that context, automation is intended to speed up data collection, analysis and insight generation for reporting tasks.
The study, led by Prof. Lik-Hang Lee of PolyU’s Department of Industrial and Systems Engineering, was published in the journal Computational Linguistics. The researchers position LMLPA as part of a broader effort to align AI systems with human values and practical operational needs.
Leave a Reply