AI In Market Research: The Story So Far – Chapter 2: Limitations of AI

Despite AI’s expanding popularity in market research, experts are fully aware that there is still a lot of ground to cover regarding their effectiveness and optimization for use cases, along with understanding and mitigating their risks and limitations.

These limitations reveal themselves most especially in efforts to replicate human behavior. One research paper on a survey employing Large Language Models observed how effective these LLMs are in understanding consumer preferences with their behaviors consistent with four economic theories, but noted that there were demonstrations of extra sensitivity to the prompts they were given. In addition, there were indications of positional bias wherein the first concept was selected more often than the others that were also presented.

AI has also been found to be too optimistic, tech-forward, and self-interested.  For example, ChatGPT is inherently focusing on maximizing expected payoffs, whereas a person would often act in a risk-averse way for gains and risk-seeking for losses. AI also exhibits a generally higher level of brand association than humans, resulting in higher brand scores. However, it struggles with lesser-known topics, notably in scenarios where new commercial products are tested and targeted toward a specific audience.

While it can be addressed by cautious prompt engineering, AI hallucinations are an unintended effect of the helpful aspect of these models where they generate unnecessary output stemming from patterns or elements they perceived but are nonexistent or imperceptible to human observers.

And while more on the side of risks than limitations, there is an understandably and famously increasing concern from artists over how text-to-image generators threaten to replace them and their work, just as there are certain roles in the market research sector that are in danger of being taken over by AI.

Perhaps the ideal recommendation for utilizing AI while keeping in mind its limitations is to use it in cases where it’s most effective and productive with the understanding that it might excel in one scenario, but it doesn’t mean it will be just as effective in another situation.