Volume 1 | Issue 25 | April 1, 2025

How to ask AI for advice and actually get good answers

AI-Generated Summary

“AI has potential as an advisory tool due to its structured feedback, impartiality, and ability to process large datasets. However, it lacks genuine understanding, can be biased, and struggles with emotional nuance. AI is best used to augment human thinking, not replace empathy and wisdom. Clear prompts improve AI’s output, but over-reliance may risk social isolation or acceptance of flawed advice.”

The burgeoning field of Artificial Intelligence (AI) has permeated numerous facets of modern life, and its potential application in providing advice on intricate human concerns such as relationships, politics, and social issues is a subject of increasing interest and debate. As AI systems like ChatGPT become more sophisticated, questions arise about their capacity to offer truly useful guidance in these complex domains, where impartiality, understanding of nuance, and the ability to navigate multifaceted perspectives are often paramount…. This article delves into the arguments surrounding AI’s potential as an advisory entity, exploring both its touted benefits and inherent limitations, drawing upon recent discussions and preliminary research in this evolving landscape.

The Promise of Impartiality and Comprehensive Data Processing

One of the central arguments for AI’s utility in offering advice stems from its perceived impartiality…. In contrast to human advisors who may be influenced by their own biases, experiences, and emotional leanings, AI is trained on vast datasets of human text and interactions, theoretically giving it access to a broad spectrum of viewpoints without inherent allegiance to any particular stance…. As noted in discussions on Reddit’s r/IntellectualDarkWeb, “AI has the benefit of knowing both sides. And AI has no reason to choose one side or the other. AI can speak from an impartial point of view, while understanding both sides”. This ability to process and understand diverse perspectives could be particularly valuable in politically and socially charged discussions where finding unbiased counsel can be challenging….

Furthermore, AI’s capacity to analyze and identify statistical correlations and trends within large datasets could offer insights that human advisors might overlook. Theoretically, given objective input data, AI could discern patterns in relationships, social dynamics, or political outcomes that are not immediately apparent to human analysis. This suggests a potential for AI to offer novel perspectives and identify less conventional solutions to complex problems.

The structure and clarity of AI-generated advice are also frequently cited as advantages. In a discussion on r/socialskills, one user found AI’s feedback to be “very clear and structured,” contrasting it with the often rambling and emotionally influenced feedback from human interactions. The framework provided by AI in navigating a difficult work situation, as described by another user, highlights its potential for offering actionable and organized guidance. Moreover, the 24/7 availability and non-judgmental nature of AI can make it an accessible resource for individuals seeking advice at any time, without the constraints or potential biases associated with human interaction….

The Challenge of Understanding, Bias, and “Hallucinations”

Despite the potential benefits, significant concerns remain regarding AI’s ability to provide truly insightful and reliable advice, particularly in domains that require a deep understanding of human emotions, motivations, and contextual nuances. A fundamental criticism leveled against current AI models, such as ChatGPT, is that they are essentially “next word prediction computer program[s]” that mimic human language without genuine comprehension of the underlying concepts…. As articulated in the r/IntellectualDarkWeb discussion, if AI speech is “based off of nothing tangible, then it may as well be unintelligible”. This lack of genuine understanding raises questions about AI’s capacity to grasp the subtleties of human relationships or the historical and cultural contexts that shape political and social issues….

Another critical concern is the issue of bias in AI. While proponents argue for AI’s impartiality, critics point out that AI models are trained on data generated by humans, which inherently contains a multitude of biases…. As one Reddit user on r/socialskills aptly stated, “AI draws from sources written by humans, which all have a bias… if you programmed an AI based on stuff average Americans wrote ~150 years ago, it would probably tell you that slavery is a good thing”. Furthermore, programmers can consciously or unconsciously introduce their own biases into the AI’s design and training. This inherent susceptibility to bias undermines the claim of AI’s impartiality and raises concerns about the potential for AI to perpetuate or even amplify existing societal inequalities.

The phenomenon of “hallucinations,” where AI models generate factually incorrect or nonsensical information, also poses a significant challenge to their reliability as advisors…. While proponents argue that humans also engage in misinformation through conspiracy theories, the underlying mechanism differs…. AI hallucinations are often attributed to the predictive nature of language models, which may generate plausible-sounding but ultimately false statements…. This lack of a concept of facts or logic makes relying on AI for critical advice in areas like law or ethics particularly risky.

The Human Element: Empathy, Context, and Wisdom

The ability to understand and respond to human emotions and motivations is crucial in providing effective advice on relationships and social issues. Critics argue that AI, lacking genuine consciousness and personal experience, cannot fully comprehend the complexities of human motive or the emotional nuances inherent in interpersonal dynamics…. For instance, the question of whether AI could discern truthfulness based on a person’s emotional state on a witness stand highlights the limitations of current AI in understanding the “humanness” of a situation. While some users on r/socialskills have found AI to be surprisingly helpful for emotional and psychological support…, others emphasize the importance of genuine human connection and the potential for over-reliance on AI to lead to social isolation….

Furthermore, the concept of “wise reasoning,” which involves considering multiple perspectives, recognizing limitations in knowledge, searching for compromise, and seeking conflict resolution, is a crucial aspect of sound advice…. While initial research suggests that AI models like GPT4 and Claude Opus can demonstrate some dimensions of wise reasoning, such as recognizing the possibility of change and searching for compromise, they often fall short in areas like intellectual humility and consideration of different perspectives. Igor Grossmann, a researcher in this area, emphasizes that “showing something that resembles wise reasoning versus actually using wise reasoning – those are very different things”. True wisdom often depends on context and life experience, qualities that current AI systems lack….

AI as a Tool, Not a Replacement

It is important to consider the potential role of AI as a tool to augment human thinking rather than a complete replacement for human advisors. AI can be valuable in providing structured frameworks, identifying potential biases, and offering alternative perspectives that might not immediately occur to a human…. As one user on r/socialskills suggested, AI can be “useful as a mirror” to help individuals think through their thoughts. Similarly, researchers are exploring the possibility of training AI to act as a “devil’s advocate” to encourage deeper consideration of different viewpoints.

However, users must exercise critical thinking and media literacy when interacting with AI, recognizing that its output is based on patterns in data and not necessarily grounded in factual accuracy or genuine understanding…. The way questions are framed can significantly influence the quality of the advice received from AI…. Clear and specific prompts are more likely to yield relevant and nuanced responses.

Conclusion: Navigating the Algorithmic Age of Advice

The question of whether AI can give useful advice on relationships, politics, and social issues is complex and multifaceted. While AI offers the potential for impartiality, comprehensive data processing, and structured feedback, it currently faces significant limitations in terms of genuine understanding, susceptibility to bias, and the capacity to grasp the nuances of human emotion and context.

Preliminary research into “wise reasoning” in AI is intriguing, suggesting that these systems can mimic some aspects of sound judgment. However, the crucial elements of intellectual humility, genuine empathy, and the integration of life experience remain significant hurdles.

Ultimately, the value of AI as an advisory entity likely lies in its role as a tool to augment human intelligence, prompting critical thinking and offering alternative perspectives. Over-reliance on AI for guidance, particularly in sensitive personal and social domains, carries risks, including potential social isolation and the uncritical acceptance of biased or factually incorrect information. As AI technology continues to evolve, ongoing research and critical evaluation will be essential to discerning its appropriate role in providing counsel on the intricate tapestry of human life. The “algorithmic oracle” may offer valuable insights, but human wisdom, empathy, and critical judgment remain indispensable.