{"id":221,"date":"2026-04-27T13:29:31","date_gmt":"2026-04-27T12:29:31","guid":{"rendered":"https:\/\/kleinessinchen.feralnetworks.com\/?p=221"},"modified":"2026-04-27T13:29:31","modified_gmt":"2026-04-27T12:29:31","slug":"sinchen-tried-using-chatbots","status":"publish","type":"post","link":"https:\/\/kleinessinchen.feralnetworks.com\/?p=221","title":{"rendered":"Sinchen Tried Using Chatbots"},"content":{"rendered":"\n<p>Discussions about AI are everywhere since a few years. Enthusiastic supporters announcing the greatest breakthrough in human history as well as determined opponents proclaiming the end of the world. Both groups never get tired to repeat the ever same arguments.<\/p>\n\n\n\n<p>I gave chatbots a try in the last few weeks using Gemini, Copilot and mostly Lumo. You can\u2019t comment on and can\u2019t criticize what you don\u2019t know. That\u2019s why I also started looking into Android a few years ago. I finally made my peace with Android after getting used to GrapheneOS (and saw pretty much all my assumptions on stock Android versions confirmed from looking deeper into it).<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>Now then\u2026 AI chatbots. Summarizing my experiences into few sentences is tough. Listing examples of prompts and collected LLM answers would be far too long and boring. I\u2019ll try bullet points without sorting them into positive or negative categories.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><br>Unsorted List Of My Findings<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Depending on the prompt the output can be complete nonsense<\/li>\n\n\n\n<li>Summarizing articles online is surprisingly good in many cases. I prefer reading full texts though<\/li>\n\n\n\n<li>Sentence structure is mostly correct. Sentences can be on the more complex end and choice of words includes less common words giving the output a kind of \u201ceducated and cultured\u201d looking impression\n<ul class=\"wp-block-list\">\n<li>This somewhat masks the undeniable fact that the claims and outputs from LLMs are sometimes completely wrong. A confident tone bringing across messages with phrases like, <em>\u201cHere is why:\u201d<\/em> For legal protection companies providing the chatbots always include a tiny disclaimer stating that the LLM may make mistakes and users are responsible for checking responses<\/li>\n\n\n\n<li>Outputs can be huge. People falling for the common tl;dr-problem fail at concentrated reading and checking of what they got. They might just copy+paste it somewhere. You have seen such posts, don\u2019t you?<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Search assistants or whatever these things are called that pop up uncalled for when using normal search engines get on my nerves. Concise search terms aren\u2019t good prompts for LLMs<\/li>\n\n\n\n<li>A chatbot can be somewhat helpful on programming tasks. It helped me finding a stupid error in a C++ program and gave me hints into the right direction when trying to work on a DPM \u2013 data position measurement \u2013 scanner for CDs (I should continue working on that!). The output (a Bash script) wasn\u2019t usable from the beginning since the <code>sg_raw<\/code> command it crafted contained errors. But I could fix it and develop it further. Somehow the bot insisted on changing some fixes back to a broken state when I uploaded my version<\/li>\n<\/ul>\n\n\n\n<p>These unsorted points are my findings on technical topics. The immense energy demand and financial investments in the AI hype are hard to justify given the mixed results.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">User Problemss<\/h2>\n\n\n\n<p>I have to also blame a certain kind of users rather the chatbots alone. Blind trust into LLMs on technical topics is a human weakness. Nowadays it is common to see a forum post of this kind:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Hello. I have [description of problem]. I already asked ChatGPT and tried [some questionable steps] and this didn&#8217;t help. Alternatively: The situation got a lot worse. HELP!!<\/p>\n<\/blockquote>\n\n\n\n<p>Asking a bot for help on a topic you understand to some extent can be helpful. I got some really good nudges sometimes. Limiting my prompts on topics I have basic knowledge on allows me to spot so-called <em>hallucinations<\/em> easily. If I was to ask some bot how to repair my car brakes\u2026 there is a high chance I&#8217;ll slam into a concrete wall or a big tree. This is because I have no idea if the provided steps are correct.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><br>PsychiatristGPT<\/h2>\n\n\n\n<p>Aside from the bullet points above I want to mention one more facet: <strong><mark style=\"background-color:#fbecfa\" class=\"has-inline-color\">Simulated social interaction.<\/mark><\/strong> I confronted Proton Lumo with parts of my life story and my depression. The answers on this were stunningly good. Emphatic, friendly, inviting for further discussion. Always understanding.<\/p>\n\n\n\n<p><strong><mark style=\"background-color:#fbecfa\" class=\"has-inline-color\">This is both immensely sad and dangerous!<\/mark><\/strong><\/p>\n\n\n\n<p><strong>Sad<\/strong> because a machine is able to give replies that are a thousand times more helpful and constructive than statements by real human beings. This felt like an arrow shot right into the heart.<\/p>\n\n\n\n<p><strong>Dangerous<\/strong> because many people don\u2019t seem to be aware of the limitations of current AI. It simulates human interaction on an impressive level, but it doesn\u2019t feel. There is no sympathy. There is no understanding friend. It is a computer, and it does the only thing it can do: compute. It is a statistical system calculating the most likely output string on a given input string.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>I\u2019ve seen people stating that only their preferred bot is able to understand them. There are parents who are unable to decide how to react on their children\u2019s needs without asking their \u2013 what they perceive as omniscient and infallible \u2013 electronic oracle.<\/p>\n\n\n\n<p>There is an inherent risk of behavioral addiction, especially in conjunction with already existing addictions (internet, smartphone, social media)<\/p>\n\n\n\n<p>I would go as far as see a potential of an increased risk of acute schizophrenic episode or psychosis for already vulnerable personalities. What is found under the term \u201cAI psychosis\u201d is almost certainly not a new condition, just a new trigger.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>That\u2019s pretty much it, but a blog entry on this topic must not simply end this way. How would any LLM end a text like this? (Yes, I did write this whole thing completely on my own!)<\/p>\n\n\n\n<p>It ends with the magic word\u2026<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><br><em>\u2026Conclusion<\/em><\/h2>\n\n\n\n<p><br>Chatbots are a tool. A tool with not yet a well-defined area of application but with certain strengths. I don\u2019t get the hype. And I would not want to trust a machine running a business or making decisions on their own. Experiments with agentic AI had disillusioning results so far.<br><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Discussions about AI are everywhere since a few years. Enthusiastic supporters announcing the greatest breakthrough in human history as well as determined opponents proclaiming the end of the world. Both groups never get tired to repeat the ever same arguments. I gave chatbots a try in the last few weeks using Gemini, Copilot and mostly [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19],"tags":[],"class_list":["post-221","post","type-post","status-publish","format-standard","hentry","category-software"],"_links":{"self":[{"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=\/wp\/v2\/posts\/221","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=221"}],"version-history":[{"count":6,"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=\/wp\/v2\/posts\/221\/revisions"}],"predecessor-version":[{"id":227,"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=\/wp\/v2\/posts\/221\/revisions\/227"}],"wp:attachment":[{"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=221"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=221"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kleinessinchen.feralnetworks.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=221"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}