<?xml version="1.0" encoding="UTF-8" ?><!-- generator=Zoho Sites --><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/"><channel><atom:link href="https://www.nownextlater.ai/Insights/tag/llm-manipulation/feed" rel="self" type="application/rss+xml"/><title>Now Next Later AI - Blog #LLM Manipulation</title><description>Now Next Later AI - Blog #LLM Manipulation</description><link>https://www.nownextlater.ai/Insights/tag/llm-manipulation</link><lastBuildDate>Wed, 26 Nov 2025 21:22:30 +1100</lastBuildDate><generator>http://zoho.com/sites/</generator><item><title><![CDATA[Manipulation in AI-Powered Product Recommendations: What Business Leaders Need to Know]]></title><link>https://www.nownextlater.ai/Insights/post/manipulation-in-ai-powered-product-recommendations-what-business-leaders-need-to-know</link><description><![CDATA[<img align="left" hspace="5" src="https://www.nownextlater.ai/Screenshot 2024-04-15 at 1.56.46 pm.png"/>A new study from Harvard University reveals how LLMs can be manipulated to boost a product's visibility and ranking in recommendations.]]></description><content:encoded><![CDATA[<div class="zpcontent-container blogpost-container "><div data-element-id="elm_pCI1lBbJTbee367QS5IxSA" data-element-type="section" class="zpsection "><style type="text/css"></style><div class="zpcontainer-fluid zpcontainer"><div data-element-id="elm_K0uN8jcfQHCufjDVgK8vuA" data-element-type="row" class="zprow zprow-container zpalign-items- zpjustify-content- " data-equal-column=""><style type="text/css"></style><div data-element-id="elm_5Q-6pU5nS3CrY-KaQN4FWg" data-element-type="column" class="zpelem-col zpcol-12 zpcol-md-12 zpcol-sm-12 zpalign-self- "><style type="text/css"></style><div data-element-id="elm_Manv2GUpARXw02tjUwB4OA" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_Manv2GUpARXw02tjUwB4OA"] .zpimage-container figure img { width: 1090px ; height: 466.95px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_Manv2GUpARXw02tjUwB4OA"] .zpimage-container figure img { width:723px ; height:309.73px ; } } @media (max-width: 767px) { [data-element-id="elm_Manv2GUpARXw02tjUwB4OA"] .zpimage-container figure img { width:415px ; height:177.78px ; } } [data-element-id="elm_Manv2GUpARXw02tjUwB4OA"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="center" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-center zpimage-size-fit zpimage-tablet-fallback-fit zpimage-mobile-fallback-fit hb-lightbox " data-lightbox-options="
                type:fullscreen,
                theme:dark"><figure role="none" class="zpimage-data-ref"><span class="zpimage-anchor" role="link" tabindex="0" aria-label="Open Lightbox" style="cursor:pointer;"><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="/Screenshot%202024-04-15%20at%201.56.46%E2%80%AFpm.png" width="415" height="177.78" loading="lazy" size="fit" alt="Bing Copilot’s response for the search phrase “coffee machines”." data-lightbox="true"/></picture></span></figure></div>
</div><div data-element-id="elm_uzBwkqd-f2CsQ0FDnLJgOQ" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_uzBwkqd-f2CsQ0FDnLJgOQ"].zpelem-text { border-radius:1px; } </style><div class="zptext zptext-align-left " data-editor="true"><p style="text-align:center;"><span style="color:inherit;font-size:10px;">Fig 1: Bing Copilot’s response for the search phrase “coffee machines”.</span></p><p style="text-align:center;"></p><p style="text-align:center;"></p><p style="text-align:center;"></p></div>
</div><div data-element-id="elm_lrUa7qVsR7Oe7cHHtvLAAg" data-element-type="text" class="zpelement zpelem-text "><style> [data-element-id="elm_lrUa7qVsR7Oe7cHHtvLAAg"].zpelem-text { border-radius:1px; } </style><div class="zptext zptext-align-center " data-editor="true"><div style="color:inherit;"><p style="font-weight:400;text-indent:0px;text-align:left;">In today's digital marketplace, consumers increasingly rely on AI-driven search tools and chatbots to guide their purchasing decisions. A <a href="https://arxiv.org/pdf/2404.07981.pdf" title="new study" rel="">new study</a> by Aounon Kumar and Himabindu Lakkaraju from Harvard University reveals how these AI systems—specifically Large Language Models—can potentially be manipulated to boost a product's visibility and ranking in recommendations. This has significant implications for fair market competition that business leaders need to be aware of.</p><p style="font-weight:400;text-indent:0px;text-align:left;"></p><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;">Key Findings:</p><ul style="text-align:left;"><li>By strategically inserting an optimized sequence of text into a product's online information page, vendors can substantially increase the likelihood of that product being listed as the top recommendation by an AI language model.</li><li>Even for products that already rank highly, this technique can further boost their chances of securing the #1 recommended spot.</li><li>The strategic text sequences can be made robust to variations in the order products are listed in the AI model's input data. This makes the technique effective across different search scenarios.</li></ul><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;"><span style="font-family:&quot;Oswald&quot;, sans-serif;font-size:16px;">Implications for Businesses</span></p><p style="font-weight:400;text-indent:0px;text-align:left;"></p><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;">Just as search engine optimization (SEO) revolutionized how companies tailor web content to rank higher in Google results, AI search optimization may become the next frontier in digital marketing. Early adopters could gain a major competitive advantage by ensuring their products are prominently featured in AI-generated recommendations.</p><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;">However, the ability to manipulate AI results also raises concerns about fair competition. If exploited at scale, it could lead to a marketplace where product visibility is based more on gaming algorithms than genuine customer value. Lack of transparency around AI search makes it difficult for consumers to recognize biased recommendations.</p><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;">As AI becomes core to e-commerce, new industry standards and regulations will be needed to ensure a level playing field. Companies relying on AI-generated recommendations (either their own or via third-party platforms) will need to invest in safeguards to detect and prevent unfair manipulation by vendors.</p><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;"><span style="font-family:&quot;Oswald&quot;, sans-serif;font-size:16px;">The Way Forward</span></p><p style="font-weight:400;text-indent:0px;text-align:left;"></p><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;">Business leaders should stay informed about emerging AI search capabilities and their potential for both opportunity and misuse in the market. Key priorities include:</p><ul style="text-align:left;"><li>Examining how AI search and chatbots factor into your industry's competitive landscape</li><li>Dedicating resources to understand and properly leverage AI search for your products</li><li>Advocating for transparency and fair competition standards around AI-driven recommendations</li><li>Collaborating with IT to implement manipulation detection for any customer-facing AI tools</li></ul><p style="font-weight:400;text-indent:0px;text-align:left;"><br></p><p style="font-weight:400;text-indent:0px;text-align:left;">The rise of AI search has the power to transform how consumers discover and choose products. It's up to business leaders to proactively shape this technology's role in their market - or risk ceding control to those willing to exploit it for unilateral gain. Careful navigation and proactive governance will be essential to harness AI's potential while preserving an equitable digital marketplace for all.</p></div><p></p></div>
</div><div data-element-id="elm_U9wEt4PmuohwemDZGffO4w" data-element-type="image" class="zpelement zpelem-image "><style> @media (min-width: 992px) { [data-element-id="elm_U9wEt4PmuohwemDZGffO4w"] .zpimage-container figure img { width: 500px ; height: 500.00px ; } } @media (max-width: 991px) and (min-width: 768px) { [data-element-id="elm_U9wEt4PmuohwemDZGffO4w"] .zpimage-container figure img { width:500px ; height:500.00px ; } } @media (max-width: 767px) { [data-element-id="elm_U9wEt4PmuohwemDZGffO4w"] .zpimage-container figure img { width:500px ; height:500.00px ; } } [data-element-id="elm_U9wEt4PmuohwemDZGffO4w"].zpelem-image { border-radius:1px; } </style><div data-caption-color="" data-size-tablet="" data-size-mobile="" data-align="center" data-tablet-image-separate="false" data-mobile-image-separate="false" class="zpimage-container zpimage-align-center zpimage-size-medium zpimage-tablet-fallback-medium zpimage-mobile-fallback-medium "><figure role="none" class="zpimage-data-ref"><a class="zpimage-anchor" href="/responsible-ai-in-the-age-of-generative-models-ai-governance-ethics-and-risk-management" target="" rel=""><picture><img class="zpimage zpimage-style-none zpimage-space-none " src="/Navy%20and%20Blue%20Modern%20We%20Provide%20Business%20Solutions%20Facebook%20Ad%20-1200%20x%201200%20px-.png" width="500" height="500.00" loading="lazy" size="medium"/></picture></a></figure></div>
</div></div></div></div></div></div> ]]></content:encoded><pubDate>Mon, 15 Apr 2024 14:00:36 +1000</pubDate></item></channel></rss>