<div dir="ltr"><div>Didn't have a chance to check out the study in detail, Indeed, really problematic evaluation of it. <br></div><div><br></div><div>That was detailed in the original article through which I found the one I sent you all and didn't read through because I got pulled into the MIT press release. </div><div><br></div><div>Here is that broader article...
<a href="https://www.post-gazette.com/news/health/2024/06/22/online-misinformation-tools/stories/202406230019">https://www.post-gazette.com/news/health/2024/06/22/online-misinformation-tools/stories/202406230019</a> </div><div><br></div><div>it gets into the many downsides but also discusses this: <br></div><div>
<p>"Althoff and fellow researchers Xinyi Zhou, Ashish Sharma and Amy
Zhang created a program similar to Trustnet but with an emphasis on
using AI to detect misinformation. Althoff said it’s complementary to
Trustnet.</p>
<p>Called MUSE, the tool detected misinformation and provided accurate
corrections to online statements better than ChatGTP 4 and the highest
rated fact checkers on Community Notes. <a href="https://arxiv.org/pdf/2403.11169" target="_blank">An academic paper on MUSE</a> is currently under review for publication, said Althoff."</p><p>MUSE supposedly outperforms ChatGPT and humans but based on my quick skim, also a relatively small n evaluation.<br></p>Rich <br></div><div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div><div><div><div>_________________________________________________<br></div>Richard M. Carpiano, PhD, MPH<br></div>Professor of Public Policy</div><div>Faculty Director, Science to Policy (S2P)<br></div>University of California, Riverside<br></div><div>School of Public Policy<br></div><div>900 University Avenue<br></div><div>Riverside, California 92521 USA<br></div><div><br></div><div>Office: 4157 Interdisciplinary South<br></div><div>Phone: 951-827-5405<br></div>E-mail: <a href="mailto:richard.carpiano@ucr.edu" target="_blank">richard.carpiano@ucr.edu</a><br>Website: <a href="https://profiles.ucr.edu/app/home/profile/rcarpian" target="_blank">https://profiles.ucr.edu/app/home/profile/rcarpian</a><br></div>X (Twitter): <a href="http://www.twitter.com/RMCarpiano" target="_blank">https://www.twitter.com/RMCarpiano</a></div><div>Bluesky: <a href="https://bsky.app/profile/rmcarpiano.bsky.social" target="_blank">https://bsky.app/profile/rmcarpiano.bsky.social</a></div><div>LinkedIn: <a href="https://www.linkedin.com/in/richard-m-carpiano-36261b30b" target="_blank">https://www.linkedin.com/in/richard-m-carpiano-36261b30b</a><br></div></div></div></div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Jun 23, 2024 at 7:04 AM Kevin M Esterling via LOGOS <<a href="mailto:logos@lists.ucr.edu">logos@lists.ucr.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg2854045077609716640">
<div dir="ltr">
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
This is indeed an interesting project, but not for the reasons that the PI intended. Instead, there doesn't seem to be any communication theory or design principles that would ensure the extension is measuring misinformation, which is what they intend. Just
wishing users will label misinformation does not mean that is what they will do, but instead they will certainly tend to label content they don't like, and then those biases will propagate to the echo chamber of their "trusted" friends. And then their validation
study had an N of 32 labeling a total of 64 items. It really is amazing to me what MIT folks can get away with....</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif;font-size:11pt;color:rgb(0,0,0)">
<br>
</div>
<div id="m_2854045077609716640Signature">
<div style="font-size:12pt;color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif" dir="ltr" id="m_2854045077609716640divtagdefaultwrapper">
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
Kevin M. Esterling (he/him)</div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
Professor of Public Policy and Political Science</div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
Director, Laboratory for Technology, Communication and Democracy (TeCD-Lab)</div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
<a href="https://tecd-lab.ucr.edu/" style="margin:0px" target="_blank">https://tecd-lab.ucr.edu/</a></div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
UC Riverside</div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
Riverside, CA 92521<br>
951-827-5591</div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
<a href="https://profiles.ucr.edu/kevin.esterling" style="margin:0px" target="_blank">https://profiles.ucr.edu/kevin.esterling</a></div>
<div style="text-align:left;text-indent:0px;margin:0px;font-family:Tahoma;font-size:13px;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Tahoma;font-size:13px;color:rgb(0,0,0)"><br>
<a href="https://www.nature.com/articles/s41586-024-07524-8" title="https://www.nature.com/articles/s41586-024-07524-8" target="_blank">What happened when Twitter deplatformed 70,000 misinformation traffickers?</a></div>
<div style="font-family:Tahoma;font-size:13px"><br>
</div>
<div style="font-family:Tahoma;font-size:13px"><br>
</div>
</div>
</div>
<div id="m_2854045077609716640appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="m_2854045077609716640divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> LOGOS <<a href="mailto:logos-bounces@lists.ucr.edu" target="_blank">logos-bounces@lists.ucr.edu</a>> on behalf of Richard Carpiano via LOGOS <<a href="mailto:logos@lists.ucr.edu" target="_blank">logos@lists.ucr.edu</a>><br>
<b>Sent:</b> Sunday, June 23, 2024 4:20 AM<br>
<b>To:</b> Logos Listserv (BCOE) <<a href="mailto:logos@lists.ucr.edu" target="_blank">logos@lists.ucr.edu</a>><br>
<b>Subject:</b> [LOGOS] Trustnet</font>
<div> </div>
</div>
<div>
<div dir="auto">
<div>Perhaps of interest... Rich</div>
<div dir="auto"><br>
</div>
<div dir="auto">Trustnet: A new web browser extension to help identify misinformation for the average person...</div>
<div dir="auto"><br>
</div>
<div dir="auto"><a href="https://news.mit.edu/2024/new-tool-trustnet-empowers-users-to-fight-online-misinformation-0516" target="_blank">https://news.mit.edu/2024/new-tool-trustnet-empowers-users-to-fight-online-misinformation-0516</a><br>
</div>
<div><br>
</div>
<div>_____________________________________<br>
Richard M. Carpiano, Ph.D., M.P.H.<br>
Professor of Public Policy<br>
Faculty Director, Science to Policy (S2P)<br>
University of California, Riverside<br>
School of Public Policy<br>
900 University Avenue<br>
Riverside, California USA 92521<br>
<br>
Office: 4157 Interdisciplinary South<br>
Phone: 951.827.5405<br>
Fax: 951.827.2303<br>
E-mail: <a href="mailto:richard.carpiano@ucr.edu" target="_blank">richard.carpiano@ucr.edu</a><br>
Website: <a href="https://profiles.ucr.edu/app/home/profile/rcarpian" target="_blank">https://profiles.ucr.edu/app/home/profile/rcarpian</a><br>
X (Twitter): <a href="https://www.twitter.com/RMCarpiano" target="_blank">https://www.twitter.com/RMCarpiano</a><br>
Bluesky: <a href="https://bsky.app/profile/RMCarpiano.bsky.social" target="_blank">https://bsky.app/profile/RMCarpiano.bsky.social</a><br>
LinkedIn: <a href="https://www.linkedIn.com/in/richard-m-carpiano-36261b30b" target="_blank">https://www.linkedIn.com/in/richard-m-carpiano-36261b30b</a></div>
</div>
</div>
</div>
_______________________________________________<br>
LOGOS mailing list<br>
<a href="mailto:LOGOS@lists.ucr.edu" target="_blank">LOGOS@lists.ucr.edu</a><br>
<a href="https://lists.ucr.edu/mailman/listinfo/logos" rel="noreferrer" target="_blank">https://lists.ucr.edu/mailman/listinfo/logos</a><br>
</div></blockquote></div>