Jump to content

Community Notes

This is a good article. Click here for more information.
From Wikipedia, the free encyclopedia
(Redirected from Birdwatch (fact checker))

Community Notes
Other namesBirdwatch
Original author(s)Twitter, Inc.
Developer(s)X Corp.
Initial releaseJanuary 25, 2021
Repositoryhttps://github.com/twitter/communitynotes
Written inPython
PlatformX
Type
LicenseApache-2.0 license
Websitehttps://communitynotes.x.com/guide

Community Notes, formerly known as Birdwatch, is a feature on X (formerly Twitter) where contributors can add context such as fact-checks under a post, image or video. It is a community-driven content moderation program, intended to provide helpful and informative context, based on a crowd-sourced system. Notes are applied to potentially misleading content by an algorithm not based on majority rule, but instead agreement from users on different sides of the political spectrum.

The program launched in 2021 and became widespread on X in 2023. Initially shown to U.S. users only, notes were popularized in March 2022 over misinformation in the Russian invasion of Ukraine followed by COVID-19 misinformation in October. Birdwatch was then rebranded to Community Notes and expanded in November 2022. As of November 2023, it had approximately 133,000 contributors; notes reportedly receive tens of millions of views per day, with its goal being to counter propaganda and misinformation. According to Mashable, most users do not see notes correcting such content as of November 2023.[1] In May 2024, a study of COVID-19 vaccine notes were deemed accurate 97% of the time.[2]

Critics have also highlighted how it has spread disinformation, is vulnerable to manipulation, and has been inconsistent in its application of notes, as well as its efforts in combating of misinformation.[a] Elon Musk, the owner of X, considers the program as a gamechanger and having considerable potential. After a post by Musk received a Community Note, he claimed the program had been manipulated by state actors.[3]

History

[edit]
The original logo of Birdwatch

In August 2020, development of Birdwatch was announced, initially described as a moderation tool. Twitter first launched the Birdwatch program in January 2021, intended as a way to debunk misinformation and propaganda, with a pilot program of 1,000 contributors,[4][5] weeks after the January 6 United States Capitol attack.[6] The aim was to "build Birdwatch in the open, and have it shaped by the Twitter community." In November 2021, Twitter updated the Birdwatch moderation tool to limit the visibility of contributors' identities by creating aliases for their accounts, in an attempt to limit bias towards the author of notes.[5][7]

Twitter then expanded access to notes made by the Birdwatch contributors in March 2022, giving a randomized set of US users the ability to view notes attached to tweets and rate them,[8] with a pilot of 10,000 contributors.[9] On average, contributors were noting 43 times a day in 2022 prior to the Russian invasion of Ukraine. This then increased to 156 on the day of the invasion, estimated to be a very small portion of the misleading posts on the platform. By March 1, only 359 of 10,000 contributors had proposed notes in 2022, while a Twitter spokeswoman described plans to scale up the program, with the focus on "ensuring that Birdwatch is something people find helpful and can help inform understanding".[10][11]

By September 2022, the program had expanded to 15,000 users.[12] In October 2022, the most commonly published notes were related to COVID-19 misinformation based on historical usage.[13] In November 2022, at the request of new owner Elon Musk, Birdwatch was rebranded to Community Notes, taking an open-source approach to deal with misinformation,[14] and expanded to Europe and countries outside of the US.[15][16][17]

Community Notes was then extended to include notes on misleading images in May 2023[18] and in September 2023 further extended to videos, but only for a group of power-users referred to as "Top Writers".[19] Twitter subsequently ended the ability to report misleading posts, instead relying exclusively on Community Notes,[20] with contributors proposing over 21,200 notes on the platform.[21]

In October 2023, Elon Musk announced that posts "corrected" by Community Notes would no longer be eligible for ad revenue in order to "maximize the incentive for accuracy over sensationalism" and in order to discourage the spread of misinformation and disinformation on the platform. The move was criticised by some users and applauded by others.[22][23] As of November 2023, it has expanded to over 50 countries, with approximately 133,000 contributors.[24]

Operation

[edit]
Algorithms used by Community Notes, November 17, 2023[25]

The Community Notes algorithm publishes notes based on agreement from contributors who have a history of disagreeing.[17] Rather than based on majority rule,[26] the program's algorithm prioritizes notes that receive ratings from a "diverse range of perspectives".[24] Programmer Vitalik Buterin has described the open-source algorithm as "insanely complicated".[24][27] For a note to be published, a contributor must first propose a note under a tweet.[17] The program assigns different values to contributors' ratings, categorising users with similar rating histories as a form of "opinion classification", determined by a vague alignment with the left and right-wing political spectrum. The machine-learning algorithm requires ratings from both sides of the spectrum in order to publish notes, that can have the intended effect of decreasing interaction with such content.[27][28]

Contributors are volunteers with access to an interface from which they have the ability to monitor tweets and replies that may be misleading.[17][5][29] Notes in need of ratings by contributors are located under a "Needs your help" section of the interface. Other contributors then give their opinion on the usefulness of the note, identifying notes as "Helpful" or "Not Helpful".[17][30] The contributor gets points if their note is validated,[31][17] known as "Rating Impact", that reflects how helpful a contributors' ratings have been.[30][32][33] X users are able to vote on whether they find notes helpful or not,[34] but must apply to become contributors in order to write notes, the latter being restricted by "Rating Impact" as well as the Community Notes guidelines.[30][32]

Application

[edit]
Elon Musk receives a Community Note, November 12, 2022.

Since 2023, Community Notes are often attached to shared articles missing context, misleading advertisements or political tweets with false arguments,[16] from content receiving widespread attention.[35]

Notes have appeared on posts by government accounts and various politicians: the White House,[36][35] the Federal Bureau of Investigation,[37] and U.S. President Joe Biden;[38] UK Prime Ministers Rishi Sunak[39] and Liz Truss;[40] former U.S. speakers of the House[41] and presidential candidates Ron DeSantis and Vivek Ramaswamy;[42] U.S. representatives,[43] senators,[44][45] and Australian ministers;[46] as well as X owner Elon Musk multiple times,[36][44][3][47] that in February 2024 led to Musk arguing with the program.[48]

The feature does not directly mention fact-checking but instead indicates that "readers added context".[31] They can also note when an image is digitally altered or AI-generated.[16][49] X allows contributors to add Community Notes to adverts, which the Financial Times noted was good for consumers but not for advertisers.[31] This resulted in brands such as Apple, Samsung, Uber and Evony receiving notes on their adverts and being accused of false or misleading posts, advertisers deleting certain posts that received notes, as well as modifying content for future advertisements.[21]

A source is attached to the note so the information can be verified, in a similar manner to Wikipedia,[17][16] and notes reportedly received tens of millions of views per day.[6] Elon Musk, the owner of X, considers the program as a "gamechanger for combating wrong information"[34] and having "incredible potential for improving information accuracy".[6] In December 2023, after receiving a note on one of his posts, Musk thanked contributors for "jumping in the honey pot" after stating that the system had been "gamed by state actors", with the intent of detecting so-called bad actors.[3]

In July 2024, as part of a pilot program, X announced the ability for eligible users to request Community Notes for certain posts, that would be directed to "Top Writers" of the software. The threshold of five requests within 24 hours would determine a note being published.[50]

Criticisms and analysis

[edit]

Former head of Twitter's Trust and Safety, Yoel Roth, has since expressed concern over the effectiveness of the system in the early stages of the program, stating that Birdwatch was never supposed to replace the curation team, but instead intended to complement it. Another former employee said it was "an imperfect replacement for Trust and Safety staff". In April 2022, a study presented by MIT researchers subsequently found users overwhelming prioritised political content, even though 80% were correctly considered misleading.[6]

A Community Notes contributor and NAFO member has said it is liable to coordinated manipulation, rife with infighting, and lacks oversight from the platform. Wired noted that in the backend of the database most notes remain unpublished, and that numerous contributors engage in "conspiracy-fueled" discussions.[6] According to Musk, anyone trying to "weaponize Community Notes to demonetize people will be immediately obvious", due to the open-source nature of the code and data.[23]

Regarding the situation in Israel and Gaza, with the difficulty of identifying accurate information and the number of unknown factors, MIT professor David Rand said "what I expect the crowd to produce is a lot of noise", regarding the crowd-sourced system. A contributor otherwise described that the system is "not really scalable for the amount of media that's being consumed or posted in any given day", while X states that the program is having a "significant impact on tackling disinformation on the platform".[6]

Studies and investigations

[edit]
See also: Twitter under Elon Musk § Handling of misinformation and disinformation

In October 2023, Community Notes experienced multi-day delays in publishing notes on misinformation in the 2023 Israel-Hamas war or failed to do so. One study by NBC News found that in the case of a fake White House press release claiming the destruction of the St. Porphyrius Orthodox Church – a week before the destruction – only 8% of posts had notes published, 26% had unpublished notes, while the majority had no proposed notes.[51] Analysis from NewsGuard of 250 of the most-engaged posts, spreading the most common unsubstantiated claims about the Israel-Hamas war and viewed more than 100 million times, failed to receive notes 68% of the time. The report found Community Notes were "inconsistently applied to top myths relating to the conflict."[52] The fact-checking website Snopes discovered three posts from verified users, who had shared a video of a hospitalized man from Gaza with false captions claiming it showed "crisis actors", had failed to receive any Community Notes after 24 hours.[53] Bellingcat found the program spread false information, in reference to Taylor Swift's bodyguard due to misinformation.[26] Wired has documented that Community Notes is susceptible to disinformation, after a graphic Hamas video shared by Donald Trump Jr. was falsely flagged as being a year old, but was instead found to be part of the recent conflict.[54] The original note was later replaced with another citing the report from Wired.[6]

In November 2023, the Atlantic Council conducted an interactive study of Community Notes highlighting how the system operated slowly and inconsistently regarding Israel and Gaza misinformation. In one example, an image originally received a Community Note but continued to spread regardless receiving over 3 million views after a week. Hundreds of viral posts from the notes public database were analyzed and according to researchers fast-moving breaking news wasn't labeled. Across 400 posts of misinformation, a note took on average 7 hours to appear, while others took 70 hours. The analysis however did show that over 50% of the posts received a note within 8 hours, with only a few taking longer than 2 days. The study included 100 tweets from 83 users who had signed up to X Premium in the past 4 months, along with 42 tweets from 25 accounts that were reinstated by Elon Musk, including Laura Loomer. The study also included Jackson Hinkle, who appeared multiple times.[55]

Another NewsGuard report found advertising appearing on 15 posts with Community Notes attached in the week of November 13, 2023, indicating that "misinformation super-spreaders" may still be eligible for ad revenue, despite posts with notes attached being ineligible according to Musk.[56] On November 30, a Mashable investigation found most users never see published notes, with examples of notes seen by less than 1% to 5% of users who viewed misinformation content, and overall, a disproportionate number of views on posts compared to the attached notes.[1]

In May 2024, John W. Ayers, a behavioural scientist from the University of California, San Diego, published a study in the Journal of the American Medical Association based on fact-checking of COVID-19 vaccines. In the sample of 205 Community Notes, according to Ayers and other researches, the information was accurate in 96% of notes, and 87% of sources were of high quality. The lead author, according to Bloomberg UK, stated that only a small percentage of misinformation received a note, while published notes were among the most viral content.[2]

In July 2024, after the attempted assassination of Donald Trump, the Center for Countering Digital Hate published a report that of the 100 most popular conspiratorial posts on X about the shooting, only five Community Notes were published to counter the false claim.[57]

See also

[edit]

Notes

[edit]
  1. ^ Inconsistencies and delays in publishing notes related to the 2023 Israel-Hamas war:
    • Liles, Jordan (November 13, 2023). "'Verified' Users on X Falsely Claim Video of Hospitalized Palestinian Man and Mother Is 'Fake'". Snopes. Retrieved November 17, 2023.
    • Weatherbed, Jess (October 20, 2023). "Blue checkmarks on X are 'superspreaders of misinformation' about Israel-Hamas war". The Verge. Retrieved November 18, 2023.
    • Goggin, Ben (October 10, 2023). "Elon Musk's fact-checking system delayed Israel corrections for days". NBC News. Retrieved November 17, 2023.
    • Alba, Davey; Lu, Denise; Yin, Leon; Fan, Eric (November 21, 2023). "How Musk's X Is Failing To Stem the Surge of Misinformation About Israel and Gaza". Bloomberg.com. Archived from the original on November 21, 2023. Retrieved November 21, 2023.

References

[edit]
  1. ^ a b Binder, Matt (November 30, 2023). "Most users on X never see Community Notes correcting misinformation". Mashable. Archived from the original on December 2, 2023. Retrieved December 2, 2023.
  2. ^ a b Flam, F.D. (May 22, 2024). "Elon Musk's Community Notes Feature on X Is Working". Bloomberg UK. Retrieved June 7, 2024.
  3. ^ a b c "Elon Musk fact-checked on X by his own system - but claims it has been 'gamed by state actors'". Sky News. Archived from the original on December 11, 2023. Retrieved December 11, 2023.
  4. ^ Hollister, Sean (October 4, 2020). "Twitter's 'Birdwatch' looks like a new attempt to root out propaganda and misinformation". The Verge. Archived from the original on November 19, 2023. Retrieved November 19, 2023.
  5. ^ a b c Lyons, Kim (January 25, 2021). "Twitter launches Birdwatch, a fact-checking program intended to fight misinformation". The Verge. Archived from the original on March 24, 2021. Retrieved January 25, 2021.
  6. ^ a b c d e f g Elliott, Vittoria (October 17, 2023). "Elon Musk's Main Tool for Fighting Disinformation on X Is Making the Problem Worse, Insiders Claim". Wired. ISSN 1059-1028. Archived from the original on October 17, 2023. Retrieved November 17, 2023.
  7. ^ Lyons, Kim (November 22, 2021). "Twitter introduces aliases for contributors to its Birdwatch moderation program". The Verge. Archived from the original on November 22, 2021. Retrieved November 22, 2021.
  8. ^ Perez, Sarah (March 3, 2022). "Twitter to show 'Birdwatch' community fact-checks to more users, following criticism". Tech Crunch. Archived from the original on March 3, 2022. Retrieved March 3, 2022.
  9. ^ Sato, Mia (March 3, 2022). "Twitter will start showing crowd-sourced fact checks to some users". The Verge. Retrieved February 28, 2024.
  10. ^ Oremus, Will; Merrill, Jeremy B. (March 2, 2022). "As Ukraine misinformation rages, Twitter's fact-checking tool is a no-show". The Washington Post. Archived from the original on June 4, 2023. Retrieved March 3, 2022.
  11. ^ Godel, William; Sanderson, Zeve; Aslett, Kevin; Nagler, Jonathan; Bonneau, Richard; Persily, Nathaniel; Tucker, Joshua A. (October 28, 2021). "Moderating with the Mob: Evaluating the Efficacy of Real-Time Crowdsourced Fact-Checking". Journal of Online Trust and Safety. 1 (1). doi:10.54501/jots.v1i1.15. ISSN 2770-3142. Archived from the original on November 24, 2023. Retrieved November 25, 2023.
  12. ^ Kelly, Makena (September 7, 2022). "Twitter is expanding its experimental community moderation system". The Verge. Archived from the original on November 19, 2023. Retrieved November 19, 2023.
  13. ^ Faife, Corin (October 10, 2022). "COVID misinfo is the biggest challenge for Twitter's Birdwatch program, data shows". The Verge. Archived from the original on November 19, 2023. Retrieved November 19, 2023.
  14. ^ Sankaran, Vishwam (December 12, 2022). "Twitter's new Community Notes feature lets people add context to tweets". The Independent. Archived from the original on November 18, 2023. Retrieved November 18, 2023.
  15. ^ Biron, Bethany. "Elon Musk said Twitter's Birdwatch feature will be renamed 'Community Notes' and is aimed at 'improving information accuracy' amid growing content-moderation concerns". Business Insider. Archived from the original on November 15, 2022. Retrieved November 15, 2022.
  16. ^ a b c d Baldacchino, Julien (August 10, 2023). "Avec les 'notes de communauté', Twitter (X) marche sur les pas... de Wikipédia". France Inter (in French). Archived from the original on September 2, 2023. Retrieved October 21, 2023.
  17. ^ a b c d e f g Leloup, Damien (July 3, 2023). "I spent one week as an 'arbiter of truth' on Twitter's 'Community Notes' service". Le Monde.fr. Archived from the original on October 22, 2023. Retrieved October 21, 2023.
  18. ^ Sato, Mia (May 30, 2023). "Twitter is adding crowdsourced fact checks to images". The Verge. Archived from the original on November 19, 2023. Retrieved November 19, 2023.
  19. ^ Khalid, Amrita (September 6, 2023). "X's Community Notes feature will now include videos". The Verge. Archived from the original on November 20, 2023. Retrieved November 19, 2023.
  20. ^ Taylor, Josh (September 27, 2023). "X/Twitter scraps feature letting users report misleading information". The Guardian. ISSN 0261-3077. Archived from the original on November 27, 2023. Retrieved November 17, 2023.
  21. ^ a b Coffee, Patrick; Graham, Megan (October 5, 2023). "'This Is a False Advertisement': X Ads Are Being Challenged by Reader Context". The Wall Street Journal. ISSN 0099-9660. Archived from the original on November 18, 2023. Retrieved November 19, 2023.
  22. ^ Roeloffs, Mary Whitfill (October 29, 2023). "Musk: X Users Won't Make Money Off Corrected Tweets". Forbes. Archived from the original on November 17, 2023. Retrieved November 17, 2023.
  23. ^ a b Bellan, Rebecca (October 29, 2023). "Posts with misinformation on X become 'ineligible for revenue share' says Musk". TechCrunch. Archived from the original on November 24, 2023. Retrieved November 24, 2023.
  24. ^ a b c Kenningham, Lucy (November 9, 2023). "Bird watching: What's going on with X/Twitter's Community Notes?". Yahoo Finance. Archived from the original on November 18, 2023. Retrieved November 18, 2023.
  25. ^ "Note ranking algorithm". Community Notes. November 17, 2023. Archived from the original on November 29, 2023. Retrieved November 29, 2023.
  26. ^ a b Bellingcat Investigation Team (October 20, 2023). "X's Community Notes is Spreading False Information About Taylor Swift's Bodyguard". bellingcat. Archived from the original on November 29, 2023. Retrieved November 17, 2023.
  27. ^ a b Fan, Eric; Dottle, Rachael; Wagner, Kurt (December 19, 2022). "Twitter's Fact-Checking System Has a Major Blind Spot: Anything Divisive". Bloomberg. Archived from the original on December 30, 2022. Retrieved December 6, 2023.
  28. ^ Czopek, Madison (June 30, 2023). "Why Twitter's Community Notes feature mostly fails to combat misinformation". Poynter. Archived from the original on November 27, 2023. Retrieved December 6, 2023.
  29. ^ "About Community Notes on X | X Help". help.twitter.com. Archived from the original on November 24, 2023. Retrieved November 17, 2023.
  30. ^ a b c Weatherbed, Jess (December 21, 2022). "Twitter is restricting who can write Community Notes". The Verge. Archived from the original on November 18, 2023. Retrieved November 18, 2023.
  31. ^ a b c Kelly, Jemima (May 4, 2023). "Has Twitter discovered a better way of correcting online falsehoods?". Financial Times. Archived from the original on October 22, 2023. Retrieved October 21, 2023.
  32. ^ a b Perez, Sarah (November 28, 2022). "Twitter says crowdsourced fact-checking system updated to better address 'low quality' contributions". TechCrunch. Archived from the original on November 23, 2023. Retrieved November 18, 2023.
  33. ^ "Rating and Writing Impact". communitynotes.twitter.com. Archived from the original on November 17, 2023. Retrieved November 17, 2023.
  34. ^ a b Sankaran, Vishwam (December 12, 2022). "Twitter's new Community Notes feature lets people add context to tweets". The Independent. Archived from the original on November 18, 2023. Retrieved November 24, 2023.
  35. ^ a b Reimann, Nicholas (November 2, 2022). "White House Deletes Misleading Tweet Giving Biden Credit For Social Security Check Raise". Forbes. Archived from the original on December 5, 2023. Retrieved December 5, 2023.
  36. ^ a b Miller, Carl (November 20, 2022). "Elon Musk Embraces Twitter's Radical Fact-Checking Experiment". Wired. ISSN 1059-1028. Archived from the original on November 20, 2022. Retrieved November 24, 2023.
  37. ^ McHardy, Martha (January 16, 2024). "FBI hit with community note after tweeting praise of Martin Luther King Jr". The Independent. Archived from the original on January 20, 2024. Retrieved January 22, 2024.
  38. ^
  39. ^
  40. ^ Nicholson, Kate (February 26, 2024). "Liz Truss Publicly Corrected By X Users After Disgruntled Attempt To Defend Herself". HuffPost UK. Retrieved February 28, 2024.
  41. ^
  42. ^ Stokel-Walker, Chris (June 13, 2023). "Twitter's Community Notes is the fiercest 2024 primary battleground". The Daily Dot. Archived from the original on June 13, 2023. Retrieved January 22, 2024.
  43. ^
  44. ^ a b Pahwa, Nitish (July 10, 2023). "What I Saw in Elon Musk's Truth Army". Slate. ISSN 1091-2339. Archived from the original on December 5, 2023. Retrieved December 5, 2023.
  45. ^
  46. ^
  47. ^ Writer, Nick Mordowanec Staff (December 15, 2023). "Microsoft Word's warning about using non-inclusive language goes viral". Newsweek. Archived from the original on December 15, 2023. Retrieved December 15, 2023.
  48. ^ Haysom, Sam (February 26, 2024). "Elon Musk is arguing with his own Community Notes on X". Mashable. Retrieved February 28, 2024.
  49. ^ Mehta, Ivan (May 31, 2023). "Twitter launches Community Notes for images". TechCrunch. Archived from the original on December 5, 2023. Retrieved December 5, 2023.
  50. ^ Belanger, Ashley (July 19, 2024). "Elon Musk's X tests letting users request Community Notes on bad posts". Ars Technica. Retrieved July 22, 2024.
  51. ^ Goggin, Ben (October 10, 2023). "Elon Musk's fact-checking system delayed Israel corrections for days". NBC News. Archived from the original on November 23, 2023. Retrieved November 17, 2023.
  52. ^ Weatherbed, Jess (October 20, 2023). "Blue checkmarks on X are 'superspreaders of misinformation' about Israel-Hamas war". The Verge. Archived from the original on October 20, 2023. Retrieved November 18, 2023.
  53. ^ Liles, Jordan (November 13, 2023). "'Verified' Users on X Falsely Claim Video of Hospitalized Palestinian Man and Mother Is 'Fake'". Snopes. Archived from the original on November 28, 2023. Retrieved November 17, 2023.
  54. ^ Gilbert, David. "A Graphic Hamas Video Donald Trump Jr. Shared on X Is Actually Real, Research Confirms". Wired. Archived from the original on October 12, 2023. Retrieved October 12, 2023.
  55. ^ Alba, Davey; Lu, Denise; Yin, Leon; Fan, Eric (November 21, 2023). "How Musk's X Is Failing To Stem the Surge of Misinformation About Israel and Gaza". Bloomberg.com. Archived from the original on November 21, 2023. Retrieved November 21, 2023.
  56. ^ Davis, Wes (November 24, 2023). "Some X 'misinformation super-spreaders' may be eligible for ads payouts". The Verge. Archived from the original on November 26, 2023. Retrieved November 26, 2023.
  57. ^ Fung, Brian (July 17, 2024). "Chaos on social media platforms after Trump shooting is a mess of their own making | CNN Business". CNN. Retrieved July 17, 2024.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Community_Notes&oldid=1240470313"