HOAXYbeta

Visualize the spread of claims and fact checking.

FAQ Index
What is Hoaxy?
Hoaxy is a tool that visualizes the spread of articles online. Articles can be found on Twitter, or in a corpus of claims and related fact checking.
What is the difference between Articles search and Twitter search?
There are two search modes. Articles search finds claims and related fact checking in a limited corpus of articles from low-credibility and fact-checking sources, dating back to 2016. This mode leverages the Hoaxy API to retrieve relevant articles, accounts, and tweets. Twitter search lets users track articles from any sources posted on Twitter, but only within the last 7 days. Twitter mode uses the Twitter Search API to retrieve relevant, popular, or mixed tweets matching your search query. It is compatible with all advanced search operators. At most, Hoaxy is capable of visualizing the top 1000 accounts and in the case of a Twitter search, this will be the most recently active 1000 accounts if sorted by Recent.
How does Articles search work?
The Hoaxy corpus tracks the social sharing of links to stories published by two types of websites: (1) Low-credibility sources that often publish inaccurate, unverified, or satirical claims according to lists compiled and published by reputable news and fact-checking organizations. (2) Independent fact-checking organizations, such as snopes.com, politifact.com, and factcheck.org, that routinely fact check unverified claims.
Twitter mode uses the Twitter Search API to retrieve relevant, popular, or mixed tweets matching your search query. It is compatible with all advanced search operators. For example, instead of puppy you could search for puppy OR kitten or puppy filter:media.
What is a “claim”? Who decides what is true or not?
We do not decide what is true or false. Low-credibility sources often publish false news, hoaxes, rumors, conspiracy theories, and satire, but may also publish accurate reports. Therefore not all claims you can visualize on Hoaxy are false, nor can we track all false stories. We aren’t even saying that the fact checkers are 100% correct all the time. You can use the Hoaxy tool to observe how unverified stories and the fact checking of those stories spread on public social media. We welcome users to click on links to fact-checking sites to see what they’ve found in their research, but it’s up to you to evaluate the evidence about a claim and its rebuttals.
Do you have an editorial team?
No. Hoaxy tracks claims and fact checks automatically, 24/7. We do not read the contents of the articles we track. This is why we cannot establish whether a claim is accurate, nor whether a particular claim was verified by a particular fact check.
What does the visualization show?
Hoaxy visualizes two aspects of the spread of claims and fact checking: temporal trends and diffusion networks. Temporal trends plot the cumulative number of Twitter shares over time. The user can zoom in on any time interval. Diffusion networks display how claims spread from person to person. Each node is a Twitter account and two nodes are connected if a link to a story is passed between those two accounts via retweets, replies, quotes, or mentions. The color of a connection indicates the type of information: claims and fact checks. Clicking on an edge reveals the tweet(s) and the link to the shared story; clicking on a node reveals claims shared by the corresponding user. The network may be pruned for performance.
What is the bot score and how is it calculated?
One can think of the bot score as the likely level of automation of an account, where a 5 may indicate a large amount of automation, and 0 may indicate little to no automation. Bot scores are calculated using a machine learning algorithm trained to classify the level of automation an account presents. More information about this topic can be found in the Botometer FAQ.
What if I see some bot scores that are wrong? How can I help?
Social bot detection is a hard problem. We are constantly improving our tool’s accuracy, but there will be accounts that our tool fails to classify. You can assist us in making more accurate classifications. You might recognize your own account. Or you might have information that allows you to recognize some other account as most likely human or bot. In these cases, you can provide feedback on those accounts. Do this by clicking on the account (node) and then the Feedback button. Feedback helps us better distinguish between humans, bots, and everything in between, so your help is greatly appreciated.
What are Trending News, Popular Claims, and Fact-Checks in the landing page panel?
The landing page panel provides shortcuts to search for new and relevant articles. Trending News are top and breaking headlines for the United States. Popular Claims are the articles from low-credibility sources most tweeted in the last month. Similarly, Popular Fact-Checks are the most tweeted articles in the last month published by fact-checking organizations.
How do you match claims to fact-checks?
We use search engine technology (think of Google) to retrieve claims and fact checks. The user enters a query and we match it against our index of claims to find relevant articles. We perform the same procedure to find fact checks matching the query. The user can select claims and fact-checking articles to be visualized.
How does Hoaxy track the spread of articles?
We collect public tweets that include links to stories. We then fetch the page linked in the tweet and store the URL and the text of the page of the article, adding them to our corpus together with the tweet. When the user submits a query in Articles search mode, we match the most relevant or recent articles (claims and fact checks) and select all the tweets that linked to them.
What is the source of social media data?
At the moment we only collect data from Twitter.
How do I add a Hoaxy story to my own website?
Click the “Embed” button at the bottom of the middle navigation menu. Then, copy the code in the popup and paste it into the body of your site’s html code or in the platform you are using as directed by that platform. What will be visible on your site or platform is a widget that should look similar to the one in the popup.
Can I download the results of a story on my own computer?
Yes! Click the “Export” button, found at the bottom of the middle navigation menu. This should download or ask you permission to download a comma separated values (CSV) file. Each row in the file represents a connection in the visualization and can be thought of as a tweet. The columns correspond to the features of the tweet, e.g., who posted it, who was mentioned, when the tweet was published, etc.
Can I import my own data into Hoaxy's Visualization tool?
Yes! Instead of searching for a specific query, click the "Or Import Data" button next to the "Search" button at the top of the Hoaxy home page. From there, you can upload a CSV or JSON file containing Tweet information. This works best with data exported directly from a previous Hoaxy query, however, correctly formatted files can be used regarless of source.
When importing files, what format does the data need to be in?
Hoaxy can visualize CSV and JSON files as long as the data is formatted correctly. While this works best with data exported directly from a Hoaxy query, any data using the columns or field names found in the exported files should work.
Do you access any private conversations?
No, we only access public tweets.
Do you provide an API to the data you collect?
Yes, check out the free Hoaxy API available on Rapid API.
Can I cite Hoaxy in my work?
Yes, if you use Hoaxy for your work then please cite the following articles:

[1] Chengcheng Shao, Pik-Mai Hui, Lei Wang, Xinwen Jiang, Alessandro Flammini, Filippo Menczer, Giovanni Luca Ciampaglia (2018). Anatomy of an online misinformation network. PLOS ONE, e0196087. https://doi.org/10.1371/journal.pone.0196087

[2] Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Kaicheng Yang, Alessandro Flammini, and Filippo Menczer (2018). The spread of low-credibility content by social bots. Nature Communications, 9:4787. https://doi.org/10.1038/s41467-018-06930-7

[3] Chengcheng Shao, Giovanni Luca Ciampaglia, Alessandro Flammini, and Filippo Menczer (2016). Hoaxy: A Platform for Tracking Online Misinformation. In Proceedings of the 25th International Conference Companion on World Wide Web (WWW '16 Companion), pp. 745-750. http://doi.org/10.1145/2872518.2890098

What technology does Hoaxy use?
Hoaxy is written primarily in Python. On the back-end we use Apache Lucene (for full-text indexing and retrieval), Scrapy (for web crawling), Apache Tika (for metadata extraction), RSS (for feed aggregation), PostgreSQL (for data indexing and storage), and SQLAlchemy (for object-relational mapping). On the front-end we use Javascript, Bootstrap, NV.D3 (for the chart), and Sigma-js (for the network). We collect data from Twitter using the Filter API. Top trending articles in the dashboard of the landing page are powered by the News API.
Is Hoaxy open source?
Yes. This makes it possible for colleagues, fact checkers, and reporters around the world to deploy versions of the tool to map the spread of claims from their own sources, in their own countries and languages. The code is available in two repositories: a backend and a frontend. Please contact us to let us know if you are using our code.
Why am I asked to log in using my Twitter account?
To retrieve search results from the Twitter API on your behalf. We also seek your permission to connect to the Twitter API if you want to refresh the bot scores in the visualization. This is needed to fetch the data needed to recompute the scores on your behalf. We do not store your Twitter personal information, nor do we use any permissions or data to do anything beyond what is necessary to provide the Hoaxy service. More information can be found on the Botometer FAQ.
Who are the Hoaxy developers?
Hoaxy is a joint project of the Indiana University Network Science Institute (IUNI) and the Center for Complex Networks and Systems Research (CNetS). Filippo Menczer, Alessandro Flammini, and Giovanni Luca Ciampaglia coordinate the project. Other past or current team members include Chengcheng Shao, Mihai Avram, Ben Serrette, Valentin Pentchev, Lei Wang, Gregory Maus, Liang Chen, Onur Varol, Clayton Davis, Kaicheng Yang, Chathuri Peli Kankanamalage, and Marc McCarty. We are members of the of First Draft Academic Partner Network. The project is supported by a Knight Prototype grant from the Democracy Fund.
How can I contact the Hoaxy team?
The best way to contact the team is by using the contact information found at the OSoMe website. You can also tweet us at @OSoMe_IU but we cannot promise to monitor Twitter at all times.