Thursday 13 March 2025
The quest for trustworthy online news sources has never been more pressing. With the proliferation of misinformation and disinformation, it’s become increasingly difficult to discern fact from fiction. That’s why a new tool, TROPIC, aims to streamline the process of evaluating online publishers’ trustworthiness.
TROPIC, short for Trustworthiness Rating of Online Publishers through online Interactions Calculation, is an interactive web interface designed to help organizations specializing in news evaluation assess the credibility of online news sources. The system analyzes social media interactions between news producers and consumers to predict a publisher’s trustworthiness score.
The tool works by first building News Engagement Communities (NECs), which are groups of news articles that have received the most attention from discussion participants on social media platforms. TROPIC then profiles users who share content related to these NECs, estimating their propensity to share low-quality information.
By leveraging this data, TROPIC calculates a trustworthiness score for each publisher not already evaluated by manual annotations. The system takes into account various factors, including the number of voters, news URLs shared within NECs, and user engagement levels.
The user interface is designed to guide users in selecting which publishers to annotate manually, prioritizing those with lower confidence levels or high IR-related metrics. This allows organizations to focus their efforts on improving the accuracy of trustworthiness scores for less reliable sources.
TROPIC’s architecture consists of separate components for edge list processing, NEC extraction, and voter profiling. The system is containerized using Docker and built with Angular and FastAPI frameworks.
While TROPIC isn’t a panacea for the complex issue of online misinformation, it represents a significant step forward in automating the process of evaluating news sources’ trustworthiness. By streamlining the annotation process, TROPIC can help organizations like NewsGuard and Mediabias Fact Check expand their coverage of online news publishers.
The tool’s potential applications extend beyond news evaluation, too. With TROPIC, social media platforms could leverage its capabilities to improve user experience by surfacing more trustworthy content in their search results or recommendation algorithms.
As the digital landscape continues to evolve, the need for reliable methods to assess online information will only grow more pressing. TROPIC’s innovative approach to trustworthiness evaluation holds promise as a valuable tool in this ongoing effort.
Cite this article: “Evaluating Online News Sources with TROPIC: A Trustworthiness Rating Tool”, The Science Archive, 2025.
Trustworthiness, Online News, Misinformation, Disinformation, Tropic, Social Media, News Evaluation, Fact-Checking, News Sources, Credibility
