The World Wide Web and social media platforms have become popular sources for news and information. Typically, multimodal information, e.g., image and text is used to convey information more effectively and to attract attention. While in most cases image content is decorative or depicts additional information, it has also been leveraged to spread misinformation and rumors in recent years. In this paper, we present a Web-based demo application that automatically quantifies the cross-modal relations of entities (persons, locations, and events) in image and text. The applications are manifold. For example, the system can help users to explore multimodal articles more efficiently, or can assist human assessors and fact-checking efforts in the verification of the credibility of news stories, tweets, or other multimodal documents.

翻译：万维网和社交媒体平台已成为新闻和信息的流行来源,通常多式信息,例如图像和文字被用来更有效地传递信息和吸引注意,虽然在多数情况下,图像内容是装饰性的或描述更多的信息,但近年来也被用来传播错误信息和谣言,在本文中,我们提出了一个基于网络的演示应用程序,自动量化图像和文字中实体(人、地点和事件)的跨模式关系,应用程序是多方面的,例如,该系统可以帮助用户更有效地探讨多式文章,或者协助人类评估员和事实核查工作,核查新闻报道、推文或其他多式文件的可信度。