Cited By
View all- Elsaesser QElkind E(2023)Sources and information reliability measuresProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/815(7081-7082)Online publication date: 19-Aug-2023
S&F: Sources and Facts Reliability Evaluation Method
Pages 2778 - 2780
Abstract
In this work we propose a family of methods that allow to conjointly compute the reliability of a set of information sources and the reliability of the facts on a set of objects in order to find the truth, by confronting the sources points of view. We use a (scoring-based) voting method for the evaluation of the trust of the sources, using Condorcet's Jury Theorem arguments in order to identify the truth and the reliable sources. We provide an experimental study that shows that we perform better than state of the art methods on the task of finding the truth among the possible facts, but we also show that we can, at the same time, adequately evaluate the reliability (trust) of the sources of information.
References
[1]
David Austen-Smith and Jeffrey Banks. 1996. Information Aggregation, Rationality, and the Condorcet Jury Theorem. American Political Science Review, Vol. 90 (1996), 34--45.
[2]
Ruth Ben-Yashar and Jacob Paroush. 2000. A nonasymptotic Condorcet jury theorem. Social Choice and Welfare, Vol. 17, 2 (2000), 189--199.
[3]
Ruth Ben-Yashar and Mor Zahavi. 2011. The Condorcet jury theorem and extension of the franchise with rationally ignorant voters. Public Choice, Vol. 148, 3/4 (2011), 435--443.
[4]
Daniel Berend and Jacob Paroush. 1998. When is Condorcet's Jury Theorem valid? Social Choice and Welfare, Vol. 15, 4 (1998), 481--488.
[5]
Marquis de Condorcet. 1785. Essai sur l'application de l'analyse à la probabilité des décisions rendues à la pluralité des voix. Imprimerie royale Paris.
[6]
Ralph Donaldson, Rosemary Dyer, and Michael Kraus. 1975. An objective evaluator of techniques for predicting severe weather events. In Preprints, Ninth Conference on Severe Local Storms, Norman, Oklahoma, American Meteorological Society, Vol. 321326.
[7]
David Estlund. 1994. Opinion leaders, independence, and Condorcet's Jury Theorem. Theory and Decision, Vol. 36, 2 (1994), 131--162.
[8]
Patricia Everaere, Sébastien Konieczny, and Pierre Marquis. 2010. The epistemic view of belief merging: can we track the truth?. In Nineteenth European Conference on Artificial Intelligence (ECAI'10). 621--626.
[9]
Patrick Hummel. 2010. Jury theorems with multiple alternatives. Social Choice and Welfare, Vol. 34, 1 (2010), 65--103.
[10]
Jon M Kleinberg. 1999. Authoritative sources in a hyperlinked environment. Journal of the ACM (JACM), Vol. 46, 5 (1999), 604--632.
[11]
Christian List and Robert E. Goodin. 2001. Epistemic Democracy: Generalizing the Condorcet Jury Theorem. Journal of Political Philosophy, Vol. 9, 3 (2001), 277--306.
[12]
David L Olson and Dursun Delen. 2008. Advanced data mining techniques. Springer Science & Business Media.
[13]
Guillermo Owen, Bernard Grofman, and Scott L. Feld. 1989. Proving a distribution-free generalization of the Condorcet Jury Theorem. Mathematical Social Sciences, Vol. 17, 1 (1989), 1--16.
[14]
Jeff Pasternack and Dan Roth. 2010. Knowing what to believe (when you already know something). In Proceedings of the 23rd International Conference on Computational Linguistics (COLING 2010). 877--885.
[15]
Bezalel Peleg and Shmuel Zamir. 2012. Extending the Condorcet Jury Theorem to a general dependent jury. Social Choice and Welfare, Vol. 39, 1 (2012), 91--125.
[16]
Joseph Singleton and Richard Booth. 2020. An axiomatic approach to truth discovery. In Autonomous Agents and Multi-Agent Systems (AAMAS'20). 2011--2013.
[17]
Joseph Singleton and Richard Booth. 2022. Towards an axiomatic approach to truth discovery. Journal of Autonomous Agents and Multi-Agent Systems, Vol. 36, 2 (2022), 1--49.
[18]
Xiaoxin Yin, Jiawei Han, and Philip S. Yu. 2008. Truth Discovery with Multiple Conflicting Information Providers on the Web. IEEE Transactions on Knowledge and Data Engineering, Vol. 20, 6 (2008), 796--808.
Index Terms
- S&F: Sources and Facts Reliability Evaluation Method
Recommendations
Reliability generalization of perceived ease of use, perceived usefulness, and behavioral intentions
A reliability generalization study (a meta-analysis of reliability coefficients) was conducted on three widely studied information systems constructs from the technology acceptance model (TAM): perceived ease of use, perceived usefulness, and behavioral ...
Performability analysis method from reliability and availability
ICHIT '09: Proceedings of the 2009 International Conference on Hybrid Information TechnologyAvailability and reliability are important attributes of dependability. Many dependability analysis methodologies measure and predict availability and reliability separately. However, those methodologies cannot reflect real system characteristics since ...
Reliability and sensitivity analysis of the controllable repair system with warm standbys and working breakdown
We investigate the reliability and sensitivity analysis of a controllable repairable system.Warm standbys and working breakdown condition are considered.The explicit expressions for reliability function R Y ( t ) and MTTF are derived.Perform sensitive ...
Comments
Information & Contributors
Information
Published In
May 2023
3131 pages
ISBN:9781450394321
- General Chairs:
- Noa Agmon,
- Bo An,
- Program Chairs:
- Alessandro Ricci,
- William Yeoh
Sponsors
Publisher
International Foundation for Autonomous Agents and Multiagent Systems
Richland, SC
Publication History
Published: 30 May 2023
Check for updates
Author Tags
Qualifiers
- Poster
Conference
AAMAS '23
Sponsor:
AAMAS '23: International Conference on Autonomous Agents and Multiagent Systems
May 29 - June 2, 2023
London, United Kingdom
Acceptance Rates
Overall Acceptance Rate 1,155 of 5,036 submissions, 23%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 22Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Feb 2025
Other Metrics
Citations
Cited By
View all- Elsaesser QElkind E(2023)Sources and information reliability measuresProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/815(7081-7082)Online publication date: 19-Aug-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in