Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Refuting Learning Revisited

  • Conference paper
  • First Online:
Algorithmic Learning Theory (ALT 2001)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2225))

Included in the following conference series:

Abstract

We consider, within the framework of inductive inference, the concept of refuting learning as introduced by Mukouchi and Arikawa, where the learner is not only required to learn all concepts in a given class but also has to explicitly refute concepts outside the class.

In the first part of the paper, we consider learning from text and introduce a concept of limit-refuting learning that is intermediate between refuting learning and reliable learning. We give characterizations for these concepts and show some results about their relative strength and their relation to confident learning.

In the second part of the paper we consider learning from texts that for some k contain all positive Πk-formulae that are valid in the standard structure determined by the set to be learned. In this model, the following results can be shown. For the language with successor, any countable axiomatizable class can be limit-refuting learned from Π1-texts. For the language with successor and order, any countable axiomatizable class can be reliably learned from Π1-texts and can be limit-refuting learned from Π2-texts, whereas the axiomatizable class of all finite sets cannot be limit-refuting learned from Π1-texts. For the full language of arithmetic, which contains in addition plus and times, for any k there is an axiomatizable class that can be limit-refuting learned from Πk+1-texts but not from Πk-texts. A similar result with k+3 in place of k+1 holds with respect to the language of Presburger’s arithmetic.

Supported by the Deutsche Forschungsgemeinschaft (DFG) under the Heisenberg grant Ste 967/1-1

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Leonard M. Adleman and Manuel Blum: Inductive inference and unsolvability. The Journal of Symbolic Logic, 56:891–900, 1991.

    Article  MathSciNet  Google Scholar 

  2. J. Richard Büchi: On a decision method in restricted second order arithmetic. Proceedings of the International Congress on Logic, Methodology and Philosophy of Science, Standford University Press, Standford, California, 1960.

    Google Scholar 

  3. Heinz-Dieter Ebbinghaus, Jörg Flum and Wolfgang Thomas: Mathematical Logic, Springer, 1994.

    Google Scholar 

  4. William I. Gasarch, Mark G. Pleszkoch and Robert Solovay: Learning via queries in [+,<]. The Journal of Symbolic Logic, 57:53–81, 1992.

    Article  MathSciNet  Google Scholar 

  5. William I. Gasarch and Carl H. Smith: Learning via queries, Journal of the Association of Computing Machinery, 39:649–674, 1992.

    Article  MathSciNet  Google Scholar 

  6. Clark Glymour: Inductive Inference in the limit. Erkenntnis 22:23–31, 1985.

    Article  Google Scholar 

  7. E. Mark Gold: Language identification in the limit. Information and Control, 10: 447–474, 1967.

    Article  MathSciNet  Google Scholar 

  8. Gunter Grieser: Reflexion in der Induktiven Inferenz. Diploma Thesis, Technische Hochschule Leipzig, 1996.

    Google Scholar 

  9. Gunter Grieser: Reflecting Inductive Inference Machines and its Improvement by Therapy. Seventh Annual International Workshop on Algorithmic Learning Theory (ALT), Lecture Notes in Artificial Intelligence 1160:325–336, Springer, 1996.

    Google Scholar 

  10. Sanjay Jain: Learning with refutation. Journal of Computer and Systems Sciences, 57:356–365, 1998.

    Article  MathSciNet  Google Scholar 

  11. Sanjay Jain, Efim Kinber, Rolf Wiehagen, Thomas Zeugmann: On learning of functions refutably, Theoretical Computer Science, to appear.

    Google Scholar 

  12. Sanjay Jain, Daniel Osherson, James Royer and Arun Sharma: Systems that Learn, revised edition of [25]. The MIT Press, Cambridge, Massachusetts, 1999.

    Google Scholar 

  13. Sanjay Jain and Arun Sharma: Elementary formal systems, intrinsic complexity and procrastination. Information and Computation, 132:65–84, 1997.

    Article  MathSciNet  Google Scholar 

  14. Klaus-Peter Jantke: Reflecting and self-confident inductive inference machines. Sixth Annual International Workshop on Algorithmic Learning Theory (ALT), Lecture Notes in Artificial Intelligence 997:282–297, Springer, 1995.

    Google Scholar 

  15. Kevin T. Kelly: The Logic of Reliable Inquiry. Oxford University Press, New York, 1996.

    MATH  Google Scholar 

  16. Kevin T. Kelly and Clark Glymour: Inductive inference from theory-laden data. Journal of Philosophical Logic, 21:391–444, 1992.

    Article  MathSciNet  Google Scholar 

  17. Steffen Lange and Phil Watson: Machine discovery in the presence of incomplete or ambiguous data. Joint Proceedings of the Fourth International Workshop on Analogical and Inductive Inference (AII) and of the Fifth Workshop on Algorithmic Learning Theory (ALT), Lecture Notes in Artificial Intelligence 872:438–452, Springer, 1994.

    Google Scholar 

  18. Eric Martin and Daniel N. Osherson: Scientific discovery based on belief revision. The Journal of Symbolic Logic, 62:1352–1370, 1997.

    Article  MathSciNet  Google Scholar 

  19. Eric Martin and Daniel N. Osherson: Elements of Scientific Inquiry. The MIT Press, Cambridge, Massachusetts, 1998.

    MATH  Google Scholar 

  20. Eric Martin, Arun Sharma and Frank Stephan: Learning Power and Language Expressiveness. Forschungsbericht Mathematische Logik 49, Mathematisches Institut, Universität Heidelberg, Heidelberg, 2000.

    Google Scholar 

  21. Eliana Minicozzi. Some natural properties of strong-identification in inductive inference. Theoretical Computer Science, 2:345–360, 1976.

    Article  MathSciNet  Google Scholar 

  22. Yasuhito Mukouchi and Setsuo Arikawa: Inductive inference machines that can refute hypothesis spaces. Fourth Annual International Workshop on Algorithmic Learning Theory (ALT), Lecture Notes in Artificial Intelligence 744:123–136, Springer, 1993.

    Google Scholar 

  23. Yasuhito Mukouchi and Setsuo Arikawa: Towards a mathematical theory of machine discovery from facts. Theoretical Computer Science, 137:53–84, 1995.

    Article  MathSciNet  Google Scholar 

  24. Piergiorgio Odifreddi: Classical Recursion Theory, Volumes I and II. North Holland and Elsevier, Amsterdam, 1989 and 1999.

    Google Scholar 

  25. Daniel Osherson, Michael Stob and Scott Weinstein: Systems That Learn. An Introduction to Learning Theory for Cognitive and Computer Scientists. Bradford — The MIT Press, Cambridge, Massachusetts, 1986.

    Google Scholar 

  26. Mojzesz Presburger: Über die Vollständigkeit eines gewissen Systems der Arithmetik der ganzen Zahlen in welchem die Addition als einzige Operation hervortritt. C. R. 1 erCongrès des Mathématiciens des Pays Slaves (Warsaw) 92–101, 395, 1930.

    Google Scholar 

  27. Hilary Putnam: Decidability and essential undecidability. The Journal of Symbolic Logic, 22:39–54, 1957.

    Article  MathSciNet  Google Scholar 

  28. Takeshi Shinohara: Inductive inference of monotonic formal systems from positive data. New Generation Computing, 8:371–384, 1991.

    Article  Google Scholar 

  29. Craig Smoryński: Logical Number Theory I. An Introduction. Springer, 1991.

    Google Scholar 

  30. Robert I. Soare: Recursively Enumerable Sets and Degrees. A Study of Computable Functions and Computably Generated Sets. Springer, 1987.

    Google Scholar 

  31. Wolfgang Thomas: Automata on Infinite Objects. Handbookof Theoretical Computer Science, Vol. B, edited by Jan van Leeuwen, p. 133–191, Elsevier, Amsterdam, 1990.

    Google Scholar 

  32. Wolfgang Thomas: Classifying regular events in symbolic logic, Journal of Computer and System Sciences, 25:360–376, 1982.

    Article  MathSciNet  Google Scholar 

  33. Thomas Wilke: Locally threshold testable languages of infinite words. Tenth Annual Symposium on Theoretical Aspects of Computer Science (STACS), Lecture Notes in Computer Science 665:607–616, Springer, 1993.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Merkle, W., Stephan, F. (2001). Refuting Learning Revisited. In: Abe, N., Khardon, R., Zeugmann, T. (eds) Algorithmic Learning Theory. ALT 2001. Lecture Notes in Computer Science(), vol 2225. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45583-3_23

Download citation

  • DOI: https://doi.org/10.1007/3-540-45583-3_23

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42875-6

  • Online ISBN: 978-3-540-45583-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics