An Introduction To LEX and YACC: SYSC-3101 1

An Introduction to LEX and YACC
SYSC-3101
Programming Languages
CONTENTS
CONTENTS
Contents
1 General Structure 2 Lex - A lexical analyzer 3 Yacc - Yet another compiler compiler 4 Main Program 3 4 10 17
SYSC-3101
1 GENERAL STRUCTURE
General Structure
Program will consist of three parts: 1. lexical analyzer: scan.l 2. parser: gram.y 3. Everything else: main.c
SYSC-3101
2 LEX - A LEXICAL ANALYZER
2
%{ /* }% /* %% /* %% /*
Lex - A lexical analyzer

C includes */ Definitions */ Rules */ user subroutines */ Figure 1: Lex program structure
SYSC-3101
Lex Denitions
Lex Denitions
Table with two columns: 1. regular expressions 2. actions ie: integer printf("found keyword INT");
If action has more than one statement, enclose it within {}
SYSC-3101
Regular Expressions
Regular Expressions
text characters: a - z, 0 - 9, space... \n : newline. \t : tab. operators: " \ [ ] - ? . * + | ( ) $ / { } % < > "..." : treat ... as text characters (useful for spaces). \ : treat next character as text character. . : match anything.
SYSC-3101
Regular Expressions
operators (cont): [...] : match anything within [] ? : match zero or one time, eg: ab?c ac, abc * : match zero or more times, eg: ab*c ac, abc, abbc... + : match one or more times, eg: ab+c abc, abbc... (...) : group ..., eg: (ab)+ ab, abab... | : alternation, eg ab|cd ab, cd {n,m} : repitition, eg a{1,3} a, aa, aaa {defn} : substitute defn (from rst section).
SYSC-3101
Actions
Actions
; Null action. ECHO; printf("%s", yytext); {...} Multi-statement action. return yytext; send contents of yytext to the parser. yytext : C-String of matched characters (Make a copy if neccessary!) yylen : Length of the matched characters.
SYSC-3101
Actions
Figure 2: LEX Template

%{ /* -*- c -*- */ #include <stdio.h> #include "gram.tab.h" %} extern YYSTYPE yylval; %% [0-9] { yylval.anInt = atoi((char *)&yytext[0]); return INTEGER; } . %% return *yytext;
SYSC-3101
3 YACC - YET ANOTHER COMPILER COMPILER
3
%{ /* }% /* %% /* %% /*
Yacc - Yet another compiler compiler

C includes */ Other Declarations */ Rules */ user subroutines */ Figure 3: Yacc program structure
SYSC-3101
10
YACC Rules
YACC Rules
A grammar rule has the following form: A : BODY ; A is a non-terminal name (LHS). BODY consists of names, literals, and actions. (RHS) literals are enclosed in quotes, eg: + \n newline. \ single quote.
SYSC-3101
11
YACC Rules
The rules: A : B ; A : C D ; A : E F G ; can be specied as: A : B | C D | E F G ;
SYSC-3101
12
YACC Rules
Names representing tokens must be declared; this is most simply done by writing %token name1 name2 . . .
Dene name1, name2,... in the declarations section. Every name not dened in the declarations section is assumed to represent a nonterminal symbol. Every nonterminal symbol must appear on the left side of at least one rule.
SYSC-3101
13
Actions
Actions
the user may associate actions to be performed each time the rule is recognized in the input process, eg: XXX : YYY ZZZ { printf("a message\n"); } ; $ is special! $n $$ psuedo-variables which refer to the values returned by the components of the right hand side of the rules. The value returned by the left-hand side of a rule. expr ) { $$ = $2 ; }
expr : (
Default return type is integer. SYSC-3101 14

Declarations
Declarations
%token : declares ALL terminals which are not literals. %type : declares return value type for non-terminals. %union : declares other return types. the type typedef union { body of union ... } YYSTYPE; is generated and must be included into the lex source so that types can be associated with tokens.
SYSC-3101
15
Declarations
Figure 4: YACC Template

%{ #include <stdio.h> %} %token <anInt> INTEGER %type <anInt> S E %union { int anInt; } %% S : E { printf( "Result is %d\n", $1 ); } ; %% yyerror( char * s ) { fprintf( stderr, "%s\n", s ); }
SYSC-3101
16
4 MAIN PROGRAM
Main Program
Figure 5: Main template
#include <stdio.h> #include <stdlib.h> extern int yyerror(), yylex(); #define YYDEBUG 1 #include "gram.tab.c" #include "lex.yy.c" main() { /* yydebug = 1; */ yyparse(); }
SYSC-3101
17
4 MAIN PROGRAM
Figure 6: Running the example

Microsoft Windows XP [Version 5.1.2600] (C) Copyright 1985-2001 Microsoft Corp. C:\DJGPP\etc\SYSC-31>bison -d gram.y C:\DJGPP\etc\SYSC-31>flex scan.l C:\DJGPP\etc\SYSC-31>gcc main.c C:\DJGPP\etc\SYSC-31>echo 1 + 2 | a.exe Result is 3 C:\DJGPP\etc\SYSC-31>
SYSC-3101
18
4 MAIN PROGRAM
Figure 7: Running the example using Visual C++

Microsoft Windows XP [Version 5.1.2600] (C) Copyright 1985-2001 Microsoft Corp. E:\YaccLex>bison -d gram.y E:\YaccLex>flex scan.l
E:\YaccLex>cl main.c Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 12.00.88 Copyright (C) Microsoft Corp 1984-1998. All rights reserved. E:\YaccLex>main.exe 2 + 1 Result is 3
SYSC-3101
19

An Introduction To LEX and YACC: SYSC-3101 1

Uploaded by

Copyright:

Available Formats

An Introduction To LEX and YACC: SYSC-3101 1

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

An Introduction To LEX and YACC: SYSC-3101 1

Uploaded by

Copyright:

Available Formats

An Introduction to LEX and YACC

2 LEX - A LEXICAL ANALYZER

Lex - A lexical analyzer

2 LEX - A LEXICAL ANALYZER

If action has more than one statement, enclose it within {}

2 LEX - A LEXICAL ANALYZER

2 LEX - A LEXICAL ANALYZER

2 LEX - A LEXICAL ANALYZER

2 LEX - A LEXICAL ANALYZER

Figure 2: LEX Template

3 YACC - YET ANOTHER COMPILER COMPILER

Yacc - Yet another compiler compiler

3 YACC - YET ANOTHER COMPILER COMPILER

3 YACC - YET ANOTHER COMPILER COMPILER

The rules: A : B ; A : C D ; A : E F G ; can be specied as: A : B | C D | E F G ;

3 YACC - YET ANOTHER COMPILER COMPILER

3 YACC - YET ANOTHER COMPILER COMPILER

Default return type is integer. SYSC-3101 14

3 YACC - YET ANOTHER COMPILER COMPILER

3 YACC - YET ANOTHER COMPILER COMPILER

Figure 4: YACC Template

Figure 6: Running the example

Figure 7: Running the example using Visual C++

You might also like