![[BACK]](/cvsweb/icons/back.gif){kind=icon}
Return to MISC CVS log ![[TXT]](/cvsweb/icons/text.gif){kind=icon}
![[DIR]](/cvsweb/icons/dir.gif){kind=icon}
Up to [Research Unix] / researchv10dc / cmd / flex|
Return to MISC CVS log | Up to [Research Unix] / researchv10dc / cmd / flex |
1.1 ! root 1: Miscellaneous flex stuff. In here you'll find an out-of-date VMS makefile ! 2: for flex and notes someone sent me regarding converting flex to deal with ! 3: 8 bit characters. This stuff is provided so that ambitious folks can pick ! 4: it up and turn it into something viable. I'd appreciate being sent any ! 5: updates resulting from work on this. ! 6: ! 7: The makefile is from Fred Brehm ([email protected]); the 8 bit chars ! 8: from Earle Horton ([email protected]). ! 9: ! 10: ! 11: ! 12: ############################ VMS MAKEFILE ############################## ! 13: ! 14: # VMS make file for "flex" tool ! 15: ! 16: # Redefine the following for your own environment ! 17: BIN = tools$$exe ! 18: LIB = tools$$library ! 19: INC = tools$$include ! 20: MAN = tools$$manual ! 21: LINKFLAGS = ,$(LIB):cc/opt ! 22: ! 23: SKELETON_FILE = "DEFAULT_SKELETON_FILE=""$(LIB):FLEX.SKEL""" ! 24: F_SKELETON_FILE = "FAST_SKELETON_FILE=""$(LIB):FLEX.FASTSKEL""" ! 25: ! 26: CCFLAGS = VMS ! 27: FLEX_FLAGS = -is ! 28: ! 29: FLEXOBJS = ccl.obj dfa.obj ecs.obj main.obj misc.obj nfa.obj parse.obj \ ! 30: scan.obj sym.obj tblcmp.obj yylex.obj ! 31: ! 32: OBJ = ccl.obj,dfa.obj,ecs.obj,main.obj,misc.obj,nfa.obj,parse.obj,\ ! 33: scan.obj,sym.obj,tblcmp.obj,yylex.obj ! 34: ! 35: default : flex ! 36: install : inc lib bin man ! 37: inc : $(INC):flexskeldef.h $(INC):fastskeldef.h $(INC):flexskelcom.h ! 38: lib : $(LIB):flex.skel $(LIB):flex.fastskel ! 39: bin : $(BIN):flex ! 40: flex :== $$ $(BIN):flex ! 41: man : $(MAN):flex.doc ! 42: ! 43: $(INC):flexskeldef.h : flexskeldef.h ! 44: copy flexskeldef.h $(INC) ! 45: $(INC):fastskeldef.h : fastskeldef.h ! 46: copy fastskeldef.h $(INC) ! 47: $(INC):flexskelcom.h : flexskelcom.h ! 48: copy flexskelcom.h $(INC) ! 49: $(LIB):flex.skel : flex.skel ! 50: copy flex.skel $(LIB) ! 51: $(LIB):flex.fastskel : flex.fastskel ! 52: copy flex.fastskel $(LIB) ! 53: $(BIN):flex.exe : flex.exe ! 54: copy flex.exe $(BIN) ! 55: $(MAN):flex.doc : flex.doc ! 56: copy flex.doc $(MAN) ! 57: ! 58: flex : flex.exe ! 59: flex :== $$ 'f$$environment("default")'flex ! 60: ! 61: flex.exe : $(FLEXOBJS) ! 62: link /exe=flex $(OBJ) $(LINKFLAGS) ! 63: ! 64: parse.h : parse.c ! 65: ! 66: parse.c : parse.y ! 67: yacc :== $$ sys$$sysroot:[shellexe]yacc ! 68: yacc -d parse.y ! 69: copy y_tab.c parse.c ! 70: copy y_tab.h parse.h ! 71: del y_tab.h;*,y_tab.c;* ! 72: ! 73: #scan.c : scan.l ! 74: # flex $(FLEX_FLAGS) scan.l ! 75: # copy lex_yy.c scan.c ! 76: # del lex_yy.c;* ! 77: scan.c : scan.dist ! 78: copy scan.dist scan.c ! 79: ! 80: ccl.obj : ccl.c flexdef.h ! 81: cc /define=$(CCFLAGS) ccl.c ! 82: dfa.obj : dfa.c flexdef.h ! 83: cc /define=$(CCFLAGS) dfa.c ! 84: ecs.obj : ecs.c flexdef.h ! 85: cc /define=$(CCFLAGS) ecs.c ! 86: main.obj : main.c flexdef.h ! 87: cc /define=($(CCFLAGS),$(SKELETON_FILE),$(F_SKELETON_FILE)) main.c ! 88: misc.obj : misc.c flexdef.h ! 89: cc /define=$(CCFLAGS) misc.c ! 90: nfa.obj : nfa.c flexdef.h ! 91: cc /define=$(CCFLAGS) nfa.c ! 92: parse.obj : parse.c flexdef.h ! 93: cc /define=$(CCFLAGS) parse.c ! 94: scan.obj : scan.c parse.h flexdef.h ! 95: cc /define=$(CCFLAGS) scan.c ! 96: sym.obj : sym.c flexdef.h ! 97: cc /define=$(CCFLAGS) sym.c ! 98: tblcmp.obj : tblcmp.c flexdef.h ! 99: cc /define=$(CCFLAGS) tblcmp.c ! 100: yylex.obj : yylex.c parse.h flexdef.h ! 101: cc /define=$(CCFLAGS) yylex.c ! 102: ! 103: clean : ! 104: del flex.exe;* ! 105: del scan.c;* ! 106: del parse.c;* ! 107: del parse.h;* ! 108: del lex_yy.c;* ! 109: del *.obj;* ! 110: del flex*.tmp;* ! 111: del *.diff;* ! 112: del y_tab.*;* ! 113: del makefile.;* ! 114: purge/log ! 115: copy makefile.vms makefile. ! 116: ! 117: makefile : makefile.vms ! 118: copy makefile.vms makefile. ! 119: ! 120: test : flex ! 121: define tools$$lib 'f$$environment("default")' ! 122: flex $(FLEX_FLAGS) scan.l ! 123: define tools$$lib tools$$sys:[lib] ! 124: diff/out=flex.diff scan.dist lex_yy.c ! 125: type/page flex.diff ! 126: ! 127: ! 128: ! 129: ######################### Stuff for 8 Bit chars ######################## ! 130: ! 131: ! 132: Earle Horton has made a version of flex run on the MacIntosh under MPW. Not ! 133: being content to scan regular ascii, he deals with all 8 bits. I also have ! 134: wanted to write VMS filters that recognize <CSI>, etc. so I contacted him ! 135: about his work. He seems to be unable to reach you directly--the rest of ! 136: this is his note... ! 137: ---------------------------Note from Earle------------------ ! 138: >From [email protected] Fri May 27 11:33:09 1988 ! 139: Received: from DARTVAX.DARTMOUTH.EDU by megaron.arizona.edu; Fri, 27 May 88 10:55:39 MST ! 140: Received: from eleazar.dartmouth.edu by dartvax.dartmouth.edu (5.59/3.4ROOT) ! 141: id AA17044; Fri, 27 May 88 13:53:18 EDT ! 142: Received: by eleazar.dartmouth.edu (5.59/3.2LEAF) ! 143: id AA15906; Fri, 27 May 88 13:53:04 EDT ! 144: Date: Fri, 27 May 88 13:53:04 EDT ! 145: From: [email protected] (Earle R. Horton) ! 146: Message-Id: <[email protected]> ! 147: To: eleazar!earleh, [email protected], naucse!jdc ! 148: Subject: Re: Flex and DEC multi-nationals, help! ! 149: Status: R ! 150: ! 151: John, ! 152: ! 153: I have posted the diffs to comp.sources.unix, and I think that ! 154: they could be used to generate a VAX C version which scans DEC ! 155: multi-nationals with little extra effort. I tried the address which ! 156: you give for Vern several times, only to have it bounce back to me for ! 157: some mysterious reason known only to a mail daemon somewhere. I would ! 158: indeed appreciate it if you could forward this to him. ! 159: ! 160: I have found that the full internal representation of all ! 161: characters as shorts is not necessary. Rather, it is only necessary to ! 162: ! 163: a) Prevent conversion of valid characters to negative ints. I ! 164: do this with a mask, defined for the Mac and UNIX as ! 165: "#define BYTEMASK 0xFF". Any time a char is converted to an ! 166: int, AND it with the mask. Then you don't have to declare ! 167: chars as unsigned chars, which is tiresome. ! 168: ! 169: b) The routine mkeccl() uses negation of characters for a flag ! 170: to determine whether they have been processed. I used a ! 171: debugger to estimate how many times this routine is actually ! 172: called when Flex scans scan.l. Based on what this looked ! 173: like to me, I decided that it would be appropriate to have ! 174: only the routine mkeccl() use an array of shorts for its ! 175: internal processing. When mkeccl() is called, it gets a ! 176: pointer to an array of shorts using alloca(), and then reads ! 177: the characters which it is to process into this array using ! 178: the method in (a). When mkeccl() is done, the shorts are put ! 179: back into chars, and things proceed. The internal processing ! 180: done by mkeccl() is the same. ! 181: ! 182: Flex compiled with these changes correctly scans all characters ! 183: in the Macintosh character set, to the best of my ability to test it. ! 184: In addition, it correctly scans chars with values > 127 on a UNIX VAX! ! 185: Contrary to "common knowledge", text files which exist on a UNIX ! 186: machine may have valid characters in the range [\0177-\0377]. An ! 187: example is if I want to write a program to run on a UNIX machine which ! 188: converts German characters to ASCII. The ess-tset (I believe that is ! 189: the name) can be converted to "ss" with little loss of sense in most cases. ! 190: ! 191: The only question I have about my procedure is that it looks ! 192: expensive to convert the ccltbl array to shorts and back every time ! 193: mkeccl() is called. However, the routine is not called an inordinately ! 194: large number of times, and this conversion is probably not more ! 195: expensive than a couple of calls to strcpy(), for instance. To ! 196: determine whether this is the most efficient method, one would have to ! 197: go through the effort to convert Flex to use shorts for all internal ! 198: representation, then profile the two methods. Not my idea of a good ! 199: time. ! 200: ! 201: Flex is a real nice program. I couldn't find anything else wrong ! 202: with it. ! 203: ! 204: Earle Horton ! 205: ! 206:
This archive runs on limited infrastructure. Preserving old code on modern bandwidth. Automated agents are requested to crawl responsibly.