Return to sandt.notes CVS log

Up to [Research Unix] / researchv10dc / vol2 / index

Annotation of researchv10dc/vol2/index/sandt.notes, revision 1.1.1.1

1.1       root        1: Indexing Vol2
                      2: 
                      3: 47 ``unrelated papers -> 40
                      4: 724 pages -> 617+index
                      5: troff, tex, monk
                      6: 
                      7: Term Generation
                      8: titles & headings - with stop list for Introduction, Conclusions etc
                      9: repeated noun phrases
                     10: distinguished words/distinguished word+next
                     11:        .I
                     12:        .CW
                     13:        .UL
                     14: code for:      single entry only
                     15:                global entry only
                     16:                font change
                     17: result: paper.terms
                     18: 
                     19: problems:
                     20:        single letter commands: sam a, sed s
                     21:        common words that are commands: anim again
                     22:        commands that match parts of words: uucp pack (not package), con
                     23: 
                     24:        partial solution: CW a, I pack
                     25:        but would like to match terms in tables, examples & pictures
                     26: 
                     27: Phrase finding
                     28: diction - fgrep for English with longest match
                     29:        works on ``sentences'' not lines (.?!)
                     30:        maps uppercase to lower, some punctuation to space
                     31:        in terms: map upper to lower, substitute something for terms with .
                     32: 
                     33: result: linenumber term1
                     34:        term2
                     35:        term3
                     36:        ...
                     37:        where case is lost in term?
                     38: restore case & terms with .
                     39: run paper.sed to remove paper dependencies
                     40:        i.e.    monk & tex font changes
                     41:                paper specific string definitions
                     42:                kludges to avoid matching problems (CW a etc)
                     43:                add some consistency between papers (DMD5620)
                     44: 
                     45: using line number as an approximation insert
                     46:        .Tm phrase or \index{phrase}
                     47: in a safe place in the paper
                     48:        i.e. not inside .TS/.TE .PS/.PE
                     49:        (for tex s/\t/<tab>/ in phrases)
                     50: 
                     51: run troff/tex/monk to produce file with page numbers
                     52: result:
                     53:        page number<tab>phrase #.*
                     54: 
                     55: create file of
                     56:        phrase:papername:page_number
                     57:        papername:phrase:page_number
                     58:        or just 1 of above if single/global only
                     59: 
                     60: sort by phrase & accumulating page numbers and tagging with font info
                     61: result: paper.ind
                     62:        con, ipc, 536   c
                     63:        ipc, con, 536   c
                     64: 
                     65: Making the index
                     66: get page ranges for each paper
                     67: trash any \\f* stuff that remains (breaks sort)
                     68: sort */*.ind
                     69: put size changes around strings of caps (with numbers $ / etc)
                     70: for multiple line with the same first term
                     71:        if term in papernames - put out papername in italic & page ranges
                     72:        then only put out 2nd term & pages - arranging for CW font where coded
                     73:        putting line breaks & indentation in appropriate places for long line
                     74: results: lots better than commencial index with v7 vol2
                     75:        about the right length - bwk books .015, bently pearls .05 gerard .01 this is .012
                     76: 
                     77: problems
                     78:        folding uppercase to lowercase destroys ability to recognize case where it matters
                     79:                (sam d D commands)
                     80:        lack of consistency between papers
                     81:                typesetter, typesetting etc
                     82:                -ms vs ms
                     83:        would like some terms to be multiply entered or qualified
                     84:                Typesetting Mathematics
                     85:                Mathematics, Typesetting
                     86:        papers that explain by example hard to index
                     87:        usefulness of headings varies greatly among the papers -
                     88:                for some they're useless, for others they're really all that's
                     89:                needed
                     90:        some terms simply not literally in the papers
                     91:        it's impossible to tell what terms are missing
                     92: 

This archive runs on limited infrastructure. Preserving old code on modern bandwidth. Automated agents are requested to crawl responsibly.