Return to sandt.notes CVS log

Up to [Research Unix] / researchv10dc / vol2 / index

Annotation of researchv10dc/vol2/index/sandt.notes, revision 1.1

1.1     ! root        1: Indexing Vol2
        !             2: 
        !             3: 47 ``unrelated papers -> 40
        !             4: 724 pages -> 617+index
        !             5: troff, tex, monk
        !             6: 
        !             7: Term Generation
        !             8: titles & headings - with stop list for Introduction, Conclusions etc
        !             9: repeated noun phrases
        !            10: distinguished words/distinguished word+next
        !            11:        .I
        !            12:        .CW
        !            13:        .UL
        !            14: code for:      single entry only
        !            15:                global entry only
        !            16:                font change
        !            17: result: paper.terms
        !            18: 
        !            19: problems:
        !            20:        single letter commands: sam a, sed s
        !            21:        common words that are commands: anim again
        !            22:        commands that match parts of words: uucp pack (not package), con
        !            23: 
        !            24:        partial solution: CW a, I pack
        !            25:        but would like to match terms in tables, examples & pictures
        !            26: 
        !            27: Phrase finding
        !            28: diction - fgrep for English with longest match
        !            29:        works on ``sentences'' not lines (.?!)
        !            30:        maps uppercase to lower, some punctuation to space
        !            31:        in terms: map upper to lower, substitute something for terms with .
        !            32: 
        !            33: result: linenumber term1
        !            34:        term2
        !            35:        term3
        !            36:        ...
        !            37:        where case is lost in term?
        !            38: restore case & terms with .
        !            39: run paper.sed to remove paper dependencies
        !            40:        i.e.    monk & tex font changes
        !            41:                paper specific string definitions
        !            42:                kludges to avoid matching problems (CW a etc)
        !            43:                add some consistency between papers (DMD5620)
        !            44: 
        !            45: using line number as an approximation insert
        !            46:        .Tm phrase or \index{phrase}
        !            47: in a safe place in the paper
        !            48:        i.e. not inside .TS/.TE .PS/.PE
        !            49:        (for tex s/\t/<tab>/ in phrases)
        !            50: 
        !            51: run troff/tex/monk to produce file with page numbers
        !            52: result:
        !            53:        page number<tab>phrase #.*
        !            54: 
        !            55: create file of
        !            56:        phrase:papername:page_number
        !            57:        papername:phrase:page_number
        !            58:        or just 1 of above if single/global only
        !            59: 
        !            60: sort by phrase & accumulating page numbers and tagging with font info
        !            61: result: paper.ind
        !            62:        con, ipc, 536   c
        !            63:        ipc, con, 536   c
        !            64: 
        !            65: Making the index
        !            66: get page ranges for each paper
        !            67: trash any \\f* stuff that remains (breaks sort)
        !            68: sort */*.ind
        !            69: put size changes around strings of caps (with numbers $ / etc)
        !            70: for multiple line with the same first term
        !            71:        if term in papernames - put out papername in italic & page ranges
        !            72:        then only put out 2nd term & pages - arranging for CW font where coded
        !            73:        putting line breaks & indentation in appropriate places for long line
        !            74: results: lots better than commencial index with v7 vol2
        !            75:        about the right length - bwk books .015, bently pearls .05 gerard .01 this is .012
        !            76: 
        !            77: problems
        !            78:        folding uppercase to lowercase destroys ability to recognize case where it matters
        !            79:                (sam d D commands)
        !            80:        lack of consistency between papers
        !            81:                typesetter, typesetting etc
        !            82:                -ms vs ms
        !            83:        would like some terms to be multiply entered or qualified
        !            84:                Typesetting Mathematics
        !            85:                Mathematics, Typesetting
        !            86:        papers that explain by example hard to index
        !            87:        usefulness of headings varies greatly among the papers -
        !            88:                for some they're useless, for others they're really all that's
        !            89:                needed
        !            90:        some terms simply not literally in the papers
        !            91:        it's impossible to tell what terms are missing
        !            92: 

This archive runs on limited infrastructure. Preserving old code on modern bandwidth. Automated agents are requested to crawl responsibly.