Main Page   Namespace List   Class Hierarchy   Alphabetical List   Compound List   File List   Namespace Members   Compound Members   File Members   Related Pages  

WebParser Class Reference

#include <WebParser.hpp>

Inheritance diagram for WebParser:

Parser TextHandler List of all members.

Public Methods

 WebParser ()
void parseFile (const string &filename)
 Parse a file.

void parseBuffer (char *buf, int len)
 Parse a buffer.

long fileTell () const
 return the current byte position of the file being parsed


Static Public Attributes

const string identifier = "web"

Detailed Description

Parses documents in NIST's Web TREC format. Does case folding for words that are not in the acronym list. Contraction suffixes and possessive suffixes are stripped.

U.S.A., USA's, and USAs are converted to USA. Does not recognize acronyms with numbers.

The DOCHDR is ignored.

Text in <script> tags is ignored. Text in HTML comments is ignored.


Constructor & Destructor Documentation

WebParser::WebParser  
 


Member Function Documentation

long WebParser::fileTell   [virtual]
 

return the current byte position of the file being parsed

Implements Parser.

void WebParser::parseBuffer char *    buf,
int    len
[virtual]
 

Parse a buffer.

Implements Parser.

void WebParser::parseFile const string &    filename [virtual]
 

Parse a file.

Implements Parser.


Member Data Documentation

const string WebParser::identifier = "web" [static]
 

Reimplemented from Parser.


The documentation for this class was generated from the following files:
Generated on Wed Nov 3 13:00:01 2004 for Lemur Toolkit by doxygen1.2.18