How To Search for Complex Patterns over Streaming and Stored Data.pdfVIP

How To Search for Complex Patterns over Streaming and Stored Data S. Chakravarthy L. Elkhalifa N. Deshpande R. Adaikkalavan R. Liuzzi Abstract becomes critical to avoid information overload (or retriev- ing very large number or portions of documents). Infor- The colossal amount of digitized information available mation filtering [1, 2, 3, 4, 5] is the process of extracting has resulted in overloading users who need to navigate relevant or useful portions of documents from continuous this information for their routine requirements. Informa- streams of textual data based on relatively static user pat- tion filtering deals with monitoring text streams to detect terns (or queries). On the other hand, Information Retrieval patterns and retrieval of documents by searching for pat- [6, 7, 8, 9] is the process of extracting relevant or useful terns over stored data. Although information filtering sys- portions of documents from a relatively static collection of tems and search engines have been effective in reducing this documents based on a stream of incoming user patterns (or information overload, they support only keyword searches queries). and queries that use Boolean operators. Consider search- Both in information filtering and retrieval, expressive- ing a full text patent database for documents containing ness of pattern (or query) specification by a user and its more than n occurrences of a particular pattern, or for detection play a significant role. In other words, in order documents that have a particular pattern followed by an- to extrac