Learning-on-the-Test-Datappt学习上的测试datappt.pptVIP

Learning on the Test Data:Leveraging “Unseen” Features Ben Taskar Ming FaiWong Daphne Koller Introduction Most statistical learning models make the assumption that data instances are IID samples from some fixed distribution. In many cases, the data are collected from different sources, at different times, locations and under different circumstances. We usually build a statistical model of features under the assumption that future data will exhibit the same regularities as the training data. In many data sets, however, there are scope-limited features whose predictive power is only applicable to a certain subset of the data. Examples 1. Classifying news articles chronologically: Suppose the task is to classify news articles chronologically. New events, people and places appear and disappear) in bursts over time. The training data might consist of articles taken over some time period; these are only somewhat representative of the future articles. The training data may contain some features that are not observed in the training data. 2. Classifying customers into categories: Our training data might be collected from one geographical region which may not represent the distribution in other regions. We can get away with this difficulty by mixing all the examples and selecting the training and test sets randomly. But this homogeneity cannot be ensured in real world task, where only the non-representative training data is actually available for training. The test data may contain many features that were never or only rarely observed in training data. These features may be used for classification. For ex, in the news article task these local features might include the names of places or people currently in the news. In the customers ex, these local features might include purchases of products that a