桃楲-TextUseinOnlineDatingProfiles.pptVIP

Text Use in Online Dating Profiles James Fung | Christo Sims ANLP | Final Presentation Instructor Marti Hearst 12.04.06 Overview Goal An exploratory exercise: can we use the text someone provides in their dating profile to assign them to various classes? The Text Cant wait to get to know you Nice, warm and sweet, as most of my friends would describe me. I love to laugh all the time. I have a strong passion towards life even through little things. I tend to be quiet in a large group but generally great with one on one basis. I am ambitious about love and romance. And I am very respectful of the needs and wants of other people. Life is a beautiful journey. I am seeking someone who would appreciate the value of life, family, have a warm heart and nice peronality to share this journey with. If you are that person, I cant wait to get to know you. Possible Classes Approach Scraping Profiles Yahoo! Personals 200 Male seeking Female 200 Female seeking Male Within 50 Miles of San Francisco Ages 25-35 Feature Extraction (Python) Token frequency Words: TF, TF.IDF Bigrams Weighted headlines Readability measures Characters, syllables, words, complex words, sentences Ratios of the above Gunning-Fog and six others Feature Selection Classification (Weka) Use Weka’s built in feature selection tools Chi-Squared, Information Gain Subset Eval (not working well with most of the classes) Explore a variety of classification algorithms, for a variety of possible classes Multinomial Na?ve Bayes K-Nearest Neighbors Decision Tree Support Vector Machines Preliminary Results Preliminary Results Able to beat a na?ve baseline in a few cases, usually where there are only two or three possible classification categories: Gender ~69% Accuracy Category # Instances Women seeking a man 196 Man seeking a woman 200 (51%) Want (more) kids ~65% Accuracy Category # Instances Yes 202 (62.3%) Not sure 105 No 17 Preliminary Results More difficult with mor