20 December 2005

Summarization

Summarization is one of the canonical NLP problems, but of all the big ones (MT, speech, IR, IE, etc.) it is in my opinion the most difficult (let the flames begin!). The reason I think it's so hard is because it's unclear what a summary is. When one cannot define a problem well, it is impossible to solve, and difficult ⊆ impossible. There has been an enormous amount of effort to define specific summarization problems that we can solve, a comparable amount of effort on figuring out how to measure how good a solution is, and a lot of effort on building models/systems that can solve these problems. We've tried many things; see the history of DUC for a small, biased, incomplete set.

That said, I think the field has much potential, but not necessarily by trying to mimick what a human would do when asked to produce a summary. I'm interested in doing summarization-like tasks that a human would never be able to do reliably. Here are some examples to give a flavor of what I'm talking about:


  • Let me go to a scientific engine like Rexa or CiteSeer and ask for a summary of "reinforcement learning." The system should know what papers I've read, what papers I've written, the relationship between all the papers in its database, an analysis of the goodness of authors and so on. What it produces for me must be markedly different from what it would produce for Satinder Singh.

  • Let me go to Amazon and ask about new digital cameras. Maybe I'm interested in spending $200-$300. It should know that I've never bought a digital camera before, or that I've bought 4. I want a summary of important specifications, user comments and so on.

  • Let me go to my own inbox and ask for a summary of what I've been discussing with John recently.



One can imagine many more similar tasks, but these are three obvious ones. The nice thing about these is that even partial solutions would be enormously useful (to me, at least...my mom might not care about the first). These are also things that people really can't do well. If someone asks me for something like the first one but, say, on structured prediction instead of reinforcement learning, I can give a summary, but it will be heavily biased. It is worse for the second, where I can basically only produce anecdotal evidence, and virtually impossible for the third.

The most important outstanding issue is how to measure sucess at such problems. I cannot imagine how to do this without doing user studies, but people probably felt the same way about MT a few years ago. How about now? But given the amount of personalization in these tasks, I feel that it would be harder to do automatic evaluation of them. Probably the most important things to measure in user studies are subjective satisfaction, how many times multiple searches had to be performed and so on. One could also take a TREC style approach for comparative pair-wise evaluations by marking system 2 down if it missed something system 1 found that a human thought was important.

There are also tons of subproblems that can be pulled from this tangle of tasks. Most notably, personalization methods, social network analysis methods, redundancy identification, coherence, information presentation (UI) techniques, generation of multimodal outputs (tables, graphs, etc.), dealing with imperfect input (googling for "reinforcement learning" also produces irrelevant documents), opinion identification, processing of ungrammatical input, anti-spam, and so on. I'm not a huge proponent of just solving subtasks that aren't proven to be necessary, but it is sometimes helpful to take this approach. I think we just have to keep the big picture in our minds.

47 comments:

Philipp said...

Isn't summarization in essence information extraction with fancy generation at the end? And what good is that generation?

Here is an idea: Why not pose some grand challenges for information extraction, such as biography generation, argument extraction from political discussions, trendspotting, etc.

hal said...

IE typically focuses on filling pre-defined templates. Summarization attempts to be broader: in addition to pulling out information in a wider range than, say, natural disasters, it also attempts to appraise novelty, interestingness and importance. Ed has suggested that one way to do summarization is to create 1000 IE templates and build a good IE system. This would be one way to go, but I don't think it would work for the application list I care about (maybe it would be okay for news). But yes, I think things like argument extraction and trendspotting are really cool things to work on in the same general area.

. said...

酒店經紀PRETTY GIRL 台北酒店經紀人 ,禮服店 酒店兼差PRETTY GIRL酒店公關 酒店小姐 彩色爆米花酒店兼職,酒店工作 彩色爆米花酒店經紀, 酒店上班,酒店工作 PRETTY GIRL酒店喝酒酒店上班 彩色爆米花台北酒店酒店小姐 PRETTY GIRL酒店上班酒店打工PRETTY GIRL酒店打工酒店經紀 彩色爆米花

garmin fleet management said...

I found your site on google, great site, keep it up. Will return in the future. Submitted this post to Google News Reader. Please come visit my site fleet management solutions when you got time.

supply chain management software service said...

sorry to ask this here but… I really love your theme, would it happen to be a free one i can download somewhere, or is it a custom theme you had made? Soon i will be launching my own blog, however i’m not great with designs but i do like the style of your site so it would be excellent if i could find (or buy) something with a similar look as my last designer cannot finish my site. Thanks! Please come visit my site supply chain management industry when you got time.

beauty hair salon said...

I am deeply in love with every single piece of information you post here. Will be back often to read more updates! Please come visit my site nail salons when you got time.

shoe repair supplies said...

Glad I stumbled into this article! Finally, got what I was looking for to put on my school report... Thanks for sharing this. I would love some feedback on my site shoe when you got time.

louis said...

Summary is the need of today's generation. Everyone wants a short and quick description.
dentists edinburgh

freeforlife12 said...

CUM! CUM SHOTS! BLOWJOBS! Amateur FACIALS!
We Got Cumshots and BLOWJOBS! Welcome the the Nastiest Cum shotand BLOWJOB Web Site on The Net. The First Spin-off of the very successful Jerker's World, Dickgoo.com promises the same true amateur porn. Taking Homegrown ( the new homade porn) genre to the next levl in 2010. DICK SUCKING, Cum swollowing, Cum eating, Cum Drinking, However you like Your jizz shots Delivered, We Got a Cum load, Amateur blowjobs, Facial Cum Video For You. No Other Sites Trolls Over 30 sites to Bring you the Best %100 Real Amateur Cumshots. Exclusive Facial Cum shots.18 Barely Legal Cum Creampies. Blowjobs you can almost feel for yourself. Facial Cum shot, Dick sucking to cum shot explosions.

Wholesale Canada Watches said...

Really great work. Congrats to everyone who are involved with this project. The website layout and graphics are really cool. Please come visit my site Wholesale Canada Designer Watches when you got time.

Wholesale jewelry said...

Awesome! I have read a lot on this topic, but you definitely give it a good vibe. This is a great post. Will be back to read more! Please come visit my site silver jewelry give me any valuable feedbacks.

Skin Care said...

I am deeply in love with every single piece of information you post here. Will be back often to read more updates! Please come visit my site healthy skin when you got time.

Burn Stomach Fat said...

Glad I stumbled into this article! Finally, got what I was looking for to put on my school report... Thanks for sharing this. I would love some feedback on my site cause of belly fat when you got time.

lilena said...

Tooth Decay, tooth decay Symptoms, tooth decay Causes, Treatments, Prevention cavities

lilena said...

Beauty Schools And Cosmetology Schools, Beauty Careers and Cosmetology training online guide. Find out how to find the best cosmetologist schools, career and job descriptions of spa therapist, hair designer, makeup artist.beauty career

thomson said...

Online resources of toe fungus, fungus treatment, nail fungus toe. fungus treatment

thomson said...

Herniated disc symptoms, Herniated Disc Pain, treatment and developmental online guide. back pain

lilena said...

Organic weed control and lawn weed control guides and tips. Include gardening basic information and soil and composting resources.lawn weed control

lilena said...

Gynecomastia treatment, gynecomastia causes, gynecomastia cure, male breast enlargement guide.gynecomastia causes

Rain gutters cleaning said...

Interesting post about summarization. I would like to know more about this field

Medicine Business Lookup said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

Medicine Hat Business Directory, Medicine Hat Agriculture, fishing & Forestry, Medicine Hat Apparel & Accessories, business directory listings of Medicine Hat Automotive, Medicine Hat Business & Professional Services, Medicine Hat Computers, Communications & Electronics, home garden furnishing, real estate business finderMedicine Hat Construction & Renovation, Medicine Hat Education, Medicine Hat Entertainment & Media, Medicine Hat Family & Community, Lawyers Attorneys & Law Firms Directory Medicine Hat Finance & Legal,dinning restaurants Entertainment serving Medicine Hat Food & Beverages, Medicine Hat Health & Medicine Doctors Hospitals, Medicine Hat Home & Garden, Medicine Hat Industrial supplies & services , Medicine Hat Personal Care, Medicine Hat Public utilities & environment, Medicine Hat Real-Estate & Insurance, Medicine Hat Shopping & Specialty Stores, shopping, retail, department stores company guide of Medicine Hat Sports & Recreation, Medicine Hat Transportation, Medicine Hat Travel & Lodging

Red Deer Canada said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

Red Deer Business Directory, Red Deer Agriculture, fishing & Forestry, Red Deer Apparel & Accessories, business directory listings of Red Deer Automotive, Red Deer Business & Professional Services, Red Deer Computers, Communications & Electronics, home garden furnishing, real estate business finderRed Deer Construction & Renovation, Red Deer Education, Red Deer Entertainment & Media, Red Deer Family & Community, Lawyers Attorneys & Law Firms Directory Red Deer Finance & Legal,dinning restaurants Entertainment serving Red Deer Food & Beverages, Red Deer Health & Medicine Doctors Hospitals, Red Deer Home & Garden, Red Deer Industrial supplies & services , Red Deer Personal Care, Red Deer Public utilities & environment, Red Deer Real-Estate & Insurance, Red Deer Shopping & Specialty Stores, shopping, retail, department stores company guide of Red Deer Sports & Recreation, Red Deer Transportation, Red Deer Travel & Lodging

City of Delta said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
Delta Business Directory, Delta Agriculture, fishing & Forestry, Delta Apparel & Accessories, business directory listings of Delta Automotive, Delta Business & Professional Services, Delta Computers, Communications & Electronics, home garden furnishing, real estate business finderDelta Construction & Renovation, Delta Education, Delta Entertainment & Media, Delta Family & Community, Lawyers Attorneys & Law Firms Directory Delta Finance & Legal,dinning restaurants Entertainment serving Delta Food & Beverages, Delta Health & Medicine Doctors Hospitals, Delta Home & Garden, Delta Industrial supplies & services , Delta Personal Care, Delta Public utilities & environment, Delta Real-Estate & Insurance, Delta Shopping & Specialty Stores, shopping, retail, department stores company guide of Delta Sports & Recreation, Delta Transportation, Delta Travel & Lodging

Canada Maple Ridge said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Maple Ridge Business Directory, Maple Ridge Agriculture, fishing & Forestry, Maple Ridge Apparel & Accessories, business directory listings of Maple Ridge Automotive, Maple Ridge Business & Professional Services, Maple Ridge Computers, Communications & Electronics, home garden furnishing, real estate business finderMaple Ridge Construction & Renovation, Maple Ridge Education, Maple Ridge Entertainment & Media, Maple Ridge Family & Community, Lawyers Attorneys & Law Firms Directory Maple Ridge Finance & Legal,dinning restaurants Entertainment serving Maple Ridge Food & Beverages, Maple Ridge Health & Medicine Doctors Hospitals, Maple Ridge Home & Garden, Maple Ridge Industrial supplies & services , Maple Ridge Personal Care, Maple Ridge Public utilities & environment, Maple Ridge Real-Estate & Insurance, Maple Ridge Shopping & Specialty Stores, shopping, retail, department stores company guide of Maple Ridge Sports & Recreation, Maple Ridge Transportation, Maple Ridge Travel & Lodging

Surrey British Columbia Directory Listing said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

Surrey British Columbia Business Directory, Surrey British Columbia Agriculture, fishing & Forestry, Surrey British Columbia Apparel & Accessories, business directory listings of Surrey British Columbia Automotive, Surrey British Columbia Business & Professional Services, Surrey British Columbia Computers, Communications & Electronics, home garden furnishing, real estate business finderSurrey British Columbia Construction & Renovation, Surrey British Columbia Education, Surrey British Columbia Entertainment & Media, Surrey British Columbia Family & Community, Lawyers Attorneys & Law Firms Directory Surrey British Columbia Finance & Legal,dinning restaurants Entertainment serving Surrey British Columbia Food & Beverages, Surrey British Columbia Health & Medicine Doctors Hospitals, Surrey British Columbia Home & Garden, Surrey British Columbia Industrial supplies & services , Surrey British Columbia Personal Care, Surrey British Columbia Public utilities & environment, Surrey British Columbia Real-Estate & Insurance, Surrey British Columbia Shopping & Specialty Stores, shopping, retail, department stores company guide of Surrey British Columbia Sports & Recreation, Surrey British Columbia Transportation, Surrey British Columbia Travel & Lodging

Victoria British Columbia Directory Listing said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

Victoria Business Directory, Victoria Agriculture, fishing & Forestry, Victoria Apparel & Accessories, business directory listings of Victoria Automotive, Victoria Business & Professional Services, Victoria Computers, Communications & Electronics, home garden furnishing, real estate business finderVictoria Construction & Renovation, Victoria Education, Victoria Entertainment & Media, Victoria Family & Community, Lawyers Attorneys & Law Firms Directory Victoria Finance & Legal,dinning restaurants Entertainment serving Victoria Food & Beverages, Victoria Health & Medicine Doctors Hospitals, Victoria Home & Garden, Victoria Industrial supplies & services , Victoria Personal Care, Victoria Public utilities & environment, Victoria Real-Estate & Insurance, Victoria Shopping & Specialty Stores, shopping, retail, department stores company guide of Victoria Sports & Recreation, Victoria Transportation, Victoria Travel & Lodging

Kamloops Online Business Directory said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
Kamloops Business Directory, Kamloops Agriculture, fishing & Forestry, Kamloops Apparel & Accessories, business directory listings of Kamloops Automotive, Kamloops Business & Professional Services, Kamloops Computers, Communications & Electronics, home garden furnishing, real estate business finderKamloops Construction & Renovation, Kamloops Education, Kamloops Entertainment & Media, Kamloops Family & Community, Lawyers Attorneys & Law Firms Directory Kamloops Finance & Legal,dinning restaurants Entertainment serving Kamloops Food & Beverages, Kamloops Health & Medicine Doctors Hospitals, Kamloops Home & Garden, Kamloops Industrial supplies & services , Kamloops Personal Care, Kamloops Public utilities & environment, Kamloops Real-Estate & Insurance, Kamloops Shopping & Specialty Stores, shopping, retail, department stores company guide of Kamloops Sports & Recreation, Kamloops Transportation, Kamloops Travel & Lodging

Arizona Criminal Defense Attorney said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
State of Arizona Lawyer Directory,
Arizona Attorney Search,
Arizona Lawyers Search, Find
A Arizona Attorney Lawyers
, Arizona Civil Law Attorneys, Arizona Collection Law Attorneys, Arizona Computers & Technology Law Attorneys, Arizona Constitutional Law Attorneys, Arizona Construction Law Attorneys, Arizona Consumer Protection Attorneys, Arizona Domestic Partnerships Attorneys, Arizona Drug Charges Attorneys, Arizona DUI/DWI Attorneys, Arizona Education Law Attorneys, Arizona Elder Law Attorneys, Arizona Land Use & Zoning Attorneys, Arizona Landlord & Tenant Law Attorneys, Arizona Legal Information Services, Arizona Legal Services, Arizona Trial Attorneys, Arizona Vehicular Accident Attorneys, Arizona Whistleblower Attorneys, Arizona Workers&#; Compensation Attorneys, Arizona Wrongful Death Attorneys, Arizona Wrongful Termination Attorneys

Arkansas Criminal Defense Attorney said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
State of Arkansas Lawyer Directory,
Arkansas Attorney Search,
Arkansas Lawyers Search, Find
A Arkansas Attorney Lawyers
, Arkansas Civil Law Attorneys, Arkansas Collection Law Attorneys, Arkansas Computers & Technology Law Attorneys, Arkansas Constitutional Law Attorneys, Arkansas Construction Law Attorneys, Arkansas Consumer Protection Attorneys, Arkansas Domestic Partnerships Attorneys, Arkansas Drug Charges Attorneys, Arkansas DUI/DWI Attorneys, Arkansas Education Law Attorneys, Arkansas Elder Law Attorneys, Arkansas Land Use & Zoning Attorneys, Arkansas Landlord & Tenant Law Attorneys, Arkansas Legal Information Services, Arkansas Legal Services, Arkansas Trial Attorneys, Arkansas Vehicular Accident Attorneys, Arkansas Whistleblower Attorneys, Arkansas Workers&#; Compensation Attorneys, Arkansas Wrongful Death Attorneys, Arkansas Wrongful Termination Attorneys

Illinois Personal Injury Attorneys said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
Illinois Attorney Yellow Pages, Attorneys
Illinois
, Illinois Corporate Business Attorneys, Illinois Corporate Finance & Securities Attorneys, Illinois Creditors&#; Rights Attorneys, Illinois Criminal Law Attorneys, Illinois Custody & Support Law Attorneys, Illinois Debt Consolidation Attorneys, Illinois Disability Law Attorneys, Illinois Discrimination & Civil Rights Attorneys, Illinois Divorce & Mediation Services, Illinois Divorce Attorneys, Illinois Election Law Attorneys, Illinois Eminent Domain & Condemnation Attorneys, Illinois Employment & Labor Law Attorneys, Illinois Entertainment & Sports Law Attorneys, Illinois Environmental & Natural Resources Attorneys, Illinois Estate Planning & Administration Attorneys, Illinois Expert Testimony Services, Illinois Family Law Attorneys, Illinois Firearm & Gun Law Attorneys, Illinois Franchise & Licensing Law Attorneys, Illinois General Practice Attorneys, Illinois Government Contracts & Claims Attorneys, Illinois Guardianship & Conservatorship Attorneys, Illinois Health Care Law Attorneys, Illinois Immigration Law Attorneys, Illinois Insurance Law Attorneys

Indiana Personal Injury Attorneys said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Indiana Attorney Yellow Pages, Attorneys
Indiana
, Indiana Corporate Business Attorneys, Indiana Corporate Finance & Securities Attorneys, Indiana Creditors&#; Rights Attorneys, Indiana Criminal Law Attorneys, Indiana Custody & Support Law Attorneys, Indiana Debt Consolidation Attorneys, Indiana Disability Law Attorneys, Indiana Discrimination & Civil Rights Attorneys, Indiana Divorce & Mediation Services, Indiana Divorce Attorneys, Indiana Election Law Attorneys, Indiana Eminent Domain & Condemnation Attorneys, Indiana Employment & Labor Law Attorneys, Indiana Entertainment & Sports Law Attorneys, Indiana Environmental & Natural Resources Attorneys, Indiana Estate Planning & Administration Attorneys, Indiana Expert Testimony Services, Indiana Family Law Attorneys, Indiana Firearm & Gun Law Attorneys, Indiana Franchise & Licensing Law Attorneys, Indiana General Practice Attorneys, Indiana Government Contracts & Claims Attorneys, Indiana Guardianship & Conservatorship Attorneys, Indiana Health Care Law Attorneys, Indiana Immigration Law Attorneys, Indiana Insurance Law Attorneys

State Of Illinois Lawyer said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
personal
injury law law firms
, Child
Abuse Law Lawyers
, patent
trademark lawyer
, find
personal injury attorney
, child
abuse attorneys
, trademark
patent lawyers
, best
personal injury attorneys

State Of Indiana Lawyer said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
child
abuse defense attorney
, Patent
Trademark attorney
, attorney
for personal injury
, attorney
for child abuse
, Patent
Trademark lawyer
, personal
injury law attorneys
, criminal
law child abuse attorneys
, Patent
lawyers Trademark Attorneys
,

tariely said...

Мультфильмы онлайн

Mark said...

I just couldnt leave your website before saying that I really enjoyed the quality information you offer to your visitors... Will be back often to check up on new stuff you post here!
Montana public insurance, Nebraska public insurance, Nevada public insurance, New Hampshire public insurance, New Jersey public insurance, New Mexico public insurance, New York public insurance, North Carolina public insurance, North Dakota public insurance, Ohio public insurance, Oklahoma public insurance, Oregon public insurance, Pennsylvania public insurance, Rhode Island public insurance,

Mark said...

Valuable information and excellent design you got here! I would like to thank you for sharing your thoughts and time into the stuff you post!! Thumbs up

South Carolina public insurance, South Dakota public insurance, Tennessee public insurance, Texas public insurance, Utah public insurance, Vermont public insurance, Virginia public insurance, Washington public insurance, West Virginia public insurance, Wisconsin public insurance, Wyoming public insurance

Mark said...

Kansas insurance agencies and brokers. Kansas car insurance, home owner insurance, health insurance, life insurance and more.
Kansas
Accident & Health Insurance
, Kansas
Aircraft & Aviation Insurance
, Kansas
Auto Insurance
, Kansas
Bail Bonds Referral Services
, Kansas
Boat & Yacht Insurance
, Kansas
Business Insurance
, Kansas
Business Interruption Insurance
, Kansas
Casualty insurance
, Kansas
Churches Insurance
, Kansas
Contents insurance
, Kansas
Corporate Insurance Adjusters
, Kansas
Credit Insurance
, Kansas
Crime insurance
, Kansas
Dental Insurance

Mark said...

Kansas insurance companies, insurance agents brokers and insurance guide. Comprehensive information about Kansas car insurance, home owner insurance, health insurance, life insurance and more.

Kansas
Home Health Care Insurance
, Kansas
Home Insurance
, Kansas
Hospitalization Insurance
, Kansas
Insurance
, Kansas
Insurance Adjusters
, Kansas
Insurance Agents & Brokers
, Kansas
Insurance Annuities
, Kansas
Insurance Bonds
, Kansas
Insurance Claims & Services
, Kansas
Insurance Claims Processing Services
, Kansas
Insurance Consultants & Advisors
, Kansas
Insurance Employment Agencies
, Kansas
Insurance Examinations
, Kansas
Insurance Examiners

seldamuratim said...

Really trustworthy blog. Please keep updating with great posts like this one. I have booked marked your site and am about to email it to a few friends of mine that I know would enjoy reading..
sesli sohbetsesli chatkamerali sohbetseslisohbetsesli sohbet sitelerisesli chat siteleriseslichatsesli sohpetseslisohbet.comsesli chatsesli sohbetkamerali sohbetsesli chatsesli sohbetkamerali sohbet
seslisohbetsesli sohbetkamerali sohbetsesli chatsesli sohbetkamerali sohbet

Yosef said...

A fantastic read….very literate and informative. Many thanks….what theme is this you are using and also, where is your RSS button ? Refrigeration
And Air Conditioning
, Driver
Training
, preservation, Canoe
Kayak Dealers
, Hvac Systems
Hvac Contractor
, Driving Instruction
School
, historic property

Yosef said...

There are certainly a lot of details like that to take into consideration. That’s a great point to bring up. I offer the thoughts above as general inspiration but clearly there are questions like the one you bring up where the most important thing will be working in honest good faith.
Canoe
Kayak Canada
, Air Conditioning
Units
, Bus Driver Training, historical preservation, Canoe
Or Kayak
, Split Air Conditioning

Kendall said...

You got a really useful blog I have been here reading for about an hour. I am a newbee and your success is very much an inspiration for me. The first page doesn’t need to be just a dream anymore.

Quebec
QC Find Business
, Saskatchewan SK Find Business, Necklace
wholesaler
, fashion
jewelrywholesale
, security alarm system, Quebec
QC Phone Listings
, Saskatchewan SK Phone Listings, wholesale
necklace

Kendall said...

Valuable information and excellent design you got here! I would like to thank you for sharing your thoughts and time into the stuff you post!! Thumbs up


designer
costume jewelry
, security camera systems, Quebec
Business Listings
, Saskatchewan Business Listings, ,wholesale necklace jewelry,, wholesale
rhinestone costume jewelry
, security alarm systems, Quebec
QC Directory Listing

darrell moddy said...

Nice post. I have been searching for articles about valves and actuators and your post really helps. Thanks a lot for posting this.
loans

darrell moddy said...

Well it gives lots of knowledge about Real Estate........
I like tit & it gives directions before going to choose any Real Estate.....

canadian pharmacy online

DiSCo said...

Really trustworthy blog. Please keep updating with great posts like this one. I have booked marked your site and am about to email it

to a few friends of mine that I know would enjoy reading..
seslisohbet
seslichat
sesli sohbet
sesli chat
sesli
sesli site
görünlütü sohbet
görüntülü chat
kameralı sohbet
kameralı chat
sesli sohbet siteleri
sesli chat siteleri
görüntülü sohbet siteleri
görüntülü chat siteleri
kameralı sohbet siteleri
canlı sohbet
sesli muhabbet
görüntülü muhabbet
kameralı muhabbet
seslidunya
seslisehir
sesli sex

Sesli Chat said...

Really trustworthy blog. Please keep updating with great posts like this one. I have booked marked your site and am about to email it

to a few friends of mine that I know would enjoy reading..
seslisohbet
seslichat
sesli sohbet
sesli chat
sesli
sesli site
görünlütü sohbet
görüntülü chat
kameralı sohbet
kameralı chat
sesli sohbet siteleri
sesli chat siteleri
sesli muhabbet siteleri
görüntülü sohbet siteleri
görüntülü chat siteleri
görüntülü muhabbet siteleri
kameralı sohbet siteleri
kameralı chat siteleri
kameralı muhabbet siteleri
canlı sohbet
sesli muhabbet
görüntülü muhabbet
kameralı muhabbet
birsesver
birses
seslidunya
seslisehir
sesli sex