03 August 2009

ACS: Machine Translation Papers at EMNLP

[Guest Post by Adam Lopez... thanks, Adam! Hal's comment: you may remember that a while ago I proposed the idea of conference area chairs posting summaries of their areas; well, Adam is the first to take me up on this idea... I still think it's a good idea, so anyone else who wants to do so in the future, let me know!]

Conferences can be exhausting, and back-to-back conferences can be really exhausting, so I want to convince you to pace yourself and save some energy for EMNLP at the end of the week, because we have some really interesting MT papers. I'll focus mainly on oral presentations, because unlike poster sessions, the parallel format of the oral sessions entails a hard choice between mutually exclusive options, and part of my motivation is to help you make that choice. That being said, there are many interesting papers at the poster session, so do take a look at them!

MT is a busy research area, and we have a really diverse set of papers covering the whole spectrum of ideas: from blue sky research on novel models, formalisms, and algorithms, to the hard engineering problems of wringing higher accuracy and speed out of a mature, top-scoring NIST system. I occasionally feel that my colleagues on far reaches of either side of this spectrum are too dismissive of work on the other side; we need both if we're going to improve translation.

Outside the Box

Before giving you a guided tour through that spectrum, I want to highlight one paper that I found thought-provoking, but hard to classify. Zaidan & Callison-Burch question a basic assumption underlying most machine learning approaches to NLP: that we must optimize on an easily computable approximation to the true loss function. They ask: why not optimize for human judgement? They design a metric that uses judgements on small snippets of a target sentence (defined by a spanning nonterminal in a parse tree of the aligned source sentence) and figure how many judgements they would need to collect (using Amazon Mechanical Turk) to cover an iteration of MERT, exploiting the fact that these snippets reoccur repeatedly during optimization. How hard is this exactly? I would say, in terms of this scale of loss functions, that their metric is a 2. Yet, it turns out to be cheap and fast to compute. The paper doesn't report results of an actual optimization run, but it's in the works... hopefully you'll learn more at the conference.

Connecting Theory and Practice

A few papers combine deep theoretical insight with convincing empirical results. Hopkins & Langmead improve on cube pruning, a popular approximate search technique for structured models with non-local features (i.e. translation with an integrated language model). They move cube pruning from its ad hoc roots to a firm theoretical basis by constructing a reduction to A* search, connecting it to classical AI search literature. This informs the derivation of new heuristics for a syntax-based translation model, including an admissible heuristic to perform exact cube pruning. It's still globally approximate, but exact for the local prediction problem that cube pruning solves (i.e., what are the n-best state splits of an item, given the n-best input states from previous deductions?). Amazingly, this is only slightly slower than the inexact version and improves the accuracy of a strong baseline on a large-scale Arabic-English task.

Li & Eisner show how to compute a huge number of statistics efficiently over a combinatorially large number of hypotheses represented in a hypergraph. The statistics include expected hypothesis length, feature expectation, entropy, cross-entropy, KL divergence, Bayes risk, variance of hypothesis length, gradient of entropy and Bayes risk, covariance and Hessian matrix. It's beautifully simple: they recast the quantities of interest as semirings and run the inside (or inside-outside) algorithm. As an example application, they perform minimum risk training on a small Chinese-English task, reporting gains in accuracy. For a related paper on minimum risk techniques, see the poster by Pauls et al.

Novel Modeling and Learning Approaches

Tromble & Eisner also connect translation to theory by way of a novel model, framing reordering as an instance of the linear ordering problem: given a matrix of pairwise ordering preferences between all words in a sentence, can we find a permutation that optimizes the global score? This is NP-hard, but they give a reasonable approximation based on ITG, with some clever dynamic programming tricks to make it work. Then they show how to learn the matrix and use it to reorder test sentences prior to translation, improving over the lexicalized reordering model of Moses on German-English.

However, most of the new models at EMNLP are syntax-based. In the last few years, syntax-based modeling has focused primarily on variants of synchronous context-free grammar (SCFG). This year there's a lot of work investigating more expressive formalisms.

Two papers model translation with restricted variants of synchronous tree-adjoining grammar (STAG). Carreras & Collins model syntax atop phrase pairs with a parser using sister adjunction (as in their 2008 parser). The model resembles a synchronous version of Markov grammar, which also connects it to recent dependency models of translation (e.g. Shen et al. 2008, Galley et al. 2009, Gimpel & Smith below, and Hassan et al. in the poster session). Decoding is NP-complete, and devising efficient beam search is a key point in the paper. The resulting system outperforms Pharaoh on German-English. DeNeefe & Knight model target-side syntax via synchronous tree insertion grammar (STIG). It's similar to synchronous tree substitution grammar (STSG; previously realized in MT as GHKM) with added left- and right-adjunction operations to model optional arguments. They show how to reuse a lot of the STSG machinery via a grammar transformation from STIG to STSG, and the results improve on a strong Arabic-English baseline.

Gimpel & Smith use a relatively new formalism: quasi-synchronous dependency grammar (QDG). In quasi-synchronous grammar, the generation of a target syntax tree is conditioned on (but not necessarily isomorphic to) a source syntax tree. Formally, each target node can be annotated with any source node. Since in dependency grammar the nodes are words, their QDG model resembles a word-to-word model. Decoding with QDG was not obvious given past work, and is one of several novel contributions of the paper. Another is the idea that all possible biphrases can fire an associated feature, regardless of overlap. Kääriäinen makes this idea central. Instead of reasoning over the latent derivations of a generative model, his model directly optimizes a feature-based representation of the target sentence, where the features consist of any biphrase in the training set (per standard heuristics). This raises some new problems -- such as how to find the target sentence given the optimal feature vector -- which are solved with dynamic programming. The decoder doesn't quite beat Moses when used with a language model, but it's an order of magnitude faster!

Three other papers operate on STSG models, with an emphasis on learning techniques. Cohn & Blunsom reformulate tree-to-string STSG induction as a problem in non-parametric Bayesian inference, extending their TSG model for monolingual parsing, and removing the dependence on heuristics over noisy GIZA++ word alignments. The model produces more compact rules, and outperforms GHKM on a Chinese-English task. This is a hot topic: check out Liu & Gildea's poster for an alternative Bayesian formulation of the same problem and language pair. Galron et al. look at tree-to-tree STSG (from a Data-Oriented Parsing perspective), with an eye towards discriminatively learning STSG rules to optimize for translation accuracy.

Bayesian inference also figures in the model of Chung & Gildea, who aim at bilingually-informed segmentation of a source language. The model is like IBM Model 1, except that the source positions are actually substrings of the source instead of single positions. Reasoning over the substring boundaries makes it resemble an HMM, and they use a sparse prior to avoid overfitting. Tokenizing new text uses the marginal distribution on source language segmentations, and this performs almost as well as a supervised segmenter on Chinese, and better on Korean, in end-to-end translation.

SCFG models aren't completely forgotten: Zhang & Li offer a new twist on reordering in binary-branching SCFG. Given a source parse, we could train a maximum entropy classifier to decide whether any binary production should be inverted; this requires a lot of computation over sparse vectors. They instead represent the features implicitly using a tree convolution kernel, showing nice gains in Chinese-English.

On the algorithmic side, Levenberg & Osborne look at language modeling under the condition that we have unbounded data streams in both source and target language, bounded computation, and the desire to bias our language model towards more recent language use without constantly retraining it. They accomplish this with online perfect hashing (extending previous work) in a succinct data structure that supports deletions, showing that they can draw on recent information in both the source and the target to incrementally update the model while keeping a bounded memory footprint.

Bai et al. focus on the problem of acquiring multiword expressions (i.e. idioms), showing why typical word alignment methods fail, and using a combination of statistical association measures and heuristics to fix the problem, with small gains in Chinese-English.

Decoding

Since SCFG models have become mainstream, there's been a greater emphasis on decoding. Following a recent strand of research on grammar transformations for SCFG, Xiao et al. observe that, in the space of possible transformations, many will pair source yields with huge numbers of target yields, which compete during decoding and thus result in more search errors. The trick is to select a transform that distributes target yields more evenly across source yields. They pose this as an optimization problem and give a greedy algorithm; the resulting grammar is reliably better under a variety of conditions on a Chinese-English task. Meanwhile, Zhang et al. engineer more efficient STSG decoding for the case in which the source is a parse forest and source units are tree fragments. The trick is to encode translation rules in the tree path equivalent of a prefix tree. On Chinese-English this improves decoding speed and ultimately translation accuracy, because the decoder can consider larger fragments much more efficiently. Finally, see Finch & Sumita's comprehensive poster on bidirectional phrase-based decoding for a huge number of language pairs.

Onwards and Upwards

The align/extract/MERT pipeline popularized by Moses and other NIST-style systems is incredibly hard to improve, but several papers manage just that.

Hermjakob's word aligner starts from lexical translation parameters learned by a statistical alignment model. Then, following some fairly general observations on different linguistic classes of words, it uses some well-motivated heuristics to fix a whole bunch of little things that many more principled models ignore: the different behavior of content words (improved via careful manipulation of pointwise mutual information) and function words (improved via constraints from parse structure) is treated along with careful handling of numbers, transliterations, and morphology to give strong improvements in Arabic-English.

Liu et al. then extract phrases by relaxing standard heuristic constraints. Given a posterior probability for every alignment point, they simply calculate the probability that a phrase would be extracted, and use this as their count in the typical frequency-based estimate. It's efficient and improves Chinese-English.

Three papers incorporate new feature types into strong baseline translation models, following a recent trend. Shen et al. devise some clever local features using source-side context, derivation span length, and dependency modeling to make impressive improvements on an already impressive baseline system in both Chinese-English and Arabic-English. Matsoukas et al. then show how a mixed-genre system can effectively be adapted for a particular target domain, by using a small amount data to tune weights tied to genre and collection types in the training corpus, again with strong results in Arabic-English. Mauser et al. take their previous triplet lexicon model (a probabilistic feature using an outside source word as additional conditioning context) and move it from a reranking step into the decoding step, with a nice experimental treatment showing improvements in large-scale Chinese-English and Arabic-English.

If you've seen the latest NIST results, you know that system combination gives huge improvements. Check out posters by He & Toutanova, Duan et al., and Feng et al. to learn the latest techniques. Last but not least, if you need a strategy for language pairs with very little parallel data, the poster by Nakov & Ng will interest you.

Thanks

EMNLP was the first time I've been area chair for a conference, and it was really rewarding to work with such great volunteers and< to see the great papers that were selected (I should note here that I included two papers not on my track that I'm quite familiar with -- the ones from Edinburgh). It was also very enlightening, but that's another story. Many thanks to Hal for offering this forum to share the results!

106 comments:

Jonathan Graehl said...

This is very nice.

One thing that bothers me about MT research is the differing baseline strengths, and the less-than-full additivity of improvements (or their effectiveness being limited to a certain amount of training data).

I appreciate it when authors are able to report their improvement over a variety of conditions, and especially when in system combination, publicly available nbests are used.

شهرام said...

Dear hall Daume!
I am philosophical logic student in Iran and seeking good articles about relationship between sintax and semantics.
Could you help me?
Best Regards.
d3d3d3@maktoob.com

english summer camp said...

I am a english teacher and having 10 year working experience. I see that your blog is very nice.

Fuck Google said...

Re: http://nlpers.blogspot.com/2009/08/acs-machine-translation-papers-at-emnlp.html

Agreed: exhausting but fascinating work! In Singapore @ACL-IJCNLP but outside of EMNLP, the TextGraphs workshop also touched on MT (by way of LM):

"Social (distributed) language modeling, clustering and dialectometry"

Slides and Such

sprachreise barcelona said...

You have put nice effort to make your blog great. It would be great if you add some posts about Conversation. It matters too much in any language.

Anonymous said...

I really liked your blog! You have some great content. Check out my blog and give me some feedback Please come visit my site Lubbock Yellow Page Business Directory when you got time.

Anonymous said...

Well, nice article buddy… Someone will love to read this infor if I tell her about this. She’s really interested in this subject. Thanks again… Please come visit my site Baltimore Business Directory when you got time.

digital asset management service said...

What a facinating article. I’m looking for a marketing expert to help with a project, could you help? Please come visit my site source digital asset
when you got time.

customer relationship management database said...

You may have not intended to do so, but I think you have managed to express the state of mind that a lot of people are in. The sense of wanting to help, but not knowing how or where, is something a lot of us are going through. Please come visit my site customer relationship
when you got time.

hotels said...

Nice, I think it could be interesting to add some more entries following this one, and probably it's not only me having this opinion. Cheers! I would love some feedback on my site hotel when you got time.

travel trailer said...

Thank you for your good humor and for allowing yourself to be convinced that this was the right show for you to work on. Please come visit my site trailers when you got time.

generalized anxiety said...

Wow! Thank you! I always wanted to write in my site something like that. Can I take part of your post to my blog? Please come visit my site generalized anxiety disorder when you got time.

headache-migraine said...

I usually don’t leave comments!!! Trust me! But I liked your blog…especially this post! Would you mind terribly if I put up a backlink from my site to your site? Please come visit my site migraine headache when you got time.

Anonymous said...

information will be very useful for me.. Thanks for all your help and wishing you all the success in your business Thanks for all your help and wishing you all the success in your business Please come visit my site Akron Business Directory when you got time.

Anonymous said...

This is just another reason why I like your website. I like your style of writing you tell your stories without out sending us to 5 other sites to complete the story. Please come visit my site Virginia Beach Yellow Page Business Directory when you got time.

telephone service said...

Thanks for posting such kind of usefull information.Keep Posted in future as well.Thank you! I would love some feedback on my site call when you got time.

sexy video's said...

I can see that you are putting a lot of time and effort into your blog and detailed articles! I am deeply in love with every single piece of information you post here. Will be back often to read more updates! Please come visit my site sexy video's when you got time.

Anonymous said...

information will be very useful for me.. Thanks for all your help and wishing you all the success in your business Thanks for all your help and wishing you all the success in your business Please come visit my site Business Reviews Of Milwaukee City when you got time.

Anonymous said...

information will be very useful for me.. Thanks for all your help and wishing you all the success in your business Thanks for all your help and wishing you all the success in your business Please come visit my site Find Business Madison when you got time.

Wholesale Distributor said...

Awesome! I have read a lot on this topic, but you definitely give it a good vibe. This is a great post. Will be back to read more! Feel free to check out my site jewelry when you got time.

wholesale gift said...

I found your blog on google and read a few Thanks for the information you mentioned here, I'm looking forward to see your future posts. Cheers !! Please come visit my site home accent give me any valuable feedbacks.

Anonymous said...

You owe a very nice and interesting blog. Please come visit my site Austin Business Services And Classifieds when you got time.

Anonymous said...

You owe a very nice and interesting blog. Please come visit my site Texas TX Phone Directory when you got time.

Anonymous said...

I usually don’t leave comments!!! Trust me! But I liked your blog…especially this post! Would you mind terribly if I put up a backlink from my site to your site? Please come visit my site Indianapolis Directory Businesses when you got time.

Anonymous said...

I usually don’t leave comments!!! Trust me! But I liked your blog…especially this post! Would you mind terribly if I put up a backlink from my site to your site? Please come visit my site Business Yellow Pages Indianapolis when you got time.

Sport Injury said...

What a blog filled with vital and important information this is .. It must have taken a lot of hours for you to write these yourself. Hats off from me for your hard work. Please come visit my site Sports injuries give me any valuable feedbacks.

Apartments Living said...

That is some inspirational stuff... Never know that opinions could be this varied. Thanks for all the enthusiasm to offer such helpful information here. Please come visit my site Apartment living when you got time.

Anonymous said...

Excellent article , i just share it with my friend of Italy. I Stumble UP your blog post , you will notice an increase of traffic within 24 hours for targeted people. Cheers . Please come visit my site City Guide Santa Ana when you got time.

rr8004 said...

Awesome! I have read a lot on this topic, but you definitely give it a good vibe. This is a great post. Will be back to read more! Please come visit my site Las Vegas Business Directory Forum Blog Classifieds when you got time.

Kamloops Business Listings said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

Kamloops Business Directory, Kamloops Agriculture, fishing & Forestry, Kamloops Apparel & Accessories, business directory listings of Kamloops Automotive, Kamloops Business & Professional Services, Kamloops Computers, Communications & Electronics, home garden furnishing, real estate business finderKamloops Construction & Renovation, Kamloops Education, Kamloops Entertainment & Media, Kamloops Family & Community, Lawyers Attorneys & Law Firms Directory Kamloops Finance & Legal,dinning restaurants Entertainment serving Kamloops Food & Beverages, Kamloops Health & Medicine Doctors Hospitals, Kamloops Home & Garden, Kamloops Industrial supplies & services , Kamloops Personal Care, Kamloops Public utilities & environment, Kamloops Real-Estate & Insurance, Kamloops Shopping & Specialty Stores, shopping, retail, department stores company guide of Kamloops Sports & Recreation, Kamloops Transportation, Kamloops Travel & Lodging

Illinois Personal Injury Attorneys said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
china
t shirt wholesale
, China
home security alarm
, rings,, buy
from china
, china
wholesale tools
, China
home security cameras

Indiana Personal Injury Attorneys said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
jewellery,, china
import export
, wholesale
product from china
, security
home alarm
, wholesale,, exporter
company
, cheapest
china wholesale

Saskatoon Directory said...

You got a really useful blog I have been here reading for about an hour. I am a newbee and your success is very much an inspiration for me. The first page doesn’t need to be just a dream anymore.
mesotheliom
lawsuits and asbestos litigation
, wholesaler,
wholesale supply, wholesale
supply
, appeal attorneys
lawyers
, Asbestos
Diseases Lawyers and Attorneys
, bulk wholesale

Regina Directory said...

Valuable information and excellent design you got here! I would like to thank you for sharing your thoughts and time into the stuff you post!! Thumbs up wholesale uk, wholesale
uk
, Litigation &
Appeals Lawyers
, asbestos
lung disease law firms

debt collection attorney said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here.Alabama Collection Attorneys,
Alaska Collection Attorneys,
Arizona Collection Attorneys,
Arkansas Collection Attorneys,
California Collection Attorneys,
Colorado Collection Attorneys,
Connecticut Collection Attorneys,
Delaware Collection Attorneys,
Washinton, DC Collection Attorneys,

Computers and Technology lawyers said...

You got a really useful blog I have been here reading for about an hour. I am a newbee and your success is very much an inspiration for me. The first page doesn’t need to be just a dream anymore.Alabama Computers Technology law Attorney,
Alaska Computers Technology law Attorney,
Arizona Computers Technology law Attorney,
Arkansas Computers Technology law Attorney,
California Computers Technology law Attorney,
Colorado Computers Technology law Attorney,
Connecticut Computers Technology law Attorney,
Delaware Computers Technology law Attorney,

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..


remedy
herbal
, nature conservation, california
guide
, Florida guide, herb
gardening
, growing vegetables, indoor
air pollution
, home garden greenhouse, herbal
remedies for

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

the nature conservancy, california
information
, Florida information, growing
herbs
, grow vegetables, indoor
air quality
, garden greenhouses, herbal
natural remedies
, nature preserve, attractions
in california

Unknown said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here.
resale consignment
shop
, real estate lawyers
los angeles
, cheap window coverings, remove
ceramic tile
, central towing, trucking
service
, maternity resale, florida
real estate lawyers
, cornice window treatment, ceramic
tile adhesive
, dingy towing, truck
transportation services
, resale
vintage
, ,

Unknown said...

found your site on del.icio.us today and really liked it.. i bookmarked it and will be back to check it out some more later ..new window installation, ceramic
tile art
, rv tow vehicle, super
service trucking
, clothes consignment

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..



Business phone directory Boston
City
, Business phone directory Denver City, Business phone directory Las Vegas City, Business phone directory Mesa City, Business phone directory Long Beach
City
, Business phone directory Anaheim City

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!


Free Classified Buy And Sell
of Boston City
, Free Classified Buy And Sell of Denver
City
, Free Classified Buy And Sell of Las
Vegas City
, Free Classified Buy And Sell of Mesa
City

Montana MT Helena Billings Classified ads said...

You got a really useful blog I have been here reading for about an hour. I am a newbee and your success is very much an inspiration for me. The first page doesn’t need to be just a dream anymore.

Free classified ads Massachusetts , Free classified ads Florida , North Carolina NC Raleigh Charlotte
Classified ads
, New Mexico
NM Santa Fe Albuquerque Classified ads
, Montana
MT Helena Billings Classified ads

Motorcycle Classified Boat Ads said...

Valuable information and excellent design you got here! I would like to thank you for sharing your thoughts and time into the stuff you post!! Thumbs up



Free Classifieds, Free
Classifieds
, Free Classifieds, Free
Classifieds
, Free Classifieds, Motorcycle Classified Boat
Ads

Houstonlaw said...

Me & my neighbour were preparing to do some research about that. We got a good book on that matter from our local library and most books where not as influensive as your information. I am very glad to see such information which I was searching for a long time.
State Of Illinois  , State Of Louisiana  , State Of Minnesota  , State Of Nevada  , State Of New Mexico  , Colorado Business Directory, Illinois
Business Directory
, Louisiana
Business Directory
, Minnesota
Business Directory

Houstonlaw said...

I just couldnt leave your website before saying that I really enjoyed the quality information you offer to your visitors... Will be back often to check up on new stuff you post here! Nevada
Business Directory
, New
Mexico Business Directory
, Colorado Yellow Pages, Illinois
Yellow Pages
, Louisiana
Yellow Pages
, Minnesota
Yellow Pages

Unknown said...

Arizona insurance companies, insurance agents brokers and insurance guide. Comprehensive information about Arizona car insurance, home owner insurance, health insurance, life insurance and more.

Arizona
Disability Insurance
, Arizona
Earthquake insurance
, Arizona
Estate Planning Insurance And Legal Services
, Arizona
Farm, Crop, & Livestock Insurance
, Arizona
Financial Guaranty & Life Insurance
, Arizona
Fire Insurance
, Arizona
Fleet Insurance
, Arizona
Flood Insurance
, Arizona
Foreign Insurance
, Arizona
Franchising
, Arizona
Government Insurance Carriers
, Arizona
Group Insurance
, Arizona
Health Insurance

nasirdallas said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader.. Detroit Business Search Engine, Columbus Business Search Engine, El Paso Business Search Engine, Garland Business Search Engine, Raleigh Business Search Engine

nasirdallas said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Philadelphia Business
Directory Forum Blog Classifieds
, Detroit Business Directory Forum Blog
Classifieds
, Columbus Business Directory Forum Blog Classifieds, El Paso Business Directory Forum
Blog Classifieds
, Garland Business Directory Forum Blog Classifieds

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
Wisconsin
Business Services And Classifieds
, Virginia Directory, Texas
Directory
, Wyoming Directory, Virginia Yellow Page Business Directory, Texas
Yellow Page Business Directory

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Wyoming
Yellow Page Business Directory
, Local Business Directory Of Virginia,

Local
Business Directory Of Texas
, Local
Business Directory Of Wyoming
, Phone
Directory Of Virginia 

Unknown said...

Washington insurance agencies and brokers. Washington car insurance, home owner insurance, health insurance, life insurance and more.
Washington
Accident & Health Insurance
, Washington
Aircraft & Aviation Insurance
, Washington
Auto Insurance
, Washington
Bail Bonds Referral Services
, Washington
Boat & Yacht Insurance
, Washington
Business Insurance
, Washington
Business Interruption Insurance
, Washington
Casualty insurance
, Washington
Churches Insurance
, Washington
Contents insurance
, Washington
Corporate Insurance Adjusters
, Washington
Credit Insurance
, Washington
Crime insurance
, Washington
Dental Insurance

Unknown said...

Washington insurance companies, insurance agents brokers and insurance guide. Comprehensive information about Washington car insurance, home owner insurance, health insurance, life insurance and more.
Washington
Home Health Care Insurance
, Washington
Home Insurance
, Washington
Hospitalization Insurance
, Washington
Insurance
, Washington
Insurance Adjusters
, Washington
Insurance Agents & Brokers
, Washington
Insurance Annuities
, Washington
Insurance Bonds
, Washington
Insurance Claims & Services
, Washington
Insurance Claims Processing Services
, Washington
Insurance Consultants & Advisors
, Washington
Insurance Employment Agencies
, Washington
Insurance Examinations
, Washington
Insurance Examiners

Anonymous said...

This is such a great resource that you are providing and you give it away for free. I love seeing websites that understand the value of providing a quality resource for free. It’s the old what goes around comes around routine.
Business Directory  Fremont , Business
Directory  Cincinnati 
, Business
Directory  Chesapeake 
, Business
Directory  St. Petersburg 
, Business Directory  Anchorage 

Anonymous said...

There are certainly a lot of details like that to take into consideration. That’s a great point to bring up. I offer the thoughts above as general inspiration but clearly there are questions like the one you bring up where the most important thing will be working in honest good faith.
Phone
Directory Of Minneapolis City Minnesota MN State 
, Business Reviews Of Fremont
City
, Business Reviews Of Cincinnati City, Business Reviews Of Chesapeake City, Business Reviews Of St. Petersburg
City
, Business Reviews Of Anchorage City

Unknown said...

Hi! Thanks for the great information you havr provided! You have touched on crucuial points! I would just like to say to all my fellow Entrepreneurs…just remember that persistence is the key to success. As Winston Churchill once said: “Never, never, never give up!”
Texas
Accident & Health Insurance
, Texas
Aircraft & Aviation Insurance
, Texas
Auto Insurance
, Texas
Bail Bonds Referral Services
, Texas
Boat & Yacht Insurance
, Texas
Business Insurance
, Texas
Business Interruption Insurance
, Texas
Casualty insurance
, Texas
Churches Insurance
, Texas
Contents insurance
, Texas
Corporate Insurance Adjusters
, Texas
Credit Insurance
, Texas
Crime insurance
, Texas
Dental Insurance

Unknown said...

Nice experience shared. Its not less than an interview. Great way of posting such good and informative stuff.
Texas
Disability Insurance
, Texas
Earthquake insurance
, Texas
Estate Planning Insurance And Legal Services
, Texas
Farm, Crop, & Livestock Insurance
, Texas
Financial Guaranty & Life Insurance
, Texas
Fire Insurance
, Texas
Fleet Insurance
, Texas
Flood Insurance
, Texas
Foreign Insurance
, Texas
Franchising
, Texas
Government Insurance Carriers
, Texas
Group Insurance
, Texas
Health Insurance

Unknown said...

If you had some way of rating posts I would for sure give you a high rating my friend!
Texas
Home Health Care Insurance
, Texas
Home Insurance
, Texas
Hospitalization Insurance
, Texas
Insurance
, Texas
Insurance Adjusters
, Texas
Insurance Agents & Brokers
, Texas
Insurance Annuities
, Texas
Insurance Bonds
, Texas
Insurance Claims & Services
, Texas
Insurance Claims Processing Services
, Texas
Insurance Consultants & Advisors
, Texas
Insurance Employment Agencies
, Texas
Insurance Examinations
, Texas
Insurance Examiners

Anonymous said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents! Local
Classified Ads Of Toledo
, Local
Classified Ads Of Arlington
, Local
Classified Ads Of Orlando
, Local
Classified Ads Of Buffalo
, St. Paul United States

Anonymous said...

What a great post, I actually found it very thought provoking, you just never know sometimes when a golden nugget of information is going to land at your feet, thanksGlendale California CA, Toledo
Ohio OH
, Arlington
Virginia VA
, Orlando Florida
FL
, Buffalo New York
NY
, Local Classified
Ads Of St. Paul

Anonymous said...

found your site on del.icio.us today and really liked it.. i bookmarked it and will be back to check it out some more later ..
Business Resources Comprehensive Listings, Business Resources Comprehensive Listings, Business Resources Comprehensive Listings, Business Resources Comprehensive Listings, St. Paul Business Phone Listing, Glendale City Business Listings

Anonymous said...

Hi! Thanks for the great information you havr provided! You have touched on crucuial points! I would just like to say to all my fellow Entrepreneurs…just remember that persistence is the key to success. As Winston Churchill once said: “Never, never, never give up!” Toledo City Business Listings, Arlington City Business Listings, Orlando City Business Listings, Buffalo City Business Listings, Business Resources Comprehensive Listings

Anonymous said...

This is such a great resource that you are providing and you give it away for free. I love seeing websites that understand the value of providing a quality resource for free. It’s the old what goes around comes around routine.
Minnesota
Insurance Information & Referral Services
, Minnesota
Insurance Inspection Services
, Minnesota
Insurance Law Attorneys
, Minnesota
Insurance Plan Administrators
, Minnesota
Insurance Retirement Annuities & Pension
, Minnesota
Insurance Underwriters
, Minnesota
Insured Property Replacement Services
, Minnesota
Landlords insurance
, Minnesota
Liability & Malpractice Insurance
, Minnesota
Life Insurance
, Minnesota
Marine insurance
, Minnesota
Medicare Supplemental & Long Term Care Insurance

Anonymous said...

There are certainly a lot of details like that to take into consideration. That’s a great point to bring up. I offer the thoughts above as general inspiration but clearly there are questions like the one you bring up where the most important thing will be working in honest good faith.
Minnesota
Mobile Home Insurance
, Minnesota
Mortgage Insurance
, Minnesota
Motorcycle Insurance
, Minnesota
Mutual Fund Insurance
, Minnesota
Oil & Gas Companies
, Minnesota
Personal Insurance
, Minnesota
Personal Watercraft Insurance
, Minnesota
Pet Insurance
, Minnesota
Property insurance
, Minnesota
Public Insurance Adjusters
, Minnesota
Restaurant Insurance
, Minnesota
RV Insurance
, Minnesota
Special Risks Insurance
, Minnesota
SR- Insurance
, Minnesota
Terrorism insurance
, Minnesota
Title Insurance
, Minnesota
Travel Insurance
, Minnesota
Truck Insurance Commercial
, Minnesota
Wage insurance

Anonymous said...

This is such a great resource that you are providing and you give it away for free. I love seeing websites that understand the value of providing a quality resource for free. It’s the old what goes around comes around routine.



Cleveland Business Services And Classifieds, Norfolk Business Services And Classifieds, Tampa Business Services And Classifieds, Jersey City Business Services And
Classifieds
, Honolulu Business Services And Classifieds

Anonymous said...

There are certainly a lot of details like that to take into consideration. That’s a great point to bring up. I offer the thoughts above as general inspiration but clearly there are questions like the one you bring up where the most important thing will be working in honest good faith.


Directory Modesto City, Directory Cleveland City, Directory Norfolk City, Directory Tampa City, Directory Jersey City City, Directory Honolulu City

Anonymous said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
buy music instruments, health
care radiology
, antique furniture store, Alternative
Medicine Treatments
, pediatric
neurology
, musical instrument
buy
, radiological xray
clinic

Anonymous said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
antique furniture stores, Alternative
Veterinary Medicine
, pediatrician
information
, buy music
instrument
, online antique stores, Cure
Alternative Medicine
, questions
to ask pediatrician

Anonymous said...

A fantastic read….very literate and informative. Many thanks….what theme is this you are using and also, where is your RSS button ?

buy
used musical instruments
, collectables and antiques, Alternative
Medicine Acne
, buy cheap
musical instruments
, antique & collectible, Alternative
Medicine Education

Anonymous said...

Hey very nice blog!! Man .. Beautiful .. Amazing .. I will bookmark your blog and take the feeds also…Hey very nice blog!! Man .. Beautiful .. Amazing .. I will bookmark your blog and take the feeds also… find dentists, where
to buy musical instruments
, antique and collectible, Alternative
Medicine Physicians
, dental
dentist
, we buy musical
instruments

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

dermatologist
consultant
, fleamarket in, senior
citizen magazine
, B2b Companies, General
Store Antiques
, Wholesale
Suppliers
, dermatologist cost, peddlers'
market
, senior citizen rent, B2b Market

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Antique
Price Guides
, Wholesale
Items
, dermatologist for acne, fairground
market
, black senior citizens, Export Trade Leads, Antique
Guide Online
, Wholesale
Rings
, dermatologist office, usa
fleamarket

Anonymous said...

Hello, i am glad to read the whole content of this blog and am very excited and happy to say that the webmaster has done a very good job here to put all the information content and information at one place, i will must refer this information with reference on my website ... antique dealer, physical
therapy rehabilitation
, family
dentist
, towing service, antiques dealers, rehabilitation, find
a dentist

Anonymous said...

Your article was quite intriguing and the information quite useful. Will check your site often to see other great posts you make! Regards
auto towing, antiques dealer, health
services occupational therapy
, general
dentistry
, tow, antique furniture dealers, rehabilitation
medical services
, general dentistry
center

Anonymous said...

Valuable information and excellent design you got here! I would like to thank you for sharing your thoughts and time into the stuff you post!! Thumbs up insurance
agent
, festival flea market, , Wholesale, Wholesale
Clothes
, Auto Dealers
Canada
, insurance brokers

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

Alexandria
Phone Directory
, Warren
Phone Directory
, Sunnyvale
Phone Directory
, Cedar
Rapids
Phone Directory
, Lancaster
Telephone Directory

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!
Kansas
City
Telephone Directory
, Alexandria
Telephone Directory
, Warren
Telephone Directory
, Sunnyvale
Telephone Directory
, Cedar
Rapids
Telephone Directory
, Lancaster Business Phone

Anonymous said...

Hello, i am glad to read the whole content of this blog and am very excited and happy to say that the webmaster has done a very good job here to put all the information content and information at one place, i will must refer this information with reference on my website ...
Garden Supply, Landscaping Equipmentpsychiatric
journalalternative medicine herbs,
Garden Supplies, Lawn Mowingpsychiatric
solutionsalternative holistic medicine

Anonymous said...

Your article was quite intriguing and the information quite useful. Will check your site often to see other great posts you make! Regards Lawn Garden Equipment, Lawn Care
Contracts
adolescent psychiatricalternative medicine center,
Lawn And Garden Equipment, Garden
Equipment
psychiatric facilitiesalternative medicine doctors

Unknown said...

Hello, i am glad to read the whole content of this blog and am very excited and happy to say that the webmaster has done a very good job here to put all the information content and information at one place, i will must refer this information with reference on my website ...

children's
resale store
, real estate
Free Legal advice
, modern window treatments, ceramic
backsplash tile
, fifth wheel
towing

Unknown said...

Your article was quite intriguing and the information quite useful. Will check your site often to see other great posts you make! Regards
brown elephant resale
store
, Real Estate Lawyers, sliding glass door window treatments, ceramic
tile backsplash
, motorhome towing

Unknown said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here. about veterinarians, Online
Printing Company
, Homes
Construction
, Brochure Printing
Company
, New Construction
Homes

Anonymous said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here.wood floor companies, diesel
truck repair
, speedy muffler, security
system
, wood flooring guide, free
truck repair

Discount Furniture Stores said...

Great researched articles and blog site, keep up the work!

Unknown said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here.
sexual abuse law firms,
Transportation
Public Utilities Attorneys
, sexual abuse attorney,
wholesale costume jewelry distributors,
Public Utilities
Attorneys

Unknown said...

Hey very nice blog!! Man .. Beautiful .. Amazing .. I will bookmark your blog and take the feeds also…
wholesale
dance wear
, State
of North Carolina Lawyer Directory
, State
of North Dakota Lawyer Directory
, wholesale
dancing wear

Anonymous said...

If you had some way of rating posts I would for sure give you a high rating my friend!cheap clothing
suppliers
, wholesale fashion jewellery,
wholesale fashion watches,
wholesale fashion watches, wholesale
fashion jewellery
, b2b website, china
manufactures
, , wholesale
fashion accessories
, wholesales
fashion
, wholesales fashion,
wholesale fashion accessories,
b2b commerce, china
buyers
,

Anonymous said...

Your summaries are always top-notch. Thanks for keeping us apprised. I’m reading every word here.wholesale
beach clothing
, wholesale fashion
costume
, wholesale fashion
sunglasses
, wholesale fashion
sunglasses
, wholesale fashion costume,
b2b directory, china
distributors
, beach clothes,
wholesaler fashion, wholesale
fashion suppliers
, wholesale fashion
suppliers
, wholesaler fashion,
b2b trade, china
importer
,

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader

Mesothelioma Attorney Michigan, Houston
County Home Loan
, wholesale
warehouses
, Divorce Attorneys In Indianapolis, Divorce
Attorneys In Phoenix
, Attorney
At San Antonio
, Attorney
At San Diego
, Attorney
At Detroit
, Attorney
At Columbus
, Attorney
At Michigan

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!



Mortgage
Company In Houston
, wholesale
distributers
Attorneys Of Indianapolis, Attorneys
Of Phoenix
, Divorce
Attorneys In San Antonio
, Divorce
Attorneys In San Diego
, Divorce
Attorneys In Detroit

Unknown said...

You got a really useful blog I have been here reading for about an hour. I am a newbee and your success is very much an inspiration for me. The first page doesn’t need to be just a dream anymore.
trade
directory
, business
forums
, business
forums
, wholesale
gifts
, ,
, business in china, business in china, trade
directory
, business
forums

Unknown said...

Valuable information and excellent design you got here! I would like to thank you for sharing your thoughts and time into the stuff you post!! Thumbs up business forums, wholesale
gifts
, ,
, business of china, business of china, b2b
leads,

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..



wholesale
shoes
, bankruptcy court information, costume jewellery, clothes
wholesale
, clothes
wholesale
, information about bankruptcy

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!



Divorce Attorneys In Alabama, Divorce
Attorneys In Alaska
, Divorce
Attorneys In Arizona
, Divorce
Attorneys In Arkansas
, Divorce
Attorneys In California
, Divorce
Attorneys In Colorado
, Divorce
Attorneys In Connecticut

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..
Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!


Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..

Business
Pages Langley
, Alberta
Business Name Search
, Business
Pages Calgary
, Business Pages
Edmonton
, Business Pages
Abbotsford
, Business Pages Calgary, Business Pages
Chilliwack

inventory said...

Nice experience shared. Its not less than an interview. Great way of posting such good and informative stuff.

Colorado
Health Insurance
, Oklahoma
Health Insurance
, disability
insurance premium
, Tennessee Health Insurance, Manufacturers,
Exporters, Importers
, West
virginia Insurance Company
, Colorado
Insurance Company

inventory said...

If you had some way of rating posts I would for sure give you a high rating my friend!

Oklahoma
Insurance Company
, disability
insurance program
, Tennessee Insurance Company, China
Suppliers
, West
virginia Manufacturers Insurance
, Colorado
Manufacturers Insurance
, Oklahoma
Manufacturers Insurance
, disability
insurance rate

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..


Burnaby
British Columbia Businesses
, Chilliwack
British Columbia Businesses
, Coquitlam
British Columbia Businesses
, Langley British
Columbia Find A Business

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

Alberta
AB Directory Listing
, Calgary
Alberta Find A Business
, Edmonton
Alberta Find A Business
, Abbotsford British Columbia Find A Business, Burnaby
British Columbia Find A Business
, Chilliwack
British Columbia Find A Business

Unknown said...

This is very interesting information. I am doing some research for a class in school. and i liked the post. do you know where I can find other information regarding this? I am finding other information on this but nothing that I can use really in my paper for my final. do you have any suggestions?

canada pharmacy

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader.. business opportunity
brokers
, Wholesale Clothing, sun
tanning salons
, jewelry,
watch, gift China Manufacturer
, security
surveillance systems
, find
a business broker
, Silver
Jewelry
, tanning salon
business
, jewelry, watch,
gift Product Supplier

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!

business
broker service
, Costume Jewelry, tanning
bed reviews
, jewelry, watch,
gift China B2b Trade Company
, http://www.patrolservicessecurityguards.com
style='visibility:hidden;mso-ignore:visibility'>&business
broker usa
, Watches Jewelry, , jewelry,
watch, gift Asian International Import Export
, Security
Guard & Patrol Services

Unknown said...

Good writing. Keep up the good work. I just added your RSS feed my Google News Reader..


wholesale
jewelry
, California Alcohol & Drug Rehab , Houston Alcohol & Drug Rehab , Detroit Alcohol & Drug Rehab , Pennsylvania Alcohol & Drug Rehab

Unknown said...

Well Whattadya know, yet another great site to add to my reader! Google blog search has you pretty well indexed it seems! you have some brilliant contents!



New York Alcohol & Drug Rehab , Phoenix Alcohol & Drug Rehab , Texas Alcohol & Drug Rehab , Colorado Alcohol & Drug Rehab