tag:blogger.com,1999:blog-19803222.post114766033923851037..comments2024-03-18T01:45:45.724-06:00Comments on natural language processing blog: NLP is an Engineering Discipline?halhttp://www.blogger.com/profile/02162908373916390369noreply@blogger.comBlogger12125tag:blogger.com,1999:blog-19803222.post-48215094364786773422009-06-01T02:58:48.228-06:002009-06-01T02:58:48.228-06:00I believe construction of such projects requires k...I believe construction of such projects requires knowledge of engineering and management principles and business procedures, economics, and human behavior.control valveshttp://www.meaincorporated.com/noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-41189009066750951242009-05-12T11:21:00.000-06:002009-05-12T11:21:00.000-06:00酒店經紀PRETTY GIRL 台北酒店經紀人 ,禮服店 酒店兼差PRETTY GIRL酒店公關 酒...酒店經紀PRETTY GIRL <A HREF="http://www.taipeilady.com/" REL="nofollow" TITLE="台北酒店經紀人">台北酒店經紀人</A> ,<A HREF="http://tw.myblog.yahoo.com/jw!qZ9n..6QEhhc0LkItOBm/" REL="nofollow" TITLE="禮服店">禮服店</A> 酒店兼差PRETTY GIRL<A HREF="http://www.mashow.org/" REL="nofollow" TITLE="酒店公關">酒店公關</A> 酒店小姐 彩色爆米花<A HREF="http://blog.xuite.net/jkl338801/blog/" REL="nofollow" TITLE="酒店兼職">酒店兼職</A>,酒店工作 彩色爆米花<A HREF="http://tw.myblog.yahoo.com/jw!BIBoU5SeBRs21nb_ajFpncbTqXds" REL="nofollow" TITLE="酒店經紀">酒店經紀</A>, <A HREF="http://mypaper.pchome.com.tw/news/thomsan/3/1310065116/20080905040949/" REL="nofollow" TITLE="酒店上班">酒店上班</A>,酒店工作 PRETTY GIRL<A HREF="http://tw.myblog.yahoo.com/jw!rybqykeeER6TH3AKz1HQ5grm/" REL="nofollow" TITLE="酒店喝酒">酒店喝酒</A>酒店上班 彩色爆米花<A HREF="http://mypaper.pchome.com.tw/news/jkl338801/" REL="nofollow" TITLE="台北酒店">台北酒店</A>酒店小姐 PRETTY GIRL<A HREF="http://www.mashow.org/" REL="nofollow" TITLE="酒店上班">酒店上班</A>酒店打工PRETTY GIRL<A HREF="http://www.tpangel.com/" REL="nofollow" TITLE="酒店打工">酒店打工</A>酒店經紀 彩色爆米花Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1158554267163596712006-09-17T22:37:00.000-06:002006-09-17T22:37:00.000-06:00why would anyone care if NLP is science or not. I...why would anyone care if NLP is science or not. Is it just that you want the prestige of doing real science? This is a funny joke.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1148932616116311752006-05-29T13:56:00.000-06:002006-05-29T13:56:00.000-06:00Given that the work in what goes on under the rubr...Given that the work in what goes on under the rubric "NLP" is driven not by theoretical questions per se, but engineering problems having to do with the computational processing of speech or text, I'd be hesitant to place this somewhat nascent field in the Science with a capital S camp. That said, there are at least a few people attempting to leverage NLP/ML/IT computational techniques and algorithms for their big-S questions. John Goldsmith, Fernando Pereira, and Mark Steedman come to mind. (In fact, most anyone who has been seriously inspired by the work of Chomsky's mentor, Zellig Harris, would probably qualify.) See especially Goldsmith's LINGUISTICA project for an example of a concrete NLP project whose implementation has serious theoretical implications.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1148447732421888322006-05-23T23:15:00.000-06:002006-05-23T23:15:00.000-06:00I'm going to throw out a naive guess and agree tha...I'm going to throw out a naive guess and agree that NLP as it has been pursued seems to be generally more of an "engineering" practice. Look at the work in general over the years: they're mostly evaluation oriented. This may very well be a result of various competitions and funding bodies' orientations, but it definitely has left an imprint.<BR/><BR/>On the other hand, I've seen some statistical physics work that was definitely not evaluation-oriented, and those studies employed NL and IR techniques as methods for exploring and validating their hypotheses. <BR/><BR/>btw- it's great that there's finally a blog dedicated to issues in NLP.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1148442365217720182006-05-23T21:46:00.000-06:002006-05-23T21:46:00.000-06:00Interesting -- I think I tend to agree with Ryan. ...Interesting -- I think I tend to agree with Ryan. It's probably somewhat unfair to pick on linguistics since there aren't many linguists hanging around here, but it's also important to acknowledge that linguistics is not just (English) syntax. Personally, I find historical linguistics and typology to be more "scientific" than your standard studies of syntax/semantics/phonology, but that may be too much of a personal bias. I would liken studying English syntax to studying how Mercury moves, but studying how all language work (eg., via typology) to be more like Newtonian mechanics. It's too bad that linguistics is largely dominated by the study of English.<BR/><BR/>I think you're dead on with the placement of NLP.halhttps://www.blogger.com/profile/02162908373916390369noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1148319396339479462006-05-22T11:36:00.000-06:002006-05-22T11:36:00.000-06:00I would argue that Linguistics could be a science,...I would argue that Linguistics could be a science, but in practice is not. Consider, for instance, Newtonian mechanics. It was a powerful and simple theory that explained most things well and predicted events accurately. However, there were cases, such as the orbit of Mercury, for which it was clearly insufficient. One could easily create a theory that explained the orbit of Mercury, but such a theory would often require complex explanations for most other events. Thus, the scientific community tended to prefer the simple theory that explained most things well over the complex theories that explained more things, but in a much more convoluted manner.<BR/><BR/>Linguistics feels to me like the study of the orbit of Mercury, whereas computational linguistics and NLP seem to provide simple solutions that handle the common cases well. It is the unusual that interests most linguists. This is fair enough, but often the theories proposed to explain the unusual are often much more than is needed for the average case. But who knows, maybe the theory of relativity for Linguistics is just around the corner :)Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1147791328808614532006-05-16T08:55:00.000-06:002006-05-16T08:55:00.000-06:00I'm now more convinced that linguistics is science...I'm now more convinced that linguistics is science than math :). Math seems to fail at Ryan's #4 for the most part (though "open questions" famously like P vs NP are tentative, there comes a point where many hypotheses---theorems---are no longer tentative).<BR/><BR/>I guess I don't see how any of the definitions given exclude the study of language from science. I have many bio friends who replicate experiments hundreds of times because they're unreliable. Just because something is a difficult version of X doesn't make it any less an X. I also don't think that language falls under the category of social phenomenon in the same way that, say, history does. I guess this goes back to my conscious choice distinction (the study of nature is the study of that which we have no real control).<BR/><BR/>I think that whomever Yortsos quoted was saying something akin to the Feynman quote. The world <I>does</I> look different after Engineering because you have changed the world. This is obviously a different sense than Feynman intended.halhttps://www.blogger.com/profile/02162908373916390369noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1147761442379807602006-05-16T00:37:00.000-06:002006-05-16T00:37:00.000-06:00I agree with y'all for the most part, but just to ...I agree with y'all for the most part, but just to play devil's advocate:<BR/><BR/>- It can be argued that math is not a science. Science is grounded in the scientific method, where one develops a hypothesis and tests it with controlled observations from the real world. Much of mathematics involve axioms and deductions, and, as such, mathematic knowledge does not come from the scientific method. Yet math and science are tightly interwined--in fact, much of the hypotheses in science is expressed as mathematic models, formulas, etc. <BR/><BR/>- Some may not classify linguistics as the same kind of science as biology, physics, or chemistry. This is the distinction people often make between soft vs. hard science, or social vs. physical science. Social scientists may argue that they apply the scientific method with the same rigorousness as physical scientists; yet, some may counter that social phenomenon is way to complex to be studied in control settings. <BR/><BR/>Anyway, personally I like Feynman's quote about science: "There is the value of the worldview created by science...The world looks so different after learning science." <BR/><BR/>Now that makes me wonder: Does the world look different after learning engineering?Kevin Duhhttps://www.blogger.com/profile/07407894290644783502noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1147750080727342372006-05-15T21:28:00.000-06:002006-05-15T21:28:00.000-06:00Thanks for the list, Ryan. I tend to agree with y...Thanks for the list, Ryan. I tend to agree with you that (d) is largely missing and that (d) implies (2). I know that, at least around here, <A HREF="http://www.isi.edu/~hovy/" REL="nofollow">Ed Hovy</A> is much more interested in (d) than many.<BR/><BR/>I see no problem with saying that language falls under the umbrella of "natural law." There seems to be little significant difference between language and biology, with the exception that language applies primarily to humans (and perhaps some other higher mammals) rather than all of "life." Language seems to essentially be a byproduct of some aspects of life; I believe this is no different from how a liver is a byproduct of some aspects of life. I'm sure I could dig up plenty of articles that disagree with this though, but I don't know the arguments.<BR/><BR/>Moreover, one can argue that much machine learning is mathematics and therefore also science.<BR/><BR/>(I suppose that here I am defining "guided by natural law" to be the same as "not guided by conscious choice" which would include mathematics [fairly standard] as well as language [perhaps less so].)halhttps://www.blogger.com/profile/02162908373916390369noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1147724562727983672006-05-15T14:22:00.000-06:002006-05-15T14:22:00.000-06:00When deciding whether a field of study is a scienc...When deciding whether a field of study is a science or not, I typically think of the following criteria:<BR/><BR/>(1) It is guided by natural law;<BR/>(2) It has to be explanatory by reference to nature law;<BR/>(3) It is testable against the empirical world;<BR/>(4) Its conclusions are tentative, i.e. are not necessarily the final word; and<BR/>(5) Its is falsifiable.<BR/><BR/>I took these from the Overton opinion (http://www.talkorigins.org/faqs/mclean-v-arkansas.html). Though Overton is not an expert on the history of science, these 5 simple criteria usually form the basis of most theories on the nature of scientific study.<BR/><BR/>I think it could be argued that NLP (and ML in general) satisfy 3-5. It would be much harder to argue for 1 or 2. The first question is whether human language falls in the same domain as<BR/>Biology, Physics, etc. Furthermore, a study of recent NLP conferences will show that most (not all) researchers are interested in systems that are:<BR/><BR/>(a) Empirically sound<BR/>(b) Mathematically sound<BR/>(c) Relatively simple to implement<BR/><BR/>Property (a) is probably given more weight by reviewers, but properties (b) and (c) often make a paper more appealing and lead to its use throughout the field. The problem is that most are not concerned with property (d): the system is based on current knowledge of how humans process and produce language. (d) is really constraint 2 from the Overton opinion. I would argue that this places NLP strictly in the realm of Engineering.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-1147689255570135132006-05-15T04:34:00.000-06:002006-05-15T04:34:00.000-06:00My tinfoil hat directs me to insist that NLP is th...My tinfoil hat directs me to insist that NLP is the science of that we have learned and the engineering of what we will create with our knowledge.Anonymousnoreply@blogger.com