tag:blogger.com,1999:blog-19803222.post7771159248994355074..comments2024-03-18T01:45:45.724-06:00Comments on natural language processing blog: More complaining about automatic evaluationhalhttp://www.blogger.com/profile/02162908373916390369noreply@blogger.comBlogger5125tag:blogger.com,1999:blog-19803222.post-66638199660705558322010-05-21T11:31:42.658-06:002010-05-21T11:31:42.658-06:00hi friends I am very happy because I found a excel...hi friends I am very happy because I found a excelent blog like More complaining about automatic evaluation"...<br />your blog is very profesional thanks a lotgeneric viagrahttp://www.xlpharmacy.com/noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-81030784377295445182009-09-20T20:02:25.428-06:002009-09-20T20:02:25.428-06:00艾葳酒店經紀公司提供專業的酒店經紀, 酒店上班小姐,八大行業,酒店兼職,傳播妹,或者想要打工兼差、打...艾葳<a href="http://www.aed8.com" rel="nofollow">酒店經紀</a>公司提供專業的<a href="http://www.aed8.com/front/bin/ptlist.phtml?Category=330637" rel="nofollow">酒店經紀</a>, <a href="http://tw.myblog.yahoo.com/jw!ycVTCIqTFRMGkedtdX2NjK6QDLD6DG9E" rel="nofollow">酒店上班</a>小姐,<a href="http://www.wretch.cc/blog/aed8888" rel="nofollow">八大行業</a>,<a href="http://blog.xuite.net/aed8888/8888" rel="nofollow">酒店兼職</a>,<a href="http://r2av.com" rel="nofollow">傳播妹</a>,或者想要<a href="http://blog.sina.com.tw/loveed8/" rel="nofollow">打工兼差</a>、<a href="http://blog.yam.com/haloveha" rel="nofollow">打工</a>,<a href="http://blog.roodo.com/kiss88" rel="nofollow">兼差</a>,<a href="http://avs6.com" rel="nofollow">八大行業</a>,<a href="http://m5av.com" rel="nofollow">酒店兼職</a>,想去<a href="http://avx0.com/05" rel="nofollow">酒店上班</a>, <a href="http://%20http://m5av.com%20/03" rel="nofollow">日式酒店</a>,<a href="http://%20http://avx6.com/03" rel="nofollow">制服酒店</a>,<a href="http://%20http://r2av.com/01" rel="nofollow">ktv酒店</a>,<a href="http://m5av.com/02" rel="nofollow">禮服店</a>,整天穿得水水漂漂的,還是想去<a href="http://avz4.com/02" rel="nofollow">制服店</a>當<a href="http://www.wretch.cc/blog/aed8ed8" rel="nofollow">日領</a>上班小姐,水水們如果想要擁有<a href="http://0av0.com" rel="nofollow">打工</a>工作、<a href="http://s6av.com/05" rel="nofollow">晚上兼差工作</a>、<a href="http://avs6.com/05" rel="nofollow">兼差打工</a>、<a href="http://avz4.com/05" rel="nofollow">假日兼職</a>、<a href="http://l7av.com/05" rel="nofollow">兼職工作</a>、<a href="http://mypaper.pchome.com.tw/news/aed8888/" rel="nofollow">酒店兼差</a>、<a href="http://avl7.com/05" rel="nofollow">兼差</a>、<a href="http://av0x.com" rel="nofollow">打工兼差</a>、<a href="http://av0x.com/01" rel="nofollow">日領工作</a>、<a href="http://av6p.com%20/01" rel="nofollow">晚上兼差工作</a>、<a href="http://av8x.com/03" rel="nofollow">酒店工作</a>、<a href="http://www.aed8.com/front/bin/ptlist.phtml?Category=330643" rel="nofollow">酒店上班</a>、<a href="http://av8x.com/05" rel="nofollow">酒店打工</a>、<a href="http://av8x.com" rel="nofollow">兼職</a>、<a href="http://av6p.com" rel="nofollow">兼差</a>、<a href="http://avz4.com" rel="nofollow">兼差工作</a>、<a href="http://avl7.com" rel="nofollow">酒店上班</a>等,想了解<a href="http://avl7.com/04" rel="nofollow">酒店相關工作</a>和<a href="http://avz4.com/04" rel="nofollow">特種行業</a>內容,想<a href="http://avu4.com" rel="nofollow">兼職工作日領</a>、<a href="http://l7av.com/" rel="nofollow">假日兼職</a>、<a href="http://s4av.com/" rel="nofollow">兼差打工</a>、或<a href="http://x6av.com" rel="nofollow">晚班兼職</a>想擁有<a href="http://blog.udn.com/aed8888" rel="nofollow">鋼琴酒吧</a>又有保障的工作嗎???又可以<a href="http://0av0.com/05" rel="nofollow">現領</a>請找專業又有保障的艾葳<a href="http://www.aed8.com/front/bin/home.phtml" rel="nofollow">酒店經紀</a>公司!<br /><br />艾葳<a href="http://www.aed8.com/front/bin/ptlist.phtml?Category=330639" rel="nofollow">酒店經紀</a>是合法的公司工作環境高雅時尚,無業績壓力,無脫秀無喝酒壓力,高層次會員制客源,工作輕鬆,可<a href="http://a3av.com" rel="nofollow">日領</a>、<a href="http://avx6.com" rel="nofollow">現領</a>。<br />一般的<a href="http://www.aed8.com/front/bin/ptlist.phtml?Category=330641" rel="nofollow">酒店經紀</a>只會在水水們第一次上班和領薪水時出現而已,對水水們的上班安全一點保障都沒有!艾葳酒店經紀公司的水水們上班時全程媽咪作陪,不需擔心!只提供最優質的<a href="http://www.aed8.com" rel="nofollow">酒店上班</a>,<a href="http://www.aed8.com/front/bin/form.phtml?Nbr=10071" rel="nofollow">酒店上班</a>,<a href="http://avx0.com" rel="nofollow">酒店打工</a>環境、上班條件給水水們。心動嗎!? 趕快來填寫你的<a href="http://www.aed8.com/front/bin/home.phtml" rel="nofollow">酒店上班</a>履歷表<br /><br />水水們妳有缺<a href="http://aed8888.pixnet.net/blog" rel="nofollow">現領</a>、有<a href="http://pink168.blogspot.com/" rel="nofollow">兼職</a>、<a href="http://m5av.com/05" rel="nofollow">缺錢</a><a href="http://aed8ed8.spaces.live.com/default.aspx" rel="nofollow">便服店</a>的煩腦嗎?想到日本留學<a href="http://www.im.tv/blog/3177093" rel="nofollow">缺錢</a>嗎?妳是<a href="http://hk.myblog.yahoo.com/aed8888@kimo.com" rel="nofollow">傳播妹</a>??想要擁有高時薪又輕鬆的<a href="http://hahapinka.spaces.live.com/default.aspx" rel="nofollow">賺錢</a>,<a href="http://aed8ed8.pixnet.net/blog" rel="nofollow">酒店</a>和,<a href="http://s4av.com/05" rel="nofollow">假日打工</a>,<a href="http://aed8888.mysinablog.com/index.php" rel="nofollow">假日兼職</a><a href="http://hahapinka.spaces.live.com/blog/" rel="nofollow">賺錢</a>的機會嗎??想實現夢想卻又<a href="http://s6av.com" rel="nofollow">缺錢</a>沒錢嗎!?? <br />艾葳酒店<a href="http://blog.xuite.net/aed8ed8/blog" rel="nofollow">台北酒店經紀</a>招兵買馬!!徵專業的<a href="http://tw.myblog.yahoo.com/jw!BKdiTxSTFRMUjbctTwdik8rQeZdDrm8T" rel="nofollow">酒店打工</a>,想要去<a href="http://aed8ed8.pixnet.net/blog" rel="nofollow">酒店</a>的水水,想要短期<a href="http://www.wretch.cc/blog/aed8ed8" rel="nofollow">日領</a>,<a href="http://%20http://blog.roodo.com/aed8ed8" rel="nofollow">酒店日領</a>,<a href="http://%20http://aed8ed8.blogspot.com/" rel="nofollow">禮服酒店</a>,<a href="http://www.im.tv/blog/3174889" rel="nofollow">制服店</a>,<a href="http://hk.myblog.yahoo.com/aed8ed8@kimo.com" rel="nofollow">酒店經紀</a>,<a href="http://aed8ed8.mysinablog.com/index.php" rel="nofollow">ktv酒店</a>,<a href="http://%20http://aed8ed8.spaces.live.com/blog/" rel="nofollow">便服店</a>,<a href="http://mypaper.pchome.com.tw/news/aed8ed8" rel="nofollow">酒店工作</a>,<a href="http://blog.udn.com/aed8ed8" rel="nofollow">禮服店</a>,<a href="http://blog.yam.com/aed8ed8" rel="nofollow">酒店小姐</a>,<a href="http://blog.sina.com.tw/aed8ed8/" rel="nofollow">酒店經紀人</a>, <br />等相關服務 幫您快速的實現您的夢想~!!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-19397372985180097612009-05-12T10:35:00.000-06:002009-05-12T10:35:00.000-06:00酒店經紀PRETTY GIRL 台北酒店經紀人 ,禮服店 酒店兼差PRETTY GIRL酒店公關 酒...酒店經紀PRETTY GIRL <A HREF="http://www.taipeilady.com/" REL="nofollow" TITLE="台北酒店經紀人">台北酒店經紀人</A> ,<A HREF="http://tw.myblog.yahoo.com/jw!qZ9n..6QEhhc0LkItOBm/" REL="nofollow" TITLE="禮服店">禮服店</A> 酒店兼差PRETTY GIRL<A HREF="http://www.mashow.org/" REL="nofollow" TITLE="酒店公關">酒店公關</A> 酒店小姐 彩色爆米花<A HREF="http://blog.xuite.net/jkl338801/blog/" REL="nofollow" TITLE="酒店兼職">酒店兼職</A>,酒店工作 彩色爆米花<A HREF="http://tw.myblog.yahoo.com/jw!BIBoU5SeBRs21nb_ajFpncbTqXds" REL="nofollow" TITLE="酒店經紀">酒店經紀</A>, <A HREF="http://mypaper.pchome.com.tw/news/thomsan/3/1310065116/20080905040949/" REL="nofollow" TITLE="酒店上班">酒店上班</A>,酒店工作 PRETTY GIRL<A HREF="http://tw.myblog.yahoo.com/jw!rybqykeeER6TH3AKz1HQ5grm/" REL="nofollow" TITLE="酒店喝酒">酒店喝酒</A>酒店上班 彩色爆米花<A HREF="http://mypaper.pchome.com.tw/news/jkl338801/" REL="nofollow" TITLE="台北酒店">台北酒店</A>酒店小姐 PRETTY GIRL<A HREF="http://www.mashow.org/" REL="nofollow" TITLE="酒店上班">酒店上班</A>酒店打工PRETTY GIRL<A HREF="http://www.tpangel.com/" REL="nofollow" TITLE="酒店打工">酒店打工</A>酒店經紀 彩色爆米花Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-19803222.post-83260325024648613012008-04-15T14:04:00.000-06:002008-04-15T14:04:00.000-06:00You should also note that human evaluation redunda...You should also note that human evaluation redundancy , as defined by DUC, is the linguistic redundancy: whether a pronoun should replace a person name... This does not cover content redundancy.<BR/><BR/>For me, the fact that redundancy is favored by ROUGE only shows our failure to merge the content of two sentences giving different details about the same thing.<BR/><BR/>Benoit.Benhttps://www.blogger.com/profile/14899730898792268821noreply@blogger.comtag:blogger.com,1999:blog-19803222.post-32222254322553194152008-04-04T16:17:00.000-06:002008-04-04T16:17:00.000-06:00Hal,We noticed exactly the same thing in our DUC20...Hal,<BR/><BR/>We noticed exactly the same thing in our DUC2007 submission. We used a generic optimizer to pick the feature weights by doing max-delta ROUGE training (we pick that sentence that maximizes the delta in the ROUGE of the summary before and after the addition of the sentence). We found that we were ranked in the top 10 when ranked according to all three ROUGE metrics (1, 2 and SU4) but ranked almost last (27/30) when our summaries were evaluated on the non-redundancy metric.<BR/><BR/>Do you think that the "old" definition of ROUGE would not suffer from the same issue ? <BR/><BR/>Nitin<BR/>PS: Funnily, the older ROUGE paper[1] still has the newer formula[2] even though it states that it picks the best reference.<BR/><BR/>[1] Lin, Chin-Yew. 2004a. ROUGE: a Package for Automatic Evaluation of Summaries. In Proceedings of the Workshop on Text Summarization Branches Out (WAS 2004), Barcelona, Spain, July 25 - 26, 2004. <BR/><BR/>[2] Lin, Chin-Yew. 2004b. Looking for a Few Good Metrics: Automatic Summarization Evaluation - How Many Samples Are Enough?. In Proceedings of the NTCIR Workshop 4, Tokyo, Japan, June 2 - June 4, 2004.DesiLinguisthttps://www.blogger.com/profile/12041190701345638856noreply@blogger.com