АВТОМАТИЧЕСКАЯ РУБРИКАЦИЯ ТЕКСТОВ СРЕДСТВАМИ...

CTpyKTypHaJI l'I n p l'I Kil 3A H aJI 11 "1 H re "1 CT"1 Ka

9

ISSN 0202-2400

• • • • • •• •• •• •••• • • • • • • • • • • • • •••••• • ••••• •••••••••••

LA FILOLÓGICA POR LA CAUSA

CAHKT-TIETEPBYPfCKJ1J1 fOCY}lAPCTBEHHhIJ1 YHJ1BEPCJ1TET

CTPYKTYPHAH 11 I1Pl1KJIA,[J;HAH Jil1HfBl1CTl1KA

Me:HCBY308CKUU c6opHuK

BhrrrycK 9


Y,UK 80+618.31 BBK 81.1

C83

Pe A a K l..l w o H Ha H Ko JI JI er w H: npoc}>. n. H. EellJleea, npocp. A. C. fepo (oTB. pe

AaKTop ), npocp. 0. H. fpuH6ayM, npocp. M.A. MapyceHKO

C e K p e T a p b peAaKQHOHHot1: KOJIJiernn B. J!f. Py6uHep

p e l..l e H 3 e H T KaHA. cpHJIOJI. Hayi< AOQ. J!f. II. llaHKOO

lle11amaemcH no nocmaHoeneHu10 PeoaK11uoHHo-u3oamenbcKOzo coeema

<fiunonozuttecKozo <fiaKynbmema C.-llemep6ypzcKozo zocyoapcmeeHHozo yHueepcumema

CTp'fKTYPHaH H npHKJiap;HaH JIHHrBHCTHKa. Bbm. 9: Me)l(

C83 By3. c6. I no.a; pe,a;. A. C. fep,a;a. - CI16.: l13A-BO C.-I1eTep6. ytt-Ta, 2012. - 356 c.

C6opttHK (Bbm. 8 BbIUieJI B 2010 r.) coAep)f(HT cTaTbH no UIHpOKOMY

Kpyry npo6JieM TeopenrtteCKOH 11 npHKJiaAHOH JIHHfBHCTHKH, no npHMe

HeHHIO MaTeManttteCKHX MeTOAOB B Jl3bIK03HaHHH.

,D;JIR cneQHaJIHCTOB no TeOpJrn: Jl3bIKa, npHKJiaAHOH H TeopenPieCKOH

JIHHfBHCTHKe.

66K81.l

© C.-IleTep6yprCKJ1H

rocyAapcTBeHHbIH,

yttHBepcHTeT,2012


. ,(''· .K. ~

., A.B.~o6poa

ABTOMATJ1qECKAJI PYBPJ1KAQJ1JI TEKCTOB CPE,n;CTBAMJ.1 KOMIInEKCHOfO nJ1HfBJ1CTJ1qECKOfO AHAJU13A

AHHomau,wc. B CTaTbe paccMaTp1trna10Tc.R cospeMeHHbie MeTOAbI aeT0MaTw1ecKoti py6p"1:Kal.\"1:"1: TeKCTOB "1: me HeAOCTaTKlt'I. IlpeAJiaraeTCR KOMnJieKCHbIH JI"1HfB"1:CTI1'ieCK"1:H nOAXOA, no3BOJIRIOI.l(HH 1t136e.>KaTh 3Tmc HeAOCTaTKOB. On"1:CbIBaeT01 pa3pa6oTaHHbIH anroplt'ITM aeTOMaTWleCKOH o6pa6oTK"1 TeKCTOB "1 OCHOBaHHbIB Ha HeM anrop1t1TM BbUIBJieH"1ff "1: paH.>K1t1posaH"1ff penesaHTHbIX TeKCTY py6plt'IK.

Kmot.testne C!losa: asT0MaTw1ecKaJ1 py6pHKal.\"1:.R TeKCTOB, HeOAH03Ha'IHOCTb, JIO.>KHaJI KOppeJI.RQlt'IR, o6pa6oTKa TeKCTOB Ha ecTeCTBeHHOM ff3bIKe, CeMaHTHKa npeAJIO.>KeHlt'l.R.

A. V.Dobrov

AUTOMATIC TEXT CLASSIFICATION BASED ON COMPLEX LINGUISTIC ANALYSIS

Summary. In this article, modern methods of automatic text classification, and their shortcomings are discussed. A complex linguistic approach is proposed to avoid these shortcomings. The developed algorithm of automatic text processing, and the further algorithm to evaluate and rank topics, that are relevant to the text, are described.

Keywords: automatic text classification, ambiguity, false correlation, natural language processing, sentential semantics.

B coBpeMeHHOH TIHHrB11.cn1qecKol1 JIHTepaType He cy~ecTByeT ycrn.HBlllerorn onpep;erreHl1..H TepMHHa «aBTOMaT11.qecKa.H py6p1.rnaQ11..H». M. C. AreeB, B. B. .Uo6poB 11. H. B. JlyKallleB11.q onpep;eJI.HIOT aBTOMarnqecKy10 py6p11.KaQHIO KaK «OTHeCeHHe nopQHH trncpopMaQHH K O,D;HOH HJIH HeCKOJibKHM KaTerop11..HM 11.3 orpaH11.qeHHOro MHO:>KeCTBa» (AreeB, .Uo-6poB, JlyKarneB11.q 2008: 25), HO He YTO"tlH.HIOT 0 KaKOM HMeHHO BH,D;e HHcpopMaQJ111 l1,D;eT pe"tlb, "tlTO nott11MaeTC.H nop; «KaTerop11..HMH», qeM orpam1-qeHo MHO:>KecTBo KaTeropm1:. B TO :>Ke BpeMR 3TH aBTOpbI roBopRT ,n;arree

©A.B.Ao6pos,2012

135


He 06 OTHeceHJm 1rncpopMau;1111 K KaTeropJUIM, a 06 OTHeCeHHH «TeKCTOB

K py6pHKaM» (TaM :>Ke), KOTOpoe OHH Ha3bIBaIOT py6pHKau;11eJ1: mm KJiaC

c11cp11Kau;HeJ1: TeKCTOB. Do BCeH BHAHMOCTH, IIOA «nopu;mlMH 11HcpopMa

u;1111» IlOHHMaIOTC.H TeKCTbI, TIOA MHO:>KeCTBOM «KaTeropHH» - HeKoe 3a

paHee onpeAeJieHHOe MHO:>KeCTBO py6pHK, K KOTOpblM AOJI:>KHbI 6blTb OT

HeCeHbI 3TH TeKCTbl, a IlOA aBTOMaTff\IeCKOH py6pHKau;HeH OTHeCeHHe

MarrrnHOH TeKCTOB K 3THM py6pHKaM. CrreAyeT pa3rrHqaTb py6p11Ka~H10

H KrracTepH3aLI;HIO TeKCTOB. B pe3yrrhTaTe KrracTep113au;1111 asT0MaTHqecK11

BblCTpaHBaIOTC.H KJiacTepbI, K KOTOpbIM OTHOC.HTC.H TeKCTbl (I1o,zmy6HbIH,

lllesenes, EopMarnos 2006; Barnrrbes 2009), B TO speMJI KaK npH aBTOMa

THqecKoJ1: py6pHKaLI;Hl1 MHO:>KeCTBO py6pHK onpeAeJI.HeTrn 3apaHee.

B HeKoTOpbIX pa6ornx AM o6o3HaqeHHH npou;eAypb1 OTHeceHH.H

TeKCTOB K 3apaHee 3aAaHHblM py6p11KaM 11CilOJib3YIOTC.H TaK:>Ke TepMH

Hbl «TeMaT11qecKa.H Krracc11cp11Kau;H.H» (MHHLI;HaTHBHbIH npoeKT ... 2003: 6; BacHrrheB 2008; 2010), «TeMaT11qecKoe npeACTasrreH11e coAep:>KaH11.H

AOKyMeHTOB» ()J;o6pos, llyKarnesHq 1996; JlyKarnes11q, ,Uo6pos 2009), «pacno3HaBaH11e TeMaTHKH TeKCTOB» (Eerros, Bonos11q 2007).

B cospeMeHHhIX CHCTeMax aBTOMaT11qecKoJ1: py6pHKau;m1 TeKcTOB

(CAPT), KaK npas11rro, 11cnorrh3YIOTrn <t>opMaJibHhie orrn:caHH.H Ka:>KAOH

py6p11K11, Il03BOMIOW:He OTHOCHTb HJIH He OTHOCHTb K 3TOH py6p11Ke TOT

HJIH HHOH TeKcT. TaKHe on11caHH.H Ha3bIBaIOT «o6pa3aMH py6p11K». 06-

pa3bI py6p11K 3aAaIOTC.H B cpopMe 6yneBCKHX cpopMyrr, npaBHJI npOAYK

u;11J1: HJIH B HHOH cpopMe.

B 3aBHCHMOCTH OT Toro, KaKHM o6pa30M cTpO.R:Trn o6pa3bI py6pHK,

MO:>KHO BbIAeJIHTb ABa KJiacca MeTOAOB aBTOMaTH\{eCKOH py6pHKau;1111

TeKCTOB HH:>KeHepHbie MeTOAbI (MeTOAhI, OCHOBaHHbie Ha 3HaHHRX)

H MeTOAbI, OCHOBaHHbie Ha MallIHHHOM o6yqeHHl1. I1p11 np11MeHett1111

HH:>KeHepHbIX MeTOAOb o6pa3bl py6pHK C03AaIOTC.R: «HH:>KeHepaMH no

3HaHHRM» (11HHfBHCTaMH 11 3KCnepTaMH B pa3JIJ1qHbIX npeAMeTHbIX 06-

naCT.HX). TipH np11MeHeHHl1 MeTOAOB, OCHOBaHHbIX Ha MallIHHHOM o6y

qeHHl1, np0113BOAHTCH CTaTHCTWieCKHH aHaJIH3 KOJIJieKu;HH AOKyMeHTOB,

npeABap11TeJibHO pacnpep;erreHHhIX no py6pHKaM spyqHy10, Ha ornosa

HHH KOToporo o6pa3bl py6p11K CTpO.R:TC.H aBTOMaT11qeCKH.

B AHCcepTau;110HHOM 11ccnep;osamrn M. C. AreeBa (2005) noApo6-

Ho OilHCaHbl pa3JIJ1qHbie MeTO,D;bl, OCHOBaHHbie Ha MallIHHHOM o6yqe

HHH: MeTop; EaH:eca, MeTop; k-6rr11:>KaJ1:rn11x cocep;eH:, Krracc11cp11KaTop

Rocchio, HeH:poHHbie ceT11, p;epesb.H perneHHH, nocTpoeH11e 6yrreBbIX

cpyHKLI;HH (IT<l>A), a TaK:>Ke MeTOA onopHblX BeKTOpOB (Support Vector

136


Machines, SVM). 3n1 MeTOAhI TaK>Ke om1caHbI so MHornx pa6orax ceM11Hapa POMJ1I1 (Arees, ,[(o6pos, JlyKarnesw-1, C11,n:opos 2004; Arees, KypanettoK 2004; Yl1C POCCJ15I ... 2008; Arees, ,[(o6pos, JlyKarnesw-1, lllrepHOB 2008).

MeTOJJ:bl aBTOMaTWleCKOH py6p11KaQl1l1 TeKCTOB, OCHOBaHHbie Ha MaIlll1HHOM o6yqeHl111, Bbl3bIBalOT 11HTepec y 11ccne,n:oBaTeJieH, nOCKOJibKY, Ha nepBbn1: B3fJIRA, no3BOJIRIOT nOHJ1311Tb Tpy,n:oeMKOCTb pa3pa60TKl1 CAPT, TaK KaK He Tpe6y10T pa6oTbI n11Hrs11cTOB l1 3KcnepTOB B pa3m1qHbIX npe,n:MeTHhIX o6rracrnx Ha,n: cocTasrremteM o6pa30B py6p11K. TeM He Mettee, no ,n:aHHbIM 11ccne,n:osamm M. C. Areesa, «Cl1CTCMbI py6p11KaQm1, OCHOBaHHbie Ha Mallll1HHOM 06r1eH1111, 11MelOT cepbe3Hble npo6neMbl ,n:a:>Ke Ha OTHOCl1TeJibHO npoCTOM py6p11KaTOpe: 50% F-Mepbl 03HaqaeT, qTo TOJibKO nonos11Ha ,n:oKyMeHTOB nonyq11na npas11JibHh1e py6p11KH» (Arees, ,[(o6pos, JlyKarnes11q 2008: 27). ,[(m1 np11MeHeH11R MalllHHHoro o6yqeHIDI Heo6xo,n:11MO C03,n:aTb penpe3eHTaTl1BHYIO KOJIJieKQl1IO TCKCTOB, pacnpe,n:eneHHYIO no py6p11KaM B COOTBCTCTBl111 c np11HQl1naMl1, e,n:11Hoo6pa3HbIMl1 .u;nR scei1 KorrrreKQ1111. CocTasneH11e TaKOH KOJIJieKQ1111 Tpy,n:oeMKO, 11, KaK npas11no, e,n:irnoo6pa311e np11HQ11nos OTHecemm TeKCTOB K py6p11KaM He rapattT11pyeTCH, qTo CKa3bIBaeTrn Ha )l;OCTOBepHOCTl1 BbICTpa11saeMblX o6pa30B py6p11K 11 Ha 3<P<PeKTl1BHOCTl1 pa60Tbl CAPT.

I1pas11na py6p11KaQ1111 TCKCTOB, <PopMarr113yeMbie B B11AC o6pa30B py6p11K, qacTO OCHOBbIBalOTCR Ha HaJIJ1lll111 11Jil1 OTCYTCTBl111 B TCKCTax Tex 11n11 11HhIX neKc11qecK11x e,n:11HHQ. B npocTei1rneM rnyqae npas11no OTHCCCHHR TeKCTa K py6p11Ke npe,n:cTaBJIJieT co6oi1 A113'blOHKQHIO HaJIJ1lll1JI B TCKCTe HCKOTOpbIX CJIOB. B 6onee CJIO)KHOM cnrrne 11CnOllb-3YIOTCH KOH'b10HKQ1111 ( Tpe6yeTrn o,n:HospeMeHHoe Han11q11e ,n:syx mrn 6onee CJIOB) 11 OTPl1QaH11e ( Tpe6yeTCR OTCYTCTBl1e B TeKCTe onpe,n:eneH -HbIX rnos). TaKoi1 no,n:xo,n: np11so,n:11T K PRAY 3aTpy,n:HeH11i1, CBR3aHHbIX c Mop<PonornqecKOH 11 JieKc11qecKOH HCOAH03HaqHOCTblO 11 c HCXBaTKOH 11H<l>opMaQ1111 o KOHTeKcTe rnosoynoTpe6neH11i1. Mop<PonornqecKaR Heo,n:H03HaqHoCTh MO:>KeT np11BOA11Tb K IlORBJICHHIO JIO:>KHbIX py6p11K 11Jll1 HeXBaTKe npaBl1llbHblX py6p11K: Hanp11Mep, np11 Han11q1111 B TeKCTe CJIO

Bo<l>opMbl «CmeKJlO» TCKCT MO:>KeT 6bITb orn116oqHo OTHeCeH K py6p11Ke «cmpoumellbHble Mamepua!lbl», B TO speMJI KaK B ,n:ei1CTBJ1TCJibHOCH1 B TeKcTe ynoTpe6neHa cpopMa e,n:11HCTBeHHOro q11rna cpe,n:Hero po,n:a nporne,n:rnero speMeH11 rnarona «cme'ib». MHoro3HaqHoCTh rreKc11qecK11x e.n;HHl1Q TaIOKe MO.>KeT 6bITb np11q11HOH HeKoppeKTHOH py6p11KaQ1111,

137


KOr,r~a cnOBO ynorpe6m1eTC.R B TeKCTe He B TOM 3Haqemni, Ha KOtopoe

paccqHTbIBaJI 3KCnept, COCTaBmrn: o6pa3 py6pHKH, HJIH B KOTOpOM OHO

6bIJIO ynotpe6neHO B TeKCTax 06}"1aIOrn;e:i1 KOJIJieKQHH.

ITpo6neMbI neKcwqeCKo:ii H MopcponornqecKo:ii Heop;H03Haqttocrw

p;ocraroqHo cyrn;ecTBeHHbl H CKa3bIBalOTCR Ha 3cp<j>eKTHBHOCTH pa6otbl

cospeMeHHhIX CAPT, HO pa3peu111MbI, taK KaK cyrn;ecTBy10r pa31rn:qHbie

cnoco6b1 CHRTHR Mop<j>onornqecKoli H p;ruKe neKcwqecKo:ii tteop;H03Haq

HOCTH. Bonee cyrn;ecTBeHHa npo6neMa «JIO>KHO:ii KOppeJIRQHH», B03HHKa

IOlI.l;aR npH HCilOJib30BaHHH KOH'bIOHKQH:ii. HanpHMep, eCJIH npH COCTaB

JieHHH o6pa3a py6pHKH «AK~UU npomecma» HCilOJib3YeTCR KOH'bIOHKQHR

Han11q11.R B TeKCTe CJIOB «aK~UH» 11 «npomecm», TO 3Ta py6p11Ka MO)l(eT

6bITb npHCBOeHa teKcty, B KOTOpOM peqb Hp;eT, HanpHMep, 0 CTOHMO

CHl aKQHli H 0 BbipruKeHHH aKQHOHepaMH npotecTa npoTHB ee IlOBbl

llleHHR. ITpHqJ.1Ha B03HHKHOBeHHR npo6neMhI «JIO)l(HO:ii KoppelIRQHH»,

KaK npep;cTaBTUleTCR, COCTOHT B HeBepHOM nop;xop;e K C03p;aHHIO JIHHfBH

CTJ1qecKOfO o6ecneqemrn CAPT: p;lIR OTttecett11.R TeKcTa K py6p11Ke «AK-4uu npomecma» Heo6xop;HMO np11cyTCTBHe B TeKCTe He CJIOB «aK~UH»

H «npomecm», a OTHOC.Rlli;HXC.R K 3TO:i1 py6pHKe IlOH.RTHli, BblpruKeHHbIX

CHHTaKc11qecKH H ceMaHTHqecKH CB.R3aHHbIMl1 JJ3bIKOBblMl1 ep;HHHQaMH

(ttanpHMep, «aKUiWl npomecma», «OeM0Hcmpa4uH npomecma», «Mm-tu

cfiecma4uH npomecma>~ H p;p.). qro6b1 CAPT npoH3BOp;Hna BhrqwcneHHH

Ha OCHOBaHHH IlOH.RT11l1, a He CJIOB, o6pa3 py6pHKl1 p;OJI)l(eH BbICTpaH

BaTbC.R He B BHp;e npoCTbIX JIOf11qecKHX <j>opMyJI, tpe6y10rn;HX Han11q1rn

HJIH OTCYTCTBHR B TeKCTe JieKcJ.1qecKHX ep;HHHQ, a B cpopMe JIHHfBHCTH

qecKHX MOp;ene:ii, orpa)l(aIOrn;Hx ceMaHTfflieCKHe CBH3H Me)l(AY IlOHHTHH

MH. ITpH 3TOM ,l\JIR OTHeceHHR TeKCTa K py6pHKe Heo6XOAHMO npoH3BO

AHTb He HOpMaJIH3aQHIO npwcytCTBYIOlI.l;l1X B TCKCTe CJIOBocpopM, a KOM

IlJICKCHbI:ii JIHHfBHCTHqecKHli aHaJIH3 TCKCTa, Il03BOJIRIOlI.l;HH BbJqJieHHTb

B TeKCTe IlOHRTHH, BXOJVllI.l;He B o6pa3 py6pHKH.

ITpHHQHilbI, wcnoJib3yeMbie B cospeMeHHbIX CAPT npw OTtteceHHH

TCKCTOB K py6pHKaM, He p;aIOT B03MO)l(HOCTH np0113BCCTH paH)l(Hpo

BaHHe 3THX py6pHK. TeKCT, B KotopoM peqb HACT 06 aKQm1 npotecTa,

HO B O,l\HOM rraparpacpe yrroMHHaeTC.R 3KOHOMJ.1qecKaR pecpopMa, B 60Jib

lllCH Mepe OTHOCJ1TC.R K aKQHRM nporecTa, qeM K 3KOHOMJ1qecKo:i1 pecpop

Me; TeM He Mettee, eCJIH Bbipa)l(eHHH «aK4UH npomecma» H «3KOHOMUtte

CKaH pecfiopMa» BCTpetiaIOTCR B TCKCTe OAHHaKOBOe KOJIHqecTBO pa3, TO

CAPT tte MO)l(eT rrpwcBOHTh 3THM py6p11KaM pa3HhIW sec. KoMrrneKc

Hhnli JI11HfBHCTHqecKHH aHaJIH3 TeKCTa .n;aeT B03MO)l(HOCTb pelllHTb TaK-

138


)Ke H :ny npo6JieMy nyteM BbUIBJieHHH TeMaTl1'.JeCKOH (KOMMYHHKaTHB

HOH) ctpyKTYPhI AHCKypca.

C11.cTeMhI, npo113so,z:vuu;11e KOMnrreKcHy10 aBTOMaTw1eCKy10 o6pa6oT

KY teKCTOB, Ha3hIBaIOT n11.HrBonpoQeccopaM11. JlHttrBonpoQeccop AOJI

)l(eH 6bITb cnoco6eH BbPIHCJIHTb CMblCJIOBOe COAep)l(aHJ1e TeKCTa, HMeR

Ha BXOAe TOJlbKO caM TeKCT l1 IIOJIHOe OIIHCaH11e Toro R3bIKa, Ha KOTO

poM ttan11.caH 3TOT TeKCT. Mop;en11. COAep)l(aH1111 TeKcTa, BbICtpa11BaeMb1e

Jll1HrBOilpOI.-leCcopoM, AOJI)l(Hbl 6bITb COBMeCTHMbIMJ1 c npaBirnaMJ1 py6-

p11KaQJ1l1, cop;ep)l(all.\J1MHCR B 06pa3ax py6pHK.

KoMnJieKCHhIH JIHHrBHcn1qecK11ti attan113 TeKcta, npo113BOA.Hll.\HHCH

JIHHfBOIIpOQeccopoM, BKJIJOqaeT B ce6.R: BbUIBJieHHe H3bIKOBbIX eAMHHQ

pa3JIH'IHhIX R3hIKOBbIX ypoBHeli. H. H. JleoHTheBa Ha3bIBaeT TaKoli aHa

rr113 TCKCTa «aBTOMaTHtleCK11M IlOHJ1MaH11CM TeKCTa» (ATIT), IlOAtJep

KHBaR, qTo «B oTJrnq11e OT MHornx Apyrnx c11cTeM AOT c11cTeMhI ATIT

o6rrap;aIOT MaKCHMallbHbIM Ha6opoM JIHHfBl1CTJ1qecKHX KOMilOHCHTOB

3TO norrHhie CHCTCMbI» (JieoHTheBa 2006: 10). Tpap;HQHOHHO BhIAeJIHIOT

TPH s11.p;a aHarr113a, npoH3BOAHMOro np11 KOMnrreKcttoJII aBTOMaT11qecKot1:

o6pa6oTKH TeKCTa, - MopcporrornqecKHH, CHHTaKCHqecKHH H ceMaHTH

qecKHH. B pe3yrrhTaTe Mopcporrorl1'1ecKoro attarr113a B TeKcTe BhUIBJIHIOT

rn CJIOBocpopMbl, KOTOpbie CHa6)l(alOTCR rpaMMaT11qecKOH 11HcpopMaQJ1-

el1 l1 COOTHOCRTCR c JICKCeMaMJ1. B pe3yJibTaTe CHHTaKCHtleCKOfO aHaJI.J13a

Ha OCHOBaHHH norryqeHHOH rpaMMaT.11.qecKOH 11.HcpopMau;.1111 0 Ka)l(AOJ1

CJIOBocpopMe .J1 HX JIHHeHHOfO nop.R:p;Ka Bbl.HBJIHIOTCR CJIOBOCoqeTaHHR,

npep;JIO)l(eHHR .J1 CBepxcppa30Bbie ep;J1HCTBa, COCTORU\He 113 3Tl1X CJIOBO

cpopM. B pe3yrrhTaTe ceMaHTw1ecKoro aHa11113a Ha ocHoBamm ceMaHTH

KH Cl1HTaKc11qecKHX CB.H3CH MC)l(AY qacTRMH BblRBJieHHbIX B npou;ecce

C.J1HTaKc11qecKoro aHaJI.J13a COCTaBJIHIOll.\HX .J1 Ha OCHOBaHJ1l1 npaBHll ce

MaHTl1'.JCCKOH coqeTaeMOCTJ.1 3HaqeHJ1H JICKCCM BblqJ1CJIHCTCR COBOKyn

HOCTb IlOHRTHH .J1 ceMaHTH'ICCKHX OTHOllleHHH, o6pa3yIOll.\MX CMbICJIO

BOe COACp)l(aHHe TeKCTa.

B paHHHX MOAeJIHX aBTOMaTJ1qecKOH o6pa60TK.J1 TCKCTOB, B qacT

HOCTH, B Mop;err11 11. A. MeJihtt:yKa «CMbICJI <=> TeKCT» (Merrh'IYK 1974) 11

B Mop;enRX ero nocrrep;osatenew (Hanp., (JieoHTbeBa 2006)) npep;nonara

rrach nornep;osateJihHaR pa6ota MopcporrornqecKoro, CHHTaKc.11.qecKoro

11 ceMaHT.11.qecKoro KOMIIOHeHTOB. Ha nepBbIH B3fJIHA, TaKOH nop;xop; no-

3BOJIJieT ynpOCTHTb npoQecc o6pa60TKJ1 TCKCTa nyteM pa36HeHHR ero

Ha 3TanbI c O'leBHAHbIMH npas11naM11 nepexop;a Me)l(p;y 3TanaM11. TeM He

MeHee npaKTH'leCKHe npl1MCHCHJ1.H TaKMX MOp;errel1 (cp., Hanp., CMCTeMa

139


«3TATI» (IO. ,U. Anpeorn i-t p;p.) noKa3arri-t, tJTO Ha KCDKAOM 3Tane anrn

MaTi-ttJecKot1 o6pa6oTK'1 TeKCTa B03Hi-tKaeT MHO)l(eCTBO B paBHOH Mepe

p;onycTHMhIX nepc11t1 aHarri-t3a, H ecrr11Ha3Tane Mop<Ponorw1ecKoro aHa

mrna CTpOHTCJI B p;OCTaTo~rno:H Mepe orpaHWleHHOe KOlIHtJeCTBO BepCHH,

TO y)l(e Ha 3Tane CHHTaKCHtJeCKOfO attaJIJ13a B03HHKaeT npaKTHtJeCKH

Henpeop;orri-tMaJI npo6neMa «KOM611HaTopttoro B3pbIBa», B03m1KaIO

~aH B pe3yllbTaTe MHOfOKpaTHOH CJ1HTaKCJ1tJeCKOH Heop;H03HatJHOCTJ1

B npep;errax OAHOfO npep;JIO)l(eHHR. Tipo6neMa «KOM6J1HaTOpHoro B3pbl

Ba» COCTOHT B TOM, tJTO B npm.~ecce CHHTaKCHtJeCKOfO attam13a ll'1HfBO

npou;eccop p;OJI)l(eH BhrnOJIHHTh nepe6op ncex B03MO)l(HbIX KOM611ttau;11:H

pa3JIJ1tJHblX J1HTepnpeTau;11:H KOMilOHeHTOB 3TOfO npep;JIO)l(eHHR, OT CJIO

Bo<t>opM ,a;o nonHOCTbIO pacnpoCTpatteHHbIX cnosocoqeraHi-ti1.

C11HTaKcw1ecKaJ1 Heop;H03HatJHOCTh MO)l(eT B03HHKaTb 11 KaK crrep;

CTBHe Mop<t>onor11qecKOH Heop;H03HatJHOCTJ1, " 6e30THOCHTellbHO K HeJ1.

Hanp11Mep, npep;JIO)l(eHi-te «3mu munbt cmanu ecmb 8 ~exe» xapaKTep11-

3yeTCJ1 C'1HTaKCHtJeCKOH Heop;H03HatJHOCTblO BCJiep;CTBHe Mop<t>orrorw1e

CKOH HeOp;H03HatJHOCTJ1 CJIOBo<PopMbl «CmallU», KOTOpaH MO)l(eT 6bITb

OTHecetta KaK K J1MeHJ1 cy~eCTBHTeJibHOMY «Cmallb», TaK H K rnarony

«cmamb». CHHTaKCHtJeCKaJI Heop;H03HatJHOCTh, He o6ycnonneHHaJI Mop

<PonomqecKo:H Heop;H03HatJHOCThIO, cocTaBJIHeT 6onee cy~ecTBeHHYIO

npo6neMy. HanpHMep, npep;JIO)l(eHHe «MupoH08 ecmpemuncJC c JlyJ1CK08btM B MocK8e» TaK)l(e xapaKTepH3yeTcH CHHTaKc11qecKo:H tteop;Ho-

3HatJHOCThIO: <PparMeHT «8 MocK8e» MO)l(eT 6bITh pacno3HaH He TOJibKO

KaK o6CTOHTellbCTBO MeCTa, OTHOCH~eecR K CKa3yeMoMy «8cmpemun

CJC», HO J1 KaK npe,a;JIO)l(HOe onpep;eneHHe, OTHOCR~eecR K p;onOJIHeHHIO

«C llyJ1CK08btM», TaK KaK c <PopMallbHO-rpaMMaTHtJeCKOH TOtJKH 3peHHH

3TO npep;JIO)l(eHHe HHtJeM He OTJIHtJaeTCR OT, Hanp11Mep, npep;JIO)l(eHHH

«YfoaH08 8cmpemuncH c Ma!lbt.iUKOM B umfl1te». TaKHe BHAhI Cl1HTaKCH

qecKot1 Heop;H03HatJHOCTH HOCJIT CHCTeMHblH xapaKTep, IlOCKOJibKY He

3aBJ1CRT OT KOHKpeTHOfO neKCi-ttJeCKOfO HailOJIHeHHH CJ1HTaKCJ1tJeCKOH

CTPYKTYPbl.

C11ttTaKcJ.tqecKaJ1 tteo,a;H03HatJHOCTh MO)l(eT 6bITh o6ycnosneHa TaK

)l(e B03MO)l(HOCTbIO BOCCTaHOBJieHHJI 3JJlIJ1IlCHCa B OTp;eJibHblX qacTHX

npep;JIO)l(emrn. TaKaH c11Tyau;:irn tta6n10,a;aeTCJ1, HanpwMep, B cnep;y10~HX

ABYX npep;JIO)l(eHHJIX: «MycynbMaHcKue JICeHtu,uHbt HocJCm napaHOJ1Cy.

UyoeucKUe M)'JICt.iUHbt - KUnbt». c <t>opMaJibHOH TOtJKH 3pemrn, BTOpoe

npe,a;JIO)KeHHe MO)l(HO HHTepnpeT11ponaTb KaK p;e<t>11Hi-tu;1110: <PparMeHT

«KUnbt» MO)l(eT 6bITb COCTaBHblM HMeHHblM CKa3yeMbIM, J1 npe,a;JIO)l(eHHe

140


MO)f(eT 03HaqaTh: "My,a;ei1cK11e My)f(qJ1HhI - 3TO Kl1Ilb1" KoppeKTHaR l1H

TepnpeTarvUI Cl1HTaKrnqecKoi1 CTPYKTYPhI TaKoro npe,a;rro)f(eHl1.H MO)f(eT

6hITb IlOCTpoeHa TOllbKO c yqeTOM B03MO)f(HOCTl1 3JIJil1nCHCa CKa3yeMO

ro «HOCRm». ,[(JI.H 3TOfO npl1 aBTOMaTJ1qecKOM Cl1HTaKcJ1qecKOM aHaJil13e

,a;orr)f(HbI BhICTpa11saTbC.H He TOJihKO Te Cl1HTaKc11qecK11e CTPYKTYPhI aHa

rr11311pyeMoro npep;JIO)f(eHl1R, KOTOpbie Hanp.HMYIO COOTBeTCTBYIOT npe,a;

CTaBJieHHbIM B TeKCTe CJIOBO<popMaM, HO l1 Te, KOTOpbie co,a;ep)f(aT B ce6e

3JIJil1nTl1pOBaHHhie 3JieMeHTbl, He npe,a;cTaBJieHHhie B aHam1311pyeMOM

npe,a;rro)f(eHl1l1. TaK KaK Cl1HTaKc11qecK11e aHaJil13aTopbI, KaK npas11rro,

o6pa6aTbIBaIOT Ka)f(p;Oe npep;JIO)f(eHJ.te B OT,a;eJibHOCTl1, a He HeCKOJibKO

npep;JIO)f(eHl1i1 O,ll;HOBpeMeHHO, B03Hl1KaeT Heo6xo,a;l1MOCTb npe,a;norra

raTb B03MO)f(HOCTb 37IJil1IlCHCa BO BCex p;onycKaIOfi.\l1X 3JIJil1nCl1C y3rrax

Cl1HTaKc11qecKotl CTPYKTYPhI. Tipo6rreMa ocJIO)f(HReTrn TeM, qTo np11

3JIJil1I1CHCe Kopecl>epeHTHOfO aHTeQe,a;eHTa MO)f(eT He 6bITb: Hanpl1Mep,

B Bonpoce «BaM KOZO?», no acei1 aepo.HTHOCTl1, 3JIJIHnTl1pOBaHbI, no

Kpafrnetl Mepe, Hanp11Mep, crrosocl>opMbI «cneoyem» 11 «no3aamb», Hl1KaK

He npep;CTaBJieHHbie B npe,a;bIAYll.\l1X npe,a;JIO)f(eHl1.HX, nOCKOJibKY npep;bI

AYll.\l1X npe,a;rro)f(eHl1H HeT.

YKa3aHHhie cl>aKTOpbI, npl1BO,a;Rll.\l1e K c11HTaKcw1ecKol1 Heop;H03Haq

HOCTl1 npep;JIO)f(eHl1H, ,a;ei1CTBYIOT O,ll;HOBpeMeHHO l1 MHOroKpaTHO rrpaK

TJ1qecKl1 B 7II060M npe,D,JIO)f(eHl1l1, Il03TOMY KOJIJ1qecTBO KOM6l1HaQl1H,

nepe6op KOTOpbIX ,!J;OJI)f(eH 6bITb BbITIOJIHeH JIHHfBOnpoQeccopoM npl1

Cl1HTaKc11qecKOM aHamrne, Kpal1He serr11Ko. KaK OTMeqaeT H. H. JleoH

TbeBa, «ITOrryqJ1Tb xopoI.I.rne pe3yllbTaTbl C~rnAH ,ll;JIR BCeX rrpep;JI.O)f(eHl1M

ecTeCTBeHHOfO, Henpenap11poBaHHOro MaCCJ1Ba TeKCTOB OKa3bIBaeTC.H

rrpaKTl1"l{eCKl1 HeBbII10JIHl1MOM J1Jll1 6e3MepHO CJIO)f(HOM 3ap;aqetf. Tipl1-

"l{J1H TOMY MHoro. 3To l1 Hernap;KOCTb nocTpoeHHR MHOrl1X pearrhHbIX

npep;JIO)f(eHl1H < ... > l1, CaMOe rnaBHOe, oqeffb 60JiblllaR JIOKaJibHaR He

O,ll;H03ffaqHoCTb» (JleOHTbeBa 2006: 79,80). Cyll.\eCTBYIOT pa3rrwrnh1e no,a;xop;bI K pellI.eHl1IO npo6rreMbI Cl1HTaK

c11qecKotl tteop;H03HaqHoCTl1. KaK OTMeqaeT M. C. Esp;oK11MoBa, «C TO"l{KH

3peHl1.H QeJil1 Cl1HTaKCJ1qecKOfO aHaJIH3a MO)f(HO Bbip;errl1Tb p;sa OCHOBHbIX

no,a;xo,a;a: o,a;HoQenesol1 l1 MHOroQerresotl. Tip11 rrepsoM no,a;xo,a;e AJI.H cl>pa-

3bI Tpe6yeTC.H IlOCTpOl1Tb O,ll;HO Cl1HTaKcJ1qecKoe npep;CTaBlleHJ1e, 3TOT

no,a;xo,a; xapaKTepeH ,D,JI.H nepsbrx arrropl1TMOB Cl1HTaKc11qecKoro aHarr11-

3a, Kor,n,a C"l{l1TaJIOCb, "l{TO Cl1HTaKCJ1"l{eCKl1X cpe,a;CTB p;ocTaTOllHQ AJI.H Toro,

qrn6h1 06ecneq11Tb npaBl1llhHhIM aHan113 cl>pa3hI, xorn 6b1 AJI.H 6onhilll1H

cTBa cl>pa3. Tip11 BTOpoM no,a;xoge ,n,nH cl>pa3hI Tpe6yeTrn nonyq11Th see Te

141


c11ttTaKc11qecK11e npeACTaBnemrn:, KOTOpb1e YAOBneTBop.HIOT onpeAeneH

HhIM cornarneHIDIM .» (EBAOKHMOBa 2006: 75). CneAyeT OTMeTHTb, tJ:To noM11Mo OAttou;eneBbIX 11 Mttorou;eneBbIX Me

TOAOB CHHTaKCH'lleCKOro attan113a cymecTBYIOT TaIOKe KOM611H11poBaH

Hbie MeTOAbl, COlJ:eTalO~He B ce6e npHeMbl o6ol1X MeTOAOB, B qacTHO

CTH MeTOA qmnbTpOB, np11 KOTOpOM pa3nJ1liHbie Bepc1111 attam13a He

pa3AeJI.HIOTC.R:, a, Hanponrn, o6'beAHH.HIOTCR B eAl1HblH HeApeBOBHAHbIH

rpa<t>. OcHOBHbie HAeH MeTOAa <t>11nbTpoB 6bIJIH c<t>opMy1mpoBaHbI B pa-

6ornx 11. Jlecep<t>a 11 pa3Bl1ThI pHAOM Apyr11x 11ccneAOBaTenel1, B qacTHO

cT11 JI. H. MopAattcKOH, IO. ,IJ;. AnpernttoM.

MeTOA <t>11nbTpoB cnoco6cTByeT 3KOHOM1111 Marn11HHhIX pecypcos 6e3

n0Tep11 n11HrB11cT11tJ:ecKol1 KoppeKTHOCT» pe3ynhTaToB attaml3a. BMecrn

nocTpoett11.H HeCKOJibK11x He3aBHCl1MhIX c11ttTaKc11qecKMX CTPYKTYP BhI

cTpa11saeTrn eA11Ha.H CTPYKTypa, coAep)f(a~a.H B ce6e KaK OAH03Ha'l{Hhie,

TaK 11 HeOAH03Ha'llHble CBH3l1. Tip11 3TOM 11cqe3aeT He06XOAHMOCTb MHO

roKpaTHOro Kon11poBaHIDI qacTeti 3TOH CTPYKTYPhI, o6~MX AJI.H pa3HhIX

Bepcm1 aHaJIJ13a. J111HrBl1CTl1lJ:eCKa.H KoppeKTHOCTb 3TOfO MeTOAa o6y

CJIOBJieHa TeM, 'llTO <t>11nbTpbl MOryT 6bITb H Cl1HTaKCl1'lleCKl1MH, H ceMaH

Tl1'l{eCKHMl1, TaK KaK np11MeHeH11e cp111IbTpOB He COCTaBJI.HeT qacn1 Heno

cpeACTBeHHO c11HTaKc11qecKoro aHan113a.

TipeAnaraeMhIH B CTaThe IlOAXOA K opraH113au;:~m pa6oThI mrnrso

np01..~eccopa OCHOBaH Ha OAHOBpeMeHHOM BbITIOJIHeHl111 Mop<t>onomqe

CKOfO, Cl1HTaKc11qecKoro 11 ceMaHTHlJ:eCKOro aHaJil13a TeKCTa, npeATIOJia

raIO~eM <t>11nhTpau;1110 qacT11 sepc11t1 Ha Ka)KAOM 113 yposHeli np11 BhI

.HBneH11H HeB03MO)KHOCTJ1 IlOCTpoeHl1.H sepc11J16onee BblCOKOro ypoBHH.

TaK, qacT11lJ:ttoe CH.HT11e Mop<t>onor11qecKoi1 HeOAH03HalJ:HOCTH MO)f(eT

npOJ13BOAl1TbC.H y)f(e TOfAa, KOrAa 06Hapy)f(11BaeTC.H HeB03MO)f(H0CTb no

CTpoeHl1R CHHTaKCHlJ:eCKOH CB.H311 Me)f(AY CJIOBo<t>opMaMl1. Ha Ka)f(AOM

mare Cl1HTaKCl1lJ:eCKOro CB.H3bIBaHIDI AOJI)f(eH BbITIOJIH.HTbCH ceMaHTl1lJ:e

CKl1H aHaJil13 nonyqeHHOH Cl1HTaKCl1'lleCKOH CBR311, B npou;ecce KOTOpo

ro <t>11nbTpyeTrn t.JaCTb sepc11J1 c11HTaKc11qecKoro aHan113a. Hanp11Mep,

np11 pa36ope npeAJIO)f(eHIDI «/{eMoHcmpaHmbt Ja6pacbt8a10m nolluu,u10 6ymblllKaMU c 3aJICuzamellbHOU CMeCb10» B OAHOH 113 sepcHH Cl1HTaKCH'lle

CKOro aHaJIH3a KOMilOHeHT «C 3aJ1Cu2amellbHOU CMeCb10» MO)f(eT paccMa

Tp11BaTbC.H KaK o6CTO.HTenbCTBO np11 CKa3yeMOM «3a6pacbtBa10m», 03Ha

qa10~ee cosMecTHOCTb AelicTBl1R. CeMaHT11tJ:ecK11l1 aHan113 noKa3brnaeT

HeKoppeKTHOCTb TaKOH Cl1HTaKCl1'lleCKOM CBH3H, TaK KaK COBMeCTHOCTb

AeHCTBl1R npeAilOJiaraeT OTHeceHHOCTb npeAMeTa, o6o3HaqaeMoro 06-

142


CTOHTeJibCTBOM, K )l(J1BbIM cyll.\eCTBaM, HO Bb1pa)f(eH11e «6ymblllKU c 3a

JICUZamellbH.OU cMecb10» He yp;oBJieTBOpHeT 3TOMY Tpe6osaH1110 HM B op;HOM 113 CBOJ1X 3Ha"leHm1.

TaKoH nop;xop; 1103som1eT cyll.\eCTBeHHO noBhICMTh npo113sop;11TeJib

HOCTb JIJ1HfBOI1pOQeccopa l1 cpaKTJ1l{eCKM rrpeop;oneTb rrpo6rreMy KOM-

611HaTOpHoro B3pbIBa. Tip11 l1HOH opraHJ13aQJ1l1 pa60Tbl JIMHfBOilpOQeC

copa rrpoBepKa ceMaHT11qecKHX orpam1qem1u ocyll.\eCTBJIHJiach 6b1 Ha

6orree Il03,ll;Hl1X 3Tarrax, l1 HeKoppeKTHbie c TO'lIKJ1 3peHJ1H ceMaHTl1Kl1 fl1-

IlOTe3bl rropo:>KJJ;aJI11 6b1 MHO:>KeCTBO JJ;pyrnx, l13Jil1llIHHX r11110Te3. Bb16op

TaKoro crroco6a opraH113aQ1111 pa6oTbI n11Hrsonp0Qeccopa o6ycnosrreH,

op;HaKO, He TOJibKO coo6pa:>KeHJ1HMJ1 rrp0113BO,D;J1TeTibHOCTJ1, HO l1 TeM,

'lITO ceMaHTl1Ka, KaK yKa3bIBaeT A. C. fepJJ;, «npoHU3bteaem ace ypoeHu

Jl3btKa l1 TeM caMbIM He rrpep;cTaBJIHeT co6oH OTJJ;eTibHOfO ypoBHH» (fep,ll;

1996: 9). l1MeHHO 1103TOMY 11p0113BO,D;l1Tb Mop<t>onorn'lleCKJ1H l1JIH CHH

TaKCJ1'tleCKl1H aHaJIJ13 TeKCTa B OTpbIBe OT ceMaHTM'lleCKOfO aHaTIJ13a, KaK

11pep;cTaBJIHeTCH, He TOJibKO HepaQMOHaJibHO, HO 11 He Bl10TIHe KoppeKTHO

c Jll1HfBJ1CTJ1l{eCKOH T0l{KJ1 3peHl1H.

J13rro:>KeHHhIH rrop;xop; K opram13aQl1l1 pa6oTbI TIHHrsorrpoQeccopa

p;aeT B03MO:>KHOCTb rrpOH3BO,D;HTb aBTOMaTl1"1eCKYIO o6pa60TKY TeKCTa

B COOTBeTCTBJ111 co CJieJJ;yIOII.\HM a6cTpaKTHbIM anropHTMOM.

1. Bo BXO,D;HOM 110TOKe BbIJJ;eJIHIOTCH aTOMapHbie ep;HHJ1Qbl.

2. )J)rn Ka:>KJJ;OH BbI,D;eJieHHOH ep;l1Hl1Qbl 11p0113BOA11TCH 110IlbITKa ce

MaHn1qecKoro aHaJIH3a.

3. ,ll,JIH Ka:>KJJ;OH 11apbl cocep;m1x BhI,D;eJieHHblX ep;l1Hl1Q, AJIH KOTOpbIX

B 11. 2 6hIJI 11011yqeH HeKl1H pe3}'TlbTaT, np0113BO,D;l1TCH 110IlblTKa 06'bep;11-

HeHl1.H 3TOH napbl B eJJ;HHYIO COCTaBJIHIOII.\YIO. B CJIY'.Jae yc11exa 11onyqeH

HaH COCTaBITHIOII.\aH Cl{J1TaeTrn HOBOH Bbip;eJieHHOH eJJ;HHHQeH, JJ;JI.H KOTO

poti IlOBTOpHIOTCH 11YHKTbl 2-3. 3TOT anropHTM B O,D;l1HaKOBOH Mepe 11pHMeHJ1M KaK K Mopcporrornqe

CKOMy, TaK 11 K Cl1HTaKc11qecKOM}' aHaJrn3y. Ha ypoBHe Mopcponor11qecKO

ro aHaTIJ13a aTOMapHbIMJ1 ep;l1HJ1QaMH BhICTy11aIOT MOpcpeMhl, a CJIO:>KHbl

MH COCTaBJIHIOI.Ql1Ml1 - CJIOBocpopMbl l1 BXO,ll;HI.IJ;He B l1X COCTaB CJIOBOJ13-

MeHl1TeJibHhie 11 CJIOBoo6pa30BaTeTihHhie OCHOBbl. B npoQecce Cl1HTaKCJ1-

qecKoro aHarr113a cnoBocpopMbI 06'bep;11HHIOTCR B cocTaBJI.HIOI.Ql1e 6orree

BbICOKMX ypoBHeH CJIOBOCO'lleTaHH.H, 11pep;Jio:>KeHl1.H l1 CBepxcppa30Bbie

ep;MHCTBa.

06'bep;11HeH11e p;Byx ep;11H11Q s eJJ;11Hy10 cocTas1rn:10u.i;y10, Bhll10JIHHIO

u.i;eern B 11. 3, rrpo113Bop;11Trn 11yTeM rrepe6opa HeQ11Krr11qecKHX Maplllpy-

143


TOB, CBH3bIBaIOI.l\l1X KJiaCCbl 3TJ1X eAJ.1Hl1IJ; B rpaMMaTHKe COCTaBJIHIOI.l\HX,

npep;cTaBJieHHOH B BHp;e rpa<Pa, Y3Jibl KOToporo COOTBeTCTBYIOT KJiac

caM COCTaBJIHIOI.l\HX, a p;yr11 CBH3bIBaIOT KCl)l(AbIH KJiacc COCTaBJUIIOI.l\HX

c K11accaM11 11x B03MO)l(HbIX AoqepHHX cocTaBJUIIOI.l\HX. Knacc o6ll\el1 co

cTaBJIRIOI.l\eti pacnonaraeTCH B TOH TOqKe MaprnpyTa, B KOTOpo:t1 J13MeHH

eTCH ero HanpaBJieH11e: TaK KaK C:TPYKTYPbl COCTaBJIHIOI.l\HX ApeBOBHAHbl,

MaprnpyT AOJI)l(eH npOXOAHTb OT nepBOH CBH3bIBaeMOH COCTaBJIHIOI.l\eH

no 1.1;enoqKe POAHTeJibCKHX COCTaBJIRIOI.l\HX (BBepx) AO Tex nop, IlOKa He

Ha:t1p;eTCH TaKaH COCTaBJIHIOI.l\aH, OT KOTopo:t1 CYI.l\eCTByeT B03MO)l(HOe

npOAOJI)l(eHHe 3T0f0 Maprnpyrn no 1.1;enoqKe p;oqepHHX COCTaBJIRIOI.l\HX

(BH113) AO BTopoti CBH3bIBaeMOM COCTaBJIRIOI.l\eH.

CeMaHT11qecK11l1 aHaJIH3 BhIAeJieHHhIX ep;HHHQ, BhmOJIHHIOl.QHHCH

B n. 2, <l>YHKIJ;HOHHpyeT crrep;yIOI.l\HM o6pa30M: eCJIJ1 aHaJIJ13HpyeMaH ep;11-

HJ1Qa aTOMapHaH l1Jll1 BXOAHT B MHO)l(eCTBO «l1Al10MaT11qecKHX» e,n;HHHIJ;

( T. e. TaKHX ep;HHHIJ;, 3HaqeHJ1e KOTOpbIX HeB03MO)l(H0 BbiqJ1CJIJ1Tb 113 3Ha

qeHJ1H 11x qacTeti), TO coBoKynHOCTb 3HaqeH11J1 3Tol1ep;11HJ1QhI113BJieKa

eTrn 113 crroaapH; ecrr11 )Ke aHarr11311pyeMaH ep;11H111.1;a cocTOHT 113 6onee

npOCTbIX COCTaBJIHIOI.l\HX J1 He l1,ll;l10MaT11qecKaH, TO ee 3HaqeHHe Bb1q11c

JIReTCH nyTeM nonbITKJ1 ycTaHOBHTb Me)l(AY 3HaqeHJ1HMJ13Tl1X COCTaBJIH

IOI.l\HX ceMaHTJ1'~1ecKoe OTHOllleHHe, COOTBeTCTBYIOI.l\ee THny l1 HanpaB

rreHHIO CJ1HTaKc11qecKOM, CJIOBoo6pa30BaTeJibHOlt J1Jll1 <l>opMoo6pa30Ba

TeJibHOH CBH3l1.

3TOT anropHTM peaJIH30BaH B BHp;e nporpaMMbI Ha H3hIKe C, pac

npocTpaHHIOIIJ;eticH B l1CXOAHbIX Kop;ax Ha HeKOMMepqecKOM OCHOBe

no.a: CBo6op;Hoti 11111.1;eH311e:t1 GNU GPL 11 BXOJV1ll\et1 B p;11cTp116yT11BhI

onepa1.1;110HHol1 c11cTeMhI «HayJI11HyKc». Pa3pa6ornHHhIH JIHHrBonpo-

1.1;eccop npol13BOAJ1T IlOCTpOeHHe B03MO)l(HbIX ceMaHTJ1qecKHX npep;

CTaBJieHHM npep;JIO)l(eHHH l1 CBepxcppa30BblX eAHHCTB aHaJIJ1311pyeMoro

TeKcTa. B npo1.1;ecce ceMaHTWiecKoro attan113a BblilOJIHHeTcH TaIOKe no

IlbITKa pa3perneHHH aHa<l>op11qecKJ1X CBH3e:t1 c yqeTOM l1HTepnpeTaQJ1l1

JIHHefrnoro nopHAKa COCTaBJIRIOI.l\HX c TOqKJ1 3peHHR aKTyaJibHOfO qJie

HeHJ1H. AHa<Popl1tJ.ecKaH CBH3b npe,n;nonaraeTrn AAA KCl)l(AOH napbI 3Jie

MeHTOB ceMaHT11qecKoro npeACTaBJieHHH AByx JIHHe:t1Ho coceAHHX npo

CThIX npep;JIO)l(eHHH, eCJIH BTopoi1 3JieMeHT napbl TeMaTH'l:leCKHH c TO'l{KJ1

3pemrn: aKTyaJibHOro qJieHeHHH, l1 Me)l(AY 3JieMeHTaMJ1 cyn.i;eCTBYIOT OT

HOllleHH.H CHHOHHMHH HJIH rnnepoHHMHH. YKa3aHHoe npaBHJIO pacnpo

cTpaHHeTCH He TOJibKO Ha HMeHHbie, HO l1 Ha rrraroJibHbie rpynnbl. KpoMe

Toro, npep;rrorrara10Trn aHa<l>op11qecK11e CBH3H Me)l(p;y MeCTOHMeHHRMH

144


M COOTBeTCTBYIOil\MMM J1X 3HaqemUIM qJieHaMM npe,rvneCTBYIOil\efO (p;JIH:

peqmeKCMBHoro MeCTOMMemrn: - rnro )l(e) npocToro npep;JIO)l(eHMR.

YcTaHaBJIMBaeMbie B cooTBeTCTBMM c yKa3aHHbIMM npaaMrraMM aHa

<PopMqecKMe CBR3M 06pa3y10T ceTb TeMaT111-1eCKMX nporpecCMH, 1103BO

JIRI011\YIO rrpOM3BO)l;MTb aBTOMaTMt{eCKyIO py6pHKaQMIO aHaJIM3MpyeMoro

TeKcTa M patt)l(MpoaaHMe npMnMcbrnaeMbIX eMy py6pMK. Patt)l(MposaHMe

py6pMK npOM3BO)l;MTCR Ha OCHOBaHMM Bblt{MCJiemrn: M cyMMMpOBaHMR

paHrOB IlOHJITMH (3JieMeHTOB ceMaHTYfqecKoro rrpep;CTaBJieHMR), o6pa3y

l011\MX o6pa3bI 3TMX py6pMK. PaHm rroHRTMH Bbit{MCJIRIOTCH B cooTBeT

CTBMM co crrep;yIOil\MMM npaBMJiaMM:

1) paHr IIOHRTMJI, Bblpa)l(eHHOfO CMHTaKCYflleCKOH COCTaBJIRIOil\eH, He

CBJI3aHHOH HM HarrpHMYIO, HM onocpep;oBaHHO HMKaKMMM aHa<PopMqe

CKHMM CBJI3RMJ1 c .n;pyr11MJ1 COCTaBJIJIIOil\11MJ1, paaeH ep;11H11u;e;

2) IIOHRTMJI, Bblpa)l(eHHbie TeMaT11qecKHMJ1 COCTaBJIJllOil\11MJ1, CBJl-

3aHHbIMM c .n;pyrMMJ1 COCTaBJIRIOil\MMM HanpRMYIO J1JIJ1 orrocpe.n;osaHHO

aHa<Pop11qecKJ1MJ1 CBR3JIMJ1, o6rrap;aIOT O)l;HHaKOBbIM pattroM;

3) IlOHRTJ1R, Bblpa)l(eHHbie peMaT11qecKJ1MJ1 COCTaBJIRIOil\11MM, CBJl-

3aHHbIMJ1 c .n;pyrnMH COCTaBJIHIOil\11MJ1 onocpep;oBaHHO atta<PopHqecKH

MH CBJl3JIMH, o6nap;aIOT paHroM, Ha ep;HHHQY 60JiblllJ1M, qeM paHr aHTe

Qep;eHTa.

qeM BbIIIIe pattr IlOHH:TMJI, TeM B MeHbllleH Mepe py6pHKJ1, K KOTO

pbIM OTHOCHTCJI 3TO IlOHRTMe, xapaKTepM3YIOT aHaJIJ13HpyeMblH TeKCT.

I1o3TOMY peneBaHTHOCTb IIOHHTMH TeKCTY Qenecoo6pa3HO Ct{MTaTb 06-

paTHO nporropQ11ottaJibHOH ero pattry. PerreBaHTHOCTh py6pMKH MO)l(HO

onpep;eJIHTb KaK OTHOilleHHe cyMMbl perreBaHTHOCTeH TeKCTY IIOHRTHH,

BXO,D;Jllll;HX B ee o6pa3, K cyMMe peneaaHTHOCTe11: TIOHRTHH, BXO)l;Rll\11X

B o6pa3 JII06oi1 py6pMKJ1, OTHOCHil\eHCR K TeKcTy·

ce lmg(rub)

R - L R, rub - 3r :c e fmg(r) '

L R,

r.n;e rub py6p11Ka, Img(r) - o6pa3 py6p11KM r, R, - perreaaHTHOCTb c.

Corrraetto 3TOH <PopMyne, perresaHTHOCTb py6pMKH Re He rrpeBbI

maeT 1 M He MO)l(eT 6bITb oTpHQaTeJihHOH; cyMMa peneBaHTHOCTetf acex

npMCBOeHHblX TeKCTY py6p11K COCTaBJIJieT 1.

145


Azeea M. C. MeTO,ll;bI aBTOMan1qecKOH py6p11Ka1.vrn TeKCTOB, ocHoBaHHbie Ha MaumHHOM o6yqemm H 3HamuIX 3KcnepToB: ,n;Hc ... KaH,n;. cpH3.-MaT. HayK. M., 2005.

AzeeB M. C., ao6po8 B. B., !IyKaweBUt.t H.B. ABTOMarnqecKaJI py6pirna1vrn TeKCTOB: MeTO,ll;bI H npo6neMbI II YqeH. 3an. Ka3aHCK. roe. ytt-Ta. 2008. T.150, KH.4.

AzeeB M. C., ao6po8 B. B., llyKaweBU'i H.B., Cuoopoa A. B. 3KcnepHMeHTaJibHbie anropHTMhI noHcKalKnaccmpHKa1vm H cpanHeHHe c «basic line» 11 PoccHJ'.1-cKHH ceMHHap no OQeHKe MeTO,ll;OB HHcpopMaQ110HHOfO nOHCKa (POMMTI 2004): CeMHHap B paMKax Bcepoc. ttar1. KoHcp. RCDI.:2004. 1 OKT. 2004 r. IIy~HHO, 2004.

AzeeB M. C., ao6po8 B. B., !IyKaweBU'i H.B., IllmepHOB c. B. YMC POCCV15I B POMMII 2008: noHcK 11 Knacrncp11KaQ1u1 HOpMarnBHbIX ,n;oKyMeHTOB 11 Pocc11J1cKHH ceMHHap no oQeHKe Mern,n;oa HttcpopMaQHOHHoro noHcKa (Tpy,n;bI POMl1II 2007-2008): CeMHHap B paMKax Bcepoc. Hayq. KoHcp. RCDI.:2008. 9 OKT. 2008 r., ,D;y6Ha. CII6., 2008.

Azeea M. C., Kypa!leHoK U. E. OcpHQHaJibHhie MeTpHKH POMMI1'2004 11 PocCHHCK11H CeMHHap no OQeHKe MeTO,ll;OB HHcpopMaQHOHHOfO IloHCKa (POMMII 2004). IIy~HHO, 2004.

Be!loB A. A., BollOBU'i M. M. ABTOMaTHqecKoe pacno3HaBaHHe TeMaTHK11 csepxKopoTKHx TeKCTOB I KoMnhIOTepttaJI JIHHrBHCTHKa H HHTenneKTyanhHbie TeXHonornH: Tpy,n;hI Me:>K,ll;yHap. Kottcp. «,l1;11anor 2007» (BeKacoso, 30 MaJI 3 HIOHH 2007 r.) I no,n; pe,n;. JI. JI. V10M,n;11tta, H. 11. Jiaycpep, A. C. HapttHhHH11, B. II. CenereH. M., 2007. C. 35-37

V1H11Q11aTHBHbH1 npoeKT poccHHCKOfO ceM11Hapa no OQeHKe MeTO,ll!OB 11HcpopMaQHOHHOfO noHcKa (POMMII) I II. M. BpacnascKHH, M. B. fy611H, B. B. )J;o-6poa, B. IO. )J;o6pbIH11H, 11. E. KypanettoK, M. C. HeKpeCThHHOB, E. IO. IIaanosa, M. B. CeranoaHq 11 KoMnhIOTepttaH JIHHra11cT11Ka H HHTenneKTyanhHbie TexttonornH: Tpy,n;bI Me)l(,n;yttap. KOH<p. ,D;ttanor-2003. IIpoTBHHO. 11-16 HIOHR 2003 r. I no,n; pe,n;. M. M. Ko603esot1:, H. J1. Jiaycpep, B. II. Cenere11. M., 2003.

Bacu!lbeB B. f. KoMnneKcHaH TeXHonorn11 asTOMaT11llecKol1 KJiacc11cp11KaQ1111 TeKCTOB 11 KoMnbIOTepttaJI n11ttrs11cTHKa 11 11HTenneKTyanbHbie TeXHonorn11: Ilo MaTepHaJiaM e)l(efO,D;HOH Me)l(,n;yttap. KOHcp. «)J.HaJIOf» (BeKaCOBO, 4-8 11IOHR 2008 r.). M., 2008. Bbm. 7 (14).

Bacu!lbeB B. f. Bh1,n;enettHe cpparMeHTOB B TeKcTax npH Knacc11cp11KaQHH 11 KoMnhIOTepHaJI JIHHrBHCT11Ka 11 HHTenneKTyanbHbie Texttonorn11: no MaTep11anaM C)l(efO,D;HOH Me)l(,u;yttap. KOHcp. «,lJ;Hanor-2009» (BeKaCOBO, 27-31 MaJI 2009 r.). M., 2009. Bhm. 8 (15).

BacUTCbeB B. r. 06yqeHHe KJiacc11cp11KaTOpOB Ha OCHOBe BbI,D;eJieHHH cpparMeHTOB 11 KOMnbIOTepHaJI llHHfBHCTHKa J1 HHTeJIJieKTyaJibHbie TeXHOJIOfl111: ilo

146


MaTepHarraM e)l(ero.n;HoJ1: Me)l(p;yHap. Komp. «.UHarror» (BeKacoao, 26-30 M3Jl 2010 r.). M., 2010. Bbm. 9 (16).

I'epo A. c. Tipep;MeT H OCHOBHbie HanpaBJieHHJI npHKJia)l;HOH JIHHrBHCTHKH II TipJ1KJia.n;ttoe JI3bIK03HaHHe: yqe6mtK. CTI6., 1996.

,ao6po8 15. B., JlyKaw.eBut.t H. B. TiocTpoeHHe H HCTIOllb30BaHHe TeMaTw-1ecKoro npep;cTaBJieHHJI co.n;ep)l(aHHJI .n;oKyMeHTOB 11 V HaQHOHaJibH3Jl KOH<l>epeHQHJI c Me)l(.n;yttapo,n;HbIM ytiaCTHeM «l1cKyccTBeHHbIH HHTerrneKT-96». Ka3aHb, 1996. T. 1. C. 130-134.

E800KUM08a U. C. ECTecTBeHHO-JI3bIKOB&Ie cHcTeMbI. YnaH-Y,n;3, 2006. JleoHmbe8a H. H. ABTOMaTHtiecKoe noHHMaHHe TeKCTOB. C11cTeMbI, Mo.n;errH,

pecypc&I. M., 2006. llyKaw.e8ut.t H. B., ,ao6po8 .5. B. ABTOMaTHtieCKoe aHHOTHpoaaHHe HOBOCT

HhIX KnacTepoa Ha OCHOBe TeMaTHtiecKoro npe.n;cTaBrreHHJI 11 KoMnbIOTepH3Jl JIJ1HfBJ1CTHKa J1 HHTeJIJieKTyaJibHbie TeXHOJIOfHH: no MaTepHaJiaM e)l(efO)l;HOH Me)l(JWHap. KOH<l>. «,UHanor-2009» (BeKacoao, 27-31 M3Jl 2009 r.). M., 2009. BbIII. 8 (15).

Menbt.tJK U. A. On&IT Teop1111 JIJ1HfBJ1CTHt1ecK11x Mo.n;e11eJ1: «CM&ICJI ¢:> TeKCT». M., 1974.

lloooy6Hbtu B. B., llleBeneB 0. I'., £opMaw.o8 ,a. A. CpasHeHHe Kat1ecTaa no.n;xo.n;oa K KJiaCTepH3aQHJ1 TeKCTOB Ha OCHOBe rnnepreoMeTpHtieCKOfO KpHTepHJI. II BecTHHK ToMcK. roe. ytt-Ta. 2006. N2 293.

YJ1C POCCJ151 B POMJ1TI'2007: noHCK H KJiacrn<l>HKaQHJI I M. C. Areea, B. B. ,Uo6poa, TI. B. Kparnn&HHKOB, H.B. llYKaweBHtI, A. M. TiaarroB, A. B. CH.n;opoa, C. B. lIITepHoB I PocrnJ1:cKHJ1: ceMJrnap no oQeHKe MeTo.n;os HH<l>opMaQHOHHoro noHcKa (Tpy,n;hI POMJ1TI 2007-2008): CeMHHap B paMKax Bcepoc. Hayq. Kott<P. RCDt2007. 18 OKT. 2007 r., TiepecnaBJI&-3arreccKHH. CTI6., 2008.


Hay'-IHOe H3AaHHe

CTPYKTYPHMI VI CTPVIKflAllHMI flVIHfBVICTVIKA

MeJKayJoacKuu c6opHuK

BbinycK 9

PeAaKTOp JI. A. Kapnoaa

KoMnblOTepHa.H sepcTKa E. M. BopoHKOaoii

no,l{mfCaHO B ne'-!aTb 13.07.12. <I>opMaT 60x84 I I 16'

CTe'-!aTb ocpcernaR. fiyMara ocpceTH<UI.

Yrn. ne'-1. n. 20,69. THpa:>K 250 3K3. 3aKa3 2.f.C

l13AaTellbCTBO CaHKT-DeTep6yprcKoro YHHBepcineTa.

199004, C.-0eTep6ypr, B.O., 6-.R !IHHH.R, 11/21.

Ten. (812)328-96-17; cpaKc (812)328-44-22

E-mail: [email protected]

www. uni press. ru

TimorpacpH.R l13,l{aTe!IbCTBa cn6n:

199061, C.-DeTep6ypr, CpeAHHtt np., 41.


MHTepHeT-MOfOJHH

OZON.ru

1113.QATEJlbCTBO C.-nETEP6YPrCKOrc II II I II I I Ill l1

1l Ill Ill I Ill 1009549712


АВТОМАТИЧЕСКАЯ РУБРИКАЦИЯ ТЕКСТОВ СРЕДСТВАМИ...

Documents

Transcript of АВТОМАТИЧЕСКАЯ РУБРИКАЦИЯ ТЕКСТОВ СРЕДСТВАМИ...