Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
,0+%0(##'+%'+%'+%&,-/'+-+4)'*,0(,..#-)+'4+
/.,+#.#-!&#+/#'/!&1+,"
,-(/,1+#'%&/.
53.0()## 2'+%4&, $-+4*-,0(,.,+'4+6
0.' *!,*
!!
1< ;<J:I@9< #' JK8K@JK@:8C D8:?@E< KI8EJC8K@FE JPJK<DJ =FI K?<
(.#,
?@E<J<
KF
E>C@J? *8K<EK'. <M8CL8K@FE #'J
GI@D8IP JPJK<D :FD9@E<J K?< KI8EJC8K@FE FLKGLK F= K?I<< ;@JK@E:K
JK8K@JK@:8C D8:?@E< KI8EJC8K@FE JPJK<DJ W G?I8J< ;@I<:K 8E; JPEK8O
98J<; KI8EJC8K@FE JPJK<DJ W LJ@E> C8E>L8>< DF;<C I<
J:FI@E> FE
:FE=LJ@FE E<KNFIBJ 8:? KI8EJC8K@FE JPJK<D ;@==<IJ @E K<IDJ F=
KI8EJC8K@FE DF;<CJ 8E; ;<:F;@E> K<:?E@HL<J J?8I@E> K?< J8D< GI<
GIF:<JJ@E> NFI; 8C@>ED<EKJ GFJK
GIF:<JJ@E> 8E; C8E>L8><
DF;<CJ #'J ?@E<J<
KF
E>C@J? GI@D8IP JPJK<D 8:?@<M<; K?<
J<:FE; ?@>?<JK &/ J:FI< FLK F= 8CC GI@D8IP JPJK<DJ
J:FI<;
NFI; 8C@>ED<EKJ FI ;<:F;@E> K?< ?@E<J< @EGLK K<OKJ 8I< GI<
GIF:<JJ<; @E K?< J8D< N8P 8J K?< KI8EJC8K@FE DF;<C KI8@E@E> 8E;
KI8EJC8K<; 9P K?< I<JG<:K@M< ;<:F;<I F= K?< K?I<< KI8EJC8K@FE
JPJK<DJ .?< KI8EJC8K@FE FLKGLKJ F= K?< K?I<< KI8EJC8K@FE JPJK<DJ
8I< :FD9@E<; :8J<
I<JKFI<; 8E; ;<
KFB<E@Q<; KF GIF;L:< K?< =@E8C
KI8EJC8K@FE FLKGLK 9CF:B ;<EFK<J 8 G?I8J< KI8EJC8K@FE G8@I
:FEJ@JK@E>F=8JFLI:<8E;8K8I><KG?I8J<
5(8KLI8C&8E>L8><*IF:<JJ@E>6'8:?@E<.I8EJC8K@FE
.?@J G8G<I @J FI>8E@Q<; 8J =FCCFNJ -<:K@FE ;<J:I@9<J GI<
GIF:<JJ@E> -<:K@FE ;@J:LJJ<J NFI; 8C@>ED<EKJ -<:K@FE GI<J<EKJ K?< KI8EJC8K@FE DF;<CJ 8E; ;<:F;@E> K<:?E@HL<J F= K?<
K?I<< JK8K@JK@:8C D8:?@E< KI8EJC8K@FE JPJK<DJ *FJK
GIF:<JJ@E>
N?@:? @E:CL;<J JPJK<D :FD9@E8K@FE @J ;@J:LJJ<; @E -<:K@FE -<:K@FE ;<J:I@9<J K?< (.#,
?@E<J<
KF
E>C@J? *8K<EK'.
<M8CL8K@FE 8E; FK?<I <OG<I@D<EK8C I<JLCKJ -<:K@FE :FE:CL;<J K?<
G8G<I
+4+8'2!+839
':+-58/+9'4* ;(0+):+9)8/6:589
C>FI@K?DJOG<I@D<EKJ&8E>L8><J
*I<
GIF:<JJ@E> :FEJ@JKJ F= NFI; J<>D<EK8K@FE <EK@KP :C8JJ@E> 8E;
G8IJ@E>
+?=58*9
-K8K@JK@:8C '8:?@E< .I8EJC8K@FE *?I8J< .I8EJC8K@FE 'F;<C @I<:K
.I8EJC8K@FE 'F;<C -PEK8O 'F;<C -PJK<D FD9@E8K@FE 1FI;
-<>D<EK8K@FE,<FI;<I@E>*8IJ@E>&8E>L8><'F;<C
!+'3'3+
#'
;(:'919'4-;'-+9
.?< GIF989@C@JK@: -' J<>D<EK<I K<E;J KF LE;<I
J<>D<EK 9P
AF@E@E> :?8I8:K<I J<HL<E:<J EFK J<<E @E K?< KI8@E@E> ;8K8
><E<I8K@E> D8EP ))0 NFI;J =FI K?< KI8EJC8K@FE C<O@:FE .?<
FK?<I J<>D<EK<I I<=<IJ KF 8 9@>I8D CFFB
LG K89C< :FEJKIL:K<; =IFD
K?< KI8@E@E> ;8K8 #= 8 KNF :?8I8:K<I J<HL<E:< @J EFK @E K?< 9@>I8D
K89C< @K JGC@KJ K?< KNF :?8I8:K<IJ .?@J K<E;J KF FM<I
J<>D<EK ;L<
KFK?<ELD<IFLJD@JJ@E>9@>I8DJ@EK?<KI8@E@E>;8K8
?@E<J<
KF
E>C@J?*8K<EK'.
>:+84'2+95;8)+9"9+*
&.&&
$58* +-3+4:':/54
1FI; J<>D<EK8K@FE @J :8II@<; FLK @E JK8><J #E K?< =@IJK JK8>< N<
8GGCP 8 =@E@K< JK8K< D8:?@E< -' J<>D<EK<I @E:FIGFI8K@E> >I8D :?8I8:K<I
98J<; C8E>L8>< DF;<C 56 =FI JK8K< KI8EJ@K@FE
GIF989@C@K@<J FI <8:? -'
J<>D<EK<; ?@E<J< NFI; @KJ FLK
F=
MF:89LC8IP ))0 JK8KLJ @J :?<:B<; 8>8@EJK K?< KI8EJC8K@FE
MF:89LC8IP #= K?< NFI; @J 8E ))0 8EFK?<I J<>D<EK<I @J 8GGC@<;
KF=LIK?<IJ<>D<EKK?<NFI;@EK?<J<:FE;JK8><
!"!
#' GI@D8IP JPJK<D =FI K?< (.#,
?@E<J<
KF
E>C@J? G8K<EK
KI8EJC8K@FE <M8CL8K@FE @J K?< :FD9@E8K@FE F= K?I<< KPG<J F=
JK8K@JK@:8C D8:?@E< KI8EJC8K@FE JPJK<DJ G?I8J< KI8EJC8K@FE 56
;@I<:K KI8EJC8K@FE 56 8E; JPEK8O
98J<; KI8EJC8K@FE 56 #E K?@J
G8G<I N< GI<J<EK K?< :FI< K<:?E@HL<J F= <8:? KI8EJC8K@FE JPJK<D
8E;K?<(.#,
*8K<EK'.<M8CL8K@FEI<JLCKJ
E FM<IM@<N F= K?< <E;
KF
<E; KI8EJC8K@FE GIF:<JJ F= K?< #'
GI@D8IP JPJK<D @J J?FNE @E @>LI< FI KI8EJC8K@FE DF;<C
KI8@E@E> N< F9K8@E ?@;;<E D8IBFM DF;<C "'' 8E; D8O@DLD
<EKIFGP ' NFI; 8C@>ED<EKJ =IFD K?< GI<
GIF:<JJ<; G8I8CC<C
:FIGLJ.I8EJC8K@FEDF;<CJ8I<;<I@M<;=IFDK?<KNFKPG<JF=
FK? J<>D<EK<IJ 8I< KI8@E<; FE 89FLK D@CC@FE NFI; :FIGLJ
J?FNE @E .89C< .?< B NFI; @E
?FLJ< 8EEFK8K@FE :FIGLJ @J
;<I@M<;=IFDG8K<EK89JKI8:KJ:C8@DJ8E;K@KC<J
!'(2+./4+9+$58* +-3+4:':/54586;9 :':/9:/)9
-FLI:<
.I8@E@E>-<K
<M<CFGD<EK-<K
&..
SBNFI;J
NFI;J
*8K<EK@E
?FLJ<
SBNFI;J
NFI;J
.?< -' J<>D<EK<I G<I=FID8E:< FE K?< . ;<M<CFGD<EK J<K @J
89FLK 8E; K?< G8K<EK ;<M<CFGD<EK K<JK J<K @J 89FLK @E D<8JLI<
― 606 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
;2+'9+*4:/:?2'99/4-
EK@KP :C8JJ@E> @J 8GGC@<; KF ELD<I@:8C <OGI<JJ@FEJ JL:? 8J .
.#' ,#(&- 8E; ),#(&- 8E; JFD< EFE
ELD<I@:8C
<OGI<JJ@FEJ JL:? 8J /,& '#& 98J<; FE I<>LC8I <OGI<JJ@FE
G8KK<IED8K:?@E>
.?< <EK@KP :C8JJ@E> ?8J GIFM<E LJ<=LC =FI G8K<EK K<OKJ K?8K @E:CL;<
D<8JLI< NFI;J JL:? 8J 2, )1 ,' <K: GI<:<;<; 9P I89@:
ELD<I8CJ 1< KI<8K K?< :FD9@E8K@FE F= I89@: ELD<I8CJ 8E;
D<8JLI< NFI;J 8J 8 J@E>C< <EK@KP 8J J?FNE @E .89C< P KI<8K@E>
K?< I89@: ELD<I8CJ 8E; D<8JLI< NFI;J 8J 8 J@E>C< <EK@KP N<
I<;L:< K?< @EGLK J@Q< @E 8;;@K@FE KF GIF;L:@E> 8::LI8K<
KI8EJC8K@FEJ=FIK?<<EK@KP:C8JJ<;<OGI<JJ@FE
.?< GI@D8IP GLIGFJ< F= LJ@E> K?< G8IJ<I N8J KF 9<KK<I DF;<C K?<
I<FI;<I@E> G?<EFD<E8 9<KN<<E ?@E<J< 8E; E>C@J? N@K? :FEK<OK
=I<< >I8DD8I ! ILC<J "FN<M<I 8J J?FNE @E @>LI< K?<I<
8I< HL@K< 8 =<N ?@E<J< :FEJKIL:KJ N?FJ< I<FI;<I@E> G8KK<IE
:8EEFK9<<8J@CP:8GKLI<;N@K?.
JKPC< !I<GI<J<EK8K@FEJ @>LI< @CCLJKI8K<J 8 ! ILC< (* ^ (* (* .?< FI;<I F= K?<
KNF :?@C;I<E (* 8E; (* D8P FI D8P EFK 9< JN8GG<; KF GIF;L:<
K?<J8D<NFI;FI;<I8JE>C@J?KI8EJC8K@FEJ
.89C<EK@KPC8JJ@E>O8DGC<J
, # * "& )# .% )
! ('# ELD7D>;C ELD7>
('# $- +/ ! ELD7 .% ) ! ('# ELD7D>;C ! '89/4-'4*!8++!8'49,583':/54
89
-FLI:< C8E>L8>< G8IJ@E> @J LJ<; =FI GI<
FI;<I@E> 9P K?< G?I8J<
KI8EJC8K@FE DF;<C KI<<
KF
JKI@E> >I8DD8I 8:HL@J@K@FE 9P K?<
JPEK8O DF;<C 8E; =<8KLI< 8:HL@J@K@FE 9P K?< ;@I<:K KI8EJC8K@FE
DF;<C
1< LJ< 8 D8O@DLD <EKIFGP ?@E<J< G8IJ<I 56 KI8@E<; FE .
8E; 8E @E
?FLJ< 8EEFK8K<; G8IK
F=
JG<<:? :FIGLJ J?FNE @E .89C<
!'(2+./4+9+'4-;'-++95;8)+9,58'89/4-FLI:<
.I8@E@E>-<K
[email protected]<
&..
SBNFI;J
.I<<98EB
/-;8+./4+9+6.8'9+9=/:.8+58*+8/4-'3(/-;/:/+9
1?<K?<I FI EFK KF JN8G K?< FI;<I 9<KN<<E (* 8E; (* ;<G<E;J
FE K?< G8IK
F=
JG<<:? F= K?< (* J :?@C;I<E #= K?< G8IK
F=
JG<<:?
F= 8 :?@C; @J 8E (( FI (, @>LI< 8 (* (* FI;<I @J DFI<
C@B<CP N?<I<8J @= K?< G8IK
F=
JG<<:? F= 8 :?@C; @J 8 $$ @>LI< 9
K?<(*(*FI;<I@JM<IPC@B<CPKFI<D8@ELE:?8E><;
#E FI;<I KF :8GKLI< K?< I<FI;<I@E> :FEK<OKJ N< I<DFM< K?< G8I<EK
EF;< (* K?8K ;FD@E8K<J K?< ;@J8D9@>L8K@FE :FEK<OKJ @>LI< =K<I (* EF;< I<DFM8C ;@J8D9@>L8K@FE :FEK<OKJ 8I< 8CC
:8GKLI<;8JK?<:?@C;I<EF=K?<J8D<(*G8I<EK @>LI<
*8K<EK@E
?FLJ<
SBNFI;J
*8IK
F=
JG<<:?
*8IK
F=
JG<<:? 8EEFK8K<; :FIGLJ N8J G8IJ<; LJ@E> :FEJKI8@EK
98J<;;<:F;@E>8E;8;;<;KFK?<KI<<98EBKI8@E@E>;8K8 1< C8K<I C<8IE<; K?8K J<EK<E:<J 8E; KFB<EJ
F= K?< G8IK
F=
JG<<:? 8EEFK8K<; ;8K8 ?8; K?< @JJL< F=
D<I>@E> DFI< K?8E FE< G8IK
F=
JG<<:? K8>><; NFI; @EKF 8 J@E>C<
KFB<E8J@E 7$$ 7(( 7 7'7. 7
,<=<I KF 56 =FI K?< C@D@K8K@FEJ F= ! I<GI<J<EK8K@FEJ @E
E>C@J?
KF
$8G8E<J<KI8EJC8K@FEJ
― 607 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
5 + R * (38 + *
+ (38 + *
.?< FGK@D8C G8K? @J =FLE; 9P ;PE8D@: GIF>I8DD@E> N@K? 8
I<:LIJ@M< =FIDLC8 N?<I< . / @J 8 G8IK@8C GIF989@C@KP
=LE:K@FE K?8K ><E<I8K<J K?< F9J<IM8K@FE J<HL<E:< I8E>@E> =IFD K?<
=@IJK JFLI:< NFI; KF K?< :LII<EK JFLI:< NFI; +/ @E JK8K< . K?8K
:FII<JGFE;JKFK?<K8I><KNFI; *.
5 5 . R . + / . / 6
. / 5 + / R *. .D8O
89
/-;8+45*+8+35<'2:5)'6:;8+8+58*+8/4-)54:+>:9
1< C<8IE K?< :FEJK@KL<EKJ LE;<I>F@E> KI8EJ=FID8K@FE N@K?
GIF989@C@JK@: KI<<
KF
JKI@E> >I8DD8IJ 56 @E=FID8CCP ;<J:I@9<;
9<CFN
[ 1FI;8C@>E8G8I8CC<C:FIGLJ8E;G8IJ<K?<JFLI:<C8E>L8><
:FIGLJ
[ .I8@E8GIF989@C@JK@:KI<<
KF
JKI@E>>I8DD8I
[ #;<EK@=P K?< :FEJK@KL<EKJ N?FJ< :?@C;I<E J<HL<E:< @J ?@>?CP
8D9@>LFLJ9<KN<<EDFEFKFE<8E;EFE
DFEFKFE<NFI;FI;<I
[ FI K?< :FEJK@KL<EK @;<EK@=@<; @E K?< GI<M@FLJ JK<G I<DFM< K?<
EF;<K?8K;FD@E8K<JK?<;@J8D9@>L8K@FE:FEK<OKJ=FII<FI;<I@E>
FI K?< (* (* J<HL<E:< @E @>LI< KI<<
KF
JKI@E> >I8DD8I
ILC<J 8JJ@>E GIF989@C@KP KF K?< EFE
DFEFKFE< FI;<I @>LI< 8 8E; KF K?< DFEFKFE< NFI; FI;<I @>LI< 9 @E;@:8K@E>
K?8K @K @J ?@>?CP 8D9@>LFLJ 9<KN<<E DFEFKFE< 8E; EFE
DFEFKFE<
NFI; FI;<I "FN<M<I 8=K<I (* EF;< I<DFM8C KI<<
KF
JKI@E>
>I8DD8I ILC<J 8JJ@>E K?< I<
FI;<I@E> GIF989@C@KP KF K?< (*
! (* J<HL<E:< @E @>LI< 8 8E; K?< DFEFKFE< FI;<I
GIF989@C@KPKFK?<$!(*J<HL<E:<@E @>LI<
9
1< KI8@E K?< G8IJ<I 8=K<I 8GGCP@E> K?< KI<< KI8EJ=FID8K@FE @<
:FEJK@KL<EK EF;< I<DFM8C KF K?< FI@>@E8C KI<< 98EB 1< LJ< K?<
G8IJ<IKI8@E<;FEK?<KI8EJ=FID<;KI<<98EB
$!
CC JPJK<DJ :FD9@E< 9CF:BJ ;<I@M<; =IFD 8E LEJLG<IM@J<; "''
56 8E; 8 JLG<IM@J<; ' 56 NFI; 8C@>ED<EKJ KF KI8@E KI8EJC8K@FE
DF;<CJ .?IFL>?FLK K?@J G8G<I N< LJ< K?< K<ID '14(0 ' KF
;<EFK< 8 G?I8J< KI8EJC8K@FE G8@I :FEJ@JK@E> F= 8 JFLI:< + 8E; 8
K8I><KG?I8J< * #/:+8(/2/-43+4:9
"'' 8C@>ED<EK LK@C@Q<J KNF :FE;@K@FE8C GIF989@C@KP DF;<CJ
-K8K<KI8EJ@K@FE8E;NFI;
KF
NFI;KI8EJC8K@FEGIF989@C@KPDF;<CJ
JJLD@E> K?< JFLI:< NFI; J<HL<E:< + +
\ + KF 9< K?<
F9J<IM8K@FE 8E; K?< K8I><K NFI;J * *
\ * KF 9< JK8K<J JK8K<
KI8EJ@K@FEGIF989@C@K@<J8I<F9K8@E<;8::FI;@E>KF
5.R. +@ (38 R . . R
1 (38 R 1 . R
;<EFK<J K?< K8I><K J<EK<E:< C<E>K? +. @J K?< JFLI:< NFI;
><E<I8K<; =IFD K?< GI<M@FLJ JK8K< . . @J K?< K?< JK8K< ><E<I8K@E>
K?< :LII<EK JFLI:< NFI; +. -K8K< KI8EJ@K@FE GIF989@C@KP @J K?< :FLEK
F= K?< ALDG N@;K? 9<KN<<E . 8E; . ;@M@;<; 9P K?< KFK8C :FLEK F=
K?<ALDGN@;K?9<KN<<E .8E;8EP:LII<EKJK8K<=IFDKF 1FI;
KF
NFI; KI8EJC8K@FE GIF989@C@KP @J F9K8@E<; 8::FI;@E> KF +@JK?<JFLI:<NFI;>@M<EK8I><KNFI; *
FI KI8@E@E> N< @E@K@8C@Q< K?< NFI; KF NFI; KI8EJC8K@FE DF;<C N@K?
8E #' DF;<C -K8K< KI8EJ@K@FE GIF989@C@K@<J 8I< @E@K@8C@Q<; N@K?
8 GI@FI DF;<C K?8K 8JJ@>EJ ?@>?<I GIF989@C@K@<J KF JD8CC<I ALDGJ
N?<I< 8EP ALDG N@;K? =IFD KF 8I< 8JJ@>E<; GFJ@K@M<
GIF989@C@K@<J 8E; 8EP ALDG N@;K? >I<8K<I K?8E 8I< 8JJ@>E<; Q<IF
GIF989@C@KP )E:< K?< FGK@D8C G8K? =FI 8 J<EK<E:< G8@I @J =FLE; N<
LG;8K< K?< 8C@>ED<EK 8E; F9K8@E K?< KI8EJC8K@FE 8E; ALDG :FLEKJ
=IFD K?< LG;8K<; 8C@>ED<EK @E K?< JK<G 8E; I<
EFID8C@Q< K?<
KI8EJC8K@FE8E;JK8K<KI8EJ@K@FEGIF989@C@K@<J@EK?<'
JK<G
'>/3;34:856?2/-43+4:9
1< LJ< K?< D8O@DLD <EKIFGP NFI; 8C@>E<I ;<J:I@9<; @E 56 1<
LJ< K?< I<JFLI:<J @E .89C< KF KI8@E K?< 8C@>E<I G8K<EK
J<EK<E:< G8@IJ 8I< J<C<:K<; =IFD K?< D@CC@FE G8I8CC<C KI8@E@E>
:FIGLJ56=FI@E
?FLJ<8EEFK8K@FEJ
!'(2+
/4-;/9:/)+95;8)+9,582/-4+8!8'/4/4-FLI:<
+L8EK@KP
&
J<EK<E:<G8@IJ
&
J<EK<E:<G8@IJ
*8K<EK;<J:I@GK@FEJ
.FK8C
J<EK<E:<G8@IJ
J<EK<E:<G8@IJ
-@D@C8I KF "'' 8C@>E<I K?< ' 8C@>E<I :FEJ@JKJ F= KNF DF;<CJ
F9J<IM8K@FE 8E; KI8EJ@K@FE DF;<CJ 1FI; 8C@>ED<EK @J :8II@<; FLK
FEK?<98J@JF=K?<J:FI@E>=LE:K@FE=FI<8:?NFI;G8@I
C@>ED<EK-:FI< 5 CF>KI8EJ@K@FE-:FI< O V 6 5 WV O CF>
D<-:FI<O UWUOD-:FI<6
#E V @J K?< KI8EJ@K@FE DF;<C N<@>?K 8E; WV @J K?< F9J<IM8K@FE
DF;<C N<@>?K U @J K?< ' J:FI< N<@>?K 8E; WU @J K?< #'
'F;<CJ:FI<N<@>?K
FI F9J<IM8K@FE DF;<C KI8@E@E> N< LJ< K?< J8D< =<8KLI<J 8J @E
56 JFLI:< 8E; K8I><K NFI; C<O@:8C =<8KLI<J 1FI;(<K 8E; JG<CC@E>
=<8KLI<J #E 8;;@K@FE N< LJ< JFLI:< :?8I8:K<I 8E; K8I><K NFI;
=<8KLI<J ;I8N@E> FE K?< =8:K K?8K <8:? ?@E<J< :?8I8:K<I ?8J @KJ
FNED<8E@E>8E;F=K<E:FII<JGFE;JKF8EE>C@J?NFI;
IFD K?< ?LD8E 8EEFK8K<; ;8K8 N< F9K8@E 89FLK B JFLI:<
8E; B K8I><K MF:89LC8IP N?@:? @J ?@>?CP C@D@K<; :FDG8I<;
N@K? 89FLK B JFLI:< 8E; B K8I><K MF:89LC8IP 8:HL@I<; =IFD
K?< G8I8CC<C KI8@E@E> ;8K8 .?<I<=FI< N< JDFFK? K?< F9J<IM8K@FE
DF;<C J:FI< N@K? 8E #' 'F;<C <JK@D8K< 8J J?FNE @E K?< 8JWUOD-:FI<
!! !
! ! & !
1< GI<J<EK K?< KI8EJC8K@FE DF;<C 8:HL@J@K@FE 8E; ;<:F;@E>
K<:?E@HL<JF=G?I8J<;@I<:K8E;JPEK8O
98J<;KI8EJC8K@FEJPJK<DJ
― 608 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
CC KI8EJC8K@FE DF;<CJ 8I< KI8@E<; FE K?< D@CC@FE G8I8CC<C
KI8@E@E> :FIGLJ C8I>< >I8D C8E>L8>< DF;<C &' @J KI8@E<;
FE 89FLK 9@CC@FE NFI; E>C@J? G8K<EK ;8K8 GL9C@J?<; 9<KN<<E
8E; JD8CC<I >I8D C8E>L8>< DF;<C @J KI8@E<; FE
K?< E>C@J? J@;< F= K?< D@CC@FE J<EK<E:< G8@I G8I8CC<C KI8@E@E>
:FIGLJ:FEK8@E@E>D@CC@FENFI;J56
1< <OG8E; K?< J<8I:? JG8:< 9P @E:I<8J@E> K?< 9<8D J@Q< @<
:8I;@E8C@KP GILE@E> K?I<J?FC; LG KF 8E; K?< :FM<I8><
GILE@E> K?I<J?FC; LG KF .F :8GKLI< K?< I<C8K@M<CP ?@>? ;<>I<<
F= ;@JKFIK@FE 9<KN<<E ?@E<J< 8E; E>C@J? N< J<K K?< JB@G J@Q< 56
.?< 98J<C@E< G?I8J< KI8EJC8K@FE JPJK<D @E:FIGFI8K@E> C<O@:8C@Q<;
;@JKFIK@FE DF;<CJ @J @E8;<HL8K< =FI :8GKLI@E> K?< EFE
CF:8C
;@JKFIK@FE 9<KN<<E ?@E<J< 8E; E>C@J? 5 6 .F @DGIFM< NFI;
FI;<I 8::LI8:P N< 8GGCP G8IJ@E>
98J<; GI<
FI;<I@E> =FI
KI8EJC8K@FEDF;<CKI8@E@E>8E;;<:F;@E>56
.8'9+!8'492':/54 ?9:+3
#' G?I8J< KI8EJC8K@FE JPJK<D @J 8E <OK<EJ@FE F= K?< G?I8J<
KI8EJC8K@FEJPJK<D;<K8@C<;@E56
!&"!"#
*?I8J< KI8EJC8K@FE DF;<C GIF989@C@K@<J 8I< C<8IE<; =IFD K?<
:FD9@E8K@FE F= 9CF:BJ ;<I@M<; =IFD 8E "'' NFI; 8C@>ED<EK 8E;
9CF:BJ<OKI8:K<;=IFD8E'NFI;8C@>ED<EK
FI 9CF:B 8:HL@J@K@FE =IFD 8E "'' 8C@>ED<EK N< NFI;
8C@>E 8
G8I8CC<C :FIGLJ 9@
;@I<:K@FE8CCP FE< =IFD 8 JFLI:< NFI; GFJ@K@FE
KF 8 K8I><K NFI; GFJ@K@FE + ^ * 8E; K?< FK?<I =IFD 8 K8I><K
NFI; GFJ@K@FE KF 8 JFLI:< NFI; GFJ@K@FE * ^ + !@M<E KNF
KPG<J F= 8C@>ED<EK a 8E; / 9CF:BJ 8I<
;<I@M<; 8::FI;@E> KF K?< GIFA<:K@FE 8E; <OK<EJ@FE 8C>FI@K?DJ 5
6 8E; N< =@CK<I FLK 9CF:BJ :FEK8@E@E> EFE
:FEJ<:LK@M< JFLI:<
NFI;J<HL<E:<J
FI 9CF:B 8:HL@J@K@FE =IFD 8E ' 8C@>ED<EK N< LJ< K?< ?@>?
I<:8CC 8C@>ED<EK , <OKI8:K@E> 9CF:BJ :FEJ@JK@E> F= :FEJ<:LK@M<
JFLI:< 8E; K8I><K NFI; J<HL<E:<J N@K? K?< :FEJKI8@EK K?8K JFLI:<
8E; K8I><K J<HL<E:<J 9< 8C@>E<; FECP KF K?< NFI;J N@K?@E K?<
9CF:B
.?I<< KPG<J F= G?I8J< KI8EJC8K@FE DF;<C GIF989@C@K@<J 8I< ;<I@M<;
=IFD K?< :FD9@E<; 9CF:BJ 8J @E T N?<I< * @J K?< JFLI:<
G?I8J<
+ K?<K8I><KG?I8J<8E; ' * + $# $# I<HL<E:P -FLI:<FEJK@KL<EK
,<FI;<I@E>*8KK<IE
(* ^ (*! (*
(*
)$ ^ (* ! (*
(*
-$ ^(* ! (*
**
&) ^* (* &
(*^(*!$*(*
1< LJ<; JL:? ILC<J N?@:? F::LI DFI< K?8E K@D<J @E K?< D@CC@FEJ<EK<E:<G8@IKI8@E@E>:FIGLJ
/8+):!8'492':/545*+2
+ @J 8 JFLI:< G?I8J< 8E; * @J 8 K8I><K G?I8J< / @J K?< ALDG
;@JK8E:< =IFD K?< GI<M@FLJCP KI8EJC8K<; JFLI:< NFI; KF K?< :LII<EK
JFLI:< NFI; LI@E> KI8@E@E> / :8E M8IP N@;<CP ;L< KF 8LKFD8K@:
NFI; 8C@>ED<EK @E K?< G8I8CC<C :FIGLJ .F C@D@K K?< JG8IJ<E<JJ
:I<8K<; 9P CFE> ALDGJ / @J :8GG<; KF 8 N@E;FN F= JFLI:< NFI;J KF NFI;J 8IFLE; K?< C8JK KI8EJC8K<; JFLI:< NFI; $LDGJ
FLKJ@;< K?< N@E;FN 8I< KI<8K<; 8J K?< D8O@DLD ALDG 8CCFN<;
5 * / R + @J 8 GI@FI ;@JKI@9LK@FE 4 @J 8 EFID8C@Q@E> K<ID 8E;
$# $# /E@>I8D'F;<C
5 '
!'(2+59:,8+7;+4:+58*+8/4-;2+9
.?< @I<:K .I8EJC8K@FE 'F;<C .' @J 8 JG<:@8C D8O@DLD
<E
KIFGP'DF;<C56.?<DF;<C?8JK?<=FCCFN@E>=FID
5 * / R + <OG . . * / + 5 * / R + %
.
-FLI:<
:?8EE<C'F;<C
5 + R * !""!!!
1< LJ< K?< ?@E<J< D8O@DLD <EKIFGP G8IJ<I KI8@E<; FE K?< KI<<
98EB N@K? K?< KI<< KI8EJ=FID8K@FE ;<J:I@9<; @E -<:K@FE 9<JK
I<FI;<I@E> ILC<J 8I< C<8IE<; =IFD K?< KI<<
KF
JKI@E> >I8DD8I ILC<J
.FG DFJK =I<HL<EKCP F::LII@E> I<FI;<I@E> ILC<J 8I< >@M<E @E
.89C< N?<I< K?< I<FI;<I@E> G8KK<IE @E;@:8K<J K?8K K?<
JFLI:<G?I8J<FI;<I@JI<M<IJ<;
@I<:K'F;<C
5 * R + (4938 ' ' (4938 ' . * / + 8I< K?< =<8KLI<J F= K?< DF;<C <8:? 9<@E> 8 9@E8IP
.?< G?I8J< ;<:F;<I LJ<J 8 9<8D J<8I:? JKI8K<>P 8E; 8 J:FI@E>
=LE:K@FE K?8K @E:FIGFI8K<J KPG<J F= D8EL8CCP N<@>?K<; =<8KLI<J
C@JK<;9<CFN
[ G?I8J<KI8EJC8K@FEDF;<CJ
[ DF;@=@<; #' DF;<C J:FI<J ;<I@M<; =IFD 9CF:BJ :FEJ@JK@E> F=
FE<JFLI:<8E;FE<K8I><KNFI;
[ NFI;:FLEKG<E8CKP
[9CF:B:FLEKG<E8CKP
[C<O@:8C@Q<;@E9FLE;8E;FLK9FLE;;@JKFIK@FEDF;<CJ56
[ 8 D@OKLI< C8E>L8>< DF;<C N@K? 8 C8I>< >I8D 8E; 8 JD8CC >I8D&'J
HL<JK@FE 8JB@E> 89FLK K?< JFLI:< 8E; K8I><K JKI<8DJ .?< =<8KLI<
N<@>?KJ . 8I< <JK@D8K<; N@K? K?< #DGIFM<; #K<I8K@M< -:8C@E> ##-
8C>FI@K?D
%#!#
CF:BJ 8I< <OKI8:K<; =IFD K?< "'' NFI; 8C@>ED<EK + ^ *
;@I<:K@FE FECP 8E; K?< ' NFI; 8C@>ED<EK .?< X*IFA<:K@FE
FEJKI8@EKY N?@:? I<HL@I<J K?8K K?< JFLI:< 8E; K8I><K J<HL<E:<J
9< 8C@>E<; FECP KF K?< NFI;J N@K?@E K?< 9CF:B @J K?<E :?<:B<; KF
.PG@:8CCPJ<KKF
.PG@:8CCPJ<KKF
.PG@:8CCPJ<KKFFI=FIFGK@D8CG<I=FID8E:<J
― 609 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
<EJLI< K?8K K?< G?I8J< G8@I @J :FEJ@JK<EK JC@>?K I<C8O8K@FE @J
D8;< KF K?< KI8;@K@FE8C G?I8J< 9CF:BJ @E K?8K 8 M8I@89C< @J 8CCFN<;
8K K?< JFLI:< FI K8I><K J@;< KF 8::FDDF;8K< K?< =FIB
JKPC<
8C@>ED<EKJ56
#$!"
&8I>< ELD9<I F= =<8KLI<J LK@C@Q<; @E K?< ' DF;<C 56 =8CC @EKF
K?<=FCCFN@E>:8K<>FI@<J
[ &<O@:8C =<8KLI<J K?8K <O8D@E< JFLI:< NFI; K8I><K NFI; 8E;
ALDG
[ &<O@:8C :FEK<OK =<8KLI<J K?8K <O8D@E< K?< GI<M@FLJ 8E; E<OK
JFLI:<NFI;J8E;8CJFK?<GI<M@FLJKNFK8I><KNFI;J
[ -<>D<EK8K@FE =<8KLI<J 98J<; FE DFIG?FCF>@:8C 8E8CPJ@J #E
K?@JNFIBK?<P8I<=<8KLI<J98J<;FE?@E<J<:?8I8:K<IJ
[ *8IK
F=
JG<<:? *)- =<8KLI<J K?8K :FCC<:K K?< JPEK8:K@:
@E=FID8K@FE=IFDK?<JFLI:<8E;K8I><KNFI;J
[ -FLI:< G8IJ< KI<< =<8KLI<J K?8K <O8D@E< K?< JFLI:< G8IJ<
C89<CJJ@9C@E>C89<CJ8E;:FM<I8><
[ FM<I8>< =<8KLI<J K?8K <O8D@E< K?< :FM<I8>< JK8KLJ F= K?<
JFLI:< NFI;J KF K?< C<=K 8E; KF K?< I@>?K .?<P =@I< FECP @= K?<
C<=KJFLI:<@JFG<ELE
KI8EJC8K<;FIK?<I@>?KJFLI:<@J:CFJ<;
.?<KFK8CELD9<IF==<8KLI<JLJ<;@EK?<JPJK<D@J8IFLE;'
9<8D J<8I:? ;<:F;<I J@D@C8I KF K?< G?I8J<
98J<; JPJK<DJ @J
LJ<; KF KI8EJC8K< K?< ?@E<J< J<EK<E:<J @EKF E>C@J? .?<J<
;<:F;<IJ ?8M< KNF G8I8D<K<IJ K?8K :FEKIFC K?<@I J<8I:? JKI8K<>P
8 K?< JB@G C<E>K? ?FN D8EP GFJ@K@FEJ 8I< 8CCFN<; KF 9< LE
KI8EJC8K<; 8E; 9 K?< N@E;FN N@;K? N?@:? :FEKIFCJ ?FN D8EP
NFI;J8I<8CCFN<;KF9<:FEJ@;<I<;=FIKI8EJC8K@FE
.?< GI@D8IP ;@==<I<E:< 9<KN<<E 8 .' ;<:F;<I 8E; JK8E;8I;
G?I8J<
98J<; ;<:F;<IJ @J K?8K K?< D8O@DLD <EKIFGP DF;<C
GIFM@;<J 8 :FJK <JK@D8K< F= GIF;L:@E> K?@J KI8EJC8K@FE LJ@E> K?<
=<8KLI<J ;<J:I@9<; 89FM< EFK?<I ;@==<I<E:< @J K?8K K?< .'
;<:F;<I ?8E;C<J 9CF:BJ N@K? M8I@89C<J 1?<E JL:? 8 9CF:B @J
GIFGFJ<; K?< @E@K@8C K8I><K J<HL<E:< @J =@IJK FLKGLK 8E; K?< JFLI:<
NFI; GFJ@K@FE @J D8IB<; 8J 9<@E> G8IK@8CCP M@J@K<; .?<E 8E @E;<O
@EKF N?@:? J<>D<EK N8J ><E<I8K<; @J B<GK =FI :FDGC<K@E> K?< M@J@K
8K 8 C8K<I K@D< -L9J<HL<EK <OK<EJ@FEJ F= K?@J G8K? :8E <@K?<I
:FDGC<K< K?@J M@J@K FI M@J@K FK?<I JFLI:< NFI;J )E 8 J<8I:? G8K?
N< D8B< 8 =LIK?<I 8JJLDGK@FE K?8K FECP FE< JFLI:< GFJ@K@FE :8E
9< @E 8 G8IK@8CCP M@J@K<; JK8K< 8K 8EP GF@EK .?@J >I<8KCP I<;L:<J K?<
J<8I:? K8JB 8E; JL==@:<J KF ?8E;C< K?< KPG< F= 9CF:BJ <E:FLEK<I<;
@E?@E<J<KFE>C@J?KI8EJC8K@FE
<:F;<I G8I8D<K<IJ 8I< FGK@D@Q<; N@K? K?< J@DGC<O 8C>FI@K?D @E
56
?4:'>5*+2
)LI JPEK8O
98J<; KI8EJC8K@FE JPJK<D @J 8 :?8IK
98J<; ;<:F;<I 8J
;<J:I@9<;@E56
FI K?@J G8K<EK <M8CL8K@FE N< 8GGC@<; 8 M8I@8K@FE F= K?< JFLI:<
KI<< KF K8I><K JKI@E> >I8DD8I KI<<
KF
JKI@E> 1< 8GGC@<; 8 =<N
KI<< KI8EJ=FID8K@FE FG<I8K@FEJ KF ?8E;C< =I8>D<EK F= KI<< FI KI<<
J<HL<E:< 56 9@E8I@Q8K@FEJ C<O@:8C@Q8K@FEJ 8E; =C8KK<E@E>
DLCK@
C<M<C KI<<J KF <OKI8:K *- ! JKPC< I<FI;<I@E> ILC<J
*I8:K@:8CCP N< <OKI8:K 8K C<8JK FE< KI<<
KF
JKI@E> ILC< =FI <8:?
8C@>E<; G?I8J<
G8@I 9CF:B
P 8GGCP@E> JL:? 8GGIF8:? N<
J@>E@=@:8EKCP @DGIFM<; K?< >I8DD8I :FM<I8>< 8E; 8CJF <E89C<
FLI;<:F;@E>GIF:<JJKF9<C<JJJ<EJ@K@M<KFK?<G8IJ<KI<<<IIFIJ
!! $"#"
!I8DD8I J<K <OKI8:K@FE @J ;@M@;<; @EKF KNF JK8><J !@M<E K?<
JFLI:< G8IJ<; NFI;
8C@>E<; G8I8CC<C ;8K8 N< =@IJK <OKI8:K K?<
J8D< J<K F= 9CF:BJ =IFD K?< KI8@E@E> ;8K8 LJ@E> K?< JK8E;8I;
8GGIF8:? 8J J?8I<; 9P G?I8J<
;<:F;<I JPJK<D #E K?@J JK8>< N<
8CCFN 9CF:BJ N@K? JFLI:< J@;< F= C<E>K? LG KF KFB<EJ 8E; D8O
K8I><KJ@;<F=C<E>K?KFB<EJ
=K<I 9CF:BJ 8I< <OKI8:K<; N< N8CB K?IFL>? <M<IP 8C@>E<; G8@I F=
G?I8J<J FI <8:? JFLI:< G?I8J< N< ><K K?< @DD<;@8K< :FDDFE
G8I<EK =FI K?< JFLI:< JG8E 8E; K?<E N< I<KI@<M< K?< KI<< =I8>D<EK
N?@:? :FM<I K?< JG8E IFD K?@J KI<<
=I8>D<EK N< @;<EK@=P K?<
=IFEK@<I EF;<J N?@:? :8E 9< ><E<I8C@Q<; @EKF EFE
K<ID@E8CJ 8E;
E<:<JJ8IP C<O@:8C@Q8K@FEJ N?@:? :8E DF;<C K?< =FIB
JKPC<
8C@>ED<EK
.?<E N< :FEJ@;<I KI<<
KI8EJ=FID8K@FEJ KF I<JKIL:KLI< K?< KI<<J M@8
JPE:?IFEFLJ 9@E8I@Q8K@FEJ =C8KK<E K?< KI<<J 9P I<DFM@E> K?<
@EK<I@FI EF;<J 8E; 8;; 8;;@K@FE8C D8IBLGJ KF @E;@:8K< K?<
KI8EJ=FID<; KI<<J
)E< @DGFIK8EK 8;;@K@FE8C D8IBLGJ 8I<
J<EK<E:<
9<>@E 8E; J<EK<E:<
<E; 8J 8K N?@:? GFJ@K@FEJ N<
><E<I8CCP ;F EFK <OG<:K K?< ;I8D8K@: I<
FI;<I@E>J KF ?8GG<E 'FI<
;<K8@CJ:8E9<=FLE;@E56
=K<I 8CC >I8DD8I ILC<J 8I< <OKI8:K<; N< GILE< K?< KI<<
KF
JKI@E>
ILC<J N@K? 8 ?8I; K?I<J?FC; F= =I<HL<E:P EP ILC<J K?8K F::LII<;
C<JJK?8EK@D<J8I<;IFGG<;
(FK< K?8K K?< KI<< KI8EJ=FID8K@FE 8GGC@<; KF K?< KI<< 98EB =FI K?<
G8IJ<I KI8@E@E> := -<:K@FE @J 8E8CF>FLJ KF K?< =C8KK<E@E>
FG<I8KFI @E 56 "FN<M<I K?< KI<< KI8EJ=FID8K@FE 8GGC@<; KF K?<
KI<< 98EB @J GI@D8I@CP KF :8GKLI< K?< ;@J8D9@>L8K@FE :FEK<OKJ =FI
I<
FI;<I@E> N@K?@E K?< ! =I8D<NFIB @< 8CC ! ILC<J 8I<
<E:F;<; @E 8 KI<< F= ;<GK? N?<I<8J K?< KI<< KI8EJ=FID8K@FEJ 9P
K?< JPEK8O DF;<C 8I< C8I><CP DFK@M8K<; KF @E:I<8J< K?< >I8DD8I
:FM<I8>< FEJK@KL<EK EF;< I<DFM8C 8GGC@<; KF K?< KI<< 98EB @J
K8I><K<; FE K?< EF;<J K?8K ;FD@E8K< ;@J8D9@>L8K@FE :FEK<OKJ
8E; K?< KI8EJ=FID8K@FE
<E89C<J K?< ! KF :8GKLI< K?<
;@J8D9@>L8K@FE :FEK<OKJ 9P =C8KK<E@E> 8 KI<< F= ;<GK? FI DFI< KF
8 KI<< F= ;<GK? )E K?< FK?<I ?8E; K?< KI<< KI8EJ=FID8K@FEJ 9P
K?< JPEK8O DF;<C @J C8I><CP ;<K<ID@E<; 9P K?< 8C@>ED<EK ;<:@J@FEJ
DG@I@:8CCP K?< KI<< KI8EJ=FID8K@FEJ 8GGC@<; KF K?< KI<< 98EB 8E;
K?FJ<G<I=FID<;9PK?<JPEK8ODF;<CD8PFID8PEFKFM<IC8G
LI@E> ;<:F;@E> N< =@IJK GFGLC8K< 8 :?8IK 8 M<:KFI F= :<CCJ N@K?
K?<I<C<M8EKI<FI;<I@E>ILC<J
1< N8CB K?IFL>? K?< >@M<E G8IJ< KI<< =FI K?< K<JK J<EK<E:< 8E; 8K
<M<IP :<CC N< I<KI@<M< K?< @DD<;@8K< :FDDFE G8I<EK =FI K?8K
JFLI:< JG8E 8E; :FII<JGFE;@E>CP K?< KI<< =I8>D<EK =FI K?8K JG8E
.?<E N< 8GGCP <M<IP GI<;<=@E<; FG<I8KFI KF KI8EJ=FID K?< KI<<
8E; J<< @= K?< KI8EJ=FID<; KI<< D8K:?<J JFD< >I8DD8I ILC<J @E FLI
C@9I8IP #= K?<I< @J EF KI<<
KF
JKI@E> ILC< D8K:?@E> K?< JG8E N<
98:B F== KF "@<IF
JKPC< 56 LEC89<C<; ILC<J 8E; @= K?<I< @J EF "@<IF
ILC< N< =LIK?<I 98:B F== KF DFEFKFE< #.!
JKPC< 56 >CL< ILC< =FI
<8:? JG8E 1< :FCC<:K 8CC K?< D8K:?<; ILC<J =FI <8:? :<CC 8E;
<OG8E; K?<D FE< 9P FE< =IFD 9FKKFD LG KF =@CC LG K?< :?8IK LEK@C
N<I<8:?K?<=@E8CKI8EJC8K@FE
@==<I<EK =IFD K?< .' ;<:F;<I N?@:? :8E LJ< D@CC@FEJ F=
=<8KLI<J ;LI@E> ;<:F;@E> N< LJ<; =<8KLI< =LE:K@FEJ @E:CL;@E>
I<C8K@M< =I<HL<E:@<J @E 9FK? ;@I<:K@FEJ #' DF;<C
J:FI< @E 9FK?
;@I<:K@FEJ ILC< :FLEK =FI 9CF:BJ >CL< ILC< "@<IF
JKPC< ILC< 8E;
KI<<
KF
JKI@E> ILC< 9I<M@KP G<E8CKP @EK<IGFC8K<; #' DF;<C
J:FI< E>I8D &' J:FI<J 8E; J<M<I8C =<8KLI< =LE:K@FEJ KF ?8E;C<
― 610 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
=LE:K@FE:FEK<EK NFI; D@JD8K:?<J @E 9FK? ;@I<:K@FEJ .?< =<8KLI<
N<@>?KJ8I<FGK@D@Q<;N@K?K?<J@DGC<O8C>FI@K?D@E56
*ILE@E> E<<;J KF 9< ;FE< KF @DGIFM< K?< JG<<; 8E; D<DFIP
I<HL@I<D<EK 1< B<GK 8K DFJK G8IK@8C ?PGFK?<J<J G<I ILC< 8E;
8K DFJK =@E8C <OG8E;<; ?PGFK?<J<J G<I :<CC LI@E> K?<
GFGLC8K@E> JK<G N< B<GK 8K DFJK ILC<J G<I :<CC I8EB<; 9P K?<@I
=I<HL<E:@<J !CL< ILC< @J EFK <E:FLI8><; =FI J?FIK JFLI:< JG8EJ
N@K? C<JJ K?8E KFB<EJ @= N< J<< KI<<
KF
JKI@E> FI "@<IF
JKPC<
ILC< =FI K?8K JG8E 1< D<I>< K?< ?PGFK?<J<J N?@:? J?8I< K?< J8D<
JK8K< 9LK ;@==<I<EK :FJK 1< 8CJF KI@>><I <8ICP JKFGG@E> N?<E K?<
J<8I:? JG8:< @J FM<I K?< D8O@DLD 8DFLEK F= D<DFIP GI<;<=@E<;
8E; K?< ;<:F;@E> GIF:<JJ N@CC I<8:? =@E8C KI8EJC8K@FE HL@:B<I LJ@E>
8I<JKI@:K<;K?<J<8I:?JG8:<8KK?8KK@D<
!
1< :FD9@E< K?< KI8EJC8K@FE FLKGLKJ =IFD K?< K?I<< JK8K@JK@:8C
D8:?@E< KI8EJC8K@FE JPJK<DJ I<JKFI< :8J< 8E; G<I=FID ;<
KFB<E@Q8K@FEKFGIF;L:<K?<=@E8CKI8EJC8K@FEFLKGLK
?9:+353(/4':/54
.?< JPJK<D :FD9@E8K@FE :FDGFE<EK @J 98J<; FE 8E @E:I<D<EK8C
8C@>ED<EK 8GGIF8:? LJ@E> @EM<IJ@FE KI8EJ;L:K@FE >I8DD8IJ
#.!J=FI8C@>E@E>JPJK<DFLKGLKJ56
'FI< JG<:@=@:8CCP 9<JK FLKGLK F= K?< -PEK8O 'F;<C @J LJ<; 8J
K?< XJB<C<KFEY KF N?@:? K?< 9<JK FLKGLKJ F= K?< FK?<I KI8EJC8K@FE
DF;<CJ 8I< 8C@>E<; FE< 9P FE< LJ@E> #.!J .?< I<JLCK@E>
:FE=LJ@FE E<KNFIB @J I<
J:FI<; LJ@E> 8 :FD9@E8K@FE F= KNF
C8E>L8>< DF;<CJ &'J >I8D &' KI8@E<; FE 9@CC@FE NFI;
:FIGLJ 8E; >I8D &' KI8@E<; FE K?< E>C@J? J@;< F= K?< G8I8CC<C
:FIGLJ 08CL<J F= K?< =I<< G8I8D<K<IJ I<C8K@M< N<@>?K F= K?< &'
JB<C<KFE JPJK<D :?F@:< 8E; K?< NFI; @EJ<IK@FE;<C<K@FE G<E8CKP
8I< J<C<:K<; LJ@E> ;<M<CFGD<EK 8E; KLE@E> J<KJ :FEK8@E@E> 8E;8E;J<EK<E:<J
.?< >8G 9<KN<<E CFN<I
:8J<; 8E; :8J<; &/ J:FI<J 8I< J?FNE
@E .89C< =FI K?< JPJK<DJ JL9D@KK<; KF (.#,
*8K<EK'.
<M8CL8K@FEJ 8J<; &/ J:FI<J 8I< CFN<I K?8E CFN<I
:8J<;
&/J:FI<J9PKF&/GF@EKJ
+:51+4/@':/54
FI ;<
KFB<E@Q8K@FE N< LJ< CFFB
LG K89C<J K?8K C@JKJ KFB<EJ KF 9<
D<I><;KFK?<GI<:<;@E>8E;=FCCFN@E>KFB<[email protected]<
!'(2++:51+4/@':/54551;6!'(2+
(FJG8:<9<=FI<KFB<EJ
S6_]JKDCC
(FJG8:<8=K<IKFB<EJ
S5_]
.FB<EJ K?8K I<HL@I< EF JG8:< 9<=FI< KFB<EJ 8I< D<I><; KF K?<
GI<:<;@E> KFB<EJ 8E; @E:CL;<J :FEKI8:KL8C =FIDJ JL:? 8J 7 8 2
11 8J N<CC 8J GLE:KL8K@FEJ 8E; JPD9FCJ .FB<EJ K?8K I<HL@I< EF
JG8:< 8=K<I KFB<EJ 8I< D<I><; KF K?< =FCCFN@E> KFB<EJ 8E; DFJKCP
@E:CL;<JJPD9FCJ
%! #"!
1< GI<J<EK K?< @DG8:K F= M8I@FLJ K<:?E@HL<J FE G?I8J< KI8EJC8K@FE
JPJK<D (.#,
?@E<J<
KF
E>C@J? KI8EJC8K@FE <M8CL8K@FE
I<JLCKJ 8E; ;@J:LJJ K?< @DG8:K F= :FEK<OKL8C ;8K8 FE FLI
JL9D@JJ@FEJPJK<DJ
36'):5,!+).4/7;+9
#E .89C< N< J?FN K?< @DG8:K F= M8I@FLJ DF;LC<J 8E;
K<:?E@HL<J FE K?< G?I8J< KI8EJC8K@FE JPJK<D LJ@E> K?< (.#,
;<M<CFGD<EK K<JK ;8K8 J<K -PJK<D G<I=FID8E:<J 8I< J?FNE @E
CFN<I
:8J<; &/ N@K? LG KF >I8DJ =FI DF;@=@<; GI<:@J@FE
:FDGLK8K@FE56
!'(2+36'):5,<'8/5;9:+).4/7;+9546.8'9+:8'492':/54
9?9:+36+8,583'4)+9
J J?FNE @E .89C< K?< JPJK<D :FD9@E8K@FE P@<C;J @E:I<8J< F=
:8J<; 8E; CFN<I
:8J<; &/ FM<I K?< 9<JK G<I=FID@E>
KI8EJC8K@FEJPJK<D
-PJK<DJ
8J<C@E<N@K?"''9CF:BJ
*I<
GIF:<JJ@E>'9CF:BJ
>I8D&'N9@CC@FENFI;J
OG8E;<;J<8I:?JG8:<
*8IJ@E>
98J<;GI<
FI;<I@E>
'9++9:58':/54
1< KI<8K :8J< I<JKFI8K@FE 8J 8 KI8EJC8K@FE K8JB K?8K KI8EJC8K<J CFN<I
:8J<;E>C@J?NFI;JKFKIL<
:8J<;:FLEK<IG8IKJ
1< LJ< K?< KI8EJC8K@FE DF;<C KF @;<EK@=P 8CC GFJJ@9C< :8J<
M8I@8K@FEJ F= 8 CFN<I
:8J<; NFI; 8E; LJ< 8 >I8D C8E>L8><
DF;<C J:FI< KF J<C<:K K?< 9<JK 8CK<IE8K@M< .?< >I8D C8E>L8><
DF;<C @J KI8@E<; FE K?< E>C@J? J@;< F= K?< D@CC@FE J<EK<E:< G8@I
KI8@E@E>:FIGLJ
!'(2+'9+*<95=+8)'9+*"9)58+9
-PJK<DJ
8J<;&/
&FN<I
:8J<;&/
-PJK<DFD9@E8K@FE
*?I8J<'F;<C
@I<:K'F;<C
-PEK8O'F;<C
.?< B<P GIFG<IK@<J F= K?< 98J<C@E< JPJK<D K?8K ;@==<IJ =IFD K?<
=@E8CJL9D@JJ@FEJPJK<D8I<C@JK<;9<CFN
[ /J< FECP K?< JD8CC<I >I8D C8E>L8>< DF;<C KI8@E<; FE D@CC@FENFI;J
[ FI GI<
GIF:<JJ@E> LJ< FECP K?< -' NFI; J<>D<EK<I 8E; 8E
<EK@KPJG8EJFM<I<O8:KCPFE<KFB<E
[ /J<9CF:BJ;<I@M<;=IFD"''NFI;8C@>ED<EKFECP
[ /J< 8 I<JKI@:K<; J<8I:? JG8:< N@K? K?< 9<8D J@Q< JB@G J@Q<
8E;K?<D8O@DLDKI8EJC8K@FEJG<IJFLI:<G?I8J<
'<I>< GLE:KL8K@FEJ JPD9FCJ 8E;FI :FEKI8:K<; =FIDJ KF K?<
GI<:<;@E>FIK?<=FCCFN@E>KFB<EJ
&/IE
.?< J:FI<J 8I< :FDGLK<; N@K? K?< FI@>@E8C @E
?FLJ< &/
J:I@GK ;@==<I<EK =IFD DK<M8C
M8GC LJ@E> K?< I<=<I<E:<
KI8EJC8K@FEGIFM@;<;9PK?<*8K<EK'.<M8CL8K@FEFI>8E@Q<IJ
E?8E:<; GI<
GIF:<JJ@E> 8E; 8;;@K@FE F= 9CF:BJ ;<I@M<; =IFD '
NFI; 8C@>ED<EK @DGIFM<J K?< G<I=FID8E:< 9P &/ GF@EKJ
*I<
GIF:<JJ@E> @DGIFM<D<EK @E:CL;<J JK8>< NFI; J<>D<EK8K@FE
@DGIFM<; EFE
?@E<J< NFI; KFB<E@Q8K@FE <EK@KP :C8JJ@E> 9L> =@O
*I<M@FLJCP @= K?< <EK@KP :FEK<EK @J F= K?< =FID8K @K LJ<; KF
JKI@G F== K?< I@>?K G8I<EK?<J@J <> 8J .?@J 9L> N8J =@O<; 9P
― 611 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
8E; K?< <EK@KP :C8JJ@E> <OK<EJ@FE K?8K :8E JG8E FM<I DFI< K?8E FE<
NFI;KFB<E
/J@E> 8 D@OKLI< C8E>L8>< DF;<C K?8K @E:CL;<J K?< >I8D
C8E>L8>< DF;<C KI8@E<; FE K?< 9@CC@FE NFI; :FIGLJ ` @E
8;;@K@FE KF K?< JD8CC<I >I8D &' ` C<8;J KF JK8K@JK@:8CCP
J@>E@=@:8EK&/>8@E
OG8EJ@FE F= K?< J<8I:? JG8:< W 9<8D J@Q< @E:I<8J< =IFD KF
:FM<I8>< M<:KFI GILE@E> K?I<J?FC; @E:I<8J< =IFD KF JB@G J@Q< @E:I<8J< =IFD KF 8E; K?< D8O@DLD KI8EJC8K@FEJ G<I
JFLI:< G?I8J< =IFD KF W @DGIFM<J K?< G<I=FID8E:< 9P &/GF@EKJ
*8IJ@E>
98J<; GI<
FI;<I@E> =FI 9FK? KI8EJC8K@FE DF;<C KI8@E@E> 8E;
;<:F;@E>@DGIFM<JK?<G<I=FID8E:<9P&/GF@EK
.?< FM<I8CC G<I=FID8E:< @DGIFM<D<EK F= K?< =@E8C JPJK<D FM<I
K?<98J<C@E<@J&/GF@EKJ
!<'2;':/54+9;2:9
#E .89C< - ;<EFK<J -&#( - -&#( 8E;
)(&#( ;<EFK<J )(&#( " JK8E;J =FI ?LD8E <M8CL8K@FE
8;<HL8:PJ:FI<J
1< 8;;<; K?@J G8I8CC<C :FIGLJ =FI KI8EJC8K@FE DF;<C KI8@E@E> F= K?<
JL9D@JJ@FE JPJK<DJ .89C< @CCLJKI8K<J K?< @DG8:K F= K?<
:FEK<OKL8C;8K8FEJPJK<DG<I=FID8E:<J
!'(2+36'):5,)54:+>:;'2*':'549?9:+36+8,583'4)+
-PJK<DJ
N:FEK<OK;8K8
NF:FEK<OK;8K8
-PJK<DFD9@E8K@FE
*?I8J<'F;<C
@I<:K'F;<C
-PEK8O'F;<C
#' GI@D8IP JPJK<D G<I=FID8E:< @E K?< (.#,
?@E<J<
KF
E>C@J?*8K<EK'.<M8CL8K@FE@[email protected]<
!'(2+8/3'8? ?9:+3+8,583'4)+/4!
'<KI@:J
-<>D<EKJ-:FI<;
-:FI<J
&/IE:
(#-.
,#-
;<HL8:P-:FI<
36'):5,54:+>:;'2':'
LI@E> K?< <M8CL8K@FE G<I@F; N< ;<I@M<; J<EK<E:< G8@IJ F=
8;;@K@FE8C G8I8CC<C :FIGLJ =IFD K?< ;F:LD<EK G8@IJ F= K?<
;<M<CFGD<EK K<JK J<K :FEK<OKL8C ;8K8 89FLK B NFI; KFB<EJ @E
?@E<J< 8E; B NFI; KFB<EJ @E E>C@J? 1< 8LKFD8K@:8CCP
J<EK<E:<8C@>E<;K?<DN@K?8E@E
?FLJ<J<EK<E:<8C@>E<I
1?@C< K?< :FEK<OKL8C ;8K8 N8J ?<CG=LC =FI 8CC F= K?< JPJK<DJ @K N8J
G8IK@:LC8ICP <==<:K@M< =FI K?< JPEK8O DF;<C @DGIFM@E> K?< &/
J:FI< 9P GF@EKJ 1< J<< K?< J@D@C8I >8G F= &/ GF@EK
=FI JPJK<D :FD9@E8K@FE E8D<CP N@K? :FEK<OKL8C ;8K8 8E;
N@K?FLK:FEK<OKL8C;8K8
&/ J:FI< 8E; ,#- J:FI< 8I< K?< J<:FE; ?@>?<JK
8E; K?< (#-. J:FI< @J K?< K?@I; ?@>?<JK 8DFE> 8CC K?< GI@D8IP
JPJK<DJJ:FI<;
.?< *<8IJFE :FII<C8K@FE :F<==@:@<EKJ 9<KN<<E K?< &/ J:FI<J
8E; K?< ?LD8E <M8CL8K@FE 8;<HL8:P J:FI<J F= K?< JPJK<DJ
J:FI<; @J N@K? , @E;@:8K@E> K?8K K?< :FII<C8K@FE
9<KN<<E &/ 8E; ?LD8E <M8CL8K@FEJ @J =8@ICP ?@>? '. J:FI<J
F=K?<JPJK<DJ8I<[email protected]<
!'(2+!<'2;':/54 )58+95, ?9:+39 )58+*
54)2;9/549
#E K?@J G8G<I N< ;<J:I@9<; #' GI@D8IP JPJK<D =FI K?< (.#,
?@E<J<
KF
E>C@J? G8K<EK KI8EJC8K@FE <M8CL8K@FE #' GI@D8IP
JPJK<D @J 8 :FD9@E8K@FE F= K?I<< KPG<J F= JK8K@JK@:8C D8:?@E<
KI8EJC8K@FE JPJK<DJ G?I8J< KI8EJC8K@FE ;@I<:K KI8EJC8K@FE 8E;
JPEK8O
98J<;KI8EJC8K@FE
CC KI8EJC8K@FE DF;<CJ 8I< KI8@E<; FE K?< D@CC@FE G8I8CC<C
KI8@E@E> :FIGLJ CC JPJK<DJ LJ< 8 D@OKLI< C8E>L8>< DF;<C
:FEJ@JK@E> F= 8 C8I>< >I8D C8E>L8>< DF;<C @J KI8@E<; FE 89FLK
9@CC@FE NFI; E>C@J? G8K<EK ;8K8 GL9C@J?<; 9<KN<<E 8E;
8E; 8 JD8CC<I >I8D C8E>L8>< DF;<C @J KI8@E<; FE K?<
E>C@J? J@;< F= K?< D@CC@FE J<EK<E:< G8@I G8I8CC<C KI8@E@E> :FIGLJ
:FEK8@E@E> D@CC@FE NFI;J 56 CC JPJK<DJ J?8I< K?< J8D<
NFI; J<>D<EK8K@FE <EK@KP :C8JJ@E> ?@E<J< G8IJ@E> :8J<
I<JKFI8K@FE8E;;<
KFB<E@Q8K@FE
-PJK<DJ
&/
"
-PJK<DJ
&/
"
!
!
!
!
!
!
!
!
!
!
#' ?@E<J<
KF
E>C@J? G8K<EK KI8EJC8K@FE JPJK<D ;<DFEJKI8K<; 8
?@>?CP :FDG<K@K@M< G<I=FID8E:< @E K?< (.#,
*8K<EK'.
<M8CL8K@FE 9P 8:?@<M@E> K?< J<:FE; ?@>?<JK &/ J:FI< 8DFE>8CCGI@D8IPJPJK<DJJ:FI<;
!
!
)145=2+*-+3+4:
!
-
!
-
1< NFLC; C@B< KF K?8EB #' -K8K@JK@:8C '8:?@E< .I8EJC8K@FE 8E;
,<8CK@D< .I8EJC8K@FE K<8DJ =FI K?< M8I@FLJ JF=KN8I< KFFCJ LJ<; @E
K?<<M8CL8K@FEJ
!
)(&#(
+,+8+4)+9
!
,'.
!
,'.
56 3 C
)E8@Q8E 8E; % *8G@E<E@ @JKFIK@FE DF;<CJ =FI
JK8K@JK@:8C D8:?@E< KI8EJC8K@FE 64(**).3,7 4+ 8><J
!
:FII<:KCP><E<I8K@E>K?<<EK@KP:FEK<EK8J
56 * IFNE 0 <CC8 *@<KI8 - <CC8 *@<KI8 8E; , '<I:<I
.?< D8K?<D8K@:J F= JK8K@JK@:8C D8:?@E< KI8EJC8K@FE
― 612 ―
Proceedings of NTCIR-9 Workshop Meeting, December 6-9, 2011, Tokyo, Japan
G8I8D<K<I
<JK@D8K@FE
`
42598&8.43&1
.3,9.78.(7
56 ?@8E> "@<I8I:?@:8C *?I8J<
8J<; 'F;<C =FI
-K8K@JK@:8C '8:?@E< .I8EJC8K@FE 64(**).3,7 4+ *8><J
56 #KKP:?<I@8? 8E; -8C@D ,FLBFJ '8O@DLD
EKIFGP 1FI; C@>E<I =FI I89@:
E>C@J? '8:?@E<
.I8EJC8K@FE 64(**).3,7 4+ 92&3 &3,9&,* "*(-3414,;
*8><J
08E:FLM<I):KF9<I
56 #KKP:?<I@8? 8E; - ,FLBFJ @I<:K KI8EJC8K@FE DF;<C
64(**).3,7 4+ " *8><J ,F:?<JK<I
(3GI@C
56 3
- &<< % *8G@E<E@ - ,FLBFJ ) D8D 8E; " "8JJ8E
&8E>L8>< 'F;<C 8J<; I89@: 1FI; -<>D<EK8K@FE
64(**).3,7 4+ 8-* 78 339&1 **8.3, 4+ 8-* 774(.&8.43
+46 42598&8.43&1 .3,9.78.(7 *8><J -8GGFIF $LCP
56 3
- &<< #' I89@:
KF
E>C@J? KI8EJC8K@FE =FI
#1-&. 64(**).3,7 4+ 8-* 38*63&8.43&1 $4607-45
43 !540*3 &3,9&,* "6&371&8.43 $!" *8><J %PFKF(FM<D9<I
56 3
- &<< 4?8F 8E; 2 &LF FEJK@KL<EK
,<FI;<I@E> 8E; -PEK8O 'F;<CJ =FI E>C@J?
KF
$8G8E<J<
-K8K@JK@:8C '8:?@E< .I8EJC8K@FE 64(**).3,7 4+ 8-* 6)
38*63&8.43&1 43+*6*3(* 43 42598&8.43&1 .3,9.78.(7
41.3,
*8><J
<@A@E>L>LJK
56 $ )C@M< ?I@JK@8EJFE 8E; $ ':8IP ;@KFIJ &3)'440 4+ &896&1 &3,9&,* 64(*77.3, &3) &(-.3*
"6&371&8.43 14'&1 984342497 &3,9&,*
:514.8&8.43#-(
56 18E> ' FCC@EJ 8E; * %F<?E ?@E<J<
-PEK8:K@: ,<FI;<I@E> =FI -K8K@JK@:8C '8:?@E< .I8EJC8K@FE
64(**).3,74+4*8><J
56 1L -KF:?8JK@: @EM<IJ@FE KI8EJ;L:K@FE >I8DD8IJ
8E; 9@C@E>L8C G8IJ@E> F= G8I8CC<C :FIGFI8 42598&8.43&1
.3,9.78.(7
56 2@8E> 8E; #KKP:?<I@8? @J:I@D@E8K@M< =<8KLI<
K@<; D@OKLI< DF;<C@E> =FI JK8K@JK@:8C D8:?@E< KI8EJC8K@FE
64(**).3,7 4+ 8-* 8- 339&1 **8.3, 4+ 8-* 774(.&8.43
+46 42598&8.43&1 .3,9.78.(7 7-468 5&5*67 8><J *FIKC8E;$LE<
56 " 4?8E> ' 4?8E> " &@ N 8E; & .8E FI<JK
98J<; KI<< J<HL<E:< KF JKI@E> KI8EJC8K@FE DF;<C
64(**).3,74+*8><JW
56 4?8F 3 C
)E8@Q8E !<E<I8C@Q@E> &F:8C 8E; (FE
&F:8C 1FI;
,<FI;<I@E> *8KK<IEJ =FI -PEK8O
8J<; '8:?@E<
.I8EJC8K@FE 64(**).3,74+*8><JS
56 4?8F 3
- &<< 2 &LF & &@ &<8IE@E> KF
.I8EJ=FID 8E; -<C<:K C<D<EK8IP .I<<J =FI #DGIFM<;
-PEK8O
98J<; '8:?@E< .I8EJC8K@FEJ 64(**).3,7 4+ *8><JW
56 # !FKF &L % * ?FN -LD@K8 8E; % .JFL )M<IM@<N F= K?< *8K<EK '8:?@E< .I8EJC8K@FE .8JB 8K K?<
(.#,
1FIBJ?FG(.#,
.FBPF<:<D9<I
56 4?8F 8E; - 3 ?<E -@DGC<O ID@AF FNE?@CC
C>FI@K?D =FI )GK@D@Q@E> -K8K@JK@:8C '8:?@E< .I8EJC8K@FE
<:F;@E> *8I8D<K<IJ J?FIK G8G<I 64(**).3,7 4+ "
56 %8I8BFJ $ @JE<I - %?L;8EGLI 8E; ' I<P<I '8:?@E< KI8EJC8K@FE JPJK<D :FD9@E8K@FE LJ@E> #.!
98J<;
8C@>ED<EKJ 64(**).3,7 4+ 8-* 8- 339&1 **8.3, 4+ 8-*
774(.&8.43 +46 42598&8.43&1 .3,9.78.(7 &3) 92&3
&3,9&,* "*(-3414,.*7 !-468 &5*67 "!-468 *8><J
56 % *8G@E<E@ - ,FLBFJ . 18I; 8E; 1 4?L C<L 8
D<K?F; =FI 8LKFD8K@: <M8CL8K@FE F= D8:?@E< KI8EJC8K@FE
64(**).3,74+*8><JW
56 ,8KE8G8IB?@ &<8IE@E> KF *8IJ< (8KLI8C &8E>L8><
N@K? '8O@DLD EKIFGP 'F;<CJ &(-.3* *&63.3, #41 *8><J
56 .@CCD8EE *IFA<:K@FE OK<EJ@FE C>FI@K?DJ =FI
-K8K@JK@:8C '8:?@E< .I8EJC8K@FE 64(**).3,7 4+
8-*
43+*6*3(* 43 25.6.(&1 *8-4)7 .3 &896&1 &3,9&,*
64(*77.3,
-8GGFIF$LCP
56 .@CCD8EE 8E; " (<P 1FI; ,<FI;<I@E> 8E; 8
PE8D@: *IF>I8DD@E> <8D
-<8I:? C>FI@K?D =FI
-K8K@JK@:8C '8:?@E< .I8EJC8K@FE 42598&8.43&1 .3,9.78.(7
#41
4 *8><J
'8I:?
56 - 0F><C " (<P 8E; .@CCD8EE "''
8J<; 1FI;
C@>ED<EK @E -K8K@JK@:8C '8:?@E< .I8EJC8K@FE 64(**).3,7
4+ 8-* 8- 38*63&8.43&1 43+*6*3(* 43 42598&8.43&1
.3,9.78.(7 41.3, *8><J FG<E?8><E
L>LJK
― 613 ―