Browsing by Author "Ng S-K"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    Anisotropic span embeddings and the negative impact of higher-order inference for coreference resolution: An empirical analysis
    (Cambridge University Press, 2024-01-25) Hou F; Wang R; Ng S-K; Zhu F; Witbrock M; Cahan SF; Chen L; Jia X
    Coreference resolution is the task of identifying and clustering mentions that refer to the same entity in a document. Based on state-of-the-art deep learning approaches, end-to-end coreference resolution considers all spans as candidate mentions and tackles mention detection and coreference resolution simultaneously. Recently, researchers have attempted to incorporate document-level context using higher-order inference (HOI) to improve end-to-end coreference resolution. However, HOI methods have been shown to have marginal or even negative impact on coreference resolution. In this paper, we reveal the reasons for the negative impact of HOI coreference resolution. Contextualized representations (e.g., those produced by BERT) for building span embeddings have been shown to be highly anisotropic. We show that HOI actually increases and thus worsens the anisotropy of span embeddings and makes it difficult to distinguish between related but distinct entities (e.g., pilots and flight attendants). Instead of using HOI, we propose two methods, Less-Anisotropic Internal Representations (LAIR) and Data Augmentation with Document Synthesis and Mention Swap (DSMS), to learn less-anisotropic span embeddings for coreference resolution. LAIR uses a linear aggregation of the first layer and the topmost layer of contextualized embeddings. DSMS generates more diversified examples of related but distinct entities by synthesizing documents and by mention swapping. Our experiments show that less-anisotropic span embeddings improve the performance significantly (+2.8 F1 gain on the OntoNotes benchmark) reaching new state-of-the-art performance on the GAP dataset.
  • Thumbnail Image
    Item
    Body appreciation around the world: Measurement invariance of the Body Appreciation Scale-2 (BAS-2) across 65 nations, 40 languages, gender identities, and age.
    (Elsevier B.V., 2023-08-13) Swami V; Tran US; Stieger S; Aavik T; Ranjbar HA; Adebayo SO; Afhami R; Ahmed O; Aimé A; Akel M; Halbusi HA; Alexias G; Ali KF; Alp-Dal N; Alsalhani AB; Álvares-Solas S; Amaral ACS; Andrianto S; Aspden T; Argyrides M; Aruta JJBR; Atkin S; Ayandele O; Baceviciene M; Bahbouh R; Ballesio A; Barron D; Bellard A; Bender SS; Beydağ KD; Birovljević G; Blackburn M-È; Borja-Alvarez T; Borowiec J; Bozogáňová M; Bratland-Sanda S; Browning MHEM; Brytek-Matera A; Burakova M; Çakır-Koçak Y; Camacho P; Camilleri VE; Cazzato V; Cerea S; Chaiwutikornwanich A; Chaleeraktrakoon T; Chambers T; Chen Q-W; Chen X; Chien C-L; Chobthamkit P; Choompunuch B; Compte EJ; Corrigan J; Cosmas G; Cowden RG; Czepczor-Bernat K; Czub M; da Silva WR; Dadfar M; Dalley SE; Dany L; Datu JAD; Berbert de Carvalho PH; Coelho GLDH; De Jesus AOS; Debbabi SH; Dhakal S; Di Bernardo F; Dimitrova DD; Dion J; Dixson B; Donofrio SM; Drysch M; Du H; Dzhambov AM; El-Jor C; Enea V; Eskin M; Farbod F; Farrugia L; Fian L; Fisher ML; Folwarczny M; Frederick DA; Fuller-Tyszkiewicz M; Furnham A; García AA; Geller S; Ghisi M; Ghorbani A; Martinez MAG; Gradidge S; Graf S; Grano C; Gyene G; Hallit S; Hamdan M; Handelzalts JE; Hanel PHP; Hawks SR; Hekmati I; Helmy M; Hill T; Hina F; Holenweger G; Hřebíčková M; Ijabadeniyi OA; Imam A; İnce B; Irrazabal N; Jankauskiene R; Jiang D-Y; Jiménez-Borja M; Jiménez-Borja V; Johnson EM; Jovanović V; Jović M; Jović M; Junqueira ACP; Kahle L-M; Kantanista A; Karakiraz A; Karkin AN; Kasten E; Khatib S; Khieowan N; Kimong PJ; Kiropoulos L; Knittel J; Kohli N; Koprivnik M; Kospakov A; Król-Zielińska M; Krug I; Kuan G; Kueh YC; Kujan O; Kukić M; Kumar S; Kumar V; Lamba N; Lauri MA; Laus MF; LeBlanc LA; Lee HJ; Lipowska M; Lipowski M; Lombardo C; Lukács A; Maïano C; Malik S; Manjary M; Baldó LM; Martinez-Banfi M; Massar K; Matera C; McAnirlin O; Mebarak MR; Mechri A; Meireles JFF; Mesko N; Mills J; Miyairi M; Modi R; Modrzejewska A; Modrzejewska J; Mulgrew KE; Myers TA; Namatame H; Nassani MZ; Nerini A; Neto F; Neto J; Neves AN; Ng S-K; Nithiya D; O J; Obeid S; Oda-Montecinos C; Olapegba PO; Olonisakin TT; Omar SS; Örlygsdóttir B; Özsoy E; Otterbring T; Pahl S; Panasiti MS; Park Y; Patwary MM; Pethö T; Petrova N; Pietschnig J; Pourmahmoud S; Prabhu VG; Poštuvan V; Prokop P; Ramseyer Winter VL; Razmus M; Ru T; Rupar M; Sahlan RN; Hassan MS; Šalov A; Sapkota S; Sarfo JO; Sawamiya Y; Schaefer K; Schulte-Mecklenbeck M; Seekis V; Selvi K; Sharifi M; Shrivastava A; Siddique RF; Sigurdsson V; Silkane V; Šimunić A; Singh G; Slezáčková A; Sundgot-Borgen C; Ten Hoor G; Tevichapong P; Tipandjan A; Todd J; Togas C; Tonini F; Tovar-Castro JC; Trangsrud LKJ; Tripathi P; Tudorel O; Tylka TL; Uyzbayeva A; Vally Z; Vanags E; Vega LD; Vicente-Arruebarrena A; Vidal-Mollón J; Vilar R; Villegas H; Vintilă M; Wallner C; White MP; Whitebridge S; Windhager S; Wong KY; Yau EK; Yamamiya Y; Yeung VWL; Zanetti MC; Zawisza M; Zeeni N; Zvaríková M; Voracek M
    The Body Appreciation Scale-2 (BAS-2) is a widely used measure of a core facet of the positive body image construct. However, extant research concerning measurement invariance of the BAS-2 across a large number of nations remains limited. Here, we utilised the Body Image in Nature (BINS) dataset - with data collected between 2020 and 2022 - to assess measurement invariance of the BAS-2 across 65 nations, 40 languages, gender identities, and age groups. Multi-group confirmatory factor analysis indicated that full scalar invariance was upheld across all nations, languages, gender identities, and age groups, suggesting that the unidimensional BAS-2 model has widespread applicability. There were large differences across nations and languages in latent body appreciation, while differences across gender identities and age groups were negligible-to-small. Additionally, greater body appreciation was significantly associated with higher life satisfaction, being single (versus being married or in a committed relationship), and greater rurality (versus urbanicity). Across a subset of nations where nation-level data were available, greater body appreciation was also significantly associated with greater cultural distance from the United States and greater relative income inequality. These findings suggest that the BAS-2 likely captures a near-universal conceptualisation of the body appreciation construct, which should facilitate further cross-cultural research.