Improving BERT Pretraining with Syntactic Supervision
Tziafas, G. and Kogkalidis, K. and Wijnholds, G. and Moortgat, M. (2021). "Improving BERT Pretraining with Syntactic Supervision." ArXiV preprint.
CV
Education
- PhD in Compositional Distributional Semantics, Queen Mary University of London, 2016-present
- MSc. in Logic. Institute for Logic, Language and Computation, University of Amsterdam, 2011-2014 (cum laude)
- BSc. in Artificial Intelligence. Utrecht University, 2009-2011 (cum laude)
- BSc. in Liberal Arts & Sciences. Utrecht University, 2008-2010 (unfinished)
Publications
SICK-NL: A Dataset for Dutch Natural Language Inference
Wijnholds, G. and Moortgat, M. (2021). "SICK-NL: A Dataset for Dutch Natural Language Inference." Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics.
Fuzzy Generalised Quantifiers for Natural Language in Categorical Compositional Distributional Semantics
Dostal, M. and Sadrzadeh, M. and Wijnholds, G. (2020). "Fuzzy Generalised Quantifiers for Natural Language in Categorical Compositional Distributional Semantics." Mathematics, Logic, and Their Philosophies: Essays in Honour of Mohammad Ardeshir, Logic, Epistemology, and the Unity of Science.
Incremental Composition in Distributional Semantics
Purver, M. and Sadrzadeh, M. and Kempson, R. and Wijnholds, G. and Hough, J. (2021). "Incremental Composition in Distributional Semantics." To appear in Journal of Logic, Language and Information.
Representation Learning for Type-Driven Composition
Wijnholds, G., and Sadrzadeh, M. and Clark, S. (2020). "Representation Learning for Type-Driven Composition." Proceedings of the 24th Conference on Computational Natural Language Learning.
A Compositional Vector Space Model of Ellipsis and Anaphora
Wijnholds, G. (2020). "A Compositional Vector Space Model of Ellipsis and Anaphora." PhD Dissertation, Queen Mary University of London.
A toy distributional model for fuzzy generalised quantifiers
Sadrzadeh, M. and Wijnholds, G. (2020). "A toy distributional model for fuzzy generalised quantifiers." Proceedings of the Probability and Meaning Conference (PaM).
A Frobenius Algebraic Analysis for Parasitic Gaps
Moortgat, M., and Sadrzadeh, M. and Wijnholds, G. (2019). "A Frobenius Algebraic Analysis for Parasitic Gaps." IfCoLog Journal of Applied Logics.
Categorical Vector Space Semantics for Lambek Calculus with a Relevant Modality
McPheat, L. and Sadrzadeh, M. and Wazni, H. and Wijnholds, G. (2020). "Categorical Vector Space Semantics for Lambek Calculus with a Relevant Modality." ArXiV preprint.
Incremental Semantic Judgments
Purver, M, and Sadrzadeh, M, and Wijnholds, G, and Kempson, R, and Hough, J. "Incremental Semantic Judgments." Third Dynamic Syntax Conference. 2019.
A Type-Driven Vector Semantics for Ellipsis with Anaphora using Lambek Calculus with Limited Contraction
Wijnholds, G. and Sadrzadeh, M. (2019). "A Type-Driven Vector Semantics for Ellipsis with Anaphora using Lambek Calculus with Limited Contraction." Journal of Logic, Language and Information, 2019.
Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings
Wijnholds, G. and Sadrzadeh, M. (2019). "Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings." NAACL-HLT 2019 (Long).
A Proof-Theoretic Approach to Scope Ambiguity in Compositional Vector Space Models
Wijnholds, G. "A Proof-Theoretic Approach to Scope Ambiguity in Compositional Vector Space Models." Journal of Language Modelling, Vol 6, No 2.
Classical Copying versus Quantum Entanglement in Natural Language: The Case of VP-ellipsis
Wijnholds, G. and Sadrzadeh, M. (2018). "Classical Copying versus Quantum Entanglement in Natural Language: The Case of VP-ellipsis." CAPNS 2018 proceedings.
Lexical and Derivational Meaning in Vector-Based Models of Relativisation
Moortgat, M. and Wijnholds, G. (2017). "Lexical and Derivational Meaning in Vector-Based Models of Relativisation." Proceedings of the 21st Amsterdam Colloquium.
Coherent Diagrammatic Reasoning in Compositional Distributional Semantics
Wijnholds, G. J. (2017). "Coherent Diagrammatic Reasoning in Compositional Distributional Semantics." WoLLIC 2017, Lecture Notes in Computer Science. 10388.
Vector Semantics for Lambek Calculus with Contraction
Wijnholds, G, and Sadrzadeh, M. "Vector Semantics for Lambek Calculus with Contraction." Workshop on Logic and Algorithms in Computational Linguistics 2017 (LACompLing2017). 2017.
Syntactic control for compositional vector space models
Moortgat, M. J., and Wijnholds, G. "Syntactic control for compositional vector space models." Topology, Algebra, and Categories in Logic 2015 (2015): 204-206.
Conversions between D and MCFG: Logical Characterizations of the Mildly Context-Sensitive Languages
Wijnholds, G. J. (2014). "Conversions between D and MCFG: Logical Characterizations of the Mildly Context-Sensitive Languages." Computational Linguistics in the Netherlands Journal. 4.
Categorical Foundations for Extended Compositional Distributional Models of Meaning
Wijnholds, G. (2014). "Categorical Foundations for Extended Compositional Distributional Models of Meaning." MSc Thesis, Institute for Logic, Language, and Computation.
Investigations into categorial grammar: Symmetric pregroup grammar and displacement calculus
Wijnholds, G. (2011). "Investigations into categorial grammar: Symmetric pregroup grammar and displacement calculus." BSc Thesis, Utrecht University.
Talks
SICK-NL: A Dataset for Dutch Natural Language Inference
Conference Presentation at EACL 2021, Online
Representation Learning for Type-Driven Composition
Conference Presentation at CoNLL 2020, Online
Type-Driven Composition of Word Embeddings in the age of BERT
Conference Presentation at CLIN 2020, Utrecht University
Neural Tensor Embeddings
Guest Lecture at ESSLLI 2019, University of Latvia, Riga, Latvia
Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings
Workshop Presentation at SEMSPACE 2019, University of Latvia, Riga, Latvia
Dependency Based Tensor Embeddings
Invited Talk at Workshop on Compositionality in formal and distributional models of natural language semantics, Utrecht, The Netherlands
Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings
Conference Presentation at NAACL-HLT 2019, Minneapolis, Minnesota, USA
Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings
Poster Presentation at Workshop on Vector Semantics for Dialogue and Discourse, Gothenburg, Sweden
Incremental Semantic Judgments
Conference Presentation at Third Dynamic Syntax Conference, University of Malta, Malta
Classical Copying versus Quantum Entanglement in Natural Language: the Case of VP-ellipsis
Workshop Presentation at Second Symposium on Compositional Structures, Strathclyde University, Glasgow, UK
Classical Copying versus Quantum Entanglement in Natural Language: the Case of VP-ellipsis
Workshop Presentation at Compositional Approaches for Physics, NLP, and Social Sciences, Nice, France
Lexical and Derivational Meaning in Vector-Based Models of Relativisation
Conference Presentation at 21st Amsterdam Colloquium, Amsterdam, The Netherlands
Proof Nets and String Diagrams
Invited Talk at Leicester University, Leicester, UK
Lambek with Contractions
Workshop Presentation at DuskoFest, Oxford, UK
Coherent Diagrammatic Reasoning in Compositional Distributional Semantics
Workshop Presentation at 1st Workshop on String Diagrams in Computation, Logic, and Physics, Oxford, UK
Vector Semantics for Lambek Calculus with Contraction
Conference Presentation at Logic and Algorithms in Computational Linguistics 2017, Stockholm University
Coherent Diagrammatic Reasoning in Compositional Distributional Semantics
Conference Presentation at 24th Workshop on Logic, Language, Information and Computation, University College London, UK
Compositional Distributional Semantics
Guest Lecture at Utrecht University, Utrecht, The Netherlands
Non-Local Information Flow in Compositional Vector Space Models: From enhanced syntax to enhanced semantics
Workshop Presentation at Workshop on Statistical and Logical Models of Meaning at NASSLLI 2016, Rutgers University, New Brunswick, NJ, USA
Syntactic control for compositional vector space models
Conference Presentation at Topology, Algebra, and Categories in Logic 2015, Ischia, Italy
Enhanced Expressivity for Compositional Distributional Semantics
Poster Presentation at Advances in Distributional Semantics, London, UK
Conversions between D and MCFG: Logical Characterizations of the Mildly Context-Sensitive Languages
Conference Presentation at 24th Meeting of Computational Linguistics in The Netherlands, Leiden, The Netherlands
Teaching
Logical Grammars
As Lecturer, Utrecht University,
Artificial Intelligence, Undergraduate
Natural Language Processing
As Teaching Assistant, Queen Mary University of London,
Computer Science, Postgraduate
Mathematics for Electronic Engineering I
As Lecturer, Queen Mary University of London,
Electronic Engineering, Undergraduate
Mathematics for Electronic Engineering I
As Teaching Assistant, Queen Mary University of London,
Electronic Engineering, Undergraduate
Logic Programming and Search Techniques
As Teaching Assistant, University of Amsterdam,
Artificial Intelligence, Undergraduate
Computational Logic
As Teaching Assistant, University of Amsterdam,
Artificial Intelligence, Undergraduate
Linear Algebra
As Teaching Assistant, University of Amsterdam,
Artificial Intelligence, Undergraduate
Introduction to Artificial Intelligence
As Teaching Assistant, University of Amsterdam,
Artificial Intelligence, Undergraduate
Introduction to Logic
As Teaching Assistant, University of Amsterdam,
Artificial Intelligence, Undergraduate
Language and Speech Technology
As Teaching Assistant, Utrecht University,
Artificial Intelligence, Undergraduate
Natural Language Processing
As Teaching Assistant, Utrecht University,
Artificial Intelligence, Undergraduate