Handling Verb Phrase Anaphora with Dependent Types and Events
Daniyar Itegulov, Ekaterina Lebedeva

TL;DR
This paper proposes a novel framework using dependent types and neo-Davidsonian events to effectively handle verb phrase anaphora in natural language understanding.
Contribution
It introduces an extended Dependent Type Semantics with a new atomic event type and an @-operator for improved anaphora resolution.
Findings
Framework successfully models verb phrase anaphora
Extended DTS captures shared event properties
Illustrative examples demonstrate effectiveness
Abstract
This paper studies how dependent typed events can be used to treat verb phrase anaphora. We introduce a framework that extends Dependent Type Semantics (DTS) with a new atomic type for neo-Davidsonian events and an extended @-operator that can return new events that share properties of events referenced by verb phrase anaphora. The proposed framework, along with illustrative examples of its use, are presented after a brief overview of the necessary background and of the major challenges posed by verb phrase anaphora.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
11institutetext: Australian National University, Canberra, Australia
11email: {daniyar.itegulov, ekaterina.lebedeva}@anu.edu.au 22institutetext: ITMO University, St. Petersburg, Russia
Handling Verb Phrase Anaphora with Dependent Types and Events
Daniyar Itegulov 11 2 2
Ekaterina Lebedeva We thank Bruno Woltzenlogel Paleo and Florrie Verity for numerous helpful discussions and insightful remarks.11
Abstract
This paper studies how dependent typed events can be used to treat verb phrase anaphora. We introduce a framework that extends Dependent Type Semantics (DTS) with a new atomic type for neo-Davidsonian events and an extended @-operator that can return new events that share properties of events referenced by verb phrase anaphora.
The proposed framework, along with illustrative examples of its use, are presented after a brief overview of the necessary background and of the major challenges posed by verb phrase anaphora.
1 Introduction
Davidson [2] observed that some verbs can imply the existence of an “action”. For example, a sentence “John eats.” represents an action of eating. This action can be anaphorically referred from a following sentence (e.g.: “The food is yummy.”). Hence, a framework of natural language semantics should encompass the notion of action and a mechanism for action reference. Davidson proposed to equip interpretations of verbs with an additional argument for events. Then the sentence “John eats.” is interpreted according to Davidson as , instead of .
Parsons [8] and Taylor [13] argued that the approach of event semantics captures the notion of adverbs better than approaches based on higher-order predicates, such as [14], and is easier to work with. For example, adverbial modifiers usually affect only the event and not the entity, as the following example illustrates:
[(1)]
a.
John buttered the toast slowly, deliberately, in the bathroom, with a knife, at midnight.
b.
Sentence (1a) contains adverbs that modify the event of buttering the toast. The corresponding interpretation is shown in (1b).
Additionally to adverbial modifiers, Parsons [8] described two more reasons for introducing events as a new atomic type: perception verbs and reference to events.
Parsons [8], furthermore, proposed a framework based on Davidson’s event theory, called neo-Davidsonian event semantics, that extends it as follows:
- •
event participants are introduced via thematic roles
- •
state verbs, in addition to action verbs, are handled with an abstract variable
- •
two concepts, event holding and event culmination, are added
- •
events are decomposed into subevents
The differences between Davidsonian and neo-Davidsonian approaches can be seen by comparing interpretations (1b) and (1) of Sentence (1a).
[(2)]
This paper proposes a framework for solving verb phrase anaphora (also known as verb phrase ellipsis) based on the neo-Davidsonian event semantics and on dependent types; and to adapt the existing techniques of handling the propositional anaphora to Dependent Type Semantics framework. Dependent types are already used to express pronominal anaphora in [1].
In Section 2, we briefly recall Dependent Type Semantics (DTS), which is a theoretical foundation for our framework. In Section 3, we discuss major problems of interpreting verb phrase anaphora. The main contribution of this paper is presented in Section 4, which describes an extension of the Dependent Type Semantics, and in Section 5, which discusses an application of subtyping in the proposed framework.
2 Recalling Dependent Type Semantics
Dynamic type semantics (DTS) proposed in [1] is a framework of discourse semantics based on dependent type theory (Martin-Löf [6]). DTS follows the constructive, proof-theoretic approach to semantics established by Sundholm [12] who introduced Sundholmian semantics and by Ranta [11] who introduced Type Theoretical Grammar.
Definition 1 (Dependent function)
For any :
Definition 2 (Dependent pair)
For any :
DTS employs two kinds of dependent types (in addition to simply-typed lambda calculus): dependent pair type or -type (notation ) and dependent function type or -type (notation ). A dependent pair is a generalization of an ordinary pair. By Curry-Howard correspondence between types and propositions, the type corresponds to an existential quantified formula and to an ordinary conjunction when .111 denotes all free variables in . A dependent function is a generalization of an ordinary function and the type corresponds to . Formal definitions are given through inference rules in definitions 1 and 2.
A comparison between the traditional notation for dependent types and the notation used in DTS can be seen in fig. 1.
The main atomic type in DTS is entity, which represents all entities in a discourse. With the employment of dependent type constructors, the entity type can be combined with additional properties. For example, is a valid DTS interpretation of “A man entered”. Therefore, in contrast to traditional approaches to semantical interpretation where entities are not distinguished by their types, each entity has its own type in DTS.
In the traditional Montague model-theoretic semantics [7] a proposition denotes a truth value (often defined as an -type). However, DTS does not follow this convention and instead the meaning of a sentence is represented by a type. In dependent type theory, types are defined by the inference rules, as shown in definitions 1 and 2. The rules specify how a dependent type (as a proposition) can be proved under a given context. Thus, the meaning of a sentence in proof-theoretic semantics lies in its verification condition similar to the philosophy of language by Dummett [3] [4] and Prawitz [9].
To handle anaphora resolution, DTS distinguishes two kinds of propositions: static and dynamic. A static proposition is called true if it is inhabited, i.e. there exists a term of type . A dynamic proposition is a function mapping context-proof (a static proposition, representing the previous discourse) to a static proposition.
@-operator is used to represent anaphora and presupposition triggers. The operator takes the left context of dynamic propositions it is used in. For example, Sentence (3a) can be interpreted as (3b) in DTS. The @-operator in (3b) takes a context as an argument and tries to find a female entity (due to the interpretation of the word “herself”) in the context passed to it.
Different @-operators can have different types (since context passed to them can vary in its type). They are distinguished with a numerical subscript. Since different @-operators can take differently typed contexts, the operators should have different types as well. That is why contexts’ types of @-operators are distinguished with a numerical subscript. The full type of -operator can look like this: .
[(3)]
a.
Mary loves herself.
b.
3 Verb Phrase Anaphora
Verb phrase anaphora [10] are anaphora with an intentional omission of part of a full-fledged verb phrase when the ellipsed part can be implicitly derived from the context. For example, verb phrase anaphora can be observed in (4a) and (4b):
[(4)]
a.
John left before Mary did.
b.
John left. Mary did too.
In (4a), the word “did” refers to an action John did before Mary. In (4b), the “did too” clause refers to an action which John and Mary both did. These sentences can be interpreted in event semantics as the following logical expressions:
[(5)]
a.
b.
Furthermore, an anaphoric verb phrase can “inherit” some properties from its referent. Consider Example (6a) where “did too” not only refers to the event of eating performed by John, but also to properties such as “quietly” and “last night”. Expression (6b) is the interpretation of this sentence in event semantics.
[(6)]
a.
John quietly ate the cake last night. Mary did too.
b.
A verb phrase anaphora may have an additional property that can ease the choice of a correct anaphoric referent-event from the context. This phenomenon is exemplified in (3), where it is explicit that “too” refers to an action connected with eating.
John ate pasta and did not feel well. Mary ate too, but nothing happened to her.
An ambiguity between strict and sloppy identity readings of verb phrase anaphora described by Prust [10] is another intriguing phenomenon. Example (LABEL:hat-all) illustrates this:
hat-all
John likes his hat. Fred does too.
The anaphoric clause in the second sentence of (3) can be interpreted as “Fred likes John’s hat” (the sloppy identity interpretation (3)) or as “Fred likes Fred’s hat” (the strict interpretation (3)). A desirable framework should be able to provide both interpretations.
4 Events with Dependent Types
To tackle phenomena discussed in Section 3, we propose to extend DTS with a new atomic type event for interpreting events. Then, given its left contect , DTS’s @-operator can be employed for retrieving a variable of type event analogously to its original use for retrieving a referent of type entity.
As was shown by Parsons [8], event semantics can be employed to represent propositional anaphora. An example of propositional anaphora is shown in (9a), where “this” refers to the whole proposition expressed in the first sentence. Formula (9b) is an interpretation of (9a).
[(9)]
a.
John loved Mary. But Mary did not believe this.
b.
Dependent typed events allow us to handle more complex types of propositional anaphora. Similar to entities, events can have various properties provided by their description. Assume the following three sentences appear in the same discourse, possibly remotely from each other, but with preservation of the order:
[(10)]
a.
Canberra was hit by a flood on Sunday.
b.
The fair was held in London.
c.
What happened in Canberra is surprising.
Here the anaphoric clause in Sentence (10c) refers to an event discussed earlier. There are however (at least) two potential events for the reference: one given by (10a) and another given by (10b). Since the anaphoric clause in (10c) specifies that it refers to an event happened in Canberra, the anaphora disambiguates to the event in (10a).
The interpretation of verb phrase anaphora is more challenging, however, than the interpretation of propositional anaphora: an anaphoric clause in a verb phrase anaphora usually talks about a new event that inherits properties of another event. For example, “John left. Bob did too.” conveys two events: one is about John leaving and the second one is about Bob leaving. In cases of pronominal and propositional anaphora, however, there is just a reference to an entity or an event in the context. For example in “John walks. He is slow.”, pronoun “he” in the second sentence just refers to the entity “John” from the first sentence.
To handle verb phrase anaphora correctly, it is not enough to just fetch a referenced variable from the left context; instead a new variable of type event should be introduced. This new variable copies properties from the referred event. Furthermore, the agent of the referred event should be changed to the current agent in the new event. This can be seen in interpretation (6b) of (6a), where the agent John is replaced with Mary.
Although -operator has type in DTS for handling pronominal anaphora, according to DTS syntax for raw terms the operator can be of any type. We therefore suggest a new type of @-operator that guarantees that the returned event has a proper agent, necessary for interpreting the verb phrase anaphora:
[(11)]
Formula (12a) is an interpretation of discourse (4b). The -operator in (12b) is applied to its left context (of type ) and an entity, and returns a new event of type event with the same properties (apart from the agent property) of the referenced event. Crucially, the event returned by -operator in (12b) is not an event that was in the context previously. It is a new event with the same properties (e.g. location, time) as a referenced event from the context, but with a replaced agent.
[(12)]
a.
b.
Note that the entity accepted by the @-operator defined in (4) is the agent in the new event. For instance, in Example (6a), the interpretation of “did too” using (4) would have the agent “John” of the referenced event replaced by “Mary”, but the patient (i.e. the cake) would remain. On the other hand, there exist cases of verb phrase anaphora where the patient in the referenced event should be replaced. This usually depends on the voice (active or passive) of an anaphoric clause, as can be seen from examples in (4).
[(13)]
a. Mary is loved by John. So is Ann.
b. John loves Mary. So does Bob.
c. d.
The first sentences in (13a) and (13b) have the same semantics and hence the interpretations given to them in (13c) and (13d) coincide. However, despite both second sentences are written in the same voice as their first sentences, the second sentences are interpreted differently. Naturally, the second sentence in (13a) means “Ann is loved by John”, while the second sentence in (13b) means “Bob loves Mary”. Note that they have replaced different participants of the first sentences: in (13a) Mary (patient) was replaced by Ann and in (13b) John (agent) was replaced by Bob.
Furthermore, an interpretation of a sentence may require both the agent and the patient to be replaced, as for example in the sloppy reading of (3). These possible cases of anaphora resolution can be tackled with the judgements (4) assuming they occur in a global context .
Another important notion in DTS is the felicity condition. The anaphora resolution for operator is launched by type checking of the following judgement: . It means that the semantical interpretation of a sentence must be of the sort type assuming that the left context is of type . A requirement of a success of the launching the type checker is called felicity condition.
In order to preserve the original DTS invariants, we should show how felicity condition is being fulfilled in the extended DTS. An example of a felicity-judgement generated by verb phrase anaphora is shown in example (4). It is different from the felicity condition from original DTS notion since the new @-operator has a new type as shown in Equation 4.
[(14)]
Let us assume that the global context contains the judgements from (4). Then one should be able to type check judgements generated by the verb phrase anaphora.
[(15)]
a.
b.
c.
d.
Functions , , construct a new event from an existing event . To express the inheritance of properties and the change of the agent in (or patient in ), properties are expressed as a function that accepts two arguments: an agent-entity (or patient-entity in ) and an event; and returns a logical expression describing the event using the entity. Function accounts for cases where both an agent and a patient are replaced.
We can now construct term of type (4), to fulfill the felicity condition of form (4), as shown in (4):
[(16)]
A substitution of in (12b) with its term defined in (4) leads to the following semantical interpretation:
[(17)]
Since anaphora in DTS is resolved using the type checking procedure, the verb phrase anaphora, just like the pronominal anaphora, can be resolved in various ways. A type checking algorithm can find different terms which conform to the specified (by felicity condition) type. For example, in order to handle the ambiguity between strict and sloppy identity readings, which were discussed in Example (LABEL:hat-all), our framework can provide both possible interpretations for Sentence (3). Term (4) shows a generic interpretation of (3) in the proposed framework.
[(18)]
In (4), “Fred does too.” is interpreted as the term , where stands for the interpretation of the preceeding sentence “John likes his hat.”. Recall from Example (LABEL:hat-all) that the latter sentence has an ambiguous meaning. (4) defines two alternative terms for , one for each of the possible meanings. Note that the type of these terms for conforms with the felicity condition.
[(19)]
a.
b.
Both terms are valid substitutions for -operator in (4) and they represent strict and sloppy anaphora readings respectively. In (19b) let-in structure is used only as a syntactical sugar for readability and is not actually a part of DTS term syntax.
5 Subtyping
Equation in (4) (i.e. an anaphora resolution solution: a proof of existence of a term with the required type under the global context ) is not sound: the type of the right side of the equation is
[TABLE]
while the type required by the left side is
[TABLE]
The former type is more specific than the latter type because it has an additional property “left”.
This is not a problem, as events have a natural subtyping relationship between them. As described in [5], an event whose agent is and patient is , is an event with agent . Despite a different theory underneath, the techniques described there can be reused for subtyping events in DTS. This leads to the following subtyping relations in event semantics:
[(20)]
a.
b.
Subtyping relations of events can also depend on other properties (e.g. a loud event performed by John is also an event performed by John). We employ Luo’s notation to define a new type , which is the type of events with agent and nature . Nature is a main predicate for each event in neo-Davidsonian semantics (e.g. “left(e)” for an event of leaving, “ate(e)” for an event of eating).
The following transformation shows how the dependent event types in DTS notation from (4) can be converted into dependent event types in Luo notation:
[(21)]
a.
b.
A subtyping relationship between these types can be constructed (assuming the appropriate subtyping rules have been added along with type ).
The discussed subtyping relationship allows us to obtain (4).
6 Conclusion
This paper introduces dependent event types for resolving verb phrase anaphora with DTS as the underlying framework. To tackle verb phrase anaphora, we extend DTS’s @-operator, which was originally introduced for handling pronominal anaphora. The paper also adresses strict and sloppy readings of verb phrase anaphora and shows that each of them can be achieved solely by manipulating the interpretation of the @-operator. The previous approaches to handling the propositional anaphora were also adapted to DTS framework.
Techniques described in this paper could be applied to handle other cases of anaphora, such as adjectival anaphora, modal and “do so” anaphora. Another interesting topic would be to study specific behaviours of various thematic roles, such as experiencer, theme and source.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Daisuke Bekki “Representing Anaphora with Dependent Types” In Logical Aspects of Computational Linguistics Springer Berlin Heidelberg, 2014, pp. 14–29
- 2[2] Donald Davidson “The Logical Form of Action Sentences” In The Logic of Decision and Action University of Pittsburgh Press, 1967
- 3[3] Michael Dummett “What is a Theory of Meaning? (II)” In Truth and Meaning: Essays in Semantics. Oxford: Clarendon Press, 1976
- 4[4] Michael A. E. Dummett “What is a Theory of Meaning?” In Mind and Language Oxford University Press, 1975
- 5[5] Zhaohui Luo and Sergei Soloviev “Dependent Event Types” In Logic, Language, Information, and Computation Berlin, Heidelberg: Springer Berlin Heidelberg, 2017, pp. 216–228
- 6[6] P. Martin-Löf and G. Sambin “Intuitionistic type theory”, Studies in proof theory Bibliopolis, 1984
- 7[7] Richard Montague “Formal Philosophy; Selected Papers of Richard Montague” New Haven: Yale University Press, 1974
- 8[8] Terence Parsons “Events in the Semantics of English: A Study in Subatomic Semantics” MIT Press, 1990
