arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ted Sanders

48 papers · 1991–2026

1991: 11992: 01993: 21994: 01995: 01996: 11997: 01998: 01999: 12000: 02001: 02002: 12003: 02004: 22005: 02006: 02007: 12008: 32009: 12010: 42011: 32012: 42013: 12014: 22015: 42016: 12017: 12018: 32019: 22020: 02021: 32022: 12023: 22024: 32025: 02026: 1
1991peak 4 in 20102026

Frequent co-authors

Papers

showing 1–25 of 48 RSS

GPT-4 Technical Report

OpenAI, Josh Achiam, Steven Adler +278 more

cs.CL · · cited 27,487× · arXiv ↗ · more like this ·

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.

Effect of genre on the generalizability of writing scores

Renske Bouwer, Anton A. Béguin, Ted Sanders +1 more

Education · Language Testing · · cited 86× · DOI ↗ · more like this ·

In the present study, aspects of the measurement of writing are disentangled in order to investigate the validity of inferences made on the basis of writing performance and to describe implications for the assessment of writing. To include genre as a facet in the measurement, we obtained writing scores of 12 texts in four different genres for each participating student. Results indicate that across raters, tasks and genres, only 10% of the variance in writing scores is related to individual writing skill. In order to draw conclusions about writing proficiency, students should therefore write at least three different texts in each of four genres rated by at least two raters. Moreover, when writing scores are obtained through highly similar tasks, generalization across genres is not warranted. Inferences based on text quality scores should, in this case, be limited to genre-specific…

Unifying dimensions in coherence relations: How various annotation frameworks are related

Ted Sanders, Vera Demberg, Jet Hoek +4 more

Artificial Intelligence · Corpus Linguistics and Linguistic Theory · · cited 71× · DOI ↗ · more like this ·

Abstract In this paper, we show how three often used and seemingly different discourse annotation frameworks – Penn Discourse Treebank (PDTB), Rhetorical Structure Theory (RST), and Segmented Discourse Representation Theory – can be related by using a set of unifying dimensions. These dimensions are taken from the Cognitive approach to Coherence Relations and combined with more fine-grained additional features from the frameworks themselves to yield a posited set of dimensions that can successfully map three frameworks. The resulting interface will allow researchers to find identical or at least closely related relations within sets of annotated corpora, even if they are annotated within different frameworks. Furthermore, we tested our unified dimension (UniDim) approach by comparing PDTB and RST annotations of identical newspaper texts and converting their original end label…

Relating self reports of writing behaviour and online task execution using a temporal model

Marion Tillema, Huub van den Bergh, Gert Rijlaarsdam +1 more

Education · Metacognition and Learning · · cited 47× · DOI ↗ · more like this ·

Current theory about writing states that the quality of (meta)cognitive processing (i.e. planning, text production, revising, et cetera) is, at least partly, determined by the temporal distribution of (meta)cognitive activities across task execution. Put simply, the quality of task execution is determined more by when activities are applied than by how often they are applied. Planning and revising are two extreme writing styles, in which (meta)cognitive activities are temporally differently distributed across the writing process. Planners are writers who generate plans before text production. Revisers use text production as a means to arrive at a content plan. The present study investigates the question whether the online (meta)cognitive processing of secondary school students during writing tasks, as measured by think aloud techniques and keystroke logging, can be predicted by their…

Linguistics markers of coherence improve text comprehension in functional contexts

Ted Sanders, Jentine Land, Gerben Mulder

Artificial Intelligence · Information Design Journal · · cited 47× · DOI ↗ · more like this ·

Text coherence can be marked linguistically by using connectives and lexical signals that make coherence relations explicit. This study focuses on the influence of such markers on text comprehension in ecologically valid contexts. A first experiment shows how readers in a business meeting and in a laboratory study benefit from the explicit marking of coherence relations. A second experiment shows how poor readers in secondary education benefit from coherence marking while answering text comprehension questions. We argue in favor of an interaction between cognitively oriented research on discourse representation and document design research, to solve crucial questions like: how do we design optimally readable texts?

Children searching information on the Internet: Performance on children's interfaces compared to Google

Hanna Jochmann-Mannak, Theo Huibers, Leo Lentz +1 more

Education · University of Twente Research Information · · cited 45× · OpenAlex ↗ · more like this ·

Children frequently make use of the Internet to search for information. However, research shows that children experience many problems with searching and browsing the web. The last decade numerous search environments have been developed, especially for children. Do these search interfaces support children in effective information-seeking? And do these interfaces add value to today’s popular search engines, such as Google? In this explorative study, we compared children’s search performance on four interfaces designed for children, with their performance on Google. We found that the children did not perform better on these interfaces than on Google. This study also uncovered several problems that children experienced with these search interfaces, which can be of use for designers of future search interfaces for children.

Accessibility in Text and Discourse Processing

Ted Sanders, Morton Ann Gernsbacher

Artificial Intelligence · Discourse Processes · · cited 43× · DOI ↗ · more like this ·

Accessibility is one of the most important challenges at the intersection of linguistic and psycholinguistic studies of text and discourse processing. Linguists have shown how linguistic indicators of referential coherence show a systematic pattern: Longer linguistic forms (like full lexical NPs) tend to be used when referents are relatively low accessible, shorter forms (pronouns and zero anaphora) are used when referents are highly accessible. This linguistic theory fits in nicely with a dynamic view of text and discourse processing: When a reader proceeds through a text, the activation of concepts as part of the reader's representation fluctuates constantly. Hypotheses considering activation patterns can be tested with on-line research methods like reading time or eye-movement recording. The articles in this special issue show how accessibility phenomena need to be studied from a…

Cloze testing for comprehension assessment: The HyTeC-cloze

Suzanne Kleijn, Henk Pander Maat, Ted Sanders

Artificial Intelligence · Language Testing · · cited 40× · DOI ↗ · more like this ·

Although there are many methods available for assessing text comprehension, the cloze test is not widely acknowledged as one of them. Critiques on cloze testing center on its supposedly limited ability to measure comprehension beyond the sentence. However, these critiques do not hold for all types of cloze tests; the particular configuration of a cloze determines its validity. We review various cloze configurations and discuss their strengths and weaknesses. We propose a new cloze procedure specifically designed to gauge text comprehension: the Hybrid Text Comprehension cloze (HyTeC-cloze). It employs a hybrid mechanical-rational deletion strategy and semantic scoring of answers. The procedure was tested in a large-scale study, involving 2926 Dutch secondary school students with 120 unique cloze tests. Our results show that, in terms of reliability and validity, the HyTeC-cloze matches…

Agree or Disagree? Cognitive Processes in Answering Contrastive Survey Questions

Naomi Kamoen, Bregje Holleman, Pim Mak +2 more

Sociology and Political Science · Discourse Processes · · cited 38× · DOI ↗ · more like this ·

Survey designers have long assumed that respondents who disagree with a negative question (“This policy is bad.”: Yes or No; 2-point scale) will agree with an equivalent positive question (“This policy is good.”: Yes or No; 2-point scale). However, experimental evidence has proven otherwise: Respondents are more likely to disagree with negative questions than to agree with positive ones. To explain these response effects for contrastive questions, the cognitive processes underlying question answering were examined. Using eye tracking, the authors show that the first reading of the question and the answers takes the same amount of time for contrastive questions. This suggests that the wording effect does not arise in the cognitive stages of question comprehension and attitude retrieval. Rereading a question and its answering options also takes the same amount of time, but happens more…

Segmenting discourse: Incorporating interpretation into segmentation?

Jet Hoek, Jacqueline Evers-Vermeul, Ted Sanders

Artificial Intelligence · Corpus Linguistics and Linguistic Theory · · cited 35× · DOI ↗ · more like this ·

Abstract Discourse segmentation is an important step in the process of annotating coherence relations. Ideally, implementing segmentation rules results in text segments that correspond to the units of thought related to each other. This paper demonstrates that accurate segmentation is in part dependent on the propositional content of text fragments, and that completely separating segmentation and annotation does not always yield text segments that correspond to the text units between which a conceptual relationship holds. In addition, it argues that elements belonging to the propositional content of the discourse should necessarily be included in the segmentation, but that inclusion of other text elements, for instance stance markers, should be optional.

PISA—A procedure for analyzing the structure of explanatory texts

Ted Sanders, Carel van Wijk

Education · Text - Interdisciplinary Journal for the Study of Discourse · · cited 34× · DOI ↗ · more like this ·

Linguistic analyses of text corpora have contributed to the understanding of natural language processing in both reading and writing. However, the impact of text analysis in psycho-linguistic research has been limited, mainly because the analyses hardly ever concern text structure. Existing models for text structure analysis tend to rely heavily on analysts intuitions and world knowledge, and they are hardly formulated explicitly enough to be applied in an objective and reliable way.This paper discusses a procedure that aims at solving this in determinacy for the domain of explanatory texts. We have formulated out intuitions about text structures in ordered sets of production rules that constitute an analytic procedure. This procedure automatically builds structure representations in an incremental way, that is, clause-by-clause in a left-to-rightmanner. It makes well-defined use of…

Quantifying the quality difference between L1 and L2 essays: A rating procedure with bilingual raters and L1 and L2 benchmark essays

Marion Tillema, Huub van den Bergh, Gert Rijlaarsdam +1 more

Education · Language Testing · · cited 33× · DOI ↗ · more like this ·

It is the consensus that, as a result of the extra constraints placed on working memory, texts written in a second language (L2) are usually of lower quality than texts written in the first language (L1) by the same writer. However, no method is currently available for quantifying the quality difference between L1 and L2 texts. In the present study, we tested a rating procedure for enabling quality judgments of L1 and L2 texts on a single scale. Two main features define this procedure: 1) raters are bilingual or near native users of both the L1 and L2; 2) ratings are performed with L1 and L2 benchmark texts. Direct comparisons of observed L1 and L2 scores are only warranted if the ratings with L1 and L2 benchmarks are parallel tests and if the ratings are reliable. Results showed that both conditions are met. Effect sizes ( Cohen’s d) indicate that, while score variances are large…

Positive, negative, and bipolar questions: The effect of question polarity on ratings of text readability

Naomi Kamoen, Bregje Holleman, Huub van den Bergh +1 more

Sociology and Political Science · DOAJ (DOAJ: Directory of Open Access Journals) · · cited 33× · DOI ↗ · more like this ·

For decades, survey researchers have known that respondents give different answers to attitude questions worded positively (X is good. Agree-Disagree), negatively (X is bad. Agree-Disagree) or on a bipolar scale (X is bad-good). This makes survey answers hard to interpret, especially since findings on exactly how the answers are affected are conflicting. In the current paper, we present twelve studies in which the effect of question polarity was measured for a set of thirteen contrastive adjectives. In each study, the same adjectives were used so the generalizability of wording effects across studies could be examined for each word pair. Results show that for five of the word pairs an effect of question wording can be generalized. The direction of these effects are largely consistent: respondents generally give the same answers to positive and bipolar questions, but they are more likely…

T-Scan: a new tool for analyzing Dutch text

Henk Pander Maat, Rogier Kraf, Antal van den Bosch +5 more

Artificial Intelligence · Computational Linguistics in the Netherlands · · cited 27× · OpenAlex ↗ · more like this ·

T-Scan is a new tool for analyzing Dutch text. It aims at extracting text features that are theoretically interesting, in that they relate to genre and text complexity, as well as practically interesting, in that they enable users and text producers to make text-specic diagnoses. T-Scan derives it features from tools such as Frog and Alpino, and resources such as SoNaR, SUBTLEX-NL and Referentie Bestand Nederlands. This paper oers a qualitative discussion of a number of T-Scan features, based on a minimal demonstration corpus of six texts, three of them scientic articles and three of them drawn from a women’s magazine. We discuss features concerning lexical complexity, sentence complexity, referential cohesion and lexical diversity, lexical semantics and personal style. For all these domains we examine the construct validity as well as the reliability of a number of important features.…

Differences in Process and Process-Product Relations in L2 Writing

Daphne van Weijen, Huub van den Bergh, Gert Rijlaarsdam +1 more

Education · ITL Review of Applied Linguistics · · cited 23× · DOI ↗ · more like this ·

Abstract This study examines whether writers vary how they write under influence of the changing task situation when writing in a second language (L2) and, if so, whether differences in the way they write are related to variations in text quality. Twenty first year students wrote four texts each in their L2 (English) under think-aloud conditions. The analysis focused on four cognitive activities: Reading the assignment and sources, Planning, Generating ideas and Formulating. Results indicate that, on average, the occurrence of each activity varies during the writing process. In addition, writers differ in the extent that they vary their process execution (i.e., the way they apply different activities) while writing. These differences, however, depend on the moment in the writing process, and on the activity being carried out. In general, writers’ behaviour is rather stable between…

Children’s information retrieval: beyond examining search strategies and interfaces

Hanna Jochmann-Mannak, Theo Huibers, Ted Sanders

Information Systems · Electronic workshops in computing · · cited 22× · DOI ↗ · more like this ·

The study of children’s information retrieval is still for the greater part untouched territory. Meanwhile, children can become lost in the digital information world, because they are confronted with search interfaces, both designed by and for adults. Most current research on children’s information retrieval focuses on examining children’s search performance on existing search interfaces to determine what kind of interfaces are suitable for children’s search behaviour. However, to discover the true nature of children’s search behaviour, we state that research has to go beyond examining search strategies used with existing search interfaces by examining children’s cognitive processes during information-seeking. A paradigm of children’s information retrieval should provide an overview of all the components beyond search interfaces and search strategies that are part of children’s…

Categories of coherence relations in discourse annotation

Merel Scholman, Jacqueline Evers-Vermeul, Ted Sanders

Artificial Intelligence · Dialogue & Discourse · · cited 20× · DOI ↗ · more like this ·

Over the last decennia, annotating discourse coherence relations has gained increasing interest of the linguistics research community. Because of the complexity of coherence relations, there is no agreement on an annotation standard. Current annotation methods often lack a systematic order of coherence relations. In this article, we investigate the usability of the cognitive approach to coherence relations, developed by Sanders et al. (1992, 1993), for discourse annotation. The theory proposes a taxonomy of coherence relations in terms of four cognitive primitives. In this paper, we first develop a systematic, step-wise annotation process. The reliability of this annotation scheme is then tested in an annotation experiment with non-trained, non-expert annotators. An implicit and explicit version of the annotation instruction was created to determine whether the type of instruction…

A Cross-Linguistic Perspective on the Acquisition of Causal Connectives and Relations

Sandrine Zufferey, Willem M. Mak, Ted Sanders

Artificial Intelligence · International Review of Pragmatics · · cited 20× · DOI ↗ · more like this ·

Causality is one of the most frequent coherence relations linking sentences together within texts and discourses, and mastering them is an essential part of acquiring a language. In this paper, we investigate the way French- and Dutch-speaking children acquire these relations depending on the way they are encoded in their mother tongue. From a cross-linguistic perspective, important differences exist in the communication of causal relations. While in some languages like Dutch, objective relations linking causes with consequences and subjective relations linking claims and conclusions are prototypically conveyed by a specific connective, in others like English and spoken French, a single connective is used in both cases. In this paper, we study the impact of these cross-linguistic differences for children’s ability to understand causal relations in a text. Our results indicate that…

The linguistic marking of coherence relations

Jet Hoek, Sandrine Zufferey, Jacqueline Evers-Vermeul +1 more

Artificial Intelligence · Pragmatics & Cognition · · cited 17× · DOI ↗ · more like this ·

Abstract Connectives and cue phrases are the most prototypical linguistic elements that signal coherence relations, but by limiting our attention to connectives, we are likely missing out on important other cues readers and listeners use when establishing coherence relations. However, defining the role of other types of linguistic elements in the signaling of coherence relations is not straightforward, and it is also not obvious why and how non-connective elements function as signals for coherence relations. In this paper, we aim to develop a systematic way of categorizing segment-internal elements as signals of coherence relations on the basis of a literature review and evidence from parallel corpora. We propose a three-way distinction between division of labor, agreement , and general collocation to categorize the different ways in which elements inside discourse segments interact…

The Role of Expectedness in the Implicitation and Explicitation of Discourse Relations

Jet Hoek, Jacqueline Evers-Vermeul, Ted Sanders

Artificial Intelligence · Data Archiving and Networked Services (DANS) · · cited 16× · DOI ↗ · more like this ·

Translation of discourse connectives varies more in human translations than in machine translations. Building on Murray's (1997) continuity hypothesis and Sanders' (2005) causality-by-default hypothesis we investigate whether expectedness influences the degree of implicitation and explicitation of discourse relations. We manually analyze how source text connectives are translated, and where connectives in target texts come from. We establish whether relations are explicitly signaled in the other language as well, or whether they have to be reconstructed by inference. We demonstrate that the amount of implicitation and explicitation of connectives in translation is influenced by the expectedness of the relation a connective signals. In addition, we show that the types of connectives most often added in translation are also the ones most often deleted.

Identifying Writing Strategies Through Text Analysis

Carel van Wijk, Ted Sanders

Education · Written Communication · · cited 16× · DOI ↗ · more like this ·

A structural analysis of an explanatory text written by a 12-year-old pupil is discussed to demonstrate how the PISA technique (the Procedures for Incremental Structural Analysis; Sanders & Van Wijk, 1996a) may contribute to the understanding of conceptual processes in writing. First, the validity of PISA is supported by showing that the hierarchical text structure corresponds with the (idiosyncratic) punctuation conventions of the writer. Then, it is explained how the writer's strategies and procedures can be reconstructed from the text structure. Evidence for the validity of these inferred cognitive plans is obtained from the distribution within the text of spelling errors, language errors, and self-corrections. Finally, the generalizability of these results is discussed together with the desirability of combining this off-line method with on-line techniques such as pause…

Empirical validations of multilingual annotation schemes for discourse relations

Sandrine Zufferey, Liesbeth Degand, Andréi Popescu-Belis +1 more

Artificial Intelligence · Bern Open Repository and Information System (University of Bern) · · cited 13× · OpenAlex ↗ · more like this ·

This paper discusses the empirical validation of annotation schemes proposed for discourse relations, when signaled explicitly by discourse connectives, through their application to texts in several languages. Considering a monolingual annotation scheme as a starting point, the paper explains the reasons for either specifying or generalizing some labels, illustrating them with a review of experiments in translation spotting of connectives. Then, an experiment with the PDTB scheme applied to five languages (EN, FR, DE, NL, and IT) shows how specification and generalization are put to work in order to build a scheme which has an improved empirical validity for several languages.

Three types of children’s informational web sites: an inventory of design conventions

Hanna Jochmann-Mannak, Leo Lentz, Theo Huibers +1 more

Human-Computer Interaction · University of Twente Research Information · · cited 11× · OpenAlex ↗ · more like this ·

Purpose: Research on Web design conventions has an almost exclusive focus on Web design for adults. There is far less knowledge about Web design for children. For the first time, an overview is presented of the current design conventions for children's informational Web sites.<br/><br/>Method: In this study a large corpus of 100 children's international, informational Web sites from four different domains (science, pets, arts, and health) is analyzed. The instrument for analyzing the Web sites included categories on visual design, navigation and information architecture.<br/><br/>Results: The design conventions identified in this study show that designers of children's informational Web sites often follow general Web design guidelines. This study also shows that there is still much confusion about how to design Web sites for children. A closer look at the data revealed three categories…

Constructing a Lexicon of Dutch Discourse Connectives

Peter Bourgonje, Jet Hoek, Jacqueline Evers-Vermeul +3 more

Artificial Intelligence · University of Groningen research database (University of Groningen / Centre for Information Technology) · · cited 10× · OpenAlex ↗ · more like this ·

We present a lexicon of Dutch Discourse Connectives (DisCoDict). Its content was obtained using a two-step process, in which we first exploited a parallel corpus and a German seed lexicon, and then manually evaluated the candidate entries against existing connective resources for Dutch, using these resources to complete our lexicon. We compared connective definitions in the research traditions of the two languages and accommodated the differences in our final lexicon. The DisCoDict lexicon is made publicly available, both human- and machine-readable, and targeted at practical use cases in the domain of automatic discourse parsing. It also supports manual investigations of discourse structure and its lexical signals.

Incremental discourse processing

Willem M. Mak, Ted Sanders

Artificial Intelligence · Linguistik aktuell · · cited 10× · DOI ↗ · more like this ·

The importance of the discourse level for the study of language and linguistics can hardly be overestimated. The study of text and discourse has become an increasingly important area over the last decades, both in linguistics and in psychology. In this paper we report on experiments which add to our understanding of a crucial process in discourse interpretation: the way in which the integration of clauses takes place. It shows that the position at which the integration takes place depends on the particular coherence relation that holds between sentences. The results once again emphasize the special status of causal relations in discourse processing and representation.