Wednesday, August 12, 2026 Strategy, technology, media, and social systems

I Think

Sorin Adam Matei

Analysis, research, maps, and essays from Sorin Adam Matei.

Why so Similar? Identifying Semantic Organizing Processes in Large Textual Corpora by Drew Margolin, Yu-Ru Lin, David Lazer :: SSRN

N-Gram Recordings Desktop Wallpaper
N-Gram Recordings Desktop Wallpaper (Photo credit: endless lazlo)

An interesting paper on social network of interaction in raw texts… Luo Si might be intrigued by this…

This paper introduces the concept of semantic organizing processes as a means of inferring theoretically meaningful behavior from the observation of raw text. Semantic organizing processes are mechanisms by which a set of authors come to produce texts that are similar in some observable, quantifiable way. We introduce three broad semantic organizing processes — authors sharing subject matter, authors sharing goals, and authors sharing sources — and argue that each of these processes will lead to texts that tend to share n-grams at different lengths: short n-grams for shared subject matter, moderate length n-grams for shared goals, and long n-grams for shared sources. To test these hypotheses, we develop a novel n-gram extraction technique to capture text similarity based on n-grams of different lengths. We then apply our technique to a corpus where the author attributes are observable: the public statements of the Members of the U.S. Congress. Our results support the hypothesis that these three processes are reflected in distinct kinds of textual similarity. This article presents the first empirical finding that different social processes are detectable through the structure of overlapping textual features. The finding has important implications for modeling text and understanding underlying social processes.

via Why so Similar?: Identifying Semantic Organizing Processes in Large Textual Corpora by Drew Margolin, Yu-Ru Lin, David Lazer :: SSRN.

Join the discussion

Your email address will not be published. Required fields are marked *