What corpus analytics has to offer (women’s ) history
Last week I gave my first talk based on doing history with
digital tools methods at the wonderful conference Women’s History in a Digital World. Emboldened by Laura Mandell’s kind query
about whether I planned to publish these initial results, I’m going to offer a
preliminary report. If you want to know
how I got here, the journey is blogged. However I would be remiss if I started
this account without thanking two people, people Heather Froelich and Whitney
Esson as well as the many digital historians and humanists mostly on twitter
who helped me along the way.
During my sabbatical in 2011-2012 I began working on a book,
The Politics of Women’s Culture. I’ve been
working, in one fashion or the other, on the issue of women’s culture since the
early 1990s. As I worked on my book, which I describe as an intellectual
history of the concept of women’s culture, I revisited the issue of the origins
of this particular phrase. Of course 20
years ago I answered it using the tools methods had, hand searching printed matter, but I began
wondering what digital means might be available to aid in a wider search.
Months latter, and many tools methods tried and discarded, I’d
embarked on a far more involved project that addressed historiographical
questions using digital history tools methods.
In particular I worked with AntConc, thus far on the full run of Chrysalis a magazine of women’s culture
(1978-1981) and date matched issues of Off Our Backs (OOB), a nationally circulated
women’s liberation newspaper. My main
goal was to determine if the widely cited interpretations of the women’s
movement from the late 1980s, that something called cultural feminism derailed
the women’s movement, could be validated digitally.[1]
According to historian Alice Echols in Daring to be Bad “cultural feminism
insisted on women’s essential sameness to each other” “vilified” male “values” and
“valorized” female bonding (244) and “evaded” rather than ‘engaged”
patriarchy.”(1) The year before, Linda Alcoff argued cultural feminism “is an
ideology of a female nature or a female essence used to “revalidate undervalued
female attributes.” Both Alcoff and
Echols are widely cited in both women’s history and women’s/gender studies despite
the fact that their conclusions have been challenged by a wide range of
scholars.
I chose these two
periodicals for pragmatic as well as illustrative reasons. JSTOR contained digitized copies of OOB. Ideologically, scholars identify OOB
identified as emblematic of radical feminism. Echols cites OOB as the location
of the first published critique of cultural feminism. Chrysalis, which my wonderful graduate
student assistant Whitney Esson digitized for me by scanning and converting
using adobe (but not cleaning yet), was chosen to represent women’s liberation
activists with an interest in culture.
In Women's Periodicals in the United States: Social and Political Issues, Kathleen N Endres describes As Off Our Backs "
the best-known newspaper of the 'radical feminist' " family while Sammaye
Johnson positions Chrysalis a magazine
of women’s culture conceived of by Rennie and Grinstead as a “new
national feminist magazine” (58). Endres quotes Grinstead and Rennie’s
criticism that OOB had left
behind radical feminist movement to focus on intra-movement schisms from a
“predominantly male left perspective” (269).
Enter twitter, which allowed me to dive head first into the
digital humanities and it that entails.
I was guided to a tool AntCOnc and a field corpus analytics as well as a
methodology, Critical discourse analysis, defined
by Van Dijk as "the way social power abuse, dominance, and
inequality are enacted, reproduced, and resisted by text and talk in the social
and political context."
I then began to reconceive my query about the validity of
interpretations into a more complex question, could I take an established way to look at discourse in linguistics
and apply it to the women’s movement? Could
I find a grammar of women’s liberation by figuring out if various activists were
even speaking the same language? Are
there/what are similarities & differences in discourses of OOB &
Chrysalis.[2]
AntConc allows
me to parse frequency out from collocates, word that are likely to appear together (with likelihood measured against in greater
than random chance and together being measured by various parameters in my case
words adjacent to one another), and clusters, words that do appear together in the
corpus. It also provides a concordance
view which allows for close readings, as well as a measure called keyness that allows
the comparison of words in one corpus to another, in this case measuring OOB
against Chrysalis and vice versa.
If we follow just the word “culture” through
the OOB & Chrysalis, first
see that in terms of word frequency, neither word particular frequent in either
corpus. As expected form the subtitle of
Chrysalis, appeared at higher frequency (356thv 463rd in
OOB). Of the top 10 clusters for culture in both
periodicals, 50% are the same, and that rises to a 60% overlap for collocates. Of the twenty-seven most
frequent lexical words that appear in both periodicals, 50% are common.
But is 50% or 60% enough to say speaking the same language in both periodicals? The differences are suggestive. For example, the collocates from Chrysalis that do not appear in OOB include “women” and “our,” reflecting the focus on women’s culture, as well as “dominant” perhaps suggesting that women’s culture is defined in opposition to the dominant (male) culture. Less easily explained are the collocates in OOB (that, which, to, as). Clusters reveal some fascinating divergences as well. For example “feminist culture” appears in the top 10 of OOB while “female culture” appears on list from Chrysalis. Conversely, “Male culture” appears in OOB results while “dominant culture” (recall the collocates) is featured in Chrysalis.
But is 50% or 60% enough to say speaking the same language in both periodicals? The differences are suggestive. For example, the collocates from Chrysalis that do not appear in OOB include “women” and “our,” reflecting the focus on women’s culture, as well as “dominant” perhaps suggesting that women’s culture is defined in opposition to the dominant (male) culture. Less easily explained are the collocates in OOB (that, which, to, as). Clusters reveal some fascinating divergences as well. For example “feminist culture” appears in the top 10 of OOB while “female culture” appears on list from Chrysalis. Conversely, “Male culture” appears in OOB results while “dominant culture” (recall the collocates) is featured in Chrysalis.
What about how culture is used as revealed by concordances?
Both periodicals show “s” as a common collocate/cluster for culture, because
the digitization process renders women’s as three separate “women” ‘ ‘”
“s”. Using the concordance view for
those results allows for a closer analysis of the occurrences. The cluster appears 53 times in Chrysalis. 32% pertain
to the title of the magazine itself.[3]
The cluster appears 54 times in OOB, roughly the same as in Chrysalis, which is half the size of the
OOB corpus. However closer analysis reveals that while in Chrysalis “‘s culture”
always correlated with women’s culture, in OOB,
that is not the case.[4]
In the 40 instances of “women’s culture,” two announce Chrysalis itself.[5]
OOB n= 38
|
Chrysalis n=53
|
Difference
|
|
Letters
|
5%
|
11%
|
6%
|
Editorials
|
7.8%
|
17%
|
9%
|
Advertisements
|
15%
|
3.7%
|
12%
|
Reports on women’s movement
|
18%
|
||
Substantive articles
|
20%
|
Looking at the similarities first, in term of
reports on the women’s movement, the mainstay of OOB as a newspaper as compared
to the longer articles in Chrysalis, the two periodicals look relatively similar
in terms of discussion of women’s culture, until close reading reveals that in
OOB the occurrences all derive from reports on the 30th anniversary
conference of the Second Sex.
The divergence in letters to the editor and
editorial content, over double in Chrysalis as opposed to OOB maybe accounted
for due to the content of Chrysalis and the usage of “women’s culture” as a
descriptor of the content. Advertising
however is the most divergent, more prevalent in OOB by a factor of three. While
historians may view the periodicals as representing different ideological
perspectives on culture, it appears vendors voted with their dollars to reach
potential customers for products they described using “women’s culture” in a OOB periodical that historians have
considered hostile to the idea?
next up, looking at keyness, and contemplating other "words"
[1] Using quantitative methods to overturn prevailing beliefs in women’s history also
done by Newman and Block “Among many other findings, we argue against two popular beliefs about women’s history: that women’s historians are overly-focused on recent history and that women’s and gender history is an ever increasing proportion of the profession.” JWH 2011 spring
(1) Echols has warned against the overly rigid application of her thesis, but to little avail in Shaky ground: the sixties and its aftershocks (69).
[2] In a sense I’m comparing apples and oranges. While date matched, OOB consists of far more
individual items because it was a newspaper rather than a magazine. The size in terms of word count also varied
dramatically with OOB almost twice as large as Chrysalis (1525881 v 734,479
words).
date matched Oct 1978 to April 1980
[3] Another 11% come from letters to the editor from readers. Another two occurrences are in advertisements
3.7%. Articles account for about 20% the times women’s culture is used, with
17% (9) coming from editorial content.
[4] “womyn’s culture” occurs 4x, one’s culture5x, people’s culture
3x and “woman’s culture” 1, “man’s culture”
[5] Of the remaining 38 items, the highest number, seven (18%),
occur in reports about the women’s movement, from a single issue that covered
the 30th anniversary of the Second Sex conference. 15% (n=6) occurred in advertisements, 7.8% editorial,
5% letters from readers.
via twitter @heatherfro
ReplyDelete@ProfessMoravec also, just keeping up with your latest blog post - 50% is a very high threshold!
via twitter @DYKEaQuarterly
ReplyDelete@ProfessMoravec I knew that ads would yield most interesting digital history results. In which culture=circulation of products +events.
via twitter @RachelCleves
ReplyDelete@ProfessMoravec blog & project really provocative - a lot to process all at once as reader, but definitely intriguing
via twitter in repsonse to
ReplyDeletehow similar does the content of periodicals need to be for them to be said to be speaking same? 50% enough?
Mary-Helen Ward @witty_knitter
@ProfessMoravec In qual work this kind of figure doesn't matter. This is why methodologies do - they explain decisions made.
Via twtitter Mary-Helen Ward @witty_knitter So what are your methodologies? Internet Inquiry (Markham & Baym 2009) is useful for method/Methodology issues
ReplyDeletealso, tools isn't phallocentric; it describes what you're using! :) and it's not the same as methodologies. Can't replace!
...those decisions have to be described and interrogated. ...