Class Blog 1

Topic Modeling

~ Annie Swafford

Topics from 50 topics and 1000 iterations-

1) Money-money business hundred men asked company american pounds answered worth thousand red gold paid city pay headed answer fifty price

2) Murder– found dead man death crime body evidence terrible unfortunate attempt violence words occurred instantly action save murderer committed escape murdered

3) Sherlock’s study– table papers small box examined study showed left carefully marks signs examination wood books round carpet mark traces fire examine

4) Women- woman wife lady husband love married child girl life mother loved daughter maid beautiful ferguson mrs mistress ways character women

Topics from 25 topics 2500 iterations-

5) Crime– man police found inspector dead crime death body evidence reason murder blood night shot person

6) Letter/message-paper table hand papers note read letter pocket box book put letters drew short handed

7) Sherlock-holmes hand chair sat back looked fire air sherlock visitor pipe rose laid pray companion

Topics from 50 topics and 2000 iterations-

8) Journey/travelling-place train station carriage found town return started long line reached drove cross miles journey

9) Appearance-face eyes man dark tall looked features expression thin lips pale mouth figure companion appearance

10) Case-case interest points curious remarkable fact attention singular account investigation matter clue events incident problem

Sherlock Holmes Topic Modeling – 10 topics

~ Annie Swafford

Topics 1-4: number of topics: 25, iterations: 2000, topic words printed: 20, removed stop words

1. CRIME: police man inspector lestrade colonel crime death reason evidence murder mystery affair case present remained criminal force arrest account undoubtedly
2. DEATH:  found end lay dead hand part body long deep lost close blood finally carried showed attention broken shot leaving horror
3. FAMILY: woman wife time father heard husband met save home family understand years day love life sister married mother ago returned
4. MESSAGES/NOTES: paper note read letter word book letters importance handed short written wrote address writing message men find answer write held

Topics 5-7: number of topics: 30, iterations: 1500, topic words printed: 20, removed stop words

5. CHARACTERISTICS (of a person): face eyes man red black white dark looked thin features hair lips tall appearance blue drawn expression pale heavy hat
6. LOVE: woman life knew husband things told wife heart girl poor lady love speak story child mine met began truth loved
7. HOUSE/HOME: room door open window opened entered bed sitting table key bedroom closed sound passage bell corner rushed floor pushed inside
Topics 8-10: number of topics: 20, iterations: 2500, topic words printed: 20, removed stop words
8. TRAVELING: road half back colonel hall found house great carriage dog horse drive town boy drove excellent country king high miles
9. EVIDENCE: paper police note found read made papers attention box letter book save examined brought handed finally crime written small run
10. TIME: night morning day hour doctor work clock station train back rooms morrow past return waiting late returned told evening quarter

Topic Modeling

~ Annie Swafford

100 Topics, 5000 iteration

1. Travel

train station carriage reached line journey cross bridge hurried passing started save ready town body class roof forty ticket charing

2. Writing

paper note letter read handed wrote written writing sheet write book post page began pen pencil slip ran printed torn

70 Topics, 1000 iteration

3. Facial Expression

face eyes looked turned features figure expression raised pale drawn lips mouth milverton grey fixed eager glance angry chin brow

4. Observing Details

examined left side floor round brought showed carefully small examination large wood marks traces lying wooden iron ground fire lower

5. Time

hour half past clock time cab ten waiting quarter work wait late minutes back drive catch eleven immediately presently church

6. Murder

found dead man body blood blow struck knife lay stick head weapon finally wound unfortunate bullet handle lying acted fainted

7. Wealth

house long master servants family butler maid musgrave brunton leading retired county charles missing ritual elderly shadow aroused personal century

70 Topics, 2000 iteration

8. Crime

crime account occurred reason murder true tragedy explanation fact incident murderer committed person disappearance criminal absolute remain probable murdered scene

9.  Country

house front large windows garden standing high houses walk building spot sun small lane round grounds scene evidently lined trees

10. Case

case points point investigation facts find theory solution explanation follow connection fact admit obvious main interest extraordinary problem disappearance theories

Topic Modeling: Sherlock Holmes Topics

~ Annie Swafford
1. Fatherly Advice to Son (20 topics, 2000 iterations)man make young time give life put miss understand thing hands told father words thought business heard money poor son
2. Facial Features (50 topics,3000 iterations)eyes face looked thin features lips dark tall figure set expression pale manner turned raised step companion glance drawn gray cold angry fixed astonishment handsome nose eager cheeks chin alert sharp bearing fierce emotion gleam spoke sprang brows advanced eyebrows colour pleasant shone gaunt brow glanced haggard flushed massive blue
3. Murder (30 topics, 2000 iterations)

found dead body death crime left murder police close attention finally struck blood part blow remained knife examination stick tragedy
4. Writing (40 topics, 5000 iterations)

paper table note letter read papers book letters box handed happened wrote written address write
5.
  House Decor (50 topics,3000 iterations)house front large round side led window left garden windows small low standing lawn close houses lane high centre building huge gate iron wooden grounds narrow park trees chamber elderly lined walls doors upper ancient rain oak fashioned leads avenue appeared winding entrance century barred modern evidently brick surrounded plainly
6. Urgency (30 topics, 3000 iterations)instant heard suddenly open sprang back silence round sound cry rushed moment door forward horrible ran arms sudden dreadful sharp waited stepped slipped feet heels threw sight fell struck throat minute figure terror deadly brandy pain dashed scream appeared mouth breath ears wide horror surprise clad gentle broke joy twisted
7. Time (50 Topics,2000 iterations)morning street half day work hour gave left fellow lestrade answered mind clock station train minutes short past
8. Crime Scene (20 topics,1000 iterations)man night found inspector men dead colonel death crime london great person body reason called brought order evidence ten question
9. John Watson (50 topics,2000 iterations)watson case matter friend sherlock doubt dear interest remember facts remarkable client singular remarked fact present curious points absolutely cases
10.  Women (40 topics, 5000 iterations)

lady wife woman miss maid husband child easy mrs girl words beautiful young left daughter

Topic Modeling Sherlock Holmes Stories

~ Annie Swafford

All categories chosen from 50 topics with 1000 iterations:

1. morning night back clock waiting past early morrow quarter arrived
Title: time

2. paper note read letter table book handed letters written wrote
Title: writing

3. face eyes looked thin features lips figure tall dark expression
Title: physical features

4. woman lady wife husband life love girl child married maid
Title: household

5. black hair red hat heavy round broad centre coat dress
Title: clothing/accessories descriptions

6. found man dead lay body blood death knife lying round
Title: death/crime

7. give matter idea reason question impossible occurred absolutely explanation true
Title: interrogation/crime solving

8. face turned back instant hand sprang forward moment side head
Title: physical reactions

9. station train road carriage passed side drive reached drove hour
Title: transportation

10. light suddenly dark long caught sat lamp spoke silence silent
Title: darkness/mystery

Topic Modeling

~ Annie Swafford

A majority of the topic models that I had been able to decode were ones found within the 100 topic range and only a few within the 50 topic range. If I had used more than around 20 words, the topics would become too broad. All iterations were around 2,000 iterations. I happen to find one of a rather interesting and almost humorous topic.

100 Topics/20 words:

Room (100 Topics): small floor side left square wood carpet lower piece furnished hand cut chamber match central edge examining hole fashioned evidently
Clothing (100 Topics): black broad coat dress eye von red heavy brown dressed looked bork double hat yellow centre shining wore cap weary
Sailing (100 Topics): wind ship long sea peter east boat captain skin carey rising box time beginning distance board rain seaman securities initials
Actions from a chair (100 Topics): chair holmes back sit pray companion laid amazement arm laughed visitor stared leaned speaking rose seated seat conceal called heartily
Pistol (100 Topics): hand pocket held drew long table opened glass laid revolver crossed noticed bottle pistol drawer sleeve laying wing nerves pressed
Horses (100 Topics): horse colonel straker moor night bicycle boy stables stable john lad stranger miles ross trainer simpson silver horses led maid
Facial Appearance (100 topics): face eyes hair white cut pale appearance entered staring colour clean cheeks blue faced middle shoulders making shaven strength forehead

50 Topics/20 words

Train (50 Topics): train london station end late line close west reached points clue hour suppose imagine investigation give affair bridge roof examine

Murder (50 topics): found dead body head struck lay drawn blood hand finally blow knife deep stick lying round terrible fell unfortunate master
Message (50 Topics): paper note read pocket book held handed written writing wrote hand drew reading sheet put post attention picked slip finger

Topic Modelling

~ Annie Swafford

50 topics 

Feminine

5. lady young woman wife maid child girl left beautiful ill give ferguson making mistress notice devoted possibly nurse poor frances

75 Topics

Sherlock’s Mannerisms

61. holmes chair sat fire pipe back asked arm rose glanced

Decor

67. light dark side lamp low match floor wall darkness held

100 Topics

Detective

40. london criminal learned dangerous attempt career order begin failed prepared chance due care fair succeeded

Travel

44. train station carriage line reached journey bridge hurried drove roof observed body opposite walk town

Murder

62. body lay blood shot found revolver blow dead head knife drawn fell weapon stick picked

Door

81. door room opened key safe locked side inside closed lock open shut fastened conscious doors

Assistant

88. watson dear surely fellow complete touch dangerous hope meet read draw report final form sufficient

500 Words

Setting

40. front house high drive road trees standing park windows place miles building sun trap drove

Furniture

178. bed bell rope end ventilator cord mantelpiece hung observe chair pull inches ring dummy fastened

Topic Modeling

~ Annie Swafford

3 topics from 50: (2000 iterations)

Death:

night poor happened death met terrible father heard mother dead creature sister died wild dreadful

Murder:

hand body found round blood dead head lay close shot revolver moment blow fell carried

Law:

police case inspector found law hands force evidence official arrest charge quietly court arrested constable

3 Topics from 80: (1000 iterations)

Relationship:

wife woman husband life left love knew child married heart made give lived loved happy

Time:

morning night hour work clock train past half time station late early breakfast morrow quarter

Finance:

set money business hundred week ten work began company earth position pay pounds thousand paid

4 Topics from 45: (1000 iterations)

Message:

word short letters words means make message single listened earth men expected true american game

Note:

paper note read hand book letter handed pocket written wrote writing put attention drew reading

Family:

father young wife son girl family returned boy child married mother poor died lived daughter

Expressions:

eyes face looked dark thin figure features tall voice lips expression pale turned spoke drawn

Google Ngram

~ Annie Swafford

The first graph I created on Google Ngram compared the use of the words ‘war’ and ‘peace’ during the years 1800 to 2000.  The most obvious pattern I noticed was how the use of the word ‘war’ spiked up during both world wars, as well as the word ‘peace’.  This shows just how much our literature reflects what is currently going on in our society.  As human beings we feel the need to record what is happening in the world and instill it into our literature.

The first spike in the use of the word ‘war’ is around 1804 which makes sense because the Russo-Persian and Napoleonic wars were taking place during this war.  The next spike occurs during the War of 1812 and then regulates until World War I.  The World War II era had a larger spike than the first world war.  This is most likely due to the fact that there were more countries involved, as well as more deaths, and more media involvement.  New technologies made it easier for news to be published and printed.  None of the spikes in use even come close to the spike of the World War II era.  The 1960s era spike was from the Vietnam and Cold War.  The graph regulates until around 2001 when the word ‘war’ would have been used more after 9/11.

It is important to note that ‘peace’ never exceeded the use of ‘war’.  While it’s use increases during the world wars, the space in-between the two is farthest at these moments.

war and peace

The next graph compared the use of ‘men’ and ‘women’.  Of course, ‘men’ was used much more often than ‘women’ during the 1800s and most of the 1900s.  Women were never seen as equal to men and the use of these two words in literature illustrates that idea.  The second wave of feminism is what caused the spike of the word ‘women’ in the 1990s, the only time ‘men’ is below ‘women’.  ‘Men’ and ‘women’ are only used equally in the 1980s and early 2000s.  There were no specific events that I could think of that would cause this.  It is possible that the feminist movements of the 1980s created a generation of feminist-minded children that then turned into feminist-minded adults in the early 2000s.  I thought it was interesting how ‘women’ started to go back down after this.  Just as we reached equality, the separation reoccurred.

men, women

Ngram’ing Information

~ Annie Swafford

The first two terms I looked up Google Ngram Viewer were “literature” and “film”. I thought this would provide interesting results, due to the ever present debate on films verses literature, and I was right.

woahinformation

Both terms are getting increasingly popular, and what I find most interesting is that even though “literature” (thankfully) came out on top, “film” is almost at the same number, and it got there in a very short time-spam. In this digital age, it is good to know  that literature is still more popular, at least according to Ngram. While literature has been around a lot longer than film has, it is interesting to see how it still has a positive, increasing slope. Even though according to the graph, there were “dips” in popularity, literature still has sustained increase. Whereas film has gone nowhere but up, but of course that is to be expected. Ever since mainstream films, or movies, popularity has only gone up. Everyone has a favorite movie, not everyone has a favorite book. I suspect that in the next few years, film will surpass literature on this graph, maybe it already has, as Google Ngram data isn’t currently up to date.

SWORDPENGRAPHWOW

For my second comparison, I used the old saying “The pen is mightier than the sword”. In this case, the pen IS mightier than the sword, but the sword was mightier than the pen for a really long time. This graph kept surprising me. The first time was when I realized how popular both sayings were at first, then to see the shrinking popularity of the terms over time. Then of course at the end I was shocked to see that pen did indeed win in the end. Swords were the weapon of choice before guns were widely used, so of course in the writings of that time, people used swords. Also a big part of early literature was the detective novel, where a pen might be used. Often in a book or work of writing, someone would be writing, for it is a common thing, so that’s where the word pen might be used. Nowadays, the fantasy and science fiction novels that are on the market are moving away from the past, and into the future. In those scenarios the characters wouldn’t use swords, but a gun of some sort, leading to the falling popularity. In other types of novels, modern day technology is seeping into books, so where a character would usually write something down with a pen, they might type it, leading to the falling popularity of that word as well.