Topic Modeling Analysis and Word Cloud

Wordcloud

My topics for MALLET were really interesting, and I think that they say a lot about Sherlock Holmes as a whole. One of the first ones I came across was one that I entitled “Evidence.” This category had words like “Facts,clear, theory, possibly…” and many others. The importance of this category to the Sherlock Holmes stories cannot be understated. Obviously, to a detective, evidence is a pretty important thing. I found many other categories which one would expect to find in detective stories (e.g. Crime and Investigation) but some of the others were a little more interesting. Take for example a category I named “Manliness.” This category had words like “pipe, fire, smoke, tobacco, armchair, cigar” and “brandy.” Just from these words alone, one can get the image of a wax mustachioed man, sipping brandy and smoking a pipe by the fireside. While this is not exactly how anyone in the Sherlock Holmes’ stories is portrayed, it does have a certain feel that you get from these stories– an almost Rudyard Kipling type ambiance. Another big category i noticed, I named “Transportation.” In it were words like “train, station, carriage, cab, drive, waiting” and “journey.” I think that this category illustrates that transportation is a big part of the stories, and also shows that there is not just one was of getting around that the stories focuses on. Sherlock and Watson use train, automobile, walking, carriage, and almost any other type of transportation that you can imagine. They are always going somewhere. These were the most interesting and telling categories I discovered with the MALLET tool, and upping the number of words in the categories really did help with creating some more unique categories. Overall, I really enjoyed using MALLET, and look forward to using it in the future.

~Austin Carpentieri

Topic Modeling for Sherlock Holmes

First, I tried my assignment with the computer just sorting them into 10 word categories. These were some of the results.

1. TIME- time, find, turn, hours, knowledge, matters, remarked, present, afternoon, problem

2. MORNING- morning, surprise, breakfast, early, sat, seated, fire, energy, finished, bright

3. NOTES- paper, note, book, read, wrote, sheet, written, writing, write, handed

4. INVESTIGATION- case, points, facts, interest, investigation, remarked, explanation, follow, solution, theory

5. TRANSPORTATION- train, station, carriage, morning, started, found, cross, time, journey, catch

6. CLUES- examined, showed, examination, carefully, cut, marks, bed, top, full, traces

7. CRIME- crime, police, case, evidence, murder, arrest, charge, tragedy, violence, murderer

Next, I updated it to 20 words per category, and I upped the amount of categories to 100! These were some of the best categories I found.

1. EVIDENCE- facts obvious clear person theory impossible explanation question idea perfectly mind means confess formed affair absurd probable possibly evident correct

2. RUNNING- door room open passage ran steps rushed led empty stair stairs pushed corridor foot tore seized feeling vague furniture running

3. CRIME- crime death murder occurred showed evidence scene tragedy violence terrible reason committed murdered moran murderer suspicion attempt criminal motive inquest

4. INVESTIGATION- case interest remarked interesting problem investigation remarkable events solution difficult clue find methods prove points give reasoning follow simple connection

5. MANLINESS- sat pipe fire laid smoke tobacco blue corner lit armchair cigar hung silent gas brandy smoked smoking comfortable shining bachelor

6. LOCATIONS- window room open bedroom moment looked sitting fire threw floor lawn garden alarm moving curtain drawn fired energy forget powder

7. WRITING- paper read note book handed table sheet papers slip written importance post piece pen page pencil tossed picked desk printed

8. TIME- years ago time twenty thirty months age year week lives ship forty voyage exposed dozen bought tongue boat popular families

9. TIMES OF DAY- night morning early clock breakfast morrow surprise sleep signs rest disappeared day slept watch midnight fault trail hopes news clearing

10. TRANSPORTATION- train station carriage cab drive waiting journey drove town cross started line follow fresh bridge reach passing hansom class reached

 

~Austin Carpentieri

Topic Modeling

100 Topics, 5000 iteration

1. Travel

train station carriage reached line journey cross bridge hurried passing started save ready town body class roof forty ticket charing

2. Writing

paper note letter read handed wrote written writing sheet write book post page began pen pencil slip ran printed torn

70 Topics, 1000 iteration

3. Facial Expression

face eyes looked turned features figure expression raised pale drawn lips mouth milverton grey fixed eager glance angry chin brow

4. Observing Details

examined left side floor round brought showed carefully small examination large wood marks traces lying wooden iron ground fire lower

5. Time

hour half past clock time cab ten waiting quarter work wait late minutes back drive catch eleven immediately presently church

6. Murder

found dead man body blood blow struck knife lay stick head weapon finally wound unfortunate bullet handle lying acted fainted

7. Wealth

house long master servants family butler maid musgrave brunton leading retired county charles missing ritual elderly shadow aroused personal century

70 Topics, 2000 iteration

8. Crime

crime account occurred reason murder true tragedy explanation fact incident murderer committed person disappearance criminal absolute remain probable murdered scene

9.  Country

house front large windows garden standing high houses walk building spot sun small lane round grounds scene evidently lined trees

10. Case

case points point investigation facts find theory solution explanation follow connection fact admit obvious main interest extraordinary problem disappearance theories

Topic Modeling Sherlock Holmes Stories

All categories chosen from 50 topics with 1000 iterations:

1. morning night back clock waiting past early morrow quarter arrived
Title: time

2. paper note read letter table book handed letters written wrote
Title: writing

3. face eyes looked thin features lips figure tall dark expression
Title: physical features

4. woman lady wife husband life love girl child married maid
Title: household

5. black hair red hat heavy round broad centre coat dress
Title: clothing/accessories descriptions

6. found man dead lay body blood death knife lying round
Title: death/crime

7. give matter idea reason question impossible occurred absolutely explanation true
Title: interrogation/crime solving

8. face turned back instant hand sprang forward moment side head
Title: physical reactions

9. station train road carriage passed side drive reached drove hour
Title: transportation

10. light suddenly dark long caught sat lamp spoke silence silent
Title: darkness/mystery

Topic Modeling

A majority of the topic models that I had been able to decode were ones found within the 100 topic range and only a few within the 50 topic range. If I had used more than around 20 words, the topics would become too broad. All iterations were around 2,000 iterations. I happen to find one of a rather interesting and almost humorous topic.

100 Topics/20 words:

Room (100 Topics): small floor side left square wood carpet lower piece furnished hand cut chamber match central edge examining hole fashioned evidently
Clothing (100 Topics): black broad coat dress eye von red heavy brown dressed looked bork double hat yellow centre shining wore cap weary
Sailing (100 Topics): wind ship long sea peter east boat captain skin carey rising box time beginning distance board rain seaman securities initials
Actions from a chair (100 Topics): chair holmes back sit pray companion laid amazement arm laughed visitor stared leaned speaking rose seated seat conceal called heartily
Pistol (100 Topics): hand pocket held drew long table opened glass laid revolver crossed noticed bottle pistol drawer sleeve laying wing nerves pressed
Horses (100 Topics): horse colonel straker moor night bicycle boy stables stable john lad stranger miles ross trainer simpson silver horses led maid
Facial Appearance (100 topics): face eyes hair white cut pale appearance entered staring colour clean cheeks blue faced middle shoulders making shaven strength forehead

50 Topics/20 words

Train (50 Topics): train london station end late line close west reached points clue hour suppose imagine investigation give affair bridge roof examine

Murder (50 topics): found dead body head struck lay drawn blood hand finally blow knife deep stick lying round terrible fell unfortunate master
Message (50 Topics): paper note read pocket book held handed written writing wrote hand drew reading sheet put post attention picked slip finger

Topic Modeling

3 topics from 50: (2000 iterations)

Death:

night poor happened death met terrible father heard mother dead creature sister died wild dreadful

Murder:

hand body found round blood dead head lay close shot revolver moment blow fell carried

Law:

police case inspector found law hands force evidence official arrest charge quietly court arrested constable

3 Topics from 80: (1000 iterations)

Relationship:

wife woman husband life left love knew child married heart made give lived loved happy

Time:

morning night hour work clock train past half time station late early breakfast morrow quarter

Finance:

set money business hundred week ten work began company earth position pay pounds thousand paid

4 Topics from 45: (1000 iterations)

Message:

word short letters words means make message single listened earth men expected true american game

Note:

paper note read hand book letter handed pocket written wrote writing put attention drew reading

Family:

father young wife son girl family returned boy child married mother poor died lived daughter

Expressions:

eyes face looked dark thin figure features tall voice lips expression pale turned spoke drawn

Tracing Prussian History

I decided to try and Look for marginalia in Books concerning with Prussian history because I am Prussian  and am proud of my heritage. The first piece of marginalia that I found was in a book written in German about Friedrich The II and his rein in Prussia. Though written entirely in German the title is “Aussen und Gedanken, Friedrich von Preussen”, which translates to “Sayings and Thoughs of Friedrich of Prussia” by Frederick. From the marginalia we can see that the person who wrote it was reminding themselves that he was Friedrich The II, because in the title of the boo he is only referred to as Friedrich of Prussia.

IMG_4915

Another piece of marginalia was Fining the original call numbers written by a librarian.

IMG_4918 (“The Man and the Statesman; being the reflections and reminiscences of Otto prince von Bismarck” by Otto von Bismarck”)

There were also notes taken like in these Two books where the reader either took notes,  underlined words or phrases or possible blacked out a section so that they could use this later when writing or to make it easier to understand and make stronger connections while reading. In the image below from “Frederic the Great” by  Thomas Macaulay, the reader underlines words and phrases that have to do with why Prussian invasion of Austrian Selisia and also makes a few side notes on where to use this in their work.

IMG_4921

Finally, and most undeniably the coolest thing that I found was in a book  called “The House of Hohenzollern”  by Hodgetts,  where someone had paste sections from a newspaper of the inside cover and on the first binding page. In the Articles it talks about how during the end of world war one when the British and American troops were pushing the German boarders in farther they found the Crown of Frederic the Great and a 15 of his personal snuff boxes and it is dated Jan. 6 – 1946.IMG_4923 (1)

post by Josh Wendt