Caleb Smith- Topic Models

Top 10 topic models with specs of 50 topics, 2000 iterations, 20 number of topic words:

1)DETAILS: case points interest facts investigation follow remarked fact explanation clue simple observed theory mystery admit prove incident solution inquiry effect.

2)ASSETS/CURRENCY: business money asked work answered good hundred ten company red office week pounds pay thousand suggested fifty city paid bank.

3)WRITING: paper note read letter papers hand table book pocket put letters handed box written wrote writing sheet post drew write.

4)RELATIONS: wife woman husband girl love life child married mother months years heart daughter died ago ferguson secret boy mrs women.

5)LAW/GOVERNMENT: police inspector matter hands case yard law arrest scotland moment official charge found important missing court quietly reached arrested move.

6)CHARACTERISTICS/FEATURES:face eyes man looked features thin dark tall pale mouth lips figure raised manner appearance gray cut beard expression.

7)TRANSPORTATION: hour station train past minutes carriage waiting drive cab quarter time drove half late wait ten hurried started journey home.

8)DESCRIPTION/COLORS: black white hat hair red coat dress broad blue faced grey thick bird brown boots double colour pair yellow dressed.

9)MURDER/CRIME/CLUES: man dead found body lay blood shot son hand knife held revolver mccarthy dropped part pool weapon cunningham heavy wound.

10)TIMES OF DAY/TIME: morning day night evening days clock morrow mrs telegram early breakfast hours news received yesterday work back leave spent arrived.

Topic Modeling

100 topics, 1000 iterations

23. Crime: murder, evidence, criminal, death, crime, reason, arrest, murderer, committed, action, charge, night, murdered, motive, tragedy, violence, occurred, scene, victim, deed

100. Case solving: problem, remarked, mystery, case, events, solution, admit, simple, prove, interesting, correct, facts, connection, chain, doubt, cases, single, incidents, presented, art

32. Observation: black, red, white, side, blue, double, coat, nose, clean, hat, brown, dressed, grey, wore, yellow, sharp, observe, high, pair, centre

40. Economy: money, hundred, business, company, pounds, thousand, worth, price, sum, fifty, pay, answered, check, terms, bank, single, stock, pycroft, appointment, mawson

52. Body: face, turned, eyes, shoulders, mouth, lips, smile, milverton, felt, white, shrugged, companion, effort, sunk, chin, breath, thick, breast, lines, straight

64. Morning/Night: room, heard, early, bed, night, surprise, morning, dressed, sleep, arrived, breakfast, vanished, clock, slept, unpleasant, midnight, walk, whistle, found, occurred

98. Appearance: man, face, eyes, features, tall, dark, hair, thin, figure, appearance, looked, huge, handsome, beard, heavy, alert, gray, colour, expression, step

75. Passing of time: time, hour, night, work, clock, ten, quarter, late, past, twelve, passed, eleven, room, coming, services, waiting, criminals, complex, retired, eagerly

82. Written documents: paper, note, letter, read, message, wrote, word, sheet, letters, written, book, handed, picture, answer, writing, slip, copy, men, post, dancing

70. Setting: street, baker, waiting, evening, cab, rooms, afternoon, minutes, hansom, working, shortly, corner, ten, haven, emerged, returning, visited, crowd, pavement, cabman

Topic Modeling

The settings I have used were 100 topics, 5,000 iterations and 30 topic words.

Smoking- chair sat fire pipe rose glanced smoke arm tobacco visitor cigar lit asked laughed silence smoking opposite laid back smoked walk armchair leaning dropped seat comfortable waved cigarette details heartily

Residential Streets- house road side place walked drive miles front led hall high stopped standing building gate windows grounds park trap houses mile yards trees low reached cottage narrow row upper lane

Family/Relationships- woman lady husband wife love young loved beautiful girl marriage daughter married nature women maid fiend de seldom marry blame lovely lover hated mistress loves physical hatred listen merville hilda

Crime (general)- crime murder death night reason police account charge evidence appeared committed proved violence arrest remained motive attempt criminal murdered terrible conduct lucas inquest attention constable probable attempted hideous strong event

Finance- money hundred business pounds thirty thousand large pay milverton worth price fifty sum letters check ten paid firm offer terms named ruin bank work city client advance bag cost market

Transportation- back carriage past drove hurried companion journey round pulled save started reach town reached follow cab drive imagine class early wheels immediately curve van stepped holmes rattled swiftly luggage coachman.

Crime(murder)-back left met father knew death poor sister returned died mother fate witness alive called make swear struck terrible unhappy enemies offered jump faithful reply cry success interview impress absent

Crime Scene- body lay found shot head revolver dead blood weapon wound floor bullet pistol lying handle finally hurt close clothes cried fatal die fired powder wounded brains sight inflicted surgeon horribly

Investigation- case watson effect remarked complete follow conclusion knowledge simple methods form result greatest reasoning work art produced credit observation formed deduction occasionally occur cases working touch step poison drug telegraph

Foreign affairs- english american time von gentleman german bork fancy brother british agents greek london added prisoner occasion england country melas secretary book exclamation living people interpreter car admiration mister worst main

Results of Topic Modeling Project: Sherlock Holmes

The settings that I used for the topic modeling project are:

30 topics, 5,000 iterations, and 30 topic words printed

1.) Travel; half back hall carriage road horse dog drive cab past colonel boy pulled side minutes drove miles companion yards stopped people observed stranger bicycle straker silver trap station stepped john

2.) Writing; paper note read letter papers table book letters word handed written hand wrote put writing message short write sheet post hands kindly document picture slip single date means envelope meaning

3.) Detective Case; case point interest fact facts points remarked attention investigation interesting explanation curious clue affair object incident mystery theory obvious question simple events admit prove story solution narrative confess details connection

5.) Death; found man lestrade house dead body night lay left finally blood carried yard sign show head made blow death great care stick back wood scotland unfortunate mark heavy weapon bridge

9.) Time; morning night hour doctor heard work time train clock late waiting station quarter started early breakfast telegram hours hurried return past arrived ready afternoon morrow returned twelve matters walk fresh

10.) Physical Description; face man eyes black white dark head hair thin features red tall blue appearance coat pale expression fashion mouth dress eye heavy figure middle brown faced short drawn thick gray

18.) Emotion; cried face hands moment eyes turned head voice looked god words forward spoke felt lips quick shook raised air staring milverton sank burst glimpse laid shot frightened move broke step

19.) Crime; police inspector crime evidence found reason murder case occurred hopkins death human force tragedy remained appeared official arrest account formed violence charge trace prisoner fate proved complete suspicion discovered failed

21.) Business; london business asked good office hundred ten answered money work pay pounds company red thousand made set gold city headed paid possession valuable worth price bank order firm sum named

29.) Building; room door window open opened bed entered floor bedroom table key closed sitting passage ran bell inside rushed empty locked dressing pushed safe stair alarm lock clothes stairs shut sleep

Topic Modeling Assignment – Jen Pereira

Here are my ten topics and their titles. My settings were 40-2000-20.

Travel: train, london, office, papers, brother, importance, station, west, evening, mycroft, monday, absolutely, town, return, plans, agent, service, taking, coming, appointment.

Time: back, hour, help, time, past, street, ten, minutes, waiting, late, cab, quarter, wait, started, hurried, reached, big, step, journey, picked.

Crime: house, crime, night, death, master, attention, murder, terrible, dangerous, tragedy, scene, made, servants, criminal, alarm, undoubtedly, man, unfortunate, absolute, suspicion.

Business/Commercial: good, business, money, asked, hundred, week, answered, men, american, pay, pounds, red, thousand, gold, city, company, worth, headed, advertisement, paid.

Police Work: holmes, inspector, lestrade, case, police, sherlock, evidence, yard, moment, investigation, force, official, arrest, important, scotland, detective, affair, charge, quietly, feel.

Construction/Evidence: left, round, store, examined, small, large, floor, side, mark, carefully, examination, ground, wall, marked, evidently, pointed, marks, wood, cut, iron.

Literature: paper, note, read, letter, papers, book, pocket, hand, table, box, put, handed, letters, written, wrote, writing, drew, sheet, post, address.

Description of Clothes: black, side, hair, red,  hat, gave, high, heavy, blue, coat, broad, centre, white dress, brown, top, faced.

Emotional Verbs/Actions: instant, cried, hands, heard, back, feet, rushed, threw, open, caught, fell, sprang, appeared, sight, ran, cry, arms, pushed, moment, voice.

Murder/Death: man, found, head, body, dead, hand, lay, blood, long, drawn, close, shot, carried, struck, part, finally, held, blow, knife, revolver.

Topic Modeling Sherlock Holmes’ Short Stories

After applying different settings at the Topic Modeling Tool, I have chosen the result of 2000 iterations, 40 topics and 20 words printed per topic.

TOPICS:

1) Investigation

“case point fact facts points remarked investigation evidence mystery interest follow simple theory incident clue confess obvious problem curious afraid”

2) Time

“day morning days evening made news surprised telegram called meet order explain yesterday week hours spent return caused received longer”

3) Violence

“man found dead body death blood struck terrible dreadful creature poor blow knife wild ground unfortunate stick horrible lay picked”

4) Location

“house road side passed hall front place dog drive windows round drove standing direction high houses yards scene building square”

5) Sitting

“chair sat room fire half laid rose pipe bell arm glass lay asked silent seated alarm lit lamp cigar smoke”

6) House

“room window door entered open bed table left key bedroom study inside round safe sitting rushed floor locked lawn dressing

7) Appearance

“black man red face dark hair thin features tall head appearance figure white middle dress blue eyes glasses yellow faced”

8) Relationship

“husband knew thought heart wife girl told love truth child mind back gentlemen break loved leave mine met mary ferguson”

9) Mystery

“door light stood window opened heard open dark sound passage closed steps silence ran instant front pushed suddenly sharp drew”

10) Conversation

“asked give answered thought matter thing make time business good call start taking kind rest turn happy questions wished excuse”

Lauren Gao’s Topic Modeling

Using Mallet’s Topic Modeling program, DHM293 ran all 56 Sherlock Holmes short stories with various settings. Changing the number of iterations and topics, I finally settled on settings of 100 topics and 2000 iterations, with 20 words in each topic.

1) Murder in Sherlock Holmes

crime death police murder reason charge scene tragedy night committed arrest violence evidence murdered motive constable caused suspicion escape attempt

2) Watson

watson dr doctor friend means surprised matter natural blessington amberley patient disease days medical continued knowing reasons armstrong trevelyan brougham

3) Men in Sherlock Holmes Stories

face man eyes dark thin tall expression figure features looked beard voice middle manner handsome gray clean age huge fierce

4) Women in Sherlock Holmes

woman wife husband love life knew girl loved married lady women rich daughter soul beautiful power nature beauty marriage young

5) Transportation in Sherlock Holmes

home minutes cab waiting heard wait glad ten ha walking twenty church quiet send reach talking feel driven long drove

6) Deducing in Sherlock Holmes

case facts points explanation fact simple theory admit investigation give solution problem confess correct present obvious formed probable connection false

7) Holmes’ mannerism

holmes head hands shook easy smiled sank sunk breast short forehead gesture rubbed began forward clapped despair branch leaning eagerly

8) Villains in Sherlock Holmes

great doubt criminal dangerous country brain set career act failed makes gang cunning power war europe compelled sufficient traced remains

9) Smoking in Sherlock Holmes

sat pipe fire looked time cigar tobacco smoke asked sherlock corner long chair armchair smoked lit roylott smoking moran observe

10) Accents in Sherlock Holmes

don ll ve won talk thing give answered didn bit ready bad couldn wait eh minute masser wouldn isn lucky

 

 

Topic Modeling Project

Here are my (informed) guesses for the theme names. The data is based on me running 150 topics, 2,000 iterations, and 30 words.

Clues:paper note read letter papers word book answer letters table importance handed short written wrote received message writing pocket attention sheet write account reading von post secret picture men document

Reaction:face cried hands eyes turned instant holmes suddenly back voice looked head sprang forward words spoke lips threw moment step quick hand feet shook raised amazement staring moved burst stepped

House: room door window open light opened entered floor bed key bedroom closed lamp sound passage safe table bell steps sitting rushed inside ran pushed locked dressing lawn stair stood study

Crime: found police crime place death evidence brought case murder hopkins dead finally making tragedy body remained person arrest unfortunate attempt order hotel violence prisoner missing inspector inquiry appeared naturally weapon

Time: night morning day hour house back evening clock work late heard happened quarter room past start early breakfast returned waited hurried usual mrs left morrow arrived ten signs occurred twelve

Gun: back heard hand head stood lay long struck held turned fell deep round sight dreadful caught blood moment body cry horror strange revolver shot blow lying gave surprise dropped arms

Case: watson case point find dear clear doubt end points possibly affair person follow investigation obvious surely simple difficult clue perfectly confess theory close admit remarked undoubtedly prove suggest formed solution

Estate: house round side front road passed place long hall carriage garden high drive walked direction windows drove dark led corner pulled reached line square standing coming low past miles slowly

Travel: street found station train lord baker office waiting st cab minutes evening started yard half quiet gentleman company west made monday town detective official afternoon scotland service home reached engaged

Physical Description: face eyes black man red dark white figure hair thin light side tall heavy fashion hat appearance blue expression pale broad dressed features mouth centre middle yellow dress sharp brown

Trends Discovered By Topic Modeling Sherlock Holmes Stories

Here is a compilation of topics I have gathered through the topic modeling project.

Settings: 75 Topics, 2,000 Iterations and 20 Topic Words Printed

Female/Romance Isses 2. lady woman left maid young told beautiful fear sudden drawn truth mistress strong voice beauty late send frightened refused fiend

Writing 3. paper note read letter book letters written handed wrote pocket writing write sheet post address drew envelope slip document description

Banking 9. money business hundred pounds company pay thousand price fifty sum terms asked manager firm worth offer ruin milverton hard paid

Murder 11. crime police evidence murder death night arrest tragedy violence charge murderer committed arrested attention escape discovered unfortunate murdered motive instantly

Individual Descriptions 25. black hat heavy dressed brown side broad coat round boots observe grey dress slight nose double pair chin yellow sharp

Romance 29. years time ago father met mother twenty months year death age life weeks married lived friends month sister home uncle

Family Life/Values 40. wife husband woman love life child knew girl loved daughter understand character women ferguson nature heart devoted influence america married

Ominous Scene 42. light dark lamp window stood long sound silent darkness shadow heavily low sharp black lit standing shining yellow vague whispered

Killing/Death 48. found body dead man blood head knife lay stick lying blow house weapon close long wood finally wound carried burned

Morning 75. night morning clock heard early day breakfast hour morrow arrived sleep twelve dropped surprise eleven bright caused late weary started