Keelan's Home Page
This is me rounding Devil's Elbow in the 2003 Mt. Diablo Challenge. It
is a bicycle race near the Bay Area, and I was one of 9 unicyclists in
the pack that year. The total distance was 10.8 miles and the gain in
elevation was 3,249 feet (my time 2:10).
I'm a Research Scientist at Educational Testing Service, where I conduct research on automated scoring of non-native spoken responses to assessments such as the TOEFL iBT and TOEIC. I received my PhD in 2009 from the University of Pennsylvania in the Linguistics Department. My thesis advisor was Bill Labov.
I have two blogs:
- The Evanini Family: A blog mostly dedicated to providing updates about our family to out-of-town family members.
- SpeechTechie: A repository for posting some coding / application details that I have found useful for my research.
- Keelan Evanini, Youngsoon So, Jidong Tao, Diego Zapata, Christine Luce, Laura Battistini, and Xinhao Wang. 2014. Performance of a trialogue-based prototype system for English language assessment for young learners. Proceedings of the Interspeech Workshop on Child Computer Interaction (WOCCI 2014), Singapore, September 19, 2014. [pdf]
- Keelan Evanini and Xinhao Wang. 2014. Automatic detection of plagiarized spoken responses. Proceedings of the Ninth Workshop on Innovative Use of NLP for Building Educational Applications (BEA-9), Baltimore, MD, June 26, 2014. [pdf]
- Klaus Zechner, Keelan Evanini, Su-Youn Yoon, Lawrence Davis, Xinhao Wang, Lei Chen, Chong Min Lee and Chee Wee Leong. 2014. Automated scoring of speaking items in an assessment for teachers of English as a Foreign Language. Proceedings of the Ninth Workshop on Innovative Use of NLP for Building Educational Applications (BEA-9), Baltimore, MD, June 26, 2014. [pdf]
- Christopher Mitchell, Keelan Evanini, and Klaus Zechner. 2014. A trialogue-based spoken dialogue system for assessment of English language learners. Proceedings of the 5th International Workshop on Spoken Dialog Systems. Napa, January 17-20, 2014. [pdf]
- Catherine Lai, Keelan Evanini, and Klaus Zechner. 2013. Applying rhythm metrics to non-native spontaneous speech. Proceedings of the Workshop on Speech and Language Technology in Education. Grenoble, August 30 - September 1, 2013. [pdf]
- Wenting Xiong, Keelan Evanini, Klaus Zechner, and Lei Chen. 2013. Automated content scoring of spoken responses containing multiple parts with factual information. Proceedings of the Workshop on Speech and Language Technology in Education. Grenoble, August 30 - September 1, 2013. [pdf]
- Keelan Evanini and Xinhao Wang. 2013. Automated speech scoring for non-native middle school students with multiple task types. 2013. Proceedings of Interspeech 2013. [pdf]
- Keelan Evanini, Shasha Xie, and Klaus Zechner. 2013. Prompt-based Content Scoring for Automated Spoken Language Assessment. Proceedings of the Eighth Workshop on Innovative Use of NLP for Building Educational Applications, pages 157-162, Atlanta, Georgia, June 13 2013. [pdf]
- Xinhao Wang, Keelan Evanini, and Klaus Zechner. 2013. Coherence Modeling for the Automated Assessment of Spontaneous Spoken Responses. Proceedings of NAACL-HLT, pages 814-819, Atlanta, Georgia, 9-14 June 2013. [pdf]
- Keelan Evanini and Becky Huang. 2013. Production of English vowels by speakers of Mandarin Chinese with prolonged exposure to English. Proceedings of Meetings on Acoustics, volume 18. [pdf]
- Klaus Zechner, Keelan Evanini, and Cara Laitusis. 2012. Using Automatic Speech Recognition to Assess the Reading Proficiency of a Diverse Sample of Middle School Students. Proceedings of the InterSpeech Workshop on Child, Computer, and Interaction. [pdf]
- Keelan Evanini and Becky Huang. 2012. Automatic detection of [th] pronunciation errors for Chinese learners of English. Proceedings of the International Symposium on Automatic Detection of Errors in Pronunciation Training, Stockholm. [pdf]
- Shasha Xie, Keelan Evanini, and Klaus Zechner. 2012. Exploring content features for automated speech scoring. Proceedings of the 2012 Meeting of the North American Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). [pdf]
- Keelan Evanini and Klaus Zechner. 2011. Using crowdsourcing to provide prosodic annotations for non-native speech. Proc. Interspeech. [pdf]
- Su-Youn Yoon, Keelan Evanini, and Klaus Zechner. 2011. Non-scorable response detection for automated speaking proficiency assessment. Proc. ACL-HLT, The 6th Workshop on Innovative Use of NLP for Building Educational Applications. [pdf]
- Xie Sun and Keelan Evanini. 2011. Gaussian mixture modeling of vowel durations for automated assessment of non-native speech. Proc. ICASSP. [pdf]
- Keelan Evanini, Catherine Lai, and Klaus Zechner. 2011. The importance of optimal parameter setting for pitch extraction. Proceedings of Meetings on Acoustics. [pdf]
- Lei Chen, Keelan Evanini, and Xie Sun. 2010. Assessment of non-native speech using vowel space characteristics. Proc. SLT. [pdf]
- Aaron Dinkin and Keelan Evanini. 2010. An elementary linguistic definition of Upstate New York. Selected Papers from NWAV 38, University of Pennsylvania Working Papers in Linguistics, v. 16.2. [pdf]
- David Suendermann, Jackson Liscombe, Roberto Pieraccini, and Keelan Evanini. 2010 "How am I Doing?": A new framework to effectively measure the performance of automated customer care contact centers. In Advances in Speech Recognition: Mobile Environments, Call Centers, and Clinics, ed. A. Neustein., p. 155 - 180. Springer.
- Keelan Evanini, Derrick Higgins, and Klaus Zechner. 2010. Using Amazon Mechanical Turk for transcription of non-native speech. Proc. NAACL HLT, Workshop on Creating Speech and Language Data With Amazon's Mechanical Turk. [pdf]
- Josh Tauberer and Keelan Evanini. 2009 Intrinsic vowel duration and the post-vocalic voicing effect: Some evidence from dialects of North American English. Proc. Interspeech. [pdf | slides]
- Keelan Evanini, Stephen Isard, and Mark Liberman. 2009. Automatic formant extraction for sociolinguistic analysis of large corpora. Proc. Interspeech. [pdf]
- David Suendermann, Keelan Evanini, Jackson Liscombe, Phillip Hunter, Krishna Dayanidhi, and Roberto Pieraccini. 2009. From rule-based to statistical grammars: Continuous improvement of large-scale spoken dialog systems. Proc. ICASSP. [pdf]
- David Suendermann, Jackson Liscombe, Keelan Evanini, Krishna Dayanidhi, Roberto Pieraccini. 2008. C^5. Proc. SLT. [pdf]
- Keelan Evanini, Phillip Hunter, Jackson Liscombe, David Suendermann, Krishna Dayanidhi, Roberto Pieraccini. 2008. Caller Experience: A method for evaluating dialog systems and its automated prediction. Proc. SLT. [pdf]
- Keelan Evanini. 2008. A shift of allegiance: The case of Erie and the North / Midland dialect boundary. Selected Papers from NWAV 36, University of Pennsylvania Working Papers in Linguistics, v. 14.2. [pdf]
- Keelan Evanini. 2008. Classifying and clustering dialects of North American English. Proc. NESCAI. [pdf]
- Keelan Evanini, David Suendermann, Roberto Pieraccini. 2007. Call classification for automated troubleshooting on large corpora. Proc. ASRU. [pdf]
- Keelan Evanini. 2007. How to formalize variation: Stochastic OT models and /s/ deletion in Spanish. Proceedings of LACUS 33, Linguistic Association of Canada and the US. [pdf]
- Keelan Evanini. 2007. Book note for American English: dialects and variation. Language in Society 36(1):7-8.
- Keelan Evanini. 2007. The phonetic realization of pitch accent in Huave. Proceedings of the 33rd Annual Berkeley Linguistics Society. [pdf]
- Tonya Wolford and Keelan Evanini. 2006. Features of AAVE as Features of PRE: A Study of Adolescents in Philadelphia. Selected Papers from NWAV 34, University of Pennsylvania Working Papers in Linguistics, v. 12.2. [pdf]
- Keelan Evanini and Giang Nguyen. 2005. Papers from NWAVE 32, University of Pennsylvania Working Papers in Linguistics, v. 10.2.
The title of my dissertation is The permeability of dialect boundaries: A case study of the region surrounding Erie, Pennsylvania. The entire dissertation can be downloaded from Penn's electronic disseration repository. Individual chapters are available here:
- Front Matter: title page, acknowledgements, abstract, table of contents, list of figures, list of tables
- Chapter 1: introduction to the empirical, methodological, and theoretical aims of the dissertation
- Chapter 2: a review of the evidence from earlier dialect geography studies (LAMSAS, DARE) that show Erie's phonology and lexicon to be Northern
- Chapter 3: a description of my data collection procedure, including how I contacted speakers for inclusion in my corpus, a description of the interview materials, and how the interviews were processed
- Chapter 4: a description of the procedure I used for automatic vowel analysis including forced alignment, measurement point selection, and formant prediction
- Chapter 5: natural break maps for 17 vowel classes
- Chapter 6: a study of the merger of /o/ and /oh/ in the Erie region
- Chapter 7: a study of other vowels that pattern differently in the Midland and the North (/ow/, /uw/, /ae/, /o/)
- Chapter 8: an investigation into the use of Midland lexical and morphosyntactic features in Erie
- Chapter 9: the settlement history of Erie and how it helps explain the course of linguistic change in the region
- Chapter 10: some brief concluding remarks
- Appendices: materials used in the interview, including the word list, minimal pairs, sentences for acceptability judgments, and DARE's reading passage
These are programs that I have written and found useful for my research. The quality of documentation, portability, usability, etc. varies widely among them. Please feel free to contact me if you have any questions about them, or if you'd like to suggest improvements.
- quickTrans: a collection of shell, python, and Praat scripts that I use for transcribing interviews [download | README]
- extractFormants: a program for automatically obtaining vowel formant measurements; takes as input a speech audio file and a word- and phone-level transcription produced by forced alignment, outputs a set of formant measurements for each vowel in the audio file [download | README]
- vowel.r: some R functions I use for plotting vowel systems [download | example data file]