Skip navigation.
Semantic Software Lab
Concordia University
Montréal, Canada

Generating an NLP Corpus from Java Source Code: The SSL Javadoc Doclet

Printer-friendly versionPrinter-friendly versionPDF versionPDF version
TitleGenerating an NLP Corpus from Java Source Code: The SSL Javadoc Doclet
Publication TypeConference Paper
Year of Publication2010
AuthorsKhamis, N., R. Witte, and J. Rilling
Refereed DesignationRefereed
Conference NameNew Challenges for NLP Frameworks
Date PublishedMay 22
Conference LocationValletta, Malta
KeywordsNLP, NLP Components, Software Engineering

Source code contains a large amount of natural language text, particularly in the form of comments, which makes it an emerging target of text analysis techniques. Due to the mix with program code, it is difficult to process source code comments directly within NLP frameworks such as GATE. Within this work we present an effective means for generating a corpus using information found in source code and in-line documentation, by developing a custom doclet for the Javadoc tool. The generated corpus uses a schema that is easily processed by NLP applications, which allows language engineers to focus their efforts on text analysis tasks, like automatic quality control of source code comments. The SSLDoclet is available as open source software.


Copyright © 2010 Ninus Khamis, Juergen Rilling, and René Witte. All rights reserved.

nlpf2010-ssldoclet.pdf436.13 KB