Crafting a Research Agenda

Spring 2022

Course Info

CSCI 699, 30098D
M/W 10-11:50pm, SAL 227A/Zoom
Instructor: Barath Raghavan
Office Hours: Th 9-10am

Overview

In this course we will aim to understand how to formulate a research agenda in Computer Science, examine trends that exist within areas of CS, and identify fruitful and problematic research directions. We will examine barriers to scientific research advancement and how to avoid them when possible, and practice thinking meta-systematically ("thinking outside of the box") when approaching selection of research problems and developing research solutions.

The course will explore the hybrid nature of Computer Science -- its existence at the intersection of mathematics, engineering, statistics, and other disciplines -- and how to evaluate progress in CS research, and identify fruitful avenues of future study. Our focus will not be on any one area of CS, so as a result we will examine research agendas in a variety of areas of CS.

Course Structure

The course will involve discussion, presentation, and group work during class. In addition, in groups of one or two, students will work on an independent project to describe the past and potential-future research in an area of CS, possibly one that is of interest to the student(s) for future study such as in a dissertation, postdoc, or faculty position.


Project

Computer Science research is diverse in both topic and method, building upon a wide array of adjacent disciplines and also having a rich body of practice of its own. Your task is to develop a research agenda in an area of CS and present this agenda in a variety of forms: 1) as a research whitepaper surveying prior work and describing a future agenda, 2) as a grant one-pager that describes why such work should be funded, 3) as a 30-minute research presentation, 4) as a 10-minute general audience presentation, and 5) as a popular-science article. Even if you choose to work on your own, you'll be paired up and will be providing peer feedback on a regular basis. (To this end, you will need to make a complete draft of each milestone available to your partner five days in advance of each deadline, to allow them time to give you feedback and for you to make edits.)

Responses

Per-class assignments will focus on assigned readings and responses to those readings. For each class's assignment, add your responses to an appropriately titled section of your Google Doc, with your most recent additions at the top of the doc. Each day's assignment is due at the start of class that day.

Grading

Details of grading will be provided in class. Grades will be determined as follows:

25% Reading responses
25% Peer feedback
10% Paper Presentation
40% Project

Schedule

Date Class Notes Reading Due Assignment Due
M 1/10
Welcome		 Notes - -
W 1/12
Areas		 -
  • Why did you sign up for this course? (1 paragraph)
  • Prepare a 1-slide presentation on your current/recent research, and ask the Five Whys on why you are working on it; append it to the shared slide deck.
  • Describe two instances of ontological remodeling in any areas of CS, one successful and one failed; also describe how they align with Chapman's analysis. (3-4 paragraphs each)
M 1/17
Holiday		 - - -
W 1/19
Foundations		 -
  • Prepare a 1-slide presentation on a recent-ish idea (~10 years) in your area that has changed the way people think, leading to fundamentally-new research; append it to the shared slide deck.
  • Apply Chapman's AI progress criteria, as appropriate, to one of the areas described by either Rogaway, Liskov, or Shenker. (3-4 paragraphs)
  • Where are abstractions (per Liskov) used in your area of CS to extract simplicity (per Shenker)? (2 paragraphs)
  • How are definitions (per Rogaway) used in your area of CS, and what issues have arisen or might arise from those definitions? (2 paragraphs)
M 1/24
Ideas
  • Propose, at a high level, three new research topics/themes/directions that excite you; use the Heilmeier catechism. (2-3 paragraphs each)
  • Revise (and include the before and after for) your three proposals using Chapman's guidance on problem formulations and vocabulary.
W 1/26
Systems		 Notes
  • For two of the three topics you proposed previously, produce a conceptual diagram of the research space following Meadows. Describe the leverage point(s) at which you are intervening. (2-3 paragraphs + diagram for each topic)
M 1/31
Stepping Stones		 -
  • Describe some research activity you or others do in your area(s) of interest that involves reasonableness; in your description, use at least 8 of the terms (in bold) from Chapman. (2-3 paragraphs)
  • Describe two research approaches that have been "made to work", referencing two or more of the five techniques from Chapman. (2 paragraphs each)
W 2/2
Nebulosity
  • Apply at least five of Rittel and Webber's ten "distinguishing properties" to a problem domain in your area of CS that has encountered difficulty in recent years. (3-4 paragraphs)
  • Relate Rittel and Webber's "distinguishing properties" to Chapman's AI progress criteria. (2-3 paragraphs)
  • Identify three "messy" "kinds" in any area of CS; what makes them messy? (1 paragraph each)
M 2/7
Meta-rationality
  • Intense research period: spend an intense period (~30 hours across two days) exploring the first steps of your research agenda; use the results to revise your agenda; describe your insights. (2-3 paragraphs)
  • Propose your semester-long research topic; identify any meta-rational steps involved in your thinking. (4-5 paragraphs)
W 2/9
Writing		 Notes
  • Who are your readers for each of the documents you are writing, and what is the distinctive value that they may be looking for and getting from in your work: (1) research whitepaper, (2) grant one-pager, (3) research presentation, (4) general-audience presentation, and (5) popular-science article? (1 paragraph each)
  • Re-write the abstract and introduction from your research agenda document in two ways: 1) to be as bad as possible (similar to the bad writing Orwell describes) and 2) to be as clear as possible (following Orwell's guidance) and with a focus on the importance to your research community (per McEnerney).
M 2/14 Project Updates Milestone 1: Progress update.
W 2/16
Community
  • Describe three ideas for improving your research scene that require no outside resources. (2-3 sentences each)
  • Ask the best researcher you know (other than your advisor) to let you "tag along" as they do research (ideally an early-stage project), ideally for at least a few hours (on video chat). Apply observation and periodically ask questions to understand what they're doing (and/or ask them to narrate). Document what you saw. (3-4 paragraphs)
M 2/21
Holiday		 - - -
W 2/23
 - Project updates Milestone 2: Progress update.
M 2/28
Eras		 -
  • Describe two instances (past or present) where it is apparent a research project/agenda in CS was strongly influenced by the era in which it was pursued. (2 paragraphs each)
W 3/2
Society		 -
  • Describe how you might follow two or more of Silberman's recommendations in your proposed research agenda. (2 paragraphs each)
  • Describe three recent research projects in any area(s) of CS; what are the embedded, unarticulated values/politics (per Winner) of these projects? (2 paragraphs each)
M 3/7
Society
  • In the use or generation of data and data types in your work, how do you or can you address and/or deal with their social construction? (4 paragraphs)
W 3/9
The (Meta) Thing from The Future		 -
  • Milestone 3: Progress update.
  • Allow yourself to wonder about examples of nebulosity in the context of any research topics; describe two such examples. (2-3 sentences each)
  • Explore those two examples of nebulosity; describe your understanding of them. (2-3 sentences each)
  • Play with the examples, modifying them and thus exploring the space; describe your explorations. (2-3 sentences each)
M 3/14
Holiday		 - - -
W 3/16
Holiday		 - - -
M 3/21
Theories		 -
  • Examine two research areas of CS and using the terminology of Lakatos and Havstad, describe whether they are each progressive, degenerative, or static research programs. (2 paragraphs each)
  • Identify four cognitive biases, three fallacies, and two paradoxes from the lists that have arisen in any area of CS at any time in the past, especially those that have been a barrier to the advancement of research. (2-3 sentences each)
W 3/23 - - -
M 3/28 - Project Checkins -
W 3/30
Advice		 -
  • What three pieces of advice were most surprising to you? (2-3 sentences each)
M 4/4 - Project Updates Milestone 4: Progress update.
W 4/6 - - -
M 4/11 - Project Updates -
W 4/13 - - -
M 4/18
Mock Program Committee		 - - -
W 4/20
Mock Program Committee		 - - -
M 4/25 Guest: David Chapman - -
W 4/27 Project presentations -

In addition to the assigned readings in the schedule above, this is an incomplete list of papers to consider for presentation in class; this list is incomplete and will be expanded: