CSC261 Artificial Intelligence

Fall 2011

Synopsis: This class introduces the fundamentals of automated intelligence. Through the "eyes" of an intelligent agent, we will learn about searching for problem solutions, exhibiting rational behavior, handling uncertainty, and learning from experience.

MTWF

9:00-9:50 am

Science 3819

Instructor: Jerod Weinman

Office: Noyce 3825

Phone: x9812

E-mail: [weinman]

[1][t]0.5Office hours:

Monday	1:30-3:00 PM
Tuesday	3:30-5:00 PM
Wednesday	2:00-3:30 PM
Friday	2:30-4:00 PM

or by appointment.

Course web page: http://www.cs.grinnell.edu/~weinman/courses/CSC261/2011F/

1 Overview
2 Textbook
3 Class attendance
4 Schedule of topics
5 Assignments and activities
    5.1 Reading
        5.1.1 Preparation
        5.1.2 Reading journal
    5.2 Participation
    5.3 Lab assignments
    5.4 Exams
6 Grading
7 Academic honesty
8 Deadlines
9 Contacting Me
10 Accommodations

1 Overview

What is intelligence? Can it be automated? These are deep questions whose algorithm roots go back thousands of years. In this course, we will examine computational approaches to problem solving, rational behavior, and learning. The field of artificial intelligence (AI) has gone through many ups and downs. AI has branched into many sub-areas that are beginning to be reunified with great success for many practical applications. We will study the foundations and theories behind the "big ideas" in AI, and spend some time exploring and implementing some real models for real problems.

Our major objectives for this course include:

Understanding the fundamental problems in AI
Learning about both new and classical approaches to AI
Sharpening functional programming skills by implementing AI algorithms
Understanding how to evaluate AI solutions

* Why take it?

Rational, learning, computer-based agents are being used to solve more, bigger, and often very important problems. If you have any interest in how this increasingly visible sub-field of computer science operates, this course is for you. Even if your occupation is not typically thought of as "AI work," exposure to these ideas may influence how you approach problem-solving and will definitely influence how you interpret future developments in the field of AI that you may learn about.

* What do I need to know?

This course assumes you have experience with functional programming in Scheme and imperative programming in C. You should also be fluent in some basic computational ideas like encapsulation and code re-use with procedures and recursion. Familiarity with some basic data organization principles (i.e., linear and recursive data structures) are also necessary. Some mathematical maturity (e.g., familiarity with multivariable calculus, linear algebra, or combinatorics) will be helpful, but not absolutely necessary.

2 Textbook

Our course will be based on the following text:

Stuart Russell and Peter Norvig. Artificial Intelligence: A Modern Approach, Third Edition. Prentice Hall, 2010. ISBN: 978-0-13-604259-4.

The authors have updated this text on average only every 6.5 years. Thus, you should expect meaningful differences that represent significant improvements between editions. While you might be able to succeed with a second edition, I do not recommend it and cannot guarantee it. This is a quality textbook that is worth owning and keeping. Buying the third edition is an investment.

Our programming exercises will be (mostly) done in Scheme. An excellent Scheme reference/textbook is available free online, but a print edition is also available (you may also find an older copy in the CS Learning Center/MathLAN Library). We'll be using R5RS for this course.

R. Kent Dyvbig. The Scheme Programming Language, Third Edition. MIT Press, 2003. ISBN: 978-0262541480. http://www.scheme.com/tspl3

Some additional programming exercises will be conducted in C. You may wish to refer to the following free online (first) or print (second) reference manuals.

Eric Huss, The C Library Reference Guide, University of Illinois Student Chapter, 1997. http://www.acm.uiuc.edu/webmonkeys/book/c_guide
Samuel P. Harbison and Guy L. Steel. C: A Reference Manual, Fifth Edition. Prentice Hall, 2002. ISBN: 0-13-08952-X

3 Class attendance

Class meetings will involve a mix of discussions, collaborative activities, labs, and the occasional mini-lecture. In short: You are expected to attend and actively participate in class. I am expected to make class worth attending.

Because is a collaborative, discussion-based course, your presence is integral to your learning. Thus, 1.5% will be deducted from your overall grade for each absence. I know that sometimes "things happen." Therefore, you will be granted one unexcused absence from class without penalty. However, this rebate is cancelled upon a second absence.

If you are absent, I would appreciate a written explanation (email is appropriate). If you know in advance that you will be absent for any reason, please notify me in writing (again, email is fine) at least 7 days in advance to make arrangements for considering your absence excused.

Because I do not wish you to risk harm to yourself or others, I am likely to moderate penalties in case of illness.

Our discussions benefit from your contributions. If you do miss a class, you must first talk to a classmate about any material that you may have missed. After that, you may follow up with the instructor about any further questions or concerns.

4 Schedule of topics

The following is an approximate schedule of topics to be discussed during the course. See the web page schedule for daily details.

Week	Topic	Week	Topic
1	Intelligent Agents	8	Bayesian Networks
2	Search	9	Learning
3	Adversarial Search	10	Classification
4	Propositional Logic	11	Neural Networks
5	First-Order Logic	12	Decision Theory
6	First-Order Logic	13	Reinforcement Learning
7	Probability	14	Philosophy of AI

5 Assignments and activities

Under a normal 16 credit load, I expect that you will spend at least 40 hours per week on your studies (class time, homework, and studying).¹ Thus, you should plan to spend a minimum of 10 hours/week (but hopefully more) on work for this course:

5.1 Reading

Our class meetings will be heavily discussion-based, and this will require a significant amount of preparation on your part. Most of this will consist of careful reading and reflection on the material through the use of a reading journal.

5.1.1 Preparation

You should check the class schedule for updates and read any material that has been assigned before coming to class. Reading the textbook entails the following:

Overview: You should quickly skim through the reading once to get an overview of the material to be covered, paying particular attention to subject headings and topic introductions. This first "reading" can (and should) be very quick. (Expected time: 5 to 10 minutes.)
In-Depth: Next, read the material closely. Try to understand what individual steps of algorithms or mathematical proofs are accomplishing. Not everything will make sense at this point, but hopefully many things will. (Expected time: 40 to 50 minutes.)
Final Notes: After carefully reading the material, mentally review and try making a few notes to yourself about what you think are the most important concepts being covered, as well as any questions you have. (Expected time: 5 to 10 minutes.)

Many of the readings are fairly short (about 13±6 pages, or roughly 30-40 pages per week), but can contain mathematics or algorithms that require a moderate amount of study. While I realize not everyone learns best by reading, you are asked to make your best effort and come to class with any questions you may have. Then we can proceed with discussion, examples, and exercises that enhance and clarify the material in class.

5.1.2 Reading journal

To help focus your efforts and give us a basis for discussion, you will be provided short a list of questions to answer for each day's reading. Reflecting upon your responses to the questions will help to give you a deeper understanding of the most important concepts surrounding each topic. See the accompanying "Reading Journal" document on the course web page.

Your responses are due by 11:59 p.m. the night before class. No late responses will be accepted. You will submit your responses electronically to a private journal via our PioneerWeb course page, where I will be able to give you feedback on your writing.

While these low-stakes writing assignments are technically "informal," they must reflect a certain level of engagement and evidence of thinking seriously about the material.

Responses will be graded using the following ternary scale:

PLUS	Exhibits exceptional clarity, insight and/or creativity.
CHECK	Exhibits evidence of processing and studying concepts.
MINUS	Superficial response or insufficient evidence of engagement.

Because I expect most entries will receive a check, I will comment on your journal to report a plus or minus. You should expect to discuss the issues raised in your reading journal entries during class.

5.2 Participation

Because much of our work in this course involves collaboration and discussion, you will be evaluated on your participation.

Participating in class involves:

being present in class (physically and mentally)
coming to class on time
coming to class prepared
asking questions when appropriate
making positive contributions to class discussion by volunteering and when called upon
staying on task during collaborative exercises, and
working effectively with your group.

Students who regularly meet these criteria can expect to earn 90% (i.e., an A-) for their participation grade. I will reward students who regularly provide significant insights or guide discussion in productive ways with a higher participation score. Students who fail to participate regularly or who participate in counterproductive ways (e.g., by dominating the conversation or making inappropriate comments) can expect to earn a lower score.

5.3 Lab assignments

You will have weekly lab-based programming assignments that use algorithms from our reading to address interesting problems. These will be due Monday night at midnight throughout the semester.

Your reading for Tuesday's lab is the lab assignment itself. It is imperative that you come to lab prepared, having read the assignment and readied any questions you may have. Bring a hard copy of the lab assignment with you.

We will launch our lab assignments with in-class warm-up lab exercises each Tuesday. If you do not complete these exercises in class, you are strongly encouraged to finish them before beginning the assignment itself.

Instructions regarding collaboration will be given with each assignment. While you are welcome to discuss course concepts with others, solutions and any work you do and submit should be that of you and your group alone. (See Academic honesty, section 7 below.)

Most work is required to be done with partners, which will often be assigned. Working with a partner will help ensure you can take some advantage of the principle that "Given enough eyeballs, all bugs are shallow."² Working with an assigned partner will increase the chances of being exposed to different ways of thinking and problem-solving as well as help you practice the skills you'll need in the real world, where you typically do not get to choose your coworkers.

Working collaboratively means everyone whose name appears on a submission has contributed to and understands all parts of the work. I reserve the right to briefly interview you to ask questions about your work. The kinds of questions I would ask will be easy for anyone who contributed to and understands their submission.

You are highly encouraged to use the PioneerWeb Discussion Board for questions related to the course. If a post is related to an assignment, it must adhere to the standards of collaboration for that particular assignment.

5.4 Exams

As opportunities for you to demonstrate your agent design prowess and grasp of artificial intelligence principles, there will be two hour exams and a cumulative final exam.

Hour Exam 1	Friday 30 September
Hour Exam 2	Friday 11 November
Final Exam	Tuesday 13 December (9 a.m.)

Do not make airline reservations that will conflict with your final exam schedule.

6 Grading

My goal is for everyone taking this course to be able to demonstrate familiarity and fluency with the course concepts. I would be very happy if you all met the goals above and received "A"s. The following weighting will provide a basis for evaluation

Programming Assignments	40%
Participation	10%
Reading Journal	15%
Exams	20%
Final Exam	15%

with the caveat that you must pass the final exam to pass the course.

7 Academic honesty

You, as students, are members of the academic community. Both the College and I expect the highest standards of academic honesty. (See the Grinnell College Student Handbook, e.g.,
http://www.grinnell.edu/offices/studentaffairs/shb/academicpolicies/academichonesty). Among other things, this means clearly distinguishing between work and ideas that are your own, and those that should be attributed to others. It is expected that the collaboration policies given in this syllabus and on particular assignments will be followed. In particular:

When you explicitly work as part of a group or team, you need not identify the work of each individual (unless I specify otherwise).
You may discuss concepts (algorithms, ideas, approaches, etc.) described in the readings, lab exercises, during class, or explained in the lab assignments with anyone.
You may only discuss homework assignments (algorithms, solutions, write-ups, code, debugging, etc.) with your group members or the instructor.
All the work submitted (code, experimental data, write-ups, etc.) must be your own. Code or documentation provided by the instructor should be attributed, but no other code or written work (from any source) may be shared with others or copied for your own use.
All non-syntax consultations (including the textbook and language references) require formal citation within the related program or write-up.
Any conceptual contributions by others (not in your group) must be acknowledged and attributed in your report. That is you must give specific attribution for any assistance you receive. The suggested acknowledgment format is

"[Person X] helped me to do [thing Y] by [explaining Z]."
Any program results or output must be faithfully recorded, not forged. (A thoughtful explanation of unexpected behavior can often be a worthwhile submission and is much better than the alternative.)
You are responsible for safeguarding your work from being copied by others. This requires you to take reasonable precautions with hard copy printouts as well as file system permissions.

As an instructor, I will meet my obligation to bring any work suspected to be in violation of the College's Academic Honesty Policy to the attention of the Committee on Academic Standing, after which there is no recourse with me.

8 Deadlines

Assignments are due at the specified time and date. Assignments due on days for which you have a prior excused absence must still be submitted by the deadline.

A late penalty of one letter grade will be deducted in each subsequent twenty-four hour period after the deadline.

Exception: Deadlines for MathLAN computer-based assignments will automatically be extended by at least one twenty-four hour period if MathLAN is down for an unscheduled period of three or more hours during the week preceding the assignment due date.

9 Contacting Me

Please come by during my office hours to discuss the course content, get any extra assistance, or just talk about how the course is going. Note that if multiple students have similar questions or issues, we may work together as a group. If you cannot attend a scheduled office hour, you may also email me to schedule an appointment; please include 3-4 possible meeting times so that I can pick one that works for both of us.

I enjoy getting to know my students, but I prefer to reserve office hours for academic matters. If you would like to have a more informal conversation, I would be delighted to accept an invitation to eat lunch with you at the Marketplace.

Email is also a reliable way to contact me, but please allow 24 hours for a response (except on weekends, when I do not regularly read email). You may also call me in my office (x9812).

10 Accommodations

If you have any disability that requires accommodations, please meet with me right away so that we can work together to find accommodations that meet your learning needs. You will also need to provide documentation of your disability to the Dean for Student Academic Support and Advising, Joyce Stern, located on the 3rd floor of the Rosenfield Center (x3702).

Please also note that I require your accommodations. The synthetic fragrances found in deodorants, lotions, after shave, body sprays, laundry products, perfume, cologne, etc. make many people who suffer with asthma, allergies, environmental sensitivities, cancer, and migraines much sicker. I am sensitive to many such chemicals you may not even notice, so please try to avoid using such scented products before coming to class and especially if you visit my office.

With thanks to Janet Davis for the "Reading Suggestions" and other key policies.

Footnotes:

¹This is a minimum recommendation for achieving "satisfactory" (i.e., C-level) results. "Good" or "excellent" results may require a greater investment.

²This principle is dubbed Linus's Law by Eric S. Raymond in The Cathedral and the Bazaar, O'Reilly Media, 1999, p. 30.