ASTRONOMY PROGRAM
ASSESSMENT PLAN 2001-2002

I.    Program/Discipline Mission Statement

The mission of the Astronomy department is to support ACC goal of being a world class learning centered institution, facilitate student learning and meet the needs of ACC students.

II.    Program/Discipline Purpose

The purpose of the Department of Astronomy is to provide educational services in the areas of astronomy for the residents of Arapahoe and Douglas counties and surrounding areas. The department takes a learner centered approach. The courses support transfer requirements for science and nonscience students. The department is committed to quality education in the area of astronomy, incorporating the most current astronomy technology and educational methods.

III.    Intended Learning Outcomes

After taking any astronomy course at ACC, the student will:

  1. Master specific course Learning Objectives/Outcomes at the appropriate level.
  2. Be able to analyze data and suggest answers or solutions to problems.
  3. Use appropriate technology and lab equipment.
  4. Apply the logic, thinking and application of the scientific method to topics in astronomy and be able to apply these principles to "real life" problems
  5. Demonstrate their ability to read, comprehend and write about science related materials.

IV.     Assessment Procedures, Measures and Criteria

For Spring Semester one of these specific learning objectives/outcomes will be assessed by administering a pre and post test which objectively measures the following specific learning objective/outcome(s):

Upon completion of AST101, the student will be able to:

1.0  Correctly identify a proper interpretation of any one of Kepler's laws.

An objective quiz will be given at the beginning of the semester and again at the end in all AST101 sections. The quiz will address the knowledge and understanding of all or some of Kepler's laws as part of it's makeup. Item analysis of the particular questions regarding Kepler's laws will be tabulated and analyzed.

V.    Assessment Implementation Plan

The ACC Astronomy Assessment Test is based closely on The Astronomy Diagnostic Test developed by The Collaboration for Astronomy Education Research (CAER). The test was administered at the beginning and at the end of  Astronomy 101 sections in Spring 2002. The test covers a broad range of topics covered in Astronomy 101 and will assist us in evaluating the effectiveness of our pedagogical methods for many of the stated learning objectives of Astronomy 101.

For this first semester we are evaluating only learning objective 1.0  (Correctly identify a proper interpretation of any one of Kepler's laws.)

Two questions on the Astronomy Assessment Test address that particular learning outcome:

14. (T/F) Kepler said planets move in circular orbits around the Sun.
30. Kepler's second law says that:

A. The planets orbit the Earth in perfect circles.
B.    The planets orbit the Sun in perfect circles.
C.    The planets move at varying speeds.
D.    The planets move at a constant speed.

VI.     Results/Findings

Item analysis of the two questions of interest on the test was performed.

Here are the results for the number of students who answered the questions incorrectly:

Class

Q14-Before

Q30-Before

Q14-After

Q30-After

6/14

9/14

4/9

1/9

2  

4/9

3/9

3/7

4/7

3

11/15

7/15

4/13

7/13

4

14/21

9/21

7/15

6/15

5

9/18

7/18

8/17

6/17

AVG.

57%

45%

42%

39%

The reason the total number of samples is different before and after is partly due to different attendance numbers on the days the assessment was given and also on some slight class attrition over the course of the semester. The results show that, on average, the students were able to answer the two questions correctly more often after having had an Astronomy 101 class than before. However, the result is not impressive and there is clearly room for growth. Improved pedagogical methods and more concentration on Kepler's Laws could certainly have an effect. Of course, this is only one of many topics covered in Astronomy I and this first iteration of assessment only addresses one of many learning outcomes. We will have more general information when we incorporate all of the learning outcomes, which may require a different Astronomy Assessment Test.

VII.     Feedback Channels

These results will be disseminated to the Department Chair all the astronomy teachers at ACC.

VIII.      Use of Result for Improvement

We can encourage the instructors to concentrate more on Kepler's Laws and that might improve the scores on these questions. However this may have the effect of lowering the scores on the other questions on the Astronomy Assessment Test as other areas of course content are neglected.

Improved pedagogical methods brought about by the advent of sophisticated and intuitive Java Applets may make the teaching of such concepts more effective. These high-tech tools are now available to all of our astronomy students for the first time. Laboratory exercises using these tools will be written and adjunct instructors will be encouraged and assisted in making use of these tools, especially the ones involving Kepler's Laws.

The next iteration of the assessment will address more of the learning outcomes and test the effectiveness of the improved pedagogical methods resulting from this first step.