BBA Management Information Systems [PID 32]

The Management Information Systems program develops competencies in analysis, design, development, and management of business information systems. Emphasis is on the development of computer application in a business environment and the effective use of computer resources to meet business objectives. Students receive hands-on experience with client-server technologies through lab-based and independent projects.

Robert Mitchell

The MIS Program is designed to develop professionals capable of fulfilling a variety of important roles in the development and management of information systems in business and industry. Specifically, the MIS program is designed to develop student intellect through expanding knowledge and analytical abilities in the development and use of information systems.

In addition, the program prepares students to serve and strengthen society by enhancing awareness particularly in the technical arena and to promote humane sensitivities and understanding of the interdependence of individuals, organizations, and nations – particularly as these issues relate to information and information systems.

Assessment is determined by the student's exhibiting an ability (using structured analysis methodology and CASE tools) to complete a systems analysis and design project encompassing data analysis (including entity-relationship diagrams, data mapping, and data normalization), and process analysis (including data flow diagrams).

Fulfilling this requirement will be determined by the students' ability to effectively deliver a verbal presentation using appropriate information technology tools. They must be skilled in communicating technical information in a non-technical end-user environment.

To demonstrate the uses of appropriate system design methodologies to develop information systems that meet user needs.

Assessment is determined by the student's exhibiting an ability to completely design a system or a subsystem. Design related projects (of students) from various courses will be assessed for each of the following design activities: file/database design, LAN Physical design, input-output design, and user interface design.

To demonstrate good written communication skills.

Fulfilling this requirement will be determined by the students' ability to effectively communicate in the written medium such as term papers, and research reports. They must be skilled in communicating technical information in a non-technical end-user environment as well.

Program Objectives Assessed This Year

One student learning objective was assessed this year:

To understand the use of IT as a strategic resource.
Assessment this year focuses on specific components of strategic use of IT skills:

Use of IT as a Strategic Resource

1. Knowledge of IT Portfolio and its Relationship with Corporate Strategy.
2. Knowledge of Different Views of Appropriate Relationship between IT and Corporate Strategy.

Procedures Used to Collect Data and Rationale

Student projects were obtained from all students completing Management 4331, a required course for all MIS majors. Students must have junior standing to take 4331; therefore students complete 4331 in their junior or senior year. A random sample of student’s answers on exam questions from the Fall 2005 semester were evaluated.

Procedures and Criteria for Evaluating Data

The student projects were assessed individually by a team of faculty members with sufficient strategic use of IT skills. Using Primary Trait Analysis on exams is a strong assessment technique. The exams are evaluated using the criteria illustrated in Appendix A. The faculty identified issues of concern relating to the student performance which were presented to a team of business representatives and students for additional evaluation/input.

MIS students that completed Management 4331 and MIS Advisory Board members with strategic use of IT were presented the results of the 2005 assessment and a newly designed rubric. The stakeholders were asked for recommendations to improve the program based on the assessment results.

Reliability and Validity of Method

The evaluative rubric was newly created for assessment this year. External evaluators (advisory council members) have evaluated content validity of the rubrics. Prior to assessing the exams, MIS faculty met to discuss the assessment process to assure clear and consistently applied evaluation standards and similarly interpreted the evaluation criteria. A team of two evaluators conducted independent reviewers of each portfolio item. The assessment coordinator verified that the agreement between the evaluators was acceptable. The scoring guide is shown in appendix B.

The results of the Primary Trait Analysis are shown in Appendix C. An acceptable total rating of 50 was established.

IT Corporate Strategies Competencies

The competencies centered on the following:

1. Ability to communicate the steps necessary to create a strategic IT portfolio.
2. Ability to communicate how to use an IT portfolio to create a competitive advantage.
3. Ability to communicate the importance of the fit between IT strategy and corporate strategy.
4. Ability to communicate value of IT capital expenditures for strategic advantage.

Analysis of Findings

1. Students’ understanding of the intricate details on the ongoing debate over the proper role of IT in relation to corporate strategy was inadequate.
2. Students’ ability to demonstrate proper use of vocabulary and discourse structures of the discipline in relation IT and corporate strategy were insufficient.
3. Students were able to demonstrate reasoning behind and knowledge of steps required to successfully assembly and manage the IT portfolio.
4. Students understood the relationship between IT portfolio and corporate strategy.

Student Feedback

As we do every year, MIS majors were presented the results of the 2005 Strategic user of IT assessment results and asked to provide their interpretation. Students believed that provision of the new rubric would improve performance. The students can use the rubrics as a study guide to better focus their analysis while looking at cases.

Curricular Recommendations Based on These Assessment Results

• Syllabus changes to the MGMT 4331 class to include more reading to stress proper use of vocabulary and discourse structures when discussing IT corporate strategy. The original syllabus from Fall 2005 is shown is appendix D. The changed appendix is shown in appendix E.
• Place more emphasis in class discussions and additional readings in the Wall Street Journal on the ongoing debate over the proper role of IT in corporate strategy.Benchmarking of MIS Majors’ Business Core Assessment

Performance of MIS majors on the ETS Business Core Exam during past years (score is number correct out of 200):

Faculty Involvement in Process

Throughout the year assessment findings, activities, and process were discussed in departmental faculty meetings. Each MIS faculty member participated in assessment data analysis, interpretation, and process refinement.

a) In April faculty define programmatic changes that will be implemented in fall semester.
b) In April and August faculty refine assessment process, including techniques for measuring accomplishment of student learning objectives.
c) In February faculty analyze and interpret collected assessment data.3. Involvement of Other Stakeholders

Industry

The MIS Business Advisory Council has participated in identifying and refining the program goals and needed student competencies for the MIS program. In addition, business representatives participate in rubric construction/validation and in evaluating assessment data.

Students

Like past years, student participation was achieved in evaluating assessment data—reviewed and evaluated written reports. Student feedback on the newly developed rubric was also obtained.
Assessment findings were presented to MIS majors; their interpretation of the findings and career implications were requested. These additional data provided insight valuable in interpreting the assessment findings.