645.769.81 - System Test & Evaluation

Course Structure

The course is divided into five modules accessed by clicking on Modules on the left menu of Canvas, each with several sections including the overview, content, resources, and assignments. Check the Course Outline for topics and assignment due dates.

Course Topics

• Test & Evaluation Definition and Life Cycle Phases
• Group Project Introduction
• Requirements Traceability
• Test Objectives, Concepts, & Environments
• MBSE and Architecture for T&E
• Statistical Techniques for Test Design & Planning
• Systems Integration Lab (SIL) Capabilities
• Informal Testing and Test Cases
• Formal Testing and Test Cases
• Methods and Tools Applied to T&E
• Operational Test & Evaluation During Production and Planning
• Deployed Systems, System of Systems (SoS), and T&E
• Artificial Intelligence and T&E

Course Goals

Create a test and evaluation approach that results in fielding a trustworthy, secure system that meets requirements. 

Course Learning Outcomes (CLOs)

• Describe a system test and evaluation process that reduces risk by assessing if a system meets requirements and performs as intended in its operational environment.
• Define test objectives, test concepts, and the method of verification for each system requirement to assure test objectives and concepts are traceable to requirements.
• Create an integration and test approach, which includes construction of efficient execution paths and test cases to describe how the system will be built and tested.
• Create a qualification test approach and test cases (cross referenced to system requirements) to generate test results that inform a system acceptance decision.
• Develop operational test and evaluation scenarios, field tests, and acceptance criteria for operational states and environmental factors.

Textbooks

No required textbook. Resources posted by module are available through the eReserves link on the course menu.

Other Materials & Online Resources

Online references and resources are available in E-Reserves on Canvas and listed in each module.

Required Software

Microsoft Office Suite, Cameo or CORE recommended but not required.

Click on the link to the SE Toolkit in the Canvas menu to see several options for software tools available for Model Based Systems Engineering (MBSE).

Student Coursework Requirements

This course consists of FIVE basic student requirements, described on the next pages:

1. Live Zoom Synchronous Sessions (Online Office Hour or VL Class participation)
2. Discussions
3. Homework Assignments
4. Course Exam
5. Group Project Final Report and Presentation

1 – Live Zoom Synchronous Sessions - 5% of Final Grade

        (Online Office Hour or VL Class participation)

The expectation is that students will attend these weekly sessions and will miss a session only when necessary.  Sessions are recorded for those unable to attend or for review while working on assignments, not as a substitute for attending live.

During these sessions, module topics are discussed, assignments are introduced, and questions are addressed.  One session is devoted to capstone guidance.  Th Virtual Live session presents and discusses module lecture topics

Each session is graded as attended (100%) or not attended (0%) including playbacks of recordings when a session is missed. 

2 - Discussions - 20% of Final Grade

Please carefully review lectures and reading material to be prepared for and discussions. Most readings are supplemental, a resource to use if needed. Required readings are called out in assignments and listed in E-Reserves.

The purpose of discussions is to interact with others about a specific topic.  Feel free to agree or disagree with others in a way that is civil and constructive.  Insightful, meaningful initial postings and responses to others will receive the highest grades.

Note: Virtual-live sessions will hold in-class participation for discussions.  Posting to Canvas is for missed weekly VL sessions as described below for Online sections.

Online sections complete two parts for each discussion, each 50% of the grade.

1.  Post an initial response to the by the first due date listed for the discussion in the Course Outline.  Where sources are drawn upon, please cite the source.

      A 5-point late penalty is assessed for each week late.

 

2 - Homework Assignments - 30% of Final Grade

There are three homework assignments, each worth 10% of the total grade. Assignments may include qualitative questions or essays, or quantitative problem sets and case study assessments.  

A grading rubric is included with each homework that shows how each question or item is weighted, and what is expected to address a particular question or item.

Please include your name and an assignment identifier, along with your name and a page number on each page. Due dates are listed in the Course Outline.

Late submissions will be reduced by one letter grade for each week late (no exceptions without prior coordination with the instructors).

If, after submitting a written assignment a grade is received less than 82, the assignment may be redone and resubmitted.  If the resubmission results in a better grade, a grade is substituted that is no higher than 90.

3 - Course Exam - 15% of Final Grade

The exam will include qualitative questions (narratives about lessons learned and their significance), and multiple-choice questions.

 A grading rubric is included with the exam that shows how each question or item is weighted, and what is expected to address a particular question or item.

Please include your name and an assignment identifier, along with your name and a page number on each page. The exam is due after the midterm.

Late assignments or resubmissions are not accepted for the exam. 

4 - Group Project Final Report and Presentation - 30% of Final Grade

 Module 1

A Group Project Overview is presented and discussed during the weekly live sessions.  A project description and artifacts are posted in a zip file, along with a detailed grading rubric. The rubric weighs key products generated by the team and where points are earned for each product in the report. 

First draft interim work products are 5% of the total grade for the Course.

At the end of Module 1, teams are assigned to work on the Group Project throughout the semester.

Modules 2, 3, and 4

Each week throughout the semester, teams meet and work on the 10 key draft interim products for the Group Project Report and Presentation.

Team members are expected to be available every week of the semester.  Travel or other events are not a reason to be absent.  Access to the internet, email, and Canvas is expected regardless of location or commitments.

Module 5

The Group Project Final Report and Presentation is due before the end of the semester. The presentation submitted to Canvas is graded as part of the final report.  Also included are the 10 interim product first drafts as 5% of the final report grade.

 Late assignments are not accepted.  

Team presentations are scheduled in the last week of the course.  Attendance is required in the live session. 

The last discussion forum for the semester follows team presentations.  The focus is assessment of and commentary on test approaches of other teams.

Grading Policy

Assignments are due according to dates posted on the Canvas Course Outline.

A grade of A indicates achievement of consistent excellence and distinction throughout the course, all aspects of assignments and discussion every week.

A grade of B indicates work that meets all course requirements on a level appropriate for graduate academic work.

EP uses a +/- grading system (see “Grading System”, Graduate Programs catalog, p. 10).

Course Evaluation

T

The following weighting is used to determine final grades.

Academic Policies

Deadlines for Adding, Dropping and Withdrawing from Courses

Students may add a course up to one week after the start of the term for that particular course. Students may drop courses according to the drop deadlines outlined in the EP academic calendar (https://ep.jhu.edu/student-services/academic-calendar/). Between the 6th week of the class and prior to the final withdrawal deadline, a student may withdraw from a course with a W on their academic record. A record of the course will remain on the academic record with a W appearing in the grade column to indicate that the student registered and withdrew from the course.

Academic Misconduct Policy

All students are required to read, know, and comply with the Johns Hopkins University Krieger School of Arts and Sciences (KSAS) / Whiting School of Engineering (WSE) Procedures for Handling Allegations of Misconduct by Full-Time and Part-Time Graduate Students.

This policy prohibits academic misconduct, including but not limited to the following: cheating or facilitating cheating; plagiarism; reuse of assignments; unauthorized collaboration; alteration of graded assignments; and unfair competition. Course materials (old assignments, texts, or examinations, etc.) should not be shared unless authorized by the course instructor. Any questions related to this policy should be directed to EP’s academic integrity officer at ep-academic-integrity@jhu.edu.

Students with Disabilities - Accommodations and Accessibility

Johns Hopkins University values diversity and inclusion. We are committed to providing welcoming, equitable, and accessible educational experiences for all students. Students with disabilities (including those with psychological conditions, medical conditions and temporary disabilities) can request accommodations for this course by providing an Accommodation Letter issued by Student Disability Services (SDS). Please request accommodations for this course as early as possible to provide time for effective communication and arrangements.

For further information or to start the process of requesting accommodations, please contact Student Disability Services at Engineering for Professionals, ep-disability-svcs@jhu.edu.

Student Conduct Code

The fundamental purpose of the JHU regulation of student conduct is to promote and to protect the health, safety, welfare, property, and rights of all members of the University community as well as to promote the orderly operation of the University and to safeguard its property and facilities. As members of the University community, students accept certain responsibilities which support the educational mission and create an environment in which all students are afforded the same opportunity to succeed academically. 

For a full description of the code please visit the following website: https://studentaffairs.jhu.edu/policies-guidelines/student-code/

Classroom Climate

JHU is committed to creating a classroom environment that values the diversity of experiences and perspectives that all students bring. Everyone has the right to be treated with dignity and respect. Fostering an inclusive climate is important. Research and experience show that students who interact with peers who are different from themselves learn new things and experience tangible educational outcomes. At no time in this learning process should someone be singled out or treated unequally on the basis of any seen or unseen part of their identity. 
 
If you have concerns in this course about harassment, discrimination, or any unequal treatment, or if you seek accommodations or resources, please reach out to the course instructor directly. Reporting will never impact your course grade. You may also share concerns with your program chair, the Assistant Dean for Diversity and Inclusion, or the Office of Institutional Equity. In handling reports, people will protect your privacy as much as possible, but faculty and staff are required to officially report information for some cases (e.g. sexual harassment).

Course Auditing

When a student enrolls in an EP course with “audit” status, the student must reach an understanding with the instructor as to what is required to earn the “audit.” If the student does not meet those expectations, the instructor must notify the EP Registration Team [EP-Registration@exchange.johnshopkins.edu] in order for the student to be retroactively dropped or withdrawn from the course (depending on when the "audit" was requested and in accordance with EP registration deadlines). All lecture content will remain accessible to auditing students, but access to all other course material is left to the discretion of the instructor.