525.759.81 - Image Compression, Packet Video, and Video Processing

Course Structure

The course content is divided into modules. Course Modules can be accessed by clicking Course Content on the left menu. A module will have several sections including the overview, content, readings, discussions, and assignments. Students are encouraged to preview all sections of the module before starting. Most modules run for a period of seven (7) days, exceptions are noted on the Course Outline page. Students should regularly check the Calendar and Announcements for assignment due dates. The students are also required to do an end of course project which will be reported in four parts:

1. Project Proposal
2. Project Status Report (Redefinition of proposal)
3. Project Presentation (Powerpoint, and recording of presentation)
4. Project Paper

Course Topics

• Module 1 - Introduction
  
• Module 2 - Image Formation and Video Models
  
• Module 3 - Transforms
  
• Module 4 - Lossless Coding and Predictive Models
  
• Module 5 - Transform Coding (JPEG)
  
• Module 6 - Video Processing using Deep Learning
  
• Module 7 - Transform Coding (Wavelets)
  
• Module 8 - 2D and Basic Motion Estimation
  
• Module 9 - Advanced Motion Estimation
  
• Module 10 - Video Coding
  
• Module 11 - Compression Standards
  
• Module 12 - Video Processing
  
• Module 13 - Applications of Video
  
• Module 14 - Authentication and Forensic Video Processing
  

Course Goals

To provide the students with the underlying theory and algorithms for image and video compression. Elements of compression algorithms that are also used for video processing methods are also covered.

Course Learning Outcomes (CLOs)

• Utilize the mathematical basis behind ISO Standard Image and Video compression algorithms to derive the performance and quality of those algorithms.
• Apply image formation techniques and computer vision methods to developing compression algorithms.
• Describe the operating environment of image and video compression.
• Perform statistical assessment on compression case studies that directly predict the performance of compression algorithms
• Identify expected artifacts that are caused by compression in both image and video systems.
• Explain the role and limitations of image and video compression algorithm on video processing.
• Use data compression artifacts to prove image and video has been manipulated.
• Utilize elements of image and video compression in video processing applications.

Textbooks

Thyagarajan, K.S. (2011). Still image and video compression with MATLAB®. Hoboken, NJ: John Wiley & Sons, Inc.

ISBN  978-0-470-48416-6.

Textbook information for this course is available online through the appropriate bookstore website: For online courses, search the MBS website.

Other Materials & Online Resources

Optional

If you have no background with Matlab, the optional text book provides a good introduction and reference:

Hanselman, D.C. & Littlefield, B.L. (2012) Mastering MATLAB®. Upper Saddle River, NJ: Prentice Hall.

ISBN 978-0136013303

In some modules, e-book chapters may also be required, which will be made available through The Sheridan Libraries e-reserves system.

Required Software

MATLAB

You will need access to a recent version of MATLAB (2017a or higher) with the Signal Processing Toolkit, image processing toolbox, Wavelet Toolbox and Computer Vision Toolbox.  The university is now supplying MATLAB at no cost to student and faculty. Log into myJHU account (using your JHED ID), and select mySoftware at the Technology Tab. Follow the link to the ITservices web page where instructions for downloading and activating the Matlab license are provided. Note that as a Hopkins Student, you can download the lastest version of Matlab. While there are some programmatic differences in versions, differences in class code will be announced, and solutions shared in the discussion group.

Student Coursework Requirements

It is expected that each class will take approximately 5–9 hours per week to complete. Here is an approximate breakdown: reading the assigned sections of the texts (approximately 2–3 hours per week) as well as some outside reading, listening to the audio annotated slide presentations (approximately 1–2 hours per week), and writing/programming assignments (approximately 2-4 hours per week). Note that the discussion forum should be viewed as many times as possible during the week, so that comments and questions might be raised. Treat the discussion forum as a converation where you supply at least one detailed response, and 5 comments or questions per week.

This course will consist of four basic student requirements:

1. Preparation and Participation (Class Discussions) (30% of Final Grade Calculation)

The discussion aspect of the class will consist of topics to be discussed every week. Students are expected to participate, offering researched comments and information. Assignments are based partially on the text, and on problems offered by Dr. Beser. MATLAB programming will be required to complete the assignments.

Each student is responsible for carefully reading all assigned material and being prepared for discussion. The majority of readings are from the course text. Additional reading may be assigned to supplement text readings.

Post your initial response to the discussion questions by the evening of day 3 for that module week. Posting a response to the discussion question is part one of your grade for class discussions (i.e., Timeliness).

Part two of your grade for class discussion is your interaction (i.e., responding to classmate postings with thoughtful responses) with at least two classmates (i.e., Critical Thinking). Just posting your response to a discussion question is not sufficient; we want you to interact with your classmates. Be detailed in your postings and in your responses to your classmates' postings.

Feel free to agree or disagree with your classmates. Please ensure that your postings are civil and constructive. Please understand that the discussion group is an exploration of the topic. All comments should be constructive, and respective of the participants. A lack of civility will result in a F for that session.

Dr. Beser will monitor class discussions and will respond to some of the discussions as discussions are posted. In some instances, Dr. Beser will summarize the overall discussions and post the summary for the class.

Evaluation of preparation and participation is based on contribution to discussions. Preparation and participation is evaluated by the following grading elements:

1. Timeliness (50%)
2. Critical Thinking (50%)

• 2 Assignments (40% of Final Grade Calculation)

Assignments will include a mix of qualitative assignments (e.g. literature reviews, model summaries), quantitative problem sets, and MATLAB programming problems. Include a cover sheet with your name and assignment identifier. Also include your name and a page number indicator (i.e., page x of y) on each page of your submissions. Each problem should have the problem statement, assumptions, computations, and conclusions / discussion delineated. All Figures and Tables should be captioned and labeled appropriately. If possible, use PDF format for the submittal and sign your work.

All assignments are due according to the dates in the Calendar.

Late submissions will be reduced by one letter grade for each week late (no exceptions without prior coordination with the instructor).

If, after submitting a written assignment a student is not satisfied with the grade received, the student is encouraged to redo the assignment and resubmit it. If the resubmission results in a better grade, that grade will be substituted for the previous grade.

• 3 Student Project (30% of Final Grade Calculation)

A class project will be proposed by the student at the end of Module 6. Project status or new proposal is due at the end of Module 9. The last week will be devoted to the class project. The project shall typically be a single student effort, but teams of no more than 2 students shall be considered on a project by project basis.

The class project is evaluated by the following grading elements:

1. Project Proposal: Goals and Objective of Project, Approach, Resources and expected results (See Class Project Description) (15%) The Proposal will be graded on:
   1. Scope of Problem
   2. Relevance to image/video compression or video processing
   3. Identification of resources
   4. Schedule for project
   5. Expectation of results (Realizable within time frame)
2. Project Status Report: Report on the progress of the project, This is also an opportunity to rescope the problem statement. (15%). The status report will be graded on:
   1. Progress as toward goal or a rescope of the proposal.
   2. If the project proposal is rescoped, the criteria from the Project Proposal will be applied
   3. Resources that have been coordinated/brought to project.
3. Project Paper: (30%) The paper reports the research topic. The Student technical understanding of the class project topic as described in the Class Project Description (10%). This is a formal class paper, and should reflect the work that was done in support of the project proposal or it’s rescope. The student should demonstrate a clear description of the approach, assumptions, and a detailed analysis. Supporting data files shall also be submitted where appropriate. The paper shall reflect the preparation and effort that the student has made to perform the research. The paper shall be reviewed by the class, and comments will be solicited as part of the class grade. The student should refrain from producing a paper that duplicates a lecture in the class, nor should the student resort to “Buzz Word”. The paper and presentation is a mini lecture that the student is providing to their classmates, and should expand on the concepts covered in class, or on a related video processing topic. Dr. Beser shall be the sole arbiter of the grade for the paper, but will consider the comments of the class in his decision.
4. Project Presentation: (30%) The student shall produce a PowerPoint presentation that covers the research. The presentation shall be page limited (not more than 15 slides). The Student shall present the paper to the class during a scheduled Zoom session, which shall be recorded for those students who were not able to attend.  Students should make every effort to attend these on line presentation, and provide immediate feedback to the presenter. A similar grading criterion that was used on the Project Paper will be applied to the presentation. The presentation shall be an abstract of the work, with detailed information provided by the paper. Typical length shall be 15 minutes with 5 minutes for questions.

Grading Policy

Student assignments are due according to the dates in the Calendar. Dr. Beser will post grades one week after assignment due dates.

We generally do not directly grade spelling and grammar. However, egregious violations of the rules of the English language will be noted without comment. Consistently poor performance in either spelling or grammar is taken as an indication of poor written communication ability that may detract from your grade.

A grade of A indicates achievement of consistent excellence and distinction throughout the course—that is, conspicuous excellence in all aspects of assignments and discussion in every week.

A grade of B indicates work that meets all course requirements on a level appropriate for graduate academic work. These criteria apply to both undergraduates and graduate students taking the course.

Final grades will be determined by the following weighting:

Academic Policies

Deadlines for Adding, Dropping and Withdrawing from Courses

Students may add a course up to one week after the start of the term for that particular course. Students may drop courses according to the drop deadlines outlined in the EP academic calendar (https://ep.jhu.edu/student-services/academic-calendar/). Between the 6th week of the class and prior to the final withdrawal deadline, a student may withdraw from a course with a W on their academic record. A record of the course will remain on the academic record with a W appearing in the grade column to indicate that the student registered and withdrew from the course.

Academic Misconduct Policy

All students are required to read, know, and comply with the Johns Hopkins University Krieger School of Arts and Sciences (KSAS) / Whiting School of Engineering (WSE) Procedures for Handling Allegations of Misconduct by Full-Time and Part-Time Graduate Students.

This policy prohibits academic misconduct, including but not limited to the following: cheating or facilitating cheating; plagiarism; reuse of assignments; unauthorized collaboration; alteration of graded assignments; and unfair competition. Course materials (old assignments, texts, or examinations, etc.) should not be shared unless authorized by the course instructor. Any questions related to this policy should be directed to EP’s academic integrity officer at ep-academic-integrity@jhu.edu.

Students with Disabilities - Accommodations and Accessibility

Johns Hopkins University values diversity and inclusion. We are committed to providing welcoming, equitable, and accessible educational experiences for all students. Students with disabilities (including those with psychological conditions, medical conditions and temporary disabilities) can request accommodations for this course by providing an Accommodation Letter issued by Student Disability Services (SDS). Please request accommodations for this course as early as possible to provide time for effective communication and arrangements.

For further information or to start the process of requesting accommodations, please contact Student Disability Services at Engineering for Professionals, ep-disability-svcs@jhu.edu.

Student Conduct Code

The fundamental purpose of the JHU regulation of student conduct is to promote and to protect the health, safety, welfare, property, and rights of all members of the University community as well as to promote the orderly operation of the University and to safeguard its property and facilities. As members of the University community, students accept certain responsibilities which support the educational mission and create an environment in which all students are afforded the same opportunity to succeed academically. 

For a full description of the code please visit the following website: https://studentaffairs.jhu.edu/policies-guidelines/student-code/

Classroom Climate

JHU is committed to creating a classroom environment that values the diversity of experiences and perspectives that all students bring. Everyone has the right to be treated with dignity and respect. Fostering an inclusive climate is important. Research and experience show that students who interact with peers who are different from themselves learn new things and experience tangible educational outcomes. At no time in this learning process should someone be singled out or treated unequally on the basis of any seen or unseen part of their identity. 
 
If you have concerns in this course about harassment, discrimination, or any unequal treatment, or if you seek accommodations or resources, please reach out to the course instructor directly. Reporting will never impact your course grade. You may also share concerns with your program chair, the Assistant Dean for Diversity and Inclusion, or the Office of Institutional Equity. In handling reports, people will protect your privacy as much as possible, but faculty and staff are required to officially report information for some cases (e.g. sexual harassment).

Course Auditing

When a student enrolls in an EP course with “audit” status, the student must reach an understanding with the instructor as to what is required to earn the “audit.” If the student does not meet those expectations, the instructor must notify the EP Registration Team [EP-Registration@exchange.johnshopkins.edu] in order for the student to be retroactively dropped or withdrawn from the course (depending on when the "audit" was requested and in accordance with EP registration deadlines). All lecture content will remain accessible to auditing students, but access to all other course material is left to the discretion of the instructor.