This course goes beyond theory, offering hands-on experience in building AI systems with the mindset and pace of a modern AI startup. Using a project-driven approach, students learn to architect, develop, and deploy real-world AI solutions entirely in the cloud, leveraging tools like Microsoft Azure, Terraform, and other cutting-edge technologies central to today’s AI ecosystems. Students will incrementally build a production-grade, cloud-deployed AI system—individually and in teams—mirroring the end-to-end process of launching an AI startup. The course emphasizes not just tools, but the engineering mindset needed for building scalable, adaptable, and reliable AI systems. Key focus areas include: 1.) Data and Model Optimization – Streamlining data pipelines, adapting existing models, and using ensembles for efficiency and performance. 2.) System Integration – Developing distributed systems with messaging, NoSQL persistence, and robust monitoring. 3.) Cloud Deployment – Live updating through containerization and orchestration in a 100% cloud-based environment. By the end of the course, students will have built a portfolio-ready AI product and gained a deep, practical foundation in modern AI engineering for production.
See Introduction Module
By the end of the course, the student acquires the following skills and capabilities:
Complete an advanced, end-to-end machine learning and inference system via: optimization of machine learning models for both performance and computer resource usage, integration of the optimized model into an complete system that integrates supporting technologies, deployment into various computer environments via proper packaging and orchestration, and post-deployment adaptation
Various book chapters and on-line tutorials/documentation as listed. All books are available through the Orielly account using a student’s Hopkins login credentials following this link: https://www.oreilly.com/member/login/ and use your John Hopkins email address. You also have the WSJ available using this link - https://education.wsj.com/search-students/ and search for John Hopkins.
Up-to-date Google Chrome Browser and high speed internet connection. All design, development, and deployment is done in the Microsoft Azure Cloud resources. A python development enviroment - such as Visual Studio Code , Cursor (Pro account Free for students for 1 year), or google antigravity.
Grading consists of multiple components:
The course does not offer pluses and minuses.
A: >= 90
B: >= 80
C: >= 70
F: <70
All assignments offer a detailed rubric that indicates the expectations. Please review the rubric for each assignment prior to starting the assignment. If a rebru
The course has a rapid flow in order to achieve all the increments of the project. It is key that you keep pace with the various assignments.
Deadlines for Adding, Dropping, and Withdrawing from Courses
Students may add a course up to one week after the start of the term for that particular course. Students may drop courses according to the drop deadlines outlined in the EP academic calendar. Between the 6th week of the class and prior to the final withdrawal deadline, a student may withdraw from a course with a W on their academic record. A record of the course will remain on the academic record with a W appearing in the grade column to indicate that the student registered and withdrew from the course.
Academic Misconduct Policy
Students with Disabilities - Accommodations and Accessibility
Student Conduct Code
Classroom Climate
JHU is committed to creating a classroom environment that values the diversity of experiences and perspectives that all students bring. Everyone has the right to be treated with dignity and respect. Fostering an inclusive climate is important. Research and experience show that students who interact with peers who are different from themselves learn new things and experience tangible educational outcomes. At no time in this learning process should someone be singled out or treated unequally on the basis of any seen or unseen part of their identity. If you have concerns in this course about harassment, discrimination, or any unequal treatment, or if you seek accommodations or resources, please reach out to the course instructor directly. Reporting will never impact your course grade. You may also share concerns with your program chair, the Assistant Dean for Diversity and Inclusion, or the Office of Institutional Equity. In handling reports, people will protect your privacy as much as possible, but faculty and staff are required to officially report information for some cases (e.g. sexual harassment).
Course Auditing
When a student enrolls in an EP course with “audit” status, the student must reach an understanding with the instructor as to what is required to earn the “audit.” If the student does not meet those expectations, the instructor must notify the EP Registration Team (EP-Registration@exchange.johnshopkins.edu) in order for the student to be retroactively dropped or withdrawn from the course (depending on when the "audit" was requested and in accordance with EP registration deadlines). All lecture content will remain accessible to auditing students, but access to all other course material is left to the discretion of the instructor.