EE260 Spring 2021: Advanced VLSI Design for Machine Learning and AI
Instructor
Sheldon Tan (stan@ece.ucr.edu)
Office Hours: Thursday 3:00 to 4:00pm (better by appointment).
Office: WCH 424
Lecture
Tuesday and Thursday from 11am to 12:20pm
Location:
Topic: EE260 Spring 2021
Time: 11:00 AM Pacific Time (US and Canada)
Join Zoom Meeting
https://ucr.zoom.us/j/92250383755?pwd=WmVrdzdsRisxVnBIZURCQWEwUHVJdz09
Meeting ID: 922 5038 3755
Passcode: 338781
Teaching assistants
Sheriff Sadiqbatcha (ssadi003@ucr.edu)
Office Hour: Thursday 2:00pm to 3:00 pm (TA will attend each course, so better by appointment right after class)
TA Office Room: WCB 361
Prerequisite
Basic background in machine learning, VLSI designs
Course description
The course will introduce the advanced topics in modern VLSI IC design techniques and methodologies for emerging applications. Topic includes VLSI/FPGA design and optimization techniques for deep neutral network, approximate/stochastic computing, computing in memory, ML/AI-based approaches to VLSI design methodologies and emerging quantum/Ising computing.
Course background and description
The first working silicon transistor was invented at Bell lab in 1954 by Morris Tanenbaum and commercially produced by Texas Instrument in 1954 and it has been 62th anniversary of the invention. Recently machine learning, especially deep neutral networks (DNN) take us by storm as they propelled an evolution in machine learning fields and redefined many existing applications with new human-level AI capabilities. DNNs such as convolution neural networks (CNN) have recently been applied to many cognitive applications such as visual object recognition, object detection, speech recognition, natural language understanding, etc. due to dramatic accuracy improvements in those tasks. In this course, we will focus on recent advances in DNNs and how to design fast and power efficient DNN networks for many emerging applications and computing platforms. We also cover important topics such as approximate/stochastic computing, novel compute architectures and computing in/near memory techniques. We will also cover emerging machine learning design techniques for VLSI digital and analog circuit design. Important emerging topics such as quantum/Ising computing will be also covered. This course has a large emphasis on paper survey and seminar presentations of many important techniques.
Who can take the course?
Both EE and CS undergraduate and graduate students are welcome as VLSI design are fundamental knowledge and skills for hardware implementation of today's complicated systems.
Course topics and calendars
1.Machine learning and AI based solution for electronic design automation (EDA)
- Electromigration modeling and analysis techniques
- EM-aware optimization and management at the circuit and system levels
- Advanced circuit simulation and modeling techniques
- Thermal modeling and analysis techniques
- Dynamic thermal/power/reliability management and optimization
- Power delivery network and design
2.Approximate and stochastic computing for machine learning
3. VLSI architecture for deep neutral networks
4.Computing in/near memory techniques
5.Advanced design techniques for deep neutral networks
6.Machine learning or AI of Thing (AIOT)
7.VLSI architecture and circuit design for machine/deep learning
8.GPU based LU factorization techniques
9.Machine /deep learning applications (YOLO and OpenPose etc.)
Reference book
Lecture notes and related papers.
Grading
Paper survey and presentations : 50%
Final project, project report and project presentation: 50%
All of them will be graded on the scale of 0 to 100 with 100 being the maximum score.
Project
Each student (can form a team with no more than 2 people) need to work on a project in this course. The topics need to be approved by instructor.