CpE 405 - Information Coding Systems
CATALOG DATA
Source coding; Huffman and arithmetic coding, predictive and differential coding, dictionary techniques, compression standards for multimedia signals. Channel coding; Linear block codes; Convolutional codes; Low density parity check codes; Hashing and Information retrieval.
COREQUISITES AND PREREQUISITES
Prerequisites: EE 220 and (MATH 431 or CpE 260). All prerequisites must be completed with a grade of C or better. Advanced Standing required.
TEXTBOOK
Khalid Sayood, “Introduction to Data Compression”, 4th Edition, Morgan Kaufmann, 2012.
COORDINATORS:
Dr. Shahram Latifi, Dr. Emma Regentova*
TOPICS:
§ Information theory: preliminaries for lossless compression.
§ Source models. Entropy coding. Huffman Code, Adaptive Huffman code.
§ Golomb, Tunstall and Rice Codes
§ Arithmetic coding.
§ Dictionary techniques: LZ77, LZ78, UNIX compress, GIF, PNG.
§ Facsimile coding schemes and standards: ITU Group 3 and 4, JBIG
§ Mathematical preliminaries of lossy compression.
§ Scalar and vector quantization.
§ Differential Encoding: DM, DPCM.
§ DCT and wavelet coding.
§ Compression standards for audio, video and still image coding: JPEG, MPEG-4
§ Noisy channel models. Error detection and correction. Parity check.
§ Linear block codes, cyclic codes
§ Convolutional codes
§ Low-Density Parity-Check Codes.
§ Hash codes and information retrieval
COURSE OUTCOMES (ABE course outcomes) [UULO course outcomes]:
Upon completion of this course, students should be able to:
1. Understand the concepts of Entropy, Shannon bound, and the need for source coding (1.1, 1.2, 1.3) [1,2]
2. Understand and implement Huffman, Arithmetic and Dictionary Coding (1.4,1.8) [1,2]
3. Apply scalar and vector quantization to real signals (1.1, 1.2) [1,2]
4. Understand the principles governing predictive coding and differential coding (1.1,1.2,1.4) [1,2]
5. Understand the need, scientific and commercial applications of the source and channel coding, watermarking and hashing (1.6,1.8,1.9) [1,2,3,4]
6. Design coding algorithms for specific sources (1.10) [1,2,3,4]
7. Become familiar with various compression standards (1.9, 1.10) [1,2,4]
8. Analyze performance of various error detection/correction schemes. (1.9, 1.10) [1,2,4]
9. Understand principles of steganography and information retrieval. (1.1, 1.2, 1.3) [1,2]
Program Outcomes
1. The appropriate technical knowledge and skills:
2. an ability to apply advanced mathematics such as differential equations and discrete mathematics,
3. an ability to apply knowledge of basic sciences,
4. an ability to apply knowledge of computer science
5. an ability to apply knowledge of probability and statistics,
6. an ability to apply knowledge of engineering
7. an ability to design a system, component, or process to meet desired needs within realistic constraints
8. an ability to identify, formulate, and solve engineering problems,
9. an ability to analyze and design complex electrical and electronic devices,
10. an ability to use the techniques, skills, and modern engineering tools necessary for engineering practice,
2. The appropriate interpersonal skills:
2. an ability to communicate effectively.
3. The knowledge and skills to be responsible citizens:
3. a recognition of the need for, and an ability to engage in life-long learning,
4. a knowledge of contemporary issues,
UULO Course Outcomes
1. Intellectual Breadth and Lifelong Learning
2. Inquiry and Critical Thinking
3. Communication
4. Global/Multicultural Knowledge and Awareness
5. Citizenship and Ethics
COMPUTER USAGE:
MATLAB, Quartus
CLASS SCHEDULE:
Lecture 3 hours per week
Grading:
Homework(20%), Midterm Project(20%), Midterm Test(20%), Final Project (20%),Final Examination (20%)
COURSE PREPARER AND DATE OF PREPARATION:
Emma Regentova, Spring 2017