Block C - Data Modelling
In block A, you explored various themes around digital transformation and critically examined applications of AI and digital technologies to existing businesses processes. In block B, you went a step further and helped a real-life client get more insight out of their data using data science tools to pre-process and get insight out of data. In this block, you will take on a more hands-on approach towards data modelling data using tools such as deep learning. In particular, this block will focus on key aspects of the modelling phase of a data science project lifecycle such as deep learning, explainable and responsible artificial intelligence (AI), and human-centered design
Project Based Learning - Creative Brief
In this project, you will develop responsible and explainable AI algorithms which are human centered. This assignment is based on the Kaggle Inclusive Images Challenge (see here) organised jointly by Google and Kaggle.
Large, publicly available image datasets, such as ImageNet, Open Images and Conceptual Captions are commonly used to develop and rank image classification algorithms. While these datasets are a necessary and critical part of developing useful machine learning (ML) models, some open-source data may be biased. As patterns in such datasets ultimately decide what an AI model learns and predicts, such bias may lead us to develop models that may not necessarily reflect the true reality.
For example, the images below show the predictions of a standard AI image classifier trained to predict if a given image represents a wedding or not. While the AI correctly detects a wedding in the first 3 images, it fails to do so in the last image. This is a consequence of developing an AI algorithm without being sensitive to biases that my exist in the training data.
Your goal for this block is to fix such broken implementations of AI and ensure that AI remains responsible, transparent and explainable. To this end, you are expected to design, implement and evaluate AI algorithms based on deep neural networks that can accurately classify an image while being sensitive to biases that may be present in the data the network is trained on. Further, keeping the end user in mind, imagine a use-case where such an algorithm would have value and create a protype of an application using the concepts learned in Human centered AI.
At the beginning of the project, you will be introduced to the project by one of the lecturers. Throught out the block, you can consult the lecturers if you have any questions or wish to deepen your understanding of project. Please refer to the project brief for more detailed information.
Creative Brief Timeline
Creative Brief Requirements:
- Dataset: Google Open images
- Class Labels: Pick a maximum of 5 labels among all the image level labels present in the data.
- Tools: Keras, Numpy, Matplotlib
- Prototype: Wireframe demo of your application made in Adobe XD.
Please click the links below to view more detailed requirements:
Block Outline
Week 1 : Responsible & Explainable AI (XAI)
Monday
Tuesday
DataLab 1: Implicit bias & A Designer's Critical Alphabet
Wednesday
Fairness & Bias: Individual fairness, debiasing techniques & toolkits
Thursday
Fairness & Bias: Group fairness metrics
Friday
DataLab 2: Fairness metrics, and debiasing techniques for image data
Week 2 : Introduction to Neural Networks
Monday
AI, Machine Learning, Deep Learning: more than just buzzwords?
Tuesday
Wednesday
Thursday
Friday
DataLab: Perceptron and Neural Network in Python
Week 3 : Neural Networks Using TensorFlow
Monday
Tuesday
Neural Networks in TensorFlow - Regression
Wednesday
Neural Networks in TensorFlow - Classification
Thursday
Neural Networks in Google PlayGround
Friday
Week 4 : Image Classification using Convolution Neural Network
Monday
Tuesday
DataLab: Working on Creative Brief tasks
Wednesday
Convolution Neural Network - Deep Dive
Thursday
Data Pre-procession and Data Augmentation
Friday
DataLab: Working on Creative Brief tasks
Week 5 : Deep Learning in Practice
Monday
Transfer Learning and fine tuning
Tuesday
DataLab: Working on Creative Brief tasks
Wednesday
Deep Learning: Practical issues and best practices
Thursday
Transfer Learning and fine tuning
Friday
DataLab: Working on Creative Brief tasks
Week 6 : Deep Learning and XAI
Monday
XAI: The need for explanations
Tuesday
Wednesday
Feature Attribution in Computer Vision
Thursday
Moving beyond feature attribution
Friday
Week 7 : Human Centered AI
Monday
Interaction & information processing fundamentals
Tuesday
DataLab: Risk-Assessment of disruptive technologies
Wednesday
Thursday
Friday
DataLab: Wizzard of Ozz Workshop
Week 8: Human Centered AI
Monday
Tuesday
Wednesday
Thursday
DataLab: Wireframes and final presentation
Friday
Good Friday: So you have a day-off!