Block C - Data Modelling

In block A, you explored various themes around digital transformation and critically examined applications of AI and digital technologies to existing businesses processes. In block B, you went a step further and helped a real-life client get more insight out of their data using data science tools to pre-process and get insight out of data. In this block, you will take on a more hands-on approach towards data modelling data using tools such as deep learning. In particular, this block will focus on key aspects of the modelling phase of a data science project lifecycle such as deep learning, explainable and responsible artificial intelligence (AI), and human-centered design

Project Based Learning - Creative Brief

In this project, you will develop responsible and explainable AI algorithms which are human centered. This assignment is based on the Kaggle Inclusive Images Challenge (see here) organised jointly by Google and Kaggle.

Large, publicly available image datasets, such as ImageNet, Open Images and Conceptual Captions are commonly used to develop and rank image classification algorithms. While these datasets are a necessary and critical part of developing useful machine learning (ML) models, some open-source data may be biased. As patterns in such datasets ultimately decide what an AI model learns and predicts, such bias may lead us to develop models that may not necessarily reflect the true reality.

For example, the images below show the predictions of a standard AI image classifier trained to predict if a given image represents a wedding or not. While the AI correctly detects a wedding in the first 3 images, it fails to do so in the last image. This is a consequence of developing an AI algorithm without being sensitive to biases that my exist in the training data.


Your goal for this block is to fix such broken implementations of AI and ensure that AI remains responsible, transparent and explainable. To this end, you are expected to design, implement and evaluate AI algorithms based on deep neural networks that can accurately classify an image while being sensitive to biases that may be present in the data the network is trained on. Further, keeping the end user in mind, imagine a use-case where such an algorithm would have value and create a protype of an application using the concepts learned in Human centered AI.

At the beginning of the project, you will be introduced to the project by one of the lecturers. Throught out the block, you can consult the lecturers if you have any questions or wish to deepen your understanding of project. Please refer to the project brief for more detailed information.

Creative Brief Timeline



Creative Brief Requirements:

  • Dataset: Google Open images
  • Class Labels: Pick a maximum of 5 labels among all the image level labels present in the data.
  • Tools: Keras, Numpy, Matplotlib
  • Prototype: Wireframe demo of your application made in Adobe XD.

Please click the links below to view more detailed requirements:

Block Outline

Week 1 : Responsible & Explainable AI (XAI)

Monday

Fairness & Bias: Definitions

Tuesday

DataLab 1: Implicit bias & A Designer's Critical Alphabet

Wednesday

Fairness & Bias: Individual fairness, debiasing techniques & toolkits

Thursday

Fairness & Bias: Group fairness metrics

Friday

DataLab 2: Fairness metrics, and debiasing techniques for image data

Week 2 : Introduction to Neural Networks

Monday

AI, Machine Learning, Deep Learning: more than just buzzwords?

Data Structures - tensor

Tuesday

DataLab: tensors

Wednesday

Perceptron

Thursday

Neural Networks concepts

Friday

DataLab: Perceptron and Neural Network in Python

Week 3 : Neural Networks Using TensorFlow

Monday

Introduction to TensorFlow

Tuesday

Neural Networks in TensorFlow - Regression

Wednesday

Neural Networks in TensorFlow - Classification

Thursday

Neural Networks in Google PlayGround

Friday

DataLab: Classification

Week 4 : Image Classification using Convolution Neural Network

Monday

Image Classification

Tuesday

DataLab: Working on Creative Brief tasks

Wednesday

Convolution Neural Network - Deep Dive

Thursday

Data Pre-procession and Data Augmentation

Friday

DataLab: Working on Creative Brief tasks

Week 5 : Deep Learning in Practice

Monday

Transfer Learning and fine tuning

Tuesday

DataLab: Working on Creative Brief tasks

Wednesday

Deep Learning: Practical issues and best practices

Thursday

Transfer Learning and fine tuning

Friday

DataLab: Working on Creative Brief tasks

Week 6 : Deep Learning and XAI

Monday

XAI: The need for explanations

Tuesday

DataLab: XAI

Wednesday

Feature Attribution in Computer Vision

Thursday

Moving beyond feature attribution

Friday

DataLab: XAI

Week 7 : Human Centered AI

Monday

Interaction & information processing fundamentals

Tuesday

DataLab: Risk-Assessment of disruptive technologies

Wednesday

Interaction design

Thursday

Interface design

Friday

DataLab: Wizzard of Ozz Workshop

Week 8: Human Centered AI

Monday

U/X testing using A/B testing

Tuesday

DataLab: A/B Testing

Wednesday

Thursday

DataLab: Wireframes and final presentation

Friday

Good Friday: So you have a day-off!