This course is an intuitive, hands-on introduction to the core concepts in AI, data science and machine learning. This is your artificial intelligence 101, data science 101 and machine learning 101 as there is significant overlap. The training focuses on key skills, leaving you with a deep understanding of the foundations of AI and data science and even some of the more advanced tools used in the field.
The skills taught are transferable to all software platforms, and the course does not involve coding, or require any coding knowledge or experience. A tool with a graphical user interface is used so you can focus on learning the central skills and ideas.
Key skills taught include building, assessing, selecting and deploying predictive models, as well as employing some of the most commonly used methods in the field, including general linear models (GLMs), and advanced methods such as random forests. This also makes it your predictive analytics 101.
The course also covers key issues of data science practice in a work environment, and directs you to a range of further learning directions.
This is our leading course; it has transformed the machine-learning (ML), artificial intelligence (AI) and data science practice of the many managers, sponsors, key stakeholders, entrepreneurs and beginning data analytics and data science practitioners who have attended it.
See “Course Outline” below for a detailed day-by-day outline.
Core concepts in AI, data science, machine learning and predictive analytics
This course will provide a conceptual overview and practical hands-on experience of a wide range of key tools, techniques and processes.
At the heart of the data mining toolkit is the suite of predictive modelling methods. Accordingly, the course will develop your literacy in the strengths, characteristics and correct application of a range of predictive modelling techniques, from relatively simple linear models through to complex and powerful Random Forests, Support Vector Machines, Decision Trees, Tree Boosting Machines and Neural Networks will be covered along the way.
It will also teach you the correct framing of predictive modelling problems, suitably preparing data, evaluating model accuracy and stability, interpreting results and interrogating models.
The two key styles of predictive modelling – operational for targeting and explanatory for insights – will be described and distinguished.
As well as predictive modelling, the course will cover a range of other key data mining tools, including:
- Data exploration and visualisation: univariate summaries, correlation matrices, heat maps, hierarchical clustering.
- Cluster analysis – used for customer segmentation and anomaly detection
- Other “unsupervised” outlier detection tools.
- This course will primarily be taught using Rattle, a graphical interface for predictive modelling and data science in R. You will be exposed to “Big Data” techniques as applied to machine learning and deployed on cloud computing platforms.
The following additional topics may be covered depending on the pace and interests of the class:
- Link and network analysis visualisation – which provide a simple and compelling way to communicate and analyse relationships, and are commonly applied in forensics, human resources and law enforcement
- Association analysis – used in retail market basket analysis and the assessment of risk groupings
- Frequent item set analysis.
Content – Core concepts in AI, data science, machine learning and predictive analytics
- An overview of key terms: what do data science, machine learning, AI and deep learning actually mean?
- An intuitive and original introduction to what a machine learning model is, and what it does.
- Practical exercise: Exploratory data analysis–summaries, visualisation, bar charts, pair plots and correlation plots.
- Key terms: What is data? What is a model? What is a record? Field. Training set. Target variable. Missing value.
- Introduction to predictive modelling: What is a decision tree model, how is one built, how does it make predictions and what else can be done with it?
- Practical exercise: Building a decision tree model for classification.
- Decision trees for regression (estimation of amounts), and practical exercise.
- Linear regression models, and practical exercise.
- Generalised linear models (logistic regression) for classification, and practical exercise.
- Most important part of the course: How are predictive models evaluated? What is the KPI of predictive modelling?
- What is the one thing that all practitioners, managers and stakeholders of machine learning must know? And what makes the definition, measurement and improvement of this KPI tricky?
- An intuitive, visual explanation of the problem of overfitting and the importance of out-of-sample testing.
- Creating training/validation spits.
- Using out-of-sample testing to evaluate models and select a final model.
- The importance of a three-way training/validation/test split.
- Accuracy measures for classification modelling.
- Practical exercises: build multiple classification models, assess them on out-of-sample data and select the best final model out of a range of models including random forests, gradient boosting and support vector machines. Repeat as a model optimisation task to build the most accurate possible decision tree.
- Model deployment. Practical exercise: make new predictions on a developed model.
- Model stability and degradation: the importance of rebuilding models and out-of-time testing.
- Advanced classification topics: selecting a classification threshold using ROC curve charts.
- Calculation of the area under the ROC curve as a classification error measure.
- K-fold cross-validation: the “industry standard” in modern machine learning model evaluation.
- Random forests: a powerful, simple to use, and reliable modelling method. How does it work? What are its unique strengths?
- Practical exercise with random forest.
Attendees will, by the end of the course:
- Understand the fundamentals of predictive modelling.
- Have developed the ability to assess the effectiveness and fitness for purpose of any predictive modelling tool or technique.
- Understand a range of unsupervised data mining techniques.
- Know how to effectively prioritise analytical resources in a data science context.
The course will be instructed by Presciient Director, Dr Eugene Dubossarsky. Eugene is a founder and Fellow of the Institute of Analytics Professionals of Australia (IAPA); Director, University of New South Wales School of Mathematics and Statistics Industry Advisory Board; and a recognised industry leader in Business Analytics. Eugene is an experienced, professional data scientist of 20 years’ experience programming in R and its parent language, S.
No prior knowledge of R is required to take this course.