Part 2: Data
Every model is only as good as its data. Learn what data looks like, how companies collect and label it, how to clean and explore it, and how to turn it into features.
Key terms in this part (6)
Working with data
- Data basics: types, features, labels and splits
Recognise the main kinds of data, tell features from labels, and split data into training, validation and test sets.
- Collecting and labelling data, with SQL
Pull training data from a database with SQL, plan where data comes from and whether you may use it, and measure how consistently people label it.
- Cleaning and exploring data
Find and fix duplicates, missing values, impossible values and messy categories, and explore data with summaries and charts before modelling.
- Feature engineering: turning raw data into model inputs
Encode categories, scale numbers, create useful features from dates and text, and avoid data leakage by using pipelines.