AI-101 · Lesson 5 of 5 · 32 min

AI and society

AI is not only a technical subject. Systems that screen job applications, approve loans, recommend medical treatments, decide what news people see, generate realistic fake images or drive cars change people's lives, for better and for worse. As AI becomes more capable and more widely used, questions about fairness, privacy, truth, work, safety and power become engineering questions too, because they depend on how systems are designed, tested and deployed.

This chapter surveys the main benefits and risks of AI, shows how some of them can be measured, describes how governments are responding, and closes with what responsible practice means for the people who build and use AI. The later courses AI-430 (safety and evaluation), AI-440 (law, policy and governance) and AI-460 (fairness and privacy) go much deeper.

The promise

The benefits are real and growing. AI helps doctors read medical images and spot disease earlier, speeds up drug discovery and protein design, forecasts weather more accurately, translates between languages, captions speech for people who are deaf or hard of hearing, describes images for people who are blind, and helps programmers, writers and analysts work faster. In engineering it optimizes energy systems, predicts equipment failures and helps design structures and circuits. Many economists expect AI to raise productivity significantly, though estimates of how much and how soon vary widely.

The same capabilities create risks. A system good at writing persuasive text can write misinformation; a system good at recognizing faces can enable mass surveillance; a system that automates tasks can displace workers. Most of the difficult questions are about how AI is used, by whom, and with what safeguards.

Fairness and bias

Machine learning learns patterns from data, and data reflect the world that produced them, including its inequalities. Bias can enter at many points:

  • Historical bias: if past hiring favoured one group, a model trained on past hiring decisions learns to favour it too.
  • Representation bias: if a face-recognition dataset contains few darker-skinned faces, the model will be less accurate on them. Studies around 2018 found commercial face-analysis systems with error rates far higher for darker-skinned women than for lighter-skinned men.
  • Measurement bias: if the label is a poor proxy for what we care about (for example, using past health care spending as a proxy for health need, when some groups have had less access to care), the model optimizes the wrong thing.
  • Deployment bias: a model used in a setting different from the one it was built for can fail unevenly.

Bias can be measured by comparing a model's errors across groups.

Worked problem

Measuring unequal errors

A loan-screening model is tested on 1000 past applicants whose repayment outcomes are known. Group A: 600 applicants, 400 of whom repaid; the model approved 360 of those who repaid and 40 who did not. Group B: 400 applicants, 200 of whom repaid; the model approved 140 of those who repaid and 20 who did not. Compare the true positive rate (qualified applicants approved), the false positive rate and the approval rate for each group.

Show solution
  1. Group A: TPR = 360/400 = 90%; FPR = 40/200 = 20%; approval rate = 400/600 = 67%.
  2. Group B: TPR = 140/200 = 70%; FPR = 20/200 = 10%; approval rate = 160/400 = 40%.
  3. A qualified applicant in group B is rejected 30% of the time, versus 10% in group A.

Answer: The model treats qualified applicants in group B much worse: three times the wrongful rejection rate. It violates equal opportunity (equal true positive rates). Investigating why, whether through the features, the training data or the labels, is the next step, and the bank would also need to check its legal obligations under human rights and lending law

Grouped bar chart for two groups. Group A: true positive rate 90%, false positive rate 20%, approval rate 67%. Group B: true positive rate 70%, false positive rate 10%, approval rate 40%. A bracket highlights the gap in true positive rates.
Error rates for the loan model by group. Qualified applicants in group B are approved far less often.

There are several mathematical definitions of fairness: equal approval rates (demographic parity), equal true positive rates (equal opportunity), equal error rates in both directions (equalized odds), or equal precision. A well-known result shows that when groups have different base rates, a model generally cannot satisfy all of these at once. Choosing which matters most is a value judgement that should involve the people affected, not only the engineers.

Privacy and surveillance

AI is hungry for data, and much of the most useful data is about people. Risks include collecting personal data without meaningful consent, using it for purposes people never agreed to, re-identifying individuals from supposedly anonymous data, and inferring sensitive facts (health, sexuality, politics) from innocent-looking data. Face recognition makes it possible to identify people in public spaces at scale.

In 2021, Canada's federal Privacy Commissioner, with provincial counterparts in Quebec, British Columbia and Alberta, found that Clearview AI had violated Canadian privacy laws by scraping billions of images from the internet to build a facial recognition database used by police and others, describing it as mass surveillance. Canadian privacy law (PIPEDA federally, and provincial laws such as Quebec's Law 25) applies to AI systems that use personal information.

Truth, deepfakes and information

Generative AI makes it cheap to produce realistic fake text, images, audio and video. Deepfakes have been used for fraud (for example, cloned voices of executives or relatives asking for money), harassment (non-consensual intimate images), and political disinformation. Detection tools help, but they are imperfect, and their errors interact with how rare fakes are.

Worked problem

Why detectors struggle

A deepfake detector correctly flags 95% of fake videos and correctly passes 95% of real ones. On a platform where 1% of uploaded videos are deepfakes, what fraction of flagged videos are actually fake?

Show solution
  1. Out of 10,000 videos: 100 are fake, 9,900 real.
  2. Flagged fakes: 0.95 × 100 = 95. Flagged real videos: 0.05 × 9,900 = 495.
  3. Fraction of flags that are fake: 95/(95 + 495) = 0.161.

Answer: Only about 16% of flagged videos are fakes; most flags are false alarms, because real videos vastly outnumber fakes. This is Bayes' theorem at work (STAT-235): detection must be combined with other evidence, such as provenance information recording where content came from

Responses include labelling AI-generated content, content provenance standards that cryptographically record how a file was created and edited, platform policies and new laws.

In Canada, the federal government introduced the Protecting Victims Act in December 2025 to prohibit distributing non-consensual sexual deepfakes, and Bill C-36 (June 2026) would let people ask companies to delete AI deepfakes of them.

Work and the economy

AI automates tasks, not whole jobs, but as more tasks become automatable, jobs change. The International Monetary Fund estimated in 2024 that about 40% of employment worldwide, and about 60% in advanced economies, is exposed to AI, meaning a significant share of the tasks involved could be affected. Exposure does not mean job loss: in many roles AI complements workers, making them more productive, while in others it may substitute for them. Unlike earlier waves of automation that mainly affected routine manual work, AI particularly affects knowledge work: writing, coding, analysis, customer service and design.

How the gains and losses are shared depends on choices by companies and governments: retraining, education, social supports and competition policy. For individuals, the most durable skills are those that combine domain expertise with judgement, responsibility and the ability to use AI tools well.

Safety, misuse and advanced AI

As models become more capable, three kinds of risk receive attention:

  • Misuse: people using AI to cause harm, for example to write malware, plan cyberattacks, run large-scale scams, or obtain knowledge that helps build biological or chemical weapons. Developers test models for such capabilities and build safeguards; governments increasingly expect them to.
  • Malfunction: systems that fail in high-stakes settings, such as a medical, financial or infrastructure system making a serious error, or an agent taking an unintended harmful action.
  • Loss of control: the concern, held by some leading researchers, that future AI systems much more capable than people could pursue goals that conflict with human interests in ways that are hard to correct. Others consider this unlikely or distant. The question is actively debated and studied in AI safety and alignment research (AI-430).

In January 2025, the first International AI Safety Report, written by about 100 experts from around the world and chaired by Yoshua Bengio, summarized the scientific evidence on these risks and stressed how uncertain many of them remain. Several governments have created AI safety institutes to evaluate advanced models.

Canada's is the Canadian AI Safety Institute, launched in November 2024.

Environmental impact

Training and running AI uses large amounts of electricity, and some data centres use substantial water for cooling. The International Energy Agency projects that global data centre electricity use will more than double between 2024 and 2030, driven largely by AI. The impact depends heavily on where the electricity comes from and how efficiently it is used. At the same time, AI can help reduce emissions elsewhere, by optimizing grids, buildings and industrial processes. Engineers can measure and reduce AI's footprint with efficient models, efficient hardware and data centres (DCE-200, DCE-460), and by choosing the smallest model that does the job.

How governments are responding

Governments are trying to capture AI's benefits while managing its risks, and they have taken different approaches. Internationally, the OECD AI Principles (2019, updated 2024) set out shared values such as transparency, robustness and accountability. The European Union's AI Act, in force since August 2024, is the most comprehensive law so far: it bans some practices outright (such as social scoring by governments) from February 2025, sets obligations for general-purpose AI models from August 2025, and imposes strict requirements on high-risk systems in areas such as employment, credit and critical infrastructure. An amendment that entered into force in July 2026 postponed the high-risk requirements to December 2027 and August 2028. The EU AI Act matters outside Europe because it applies to anyone offering AI systems in the EU market.

In Canada

Canada does not yet have a general AI law. The proposed Artificial Intelligence and Data Act, part of Bill C-27, died when Parliament was prorogued in January 2025. Since then, the federal government has taken a different path:

  • A Minister of Artificial Intelligence and Digital Innovation was appointed for the first time in May 2025.
  • In June 2026 the government launched "AI for All", a five-year national AI strategy with six pillars, including protecting Canadians, AI literacy, sovereign computing capacity (a target of 850 MW by 2030), scaling Canadian companies, and $50 million to expand the Canadian AI Safety Institute.
  • Bill C-36, the Protecting Privacy and Consumer Data Act (June 2026), would modernize PIPEDA, recognize privacy as a fundamental right, require organizations to explain automated decision-making, extend deletion rights to AI deepfakes and create a new Digital Safety and Data Protection Commission with penalties of up to $25 million or 5% of global revenue. It is before Parliament.
  • Existing rules continue to apply. The federal Directive on Automated Decision-Making (2019) requires federal institutions to complete an Algorithmic Impact Assessment before using automated decision systems, with safeguards that scale with the impact level. Quebec's Law 25 requires organizations to tell people when a decision about them is based exclusively on automated processing. A Voluntary Code of Conduct on generative AI (2023) has been signed by many companies, and human rights and consumer protection laws apply to AI as to anything else.

AI law is changing quickly. Anyone deploying AI in a regulated area must check the current rules, and AI-440 tracks them in detail.

Responsible AI in practice

Laws set minimums. Engineers and organizations that build and deploy AI can do much more, and professional engineers have an existing duty to put public safety and welfare first. Common responsible-AI practices include:

  • Define the purpose, the people affected and what could go wrong before building, and decide whether AI is the right tool at all.
  • Document data sources, consent and known limitations; publish model documentation ("model cards").
  • Test for performance and fairness across groups, for robustness and for misuse, before and after deployment.
  • Keep meaningful human oversight for high-stakes decisions, with a way for people to contest them.
  • Protect privacy by collecting only what is needed and securing it.
  • Monitor in operation, report incidents and fix problems.
  • Be honest about what a system can and cannot do.

Worked problem

Should this be automated?

A city wants an AI system to decide automatically which applicants receive emergency housing support. List three questions to answer before going ahead.

Show solution
  1. What are the consequences of errors, and for whom? A wrongful denial could leave a family without shelter.
  2. Does the training data reflect past decisions that may have been unfair, and how will performance be checked across groups?
  3. Will a human review denials, can applicants understand and appeal the decision, and which laws (privacy, human rights, administrative fairness) apply?

Answer: For a decision this consequential, a reasonable design keeps a human decision-maker, uses AI at most to help prioritize or flag information, tests fairness before and after launch, and gives applicants an explanation and an appeal. Sometimes the responsible answer is not to automate

Common mistakes

  • MistakeAssuming an algorithm is neutral because it is mathematical.

    InsteadModels inherit patterns, including unfair ones, from their data, labels and design choices. Measure outcomes across groups.

  • MistakeRemoving a sensitive attribute and declaring the model fair.

    InsteadOther features (postal or ZIP code, school, purchase history) can act as proxies. Test the outcomes, not just the inputs.

  • MistakeTrusting a detector's accuracy without considering base rates.

    InsteadWhen the thing being detected is rare, most alarms can be false even for an accurate detector.

  • MistakeTreating AI regulation as settled.

    InsteadLaws and policies are changing quickly in Canada, the US and abroad; check the current rules for each deployment.

  • MistakeLeaving ethics to someone else.

    InsteadDesign choices made by engineers decide many of these outcomes. Professional responsibility applies to AI work.

Summary and key terms

  • AI brings real benefits in health, science, accessibility, engineering and productivity, alongside risks that depend largely on how it is used.
  • Bias enters through historical, representation, measurement and deployment effects; measure it by comparing error rates across groups. Different fairness definitions can conflict when base rates differ.
  • Privacy risks include collection without consent, re-identification and surveillance through face recognition.
  • Deepfakes enable fraud, harassment and disinformation; detectors face the base-rate problem, so provenance and law also matter.
  • About 40% of global employment is exposed to AI (IMF); effects range from complementing to replacing workers.
  • Safety concerns cover misuse, malfunction and loss of control; AI safety institutes and the International AI Safety Report study them.
  • Canada: no general AI law since AIDA died in 2025; the "AI for All" strategy (June 2026), Bill C-36 on privacy and automated decisions, the Directive on Automated Decision-Making and Quebec's Law 25 shape the rules.
  • The EU AI Act is the most comprehensive AI law and reaches companies outside Europe. Responsible AI practice goes beyond legal minimums.
Algorithmic bias
Systematic differences in an AI system's errors or outcomes across groups of people.
True positive rate
The fraction of actual positives correctly identified; also called recall or sensitivity.
Equal opportunity
A fairness criterion requiring equal true positive rates across groups.
Base rate
How common the condition being predicted is in a population.
Deepfake
Synthetic audio, images or video that realistically depict people saying or doing things they did not.
Automated decision system
A system that makes or helps make decisions about people with little or no human involvement.
EU AI Act
The European Union's risk-based AI regulation, in force since August 2024 with obligations phased in over several years.
AI safety institute
A government body that evaluates the capabilities and risks of advanced AI models.
Responsible AI
Practices for designing, building and deploying AI that is safe, fair, transparent, accountable and respects privacy.
Algorithmic Impact Assessment
The federal questionnaire that sets an automated decision system's impact level and the safeguards required.
PIPEDA
The Personal Information Protection and Electronic Documents Act, Canada's federal private-sector privacy law.

Practice problems

Work each problem on paper first, then reveal the answer to check.

  1. Identify the likely type of bias: a voice assistant trained mostly on recordings of one accent performs poorly on others.

    Show answer

    Representation bias: some groups are underrepresented in the training data.

  2. In the loan example, compute the precision (fraction of approved applicants who repaid) for each group.

    Show answer

    Group A: 360/400 = 90%. Group B: 140/160 = 87.5%.

  3. Why might a model that never sees applicants' ethnicity still produce unequal outcomes by ethnicity?

    Show answer

    Other features, such as neighbourhood, school or name, can correlate with ethnicity and act as proxies; historical labels may also reflect past discrimination.

  4. A fraud detector flags 2% of honest transactions and catches 90% of frauds. Fraud is 0.5% of transactions. What fraction of flags are real fraud?

    Show answer

    Per 100,000: fraud 500, caught 450; honest 99,500, flagged 1,990. 450/2,440 = 18.4%.

  5. Give one example each of AI complementing a worker and AI substituting for a worker.

    Show answer

    Complementing: an engineer using an AI assistant to draft code that they review. Substituting: an automated system handling routine customer inquiries that people used to answer.

  6. Distinguish misuse, malfunction and loss of control with one example each.

    Show answer

    Misuse: using a model to write phishing emails. Malfunction: a medical model giving a wrong recommendation. Loss of control: a hypothetical advanced system pursuing goals its developers cannot correct.

  7. Under the EU AI Act, which kinds of obligations applied from February 2025 and August 2025?

    Show answer

    Prohibitions on certain practices from 2 February 2025; obligations for general-purpose AI models from 2 August 2025.

  8. What happened to the Artificial Intelligence and Data Act, and what does Bill C-36 propose about automated decisions?

    Show answer

    AIDA died on the order paper when Parliament was prorogued in January 2025. Bill C-36 would require organizations to explain automated decision-making and extend deletion rights to AI deepfakes.

  9. List four responsible-AI practices for a team deploying a hiring screening tool.

    Show answer

    For example: test outcomes across groups before and after launch; document data and limitations; keep human review of rejections with a way to contest; collect only necessary data; monitor and report incidents; check employment and human rights law.

  10. Why can't a model usually satisfy demographic parity, equal opportunity and equal precision at the same time?

    Show answer

    When groups have different base rates, the mathematics forces trade-offs: equalizing one measure generally unbalances another, so a choice about which matters most is required.

Lesson quiz · 5 questions

Score 60% or more to complete this lesson.

Take the quiz