Thaw came from a working class background, having been born in Longsight, Manchester to parents John and Dorothy. He had a younger brother called Ray. He grew up in the Burnage area of the city. He attended Ducie Technical High School for Boys in Manchester. He entered the Royal Academy of Dramatic Art at the age of 17, where he was a contemporary of Tom Courtenay.

Soon after leaving RADA he made his stage début in A Shred of Evidence at the Liverpool Playhouse and was awarded a contract with the theatre. His first film role was a bit part in the 1962 adaptation of The Loneliness of the Long Distance Runner starring Tom Courtenay and he also acted on-stage opposite Sir Laurence Olivier in Semi-Detached (1962).

He appeared in several episodes of the seminal BBC police series Z Cars in 1963–64 as a detective constable with a drink problem. Between 1964–66 he appeared as the central role of hard-nosed military policeman, Sgt John Mann, in two series of the ABC Weekend Television/ITV production Redcap.

He was also a guest star in an early episode of The Avengers. In 1967 he appeared in the Granada TV/ITV series, Inheritance, alongside James Bolam and Michael Goodliffe, as well as appearing in TV plays such as The Talking Head and episodes of series such as Budgie, where he played against type (opposite Adam Faith) as an effeminate failed playwright with a full beard and a Welsh accent.

Thaw will perhaps be best remembered for two roles: the hard-bitten Flying Squad detective Jack Regan in the Thames Television/ITV series (and two films) The Sweeney (1975 – 1978), which established him as a major star in the United Kingdom, and as the quietly-spoken, introspective but well educated and bitter detective Inspector Morse (1987 – 2000), with specials in 1995 – 1998 and 2000.

He subsequently played liberal working class Lancastrian barrister James Kavanagh in Kavanagh QC (1995 – 1999, and a special in 2001). Thaw also tried his hand at comedy with two sitcoms — Thick as Thieves (London Weekend/ITV, 1974) with Bob Hoskins and Home to Roost (Yorkshire/ITV, 1985 – 1990). Thaw is best known in America for the BBC series A Year in Provence with Lindsay Duncan.

During the 1970s and 1980s, Thaw frequently appeared in productions with the Royal Shakespeare Company and Royal National Theatre. He appeared in a number of films, including Cry Freedom, where he portrayed the conservative South African justice minister Jimmy Kruger, for which he received a BAFTA nomination for Best Supporting Actor, and Chaplin for director Richard Attenborough.

Thaw also appeared in the TV adaptation of the Michelle Magorian book Goodnight Mister Tom (Carlton Television/ITV) as the title character.