Pryce works as a career counsellor. Nick is one of his unemployed customers who gets in a fight with another customer. After Nick is thrown out, Pryce invites him out for coffee. After Nick tells him about his brother and the hard times they've had, Pryce tells him about a religious group he is part of called the Sons of Jacob that wants to "clean up" the country.
After the coup d'etat
Pryce initially states they must treat "these girls (i.e. the remaining fertile women) respectfully, in a Godly fashion, despite the moral stain from their lives before". Guthrie and Waterford reject this as "window dressing" and ineffective. They eventually decide that all remaining fertile women should be collected to be "impregnated" by men of superior status during The Ceremony. 
In the present
Pryce reveals to Nick that Commander Guthrie has been sleeping with his last two Handmaids and is skimming from the transportation budget, according to his aide and his Martha.
Pryce is chairing the counsil of local commanders (among them Waterford) that is hearing the case of Commander Putnam. Waterford pleads for a meek verdict, reminding Commander Putnam has a family, a wife and a new child. Pryce replies that Mrs. Putnam came to him herself to ask for the harshest punishment possible, as she fears for her husband's immortal soul. Ultimately, Putnam's left hand is amputated..
Pryce calls Nick "son".
Before Gilead, Pryce wanted to clean up "the country" (i.e. the USA). In the present, he wants to clean up Gilead, the result of this first "cleanup".
Pryce is planning a purge. In the novel, several characters who were alive during the timeframe of The Handmaid's Tale are described as "dying during purges" which occurred in the Middle Gilead Period .
Pryce used to prefer a "respectful" treatment of fertile women. A successful "purge" (orchestrated by him) could mean an improvement for the life conditions of Handmaids (who aren't usually treated respectfully).
After the coup d'etat, Pryce concedes to Waterford and Guthrie. In the present, he spies on them.
Pryce accepted the detention of fertile women although preferring a "respectful" treatment. The suicide of Offred's predecessor may have reconfirmed his initial point of view.