What could happen to people who refused to answer the questions of the house un-american activities committee? apex?

Imprisoned--not answer to HUAC became guilty by silence and imprisonment was often the next step. 

Suspicion of communism was so heightened in the 1950s that if you could not prove innocence or refused to defend yourself it was assumed guilt. The punishment was imprisonment and could go to the extreme of death penalty.