The idea of a facial recognition system that read the smile or frown of the viewer and edits the projected portrait subject’s expression accordingly.

You could then determine if a smiling person changed expression after seeing an opposite expression, or just see how people reacted to seeing their same expression. How about if it changes while they are watching? What if it detects your expression and slowly transitions to an opposite expression? Would this cause a reaction?