One commissioner demanded that Lee resign. It is now up to the city manager to decide whether or not to let Lee go.
"The unknown in a tragedy will make the heart do crazy things, and we haven't done a good job of getting out in front of that," said Sanford Mayor Jeff Triplett after the vote. "I have confidence in him in a lot of ways, and don't have confidence in him in some ways."
The vote of "no confidence" came after Triplett was forced to answer some tough questions from neighborhood residents and the media, during an NAACP meeting aimed at addressing allegations of police misconduct in the community.
"If there were mistakes made we are going to act accordingly," Triplett said in response to a question from ABC News about the investigation into Martin's death.