Can a Jedi leave the Jedi order?

Yes, I think they can leave. The first Sith Lord was a Jedi who left and was seduced by the Dark Side. Count Dooku also left the order.