I broke my elbow about three weeks ago and?

the doctor said that I do not have to wear a cast because the kind of fracture that I have needs no cast. He also told me to keep it mobile, but to drop to basically nothing on the weights. I have not lifted weights in over three weeks, but when I extend my arm, there is sometimes a crack or a pop. I read online that a pop is just air moving between the joints and it is nothing to worry about. The pain in my elbow is gone. I have no problem lifting small things. I want to know how long should I wait before I can start hitting the weights again with full intensity and with full reassurance that I will not re-injure my elbow again?